The Compatibility between CUDA, GPU, Base Image, and PyTorch

1 · Norm Inui · Aug. 29, 2023, 6:45 p.m.
The relationship between the CUDA version, GPU architecture, and PyTorch version can be a bit complex but is crucial for the proper functioning of PyTorch-based deep learning tasks on a GPU. Suppose you’re planning to deploy your awesome service on an NVIDIA A100-PCIE-40Gb server with CUDA 11.2 and Driver Version 460.32.03. You’ve built your service using PyTorch 1.12.1, and your Docker image is built based on an NVIDIA base image, specifically nvidia-cuda:10.2-base-ubuntu20.04. How can you jud...