AI Training System Requirements

Training

GPU

A GPU is strongly recommended for training deep learning models. Training performance on a GPU can be up to 20x faster than on a CPU, and can shorten training time from weeks to hours.

*GPU training requires an NVIDIA GPU with compute capability 3.5 to 8.x (Kepler, Maxwell, Pascal, Volta, Turing, or Ampere architecture), and your driver must support CUDA Toolkit 11 or higher. We recommend you update your NVIDIA driver to the latest version here. Learn more about CUDA here.

Below is a list of recommended GPU options:

Below is chart of benchmark comparisons between various cards. The red bar is most relevant to deep learning training performance.

Source: https://timdettmers.com/2019/04/03/which-gpu-for-deep-learning/

Applying

GPU

A GPU is also recommended for applying deep learning models. Application performance on a GPU can be up to 20x faster than on a CPU.

CPU

Since applying often takes seconds, compared to hours for training, a CPU can more reasonably be used if necessary. Please refer to the general System Requirements for more information on CPU requirements and recommendations.