Items marked ▧ come from the documented NVIDIA DGX A100 platform specification.
- System / node model
- NVIDIA DGX A100
- Compute nodes of this type
- 560
- CPU model
- AMD EPYC 7742 64C 2.25GHz
- CPU sockets per node
- 2
- Cores per socket
- 64
- Physical CPU cores
- 128
- Accelerator model
- NVIDIA A100
- Physical accelerators per node
- 8
- Host / unified memory
- 2 TB (32 × 64 GB)
- Accelerator memory
- 80 GB per GPU
- Accelerator ↔ accelerator link
- NVLink / NVSwitch
- On-node fabric
- NVLink 3 through NVSwitch, 600 GB/s GPU-to-GPU
- CPU ↔ accelerator link
- PCIe 4.0
- Network interfaces per node
- 8
- Interface model
- NVIDIA ConnectX-6 / ConnectX-7 (platform configuration)
- Interface speed
- 200 Gb/s per HCA (HDR InfiniBand)
- Interface-to-accelerator topology
- One adapter per GPU
- Management / storage networking
- Two additional 200 Gb/s HDR InfiniBand HCAs per node dedicated to storage
- Local storage
- 2 TB OS drive plus 30 TB internal NVMe SSD (8 × 3.84 TB)
- Form factor
- 6U rackmount