Items marked ▧ come from the documented NVIDIA DGX H100 platform specification.
- System / node model
- NVIDIA DGX H100
- Compute nodes of this type
- 191
- CPU model
- Xeon Platinum 8480C 56C 2GHz
- CPU sockets per node
- 2
- Cores per socket
- 56
- Physical CPU cores
- 112
- Accelerator model
- NVIDIA H100 SXM5 80GB
- Physical accelerators per node
- 8
- Host / unified memory
- 2 TB (DGX H100 platform specification)
- Accelerator memory
- 80 GB per GPU
- Accelerator ↔ accelerator link
- NVLink / NVSwitch
- On-node fabric
- NVLink 4 through 4 × 4th-generation NVSwitch, 900 GB/s GPU-to-GPU
- CPU ↔ accelerator link
- PCIe 5.0
- Network interfaces per node
- 8
- Interface model
- NVIDIA ConnectX-7 single-port InfiniBand
- Interface speed
- 400 Gb/s InfiniBand per adapter
- Interface-to-accelerator topology
- One adapter per GPU
- Management / storage networking
- 2 × ConnectX-7 dual-port Ethernet (storage and in-band management) + 1 GbE BMC
- Local storage
- 2 × 1.92 TB NVMe M.2 SSD in RAID 1 (OS) + 8 × 3.84 TB NVMe U.2 SSD in RAID 0 (data cache)
- Form factor
- 8U rackmount · 6 × 3.3 kW power supplies (4+2 redundant)