- System / node model
- Microsoft ND H200 v5 (Azure Standard_ND96isr_H200_v5)
- CPU model
- Intel Xeon Platinum 8480C (Sapphire Rapids)
- CPU sockets per node
- 96
- Physical CPU cores
- 96
- CPU note
- Microsoft lists 96 vCPUs for the ND H200 v5 size; the physical host socket layout behind that allocation is not published.
- Accelerator model
- NVIDIA H200
- Physical accelerators per node
- 8
- Host / unified memory
- 1,850 GiB (VM specification)
- Accelerator memory
- 141 GB per GPU
- Accelerator ↔ accelerator link
- NVLink 4 · all GPU pairs
- On-node fabric
- NVLink 4 within the VM
- Network interfaces per node
- 8
- Interface model
- NVIDIA Quantum-2 CX7 InfiniBand
- Interface speed
- 400 Gb/s per adapter
- Interface-to-accelerator topology
- One dedicated, topology-agnostic adapter per GPU
- Aggregate scale-out per node
- 3.2 Tb/s per VM
- GPUDirect RDMA
- Yes
- Local storage
- 1,024 GiB temporary disk (VM specification)
- NVMe data disks
- Up to 8 × 28 TiB NVMe data disks (VM specification)
- Max remote data disks
- 16
- Uncached disk IOPS
- 40800
- Uncached disk throughput (MBps)
- 612