| GPU memory | 24GB HBM2 | |
| GPU memory bandwidth | 933GB/s | |
| Interconnect | PCIe Gen4: 64GB/s
Third-gen NVLink: 200GB/s** |
|
| Form factor | Dual-slot, full-height, full-length (FHFL) | |
| Max thermal design power (TDP) | 165W | |
| Multi-Instance GPU (MIG) | 4 GPU instances @ 6GB each
2 GPU instances @ 12GB each 1 GPU instance @ 24GB |
|
| Virtual GPU (vGPU) software support | NVIDIA AI Enterprise for VMware
NVIDIA Virtual Compute Server |
|
