| GPU memory | 24GB HBM2 | |
| GPU memory bandwidth | 933GB/s | |
| Interconnect | PCIe Gen4: 64GB/s Third-gen NVLink: 200GB/s** | |
| Form factor | Dual-slot, full-height, full-length (FHFL) | |
| Max thermal design power (TDP) | 165W | |
| Multi-Instance GPU (MIG) | 4 GPU instances @ 6GB each 2 GPU instances @ 12GB each 1 GPU instance @ 24GB | |
| Virtual GPU (vGPU) software support | NVIDIA AI Enterprise for VMware NVIDIA Virtual Compute Server | |
