NVIDIA HGX B300 GPU server Graphics cards Video cards 2.1 TB 16 × NVIDIA Blackwell Ultra GPUs 270 GB HBM3E 7.7 TB/s
|
Technical Specifications HGX B300
|
|
|
GB300 NVL72
|
|
Blackwell Ultra GPUs | Grace CPUs
|
72 | 36
|
8 | 0
|
|
CPU Cores
|
2,592 Arm Neoverse V2 Cores
|
-
|
|
Total FP4 Tensor Core1
|
1,440 PFLOPS | 1,080 PFLOPS
|
144 PFLOPS | 108 PFLOPS
|
|
Total FP8/FP6 Tensor Core2
|
720 PFLOPS
|
72 PFLOPS
|
|
Total Fast Memory
|
37 TB
|
2.1 TB
|
|
Total Memory Bandwidth
|
576 TB/s
|
62 TB/s
|
|
Total NVLink Switch Bandwidth
|
130 TB/s
|
14.4 TB/s
|
|
Individual Blackwell Ultra GPU Specifications
|
|
FP4 Tensor Core1
|
20 PFLOPS | 15 PFLOPS
|
18 PFLOPS | 14 PFLOPS
|
|
FP8/FP6 Tensor Core2
|
10 PFLOPS
|
9 PFLOPS
|
|
INT8 Tensor Core2
|
330 TOPS
|
307 TOPS
|
|
FP16/BF16 Tensor Core2
|
5 PFLOPS
|
4.5 PLFOPS
|
|
TF32 Tensor Core2
|
2.5 PFLOPS
|
2.2 PFLOPS
|
|
FP32
|
80 TFLOPS
|
75 TFLOPS
|
|
FP64/FP64 Tensor Core
|
1.3 TFLOPS
|
1.2 TFLOPS
|
|
GPU Memory | Bandwidth
|
279 GB HBM3E | 8 TB/s
|
270 GB HBM3E | 7.7 TB/s
|
|
Multi-Instance GPU (MIG)
|
7
|
|
Decompression Engine
|
Yes
|
|
Decoders
|
7 NVDEC3
7 nvJPEG
|
|
Max Thermal Design Power (TDP)
|
Configurable up to 1,400 W
|
Configurable up to 1,100 W
|
|
Interconnect
|
Fifth-Generation NVLink: 1.8 TB/s
PCIe Gen6: 256 GB/s
|
|
Server Options
|
NVIDIA GB300 NVL72 partner and NVIDIA-Certified Systems™
|
NVIDIA HGX B300 partner and NVIDIA-Certified Systems
|
|
1. Specification in Sparse | Dense
2. Specification in sparse. Dense is ½ sparse spec shown.
3. Supported formats provide these speed-ups over H100 GPUs: 2x H.264, 1.25x HEVC, 1.25x VP9. AV1
|
