1 / 4

NVIDIA Tesla H100 80GB pcie GPU Graphics Cards Video Card For Server

Name: NVIDIA Tesla H100 80GB pcie GPU Graphics Cards Video Card For Server
Brand: Neobitti Inc. In the field of artificial intelligence
Price: 59999 USD
Availability: InStock

$59,999.00 USD

NVIDIA H100 80GB pcie GPU Graphics Cards Video Card

Supercharge Large Language Model Inference With H100 NVL

For LLMs up to 70 billion parameters (Llama 2 70B), the PCIe-based NVIDIA H100 NVL with NVLink bridge utilizes Transformer Engine, NVLink, and 188GB HBM3 memory to provide optimum performance and easy scaling across any data center, bringing LLMs to the mainstream. Servers equipped with H100 NVL GPUs increase Llama 2 70B performance up to 5x over NVIDIA A100 systems while maintaining low latency in power-constrained data center environments.

Product Specifications

	H100 SXM	H100 NVL
FP64	34 teraFLOPS	30 teraFLOPs
FP64 Tensor Core	67 teraFLOPS	60 teraFLOPs
FP32	67 teraFLOPS	60 teraFLOPs
TF32 Tensor Core^*	989 teraFLOPS	835 teraFLOPs
BFLOAT16 Tensor Core^*	1,979 teraFLOPS	1,671 teraFLOPS
FP16 Tensor Core^*	1,979 teraFLOPS	1,671 teraFLOPS
FP8 Tensor Core^*	3,958 teraFLOPS	3,341 teraFLOPS
INT8 Tensor Core^*	3,958 TOPS	3,341 TOPS
GPU Memory	80GB	94GB
GPU Memory Bandwidth	3.35TB/s	3.9TB/s
Decoders	7 NVDEC 7 JPEG	7 NVDEC 7 JPEG
Max Thermal Design Power (TDP)	Up to 700W (configurable)	350-400W (configurable)
Multi-Instance GPUs	Up to 7 MIGS @ 10GB each	Up to 7 MIGS @ 12GB each
Form Factor	SXM	PCIe dual-slot air-cooled
Interconnect	NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s	NVIDIA NVLink: 600GB/s PCIe Gen5: 128GB/s
Server Options	NVIDIA HGX H100 Partner and NVIDIA- Certified Systems^™ with 4 or 8 GPUs NVIDIA DGX H100 with 8 GPUs	Partner and NVIDIA-Certified Systems with 1–8 GPUs
NVIDIA AI Enterprise	Add-on	Included

* With sparsity

NVIDIA Tesla H100 80GB pcie GPU Graphics Cards Video Card For Server

Product Specifications

You may also like

Recently viewed

Cart