Accelerate Next-
Generation Workloads
> NVIDIA Omniverse™ Enterprise
> Rendering and 3D Graphics
> High-Performance Virtual
Workstations with NVIDIA RTX™
Virtual Workstation (RTX vWS)
Software
> AI Training and Data Science
> Streaming and Video Content
NVIDIA L40 Delivering unprecedented visual computing performance for the data center.
| Technical Specifications* |
|
| GPU Architecture |
NVIDIA Ada Lovelace architecture |
| GPU Memory |
48GB GDDR6 with ECC |
| Memory Bandwidth |
864GB/s |
| Interconnect Interface |
PCIe Gen4x16: 64GB/s bi-directional |
| NVIDIA Ada Lovelace architecture-based CUDA Cores |
18,176 |
| NVIDIA third-generation RT Cores |
142 |
| NVIDIA fourth-generation Tensor Cores |
586 |
| RT Core performance TFLOPS |
209 |
| FP32 TFLOPS |
90.5 |
| TF32 Tensor Core TFLOPS |
90.5 | 181** |
| BFLOAT16 Tensor Core TFLOPS |
181.05 | 362.1** |
| FP16 Tensor Core |
181.05 | 362.1** |
| FP8 Tensor Core |
362 | 724** |
| Peak INT8 Tensor TOPS |
362 | 724** |
| Peak INT4 Tensor TOPS |
724 | 1448** |
| Form Factor |
4.4” (H) x 10.5” (L) - dual slot |
| Display Ports |
4 x DisplayPort 1.4a |
| Max Power Consumption |
300W |
| Power Connector |
16-pin |
| Thermal |
Passive |
| Virtual GPU (vGPU) software support |
Yes |
| vGPU Profiles Supported |
See Virtual GPU Licensing Guide1 |
| NVENC I NVDEC |
3x l 3x (Includes AV1 Encode & Decode) |
| Secure Boot with Root of Trust |
yes |
| NEBS Ready |
Level 3 |
| MIG Support |
No |
| NVLink Support |
No |
