L40 vs A100
Explore a head to head comparison of specifications, performance, and pricing.
L40
The NVIDIA L40 delivers high-performance computing capabilities for AI, machine learning, and data science applications.
ManufacturerNVIDIA
GPU Architecture—
Average Price$3.42/hr
GPU VRAM48 GB
Cloud Availability2 clouds
System Memory768 GB
CPU Cores252
Storage6.6 TB
A100
The NVIDIA A100 is a powerful Ampere-based GPU designed for AI training, inference, and high-performance computing workloads.
ManufacturerNVIDIA
GPU ArchitectureAmpere
Average Price$6.63/hr
GPU VRAM40 GB
Cloud Availability5 clouds
System Memory1800 GB
CPU Cores176
Storage13.6 TB
See how the L40 & A100 compare
Compare detailed hardware specifications and average pricing for the L40 and A100.
Compare Hardware Specifications
| L40 | A100 | |
|---|---|---|
| GPU Type | L40 | A100 |
| VRAM per GPU | 48 GB | 40 GB |
| Manufacturer | NVIDIA | NVIDIA |
| Architecture | Ada Lovelace | Ampere |
| Interconnect | PCIe Gen4 | PCIe Gen4 or SXM4 |
| Memory Bandwidth | 864 GB/s | 1.55 TB/s |
| FP16 TFLOPS | 90.52 TFLOPS (1:1) | 77.97 TFLOPS (4:1) |
| CUDA Cores | 18176 | 6912 |
| Tensor Cores | 568 (4th Gen) | 432 (3rd Gen) |
| RT Cores | 142 (3rd Gen) | N/A |
| Base Clock | 735 MHz | 765 MHz |
| Boost Clock | 2490 MHz | 1410 MHz |
| TDP | 300W | 250W-400W |
| Process Node | TSMC 4N | TSMC 7nm |
| Data Formats | FP8, INT8, BF16, FP16, TF32, FP32 | INT8, BF16, FP16, TF32, FP32, FP64 |
Compare Average On-Demand Pricing
| L40 | A100 | |
|---|---|---|
| 1 GPU | $0.99 /hr | $1.71 /hr |
| 2 GPUs | $1.99 /hr | $3.91 /hr |
| 4 GPUs | $4.98 /hr | $7.80 /hr |
| 8 GPUs | $8.00 /hr | $13.54 /hr |
Explore L40 & A100 Instances
Browse available instances with L40 and A100 GPUs. Filter by provider, availability, and more to find the perfect instance for your needs.
Explore more GPU comparisons
Select any two GPUs to compare their specifications and explore pricing across providers.
