A40 vs H200
Explore a head to head comparison of specifications, performance, and pricing.
A40
The NVIDIA A40 delivers high-performance computing capabilities for AI, machine learning, and data science applications.
ManufacturerNVIDIA
GPU Architecture—
Average Price$4.30/hr
GPU VRAM48 GB
Cloud Availability2 clouds
System Memory480 GB
CPU Cores96
Storage7.8 TB
H200
The NVIDIA H200 is an advanced Hopper-based GPU that significantly boosts performance for generative AI, LLM, and HPC workloads with enhanced memory and bandwidth.
ManufacturerNVIDIA
GPU ArchitectureHopper
Average Price$14.99/hr
GPU VRAM141 GB
Cloud Availability7 clouds
System Memory2048 GB
CPU Cores480
Storage30.7 TB
See how the A40 & H200 compare
Compare detailed hardware specifications and average pricing for the A40 and H200.
Compare Hardware Specifications
| A40 | H200 | |
|---|---|---|
| GPU Type | A40 | H200 |
| VRAM per GPU | 48 GB | 141 GB |
| Manufacturer | NVIDIA | NVIDIA |
| Architecture | Ampere | Hopper |
| Interconnect | PCIe Gen4 | SXM5 |
| Memory Bandwidth | 696 GB/s | 4.8 TB/s |
| FP16 TFLOPS | 37.42 TFLOPS (1:1) | 267.6 TFLOPS (4:1) |
| CUDA Cores | 10752 | 16896 |
| Tensor Cores | 336 (3rd Gen) | 528 (4th Gen) |
| RT Cores | 84 (2nd Gen) | N/A |
| Base Clock | 1125 MHz | 1500 MHz |
| Boost Clock | 1740 MHz | 1980 MHz |
| TDP | 300W | 350-700W |
| Process Node | TSMC 8nm | TSMC 4N |
| Data Formats | INT8, BF16, FP16, TF32, FP32 | FP8, INT8, BF16, FP16, TF32, FP32, FP64 |
Compare Average On-Demand Pricing
| A40 | H200 | |
|---|---|---|
| 1 GPU | $1.48 /hr | $3.44 /hr |
| 2 GPUs | $2.20 /hr | $6.82 /hr |
| 4 GPUs | $5.92 /hr | $12.00 /hr |
| 8 GPUs | $8.80 /hr | $22.56 /hr |
Explore A40 & H200 Instances
Browse available instances with A40 and H200 GPUs. Filter by provider, availability, and more to find the perfect instance for your needs.
Explore more GPU comparisons
Select any two GPUs to compare their specifications and explore pricing across providers.
