H100 vs A100
Explore a head to head comparison of specifications, performance, and pricing.
H100
The NVIDIA H100 is a Hopper-based GPU that provides exceptional performance, scalability, and economics for AI, deep learning, and HPC workloads.
ManufacturerNVIDIA
GPU ArchitectureHopper
Average Price$9.88/hr
GPU VRAM80 GB
Cloud Availability13 clouds
System Memory1920 GB
CPU Cores252
Storage31.3 TB
A100
The NVIDIA A100 is a powerful Ampere-based GPU designed for AI training, inference, and high-performance computing workloads.
ManufacturerNVIDIA
GPU ArchitectureAmpere
Average Price$6.36/hr
GPU VRAM40 GB
Cloud Availability5 clouds
System Memory1800 GB
CPU Cores124
Storage13.6 TB
See how the H100 & A100 compare
Compare detailed hardware specifications and average pricing for the H100 and A100.
Compare Hardware Specifications
| H100 | A100 | |
|---|---|---|
| GPU Type | H100 | A100 |
| VRAM per GPU | 80 GB | 40 GB |
| Manufacturer | NVIDIA | NVIDIA |
| Architecture | Hopper | Ampere |
| Interconnect | PCIe Gen5 or SXM5 | PCIe Gen4 or SXM4 |
| Memory Bandwidth | 3.35 TB/s | 1.55 TB/s |
| FP16 TFLOPS | 267.6 TFLOPS (4:1) | 77.97 TFLOPS (4:1) |
| CUDA Cores | 16896 | 6912 |
| Tensor Cores | 528 (4th Gen) | 432 (3rd Gen) |
| Base Clock | 1365 MHz | 765 MHz |
| Boost Clock | 1785 MHz | 1410 MHz |
| TDP | 350-700W | 250W-400W |
| Process Node | TSMC 4N | TSMC 7nm |
| Data Formats | FP8, INT8, BF16, FP16, TF32, FP32, FP64 | INT8, BF16, FP16, TF32, FP32, FP64 |
Compare Average On-Demand Pricing
| H100 | A100 | |
|---|---|---|
| 1 GPU | $2.84 /hr | $1.71 /hr |
| 2 GPUs | $5.01 /hr | $3.91 /hr |
| 4 GPUs | $9.50 /hr | $7.80 /hr |
| 8 GPUs | $19.23 /hr | $14.20 /hr |
Explore H100 & A100 Instances
Browse available instances with H100 and A100 GPUs. Filter by provider, availability, and more to find the perfect instance for your needs.
Cloud | GPU Type | Price | GPUs | VRAM in GB | Regions | Interconnect | Memory in GB | Storage in GB | vCPU |
|---|---|---|---|---|---|---|---|---|---|
$1.90 | 1 | 80 | 🇨🇦 CA, Montreal | PCIe | 180 | 850 | 28 | ||
$1.99 | 1 | 80 | 🇺🇸 US, Dallas, TX | PCIe | 192 | 7600 | 16 | ||
$2.98 | 1 | 80 | 🇺🇸 US, Des Moines, IA | PCIe | 128 | 1250 | 20 | ||
$3.08 | 1 | 80 | 🇫🇷 FR, Paris +1 more | PCIe | 240 | 3500 | 24 | ||
$3.34 | 1 | 80 | 🇳🇱 NL, Amsterdam | sxm5 | 240 | 4400 | 20 | ||
$5.99 | 1 | 80 | 🇺🇸 US, New York, NY | PCIe | 268 | 500 | 16 | ||
$3.80 | 2 | 160 | 🇨🇦 CA, Montreal | PCIe | 360 | 1600 | 60 | ||
$5.96 | 2 | 160 | 🇺🇸 US, Des Moines, IA | PCIe | 256 | 2500 | 40 | ||
$6.08 | 2 | 160 | 🇫🇷 FR, Paris +1 more | PCIe | 480 | 6500 | 48 | ||
$7.60 | 4 | 320 | 🇨🇦 CA, Montreal | PCIe | 720 | 3300 | 124 |
Have an instance you want to list?
Rows
Page 1 of 2
Explore more GPU comparisons
Select any two GPUs to compare their specifications and explore pricing across providers.
