A100 vs RTX4090
Explore a head to head comparison of specifications, performance, and pricing.
A100
The NVIDIA A100 is a powerful Ampere-based GPU designed for AI training, inference, and high-performance computing workloads.
ManufacturerNVIDIA
GPU ArchitectureAmpere
Average Price$6.63/hr
GPU VRAM40 GB
Cloud Availability5 clouds
System Memory1800 GB
CPU Cores176
Storage13.6 TB
RTX4090
The nvidia RTX4090 delivers high-performance computing capabilities for AI, machine learning, and data science applications.
Manufacturernvidia
GPU Architecture—
Average Price$2.69/hr
GPU VRAM24 GB
Cloud Availability3 clouds
System Memory706 GB
CPU Cores120
Storage15.4 TB
See how the A100 & RTX4090 compare
Compare detailed hardware specifications and average pricing for the A100 and RTX4090.
Compare Hardware Specifications
| A100 | RTX4090 | |
|---|---|---|
| GPU Type | A100 | RTX4090 |
| VRAM per GPU | 40 GB | 24 GB |
| Manufacturer | NVIDIA | nvidia |
| Architecture | Ampere | N/A |
| Interconnect | PCIe Gen4 or SXM4 | pcie |
| Memory Bandwidth | 1.55 TB/s | N/A |
| FP16 TFLOPS | 77.97 TFLOPS (4:1) | N/A |
| CUDA Cores | 6912 | N/A |
| Tensor Cores | 432 (3rd Gen) | N/A |
| Base Clock | 765 MHz | N/A |
| Boost Clock | 1410 MHz | N/A |
| TDP | 250W-400W | N/A |
| Process Node | TSMC 7nm | N/A |
| Data Formats | INT8, BF16, FP16, TF32, FP32, FP64 | N/A |
Compare Average On-Demand Pricing
| A100 | RTX4090 | |
|---|---|---|
| 1 GPU | $1.71 /hr | $0.60 /hr |
| 2 GPUs | $3.91 /hr | $1.20 /hr |
| 4 GPUs | $7.80 /hr | $2.40 /hr |
| 8 GPUs | $13.54 /hr | $3.97 /hr |
Explore A100 & RTX4090 Instances
Browse available instances with A100 and RTX4090 GPUs. Filter by provider, availability, and more to find the perfect instance for your needs.
Explore more GPU comparisons
Select any two GPUs to compare their specifications and explore pricing across providers.
