gpu catalog: h100 sxm
The GPU that trained the current generation of frontier models. NVLink-connected 8× nodes remain the standard unit of serious training compute.
| GPU | VRAM | Regions | Availability | Price / GPU | |
|---|---|---|---|---|---|
| H100 SXM | 80G | 4 regions | available | $5.27/hr | launch |
The GPU that trained the current generation of frontier models. NVLink-connected 8× nodes remain the standard unit of serious training compute. VRAM80 GB HBM3 Memory bandwidth3.4 TB/s FP16 tensor990 TFLOPS ArchitectureHopper InterconnectNVLink 4 (900 GB/s) Board power700 W CUDA cores16,896 Released2022 Regionsasia-pacific, eu-west, us-east, us-west | |||||
| H100 SXMcommunity | 80G | 2 regions | running low | $4.41/hr | launch |
| RTX PRO 6000 | 96G | 4 regions | high availability | $2.03/hr | launch |
| RTX A6000 | 48G | 2 regions | high availability | $0.54/hr | launch |
| L40 | 48G | 2 regions | high availability | $0.94/hr | launch |
| RTX 6000 ADA | 48G | 2 regions | high availability | $0.78/hr | launch |
| RTX 5090community | 32G | 8 regions | high availability | $0.52/hr | launch |
| RTX 4090community | 24G | 7 regions | high availability | $0.45/hr | launch |
| RTX 3090community | 24G | 6 regions | high availability | $0.18/hr | launch |
| A100 | 80G | 5 regions | available | $1.48/hr | launch |
| H200 SXMcommunity | 141G | 5 regions | available | $4.31/hr | launch |
| H200 SXM | 141G | 5 regions | available | $6.35/hr | launch |
| RTX 5080community | 16G | 7 regions | available | $0.24/hr | launch |
| RTX 3080community | 10G | 4 regions | available | $0.13/hr | launch |
| RTX A4000community | 16G | 6 regions | available | $0.10/hr | launch |
| A100community | 80G | 5 regions | available | $1.28/hr | launch |
| B200 | 192G | 3 regions | available | $9.59/hr | launch |
| A16 | 16G | 6 regions | available | $0.56/hr | launch |
| H100 PCIE | 80G | 1 region | available | $2.98/hr | launch |
| H200 NVLcommunity | 141G | 6 regions | available | $3.92/hr | launch |
| L40S | 48G | 2 regions | available | $0.96/hr | launch |
| A40 | 48G | 3 regions | running low | $0.71/hr | launch |
| L40Scommunity | 48G | 3 regions | running low | $0.93/hr | launch |
| RTX 4090 | 24G | 2 regions | running low | $1.07/hr | launch |
| RTX 5090 | 32G | 2 regions | running low | $1.67/hr | launch |
| B300 | 288G | 1 region | running low | $10.79/hr | launch |
| H200 NVL | 141G | 1 region | running low | $3.95/hr | launch |
| L4community | 24G | 2 regions | running low | $0.53/hr | launch |
| A40community | 48G | 1 region | running low | $0.63/hr | launch |
| A100 40GBcommunity | 40G | 4 regions | running low | $0.45/hr | launch |
| B200community | 192G | 1 region | running low | $12.75/hr | launch |
| RTX 4080community | 16G | 2 regions | running low | $0.27/hr | launch |
| RTX 4000 ADA | 20G | 1 region | running low | $0.34/hr | launch |
| RTX 3090 | 24G | 1 region | running low | $0.60/hr | launch |
| L4 | 24G | 1 region | running low | $0.83/hr | launch |
| RTX PRO 4500 | 32G | 1 region | running low | $0.86/hr | launch |
| RTX A6000community | 48G | 1 region | running low | $0.58/hr | launch |
| H100 NVLcommunity | 94G | 1 region | running low | $5.08/hr | launch |
| V100community | 16G | 1 region | running low | $0.16/hr | launch |
lowest live on-demand rate per GPU, refreshed continuously · per-second billing
Our floor price for the H100 SXM, sampled continuously across every provider in the fleet and rolled up to one point per day. A dot on the zero line is a day we checked and found nothing launchable; a shaded break is a day we did not sample. Those are different facts, so this chart never draws one as the other.
Daily trend, updated hourly · Full 15-minute history available via API
| Provider | Price / GPU / hr | Notes |
|---|---|---|
| GPU.ai (Secure Cloud) | $5.27/hr | Vetted data center capacity, per-second billing |
| GPU.ai (Community Cloud) | $4.41/hr | Marketplace capacity from independent suppliers |
| CoreWeave | $6.16/hr | Public on-demand list rate |
| AWS | $3.93/hr | Public on-demand list rate |
| Azure | $12.29/hr | Public on-demand list rate |
competitor rates are public on-demand list prices, refreshed daily · gpu.ai prices are live floor rates · market data via Compute Prices
faq
H100 SXM cloud instances on GPU.ai currently start at $4.41 per GPU per hour, billed per second. That is the live floor price across every provider in our fleet. We route your launch to the cheapest provider with stock.
The NVIDIA H100 SXM has 80 GB of HBM3 memory with up to 3,350 GB/s of bandwidth. GPU.ai reports the minimum VRAM actually delivered across our fleet, so the figure you see at launch is the figure you get.
GPU.ai aggregates a dozen-plus GPU clouds and routes each launch to the cheapest one with stock, so the same silicon is typically far cheaper than hyperscaler list rates. The comparison table on this page shows the current public on-demand list prices side by side.
Billing is per second, starting when your instance is SSH-ready and stopping the moment you terminate. There are no minimum commitments, no reservation fees, and no egress surprises: you pay the listed hourly rate pro-rated to the second.