GPU Cloud Pricing · Hopper
An H100 with 76% more memory and 43% more bandwidth — 141 GB of HBM3e makes it the sweet spot for large-model inference without Blackwell pricing.
GPU.ai rates are the live fleet floor — the cheapest provider with stock, passed through at cost. Competitor rates are public on-demand list prices.
| Provider | $ / GPU / hr |
|---|---|
| GPU.ai — Secure Cloud | $3.59 |
| GPU.ai — Community Cloud | $3.82 |
| CoreWeave | $6.31 |
| AWS | $4.97 |
| Azure | $12.99 |
Need scale? Real 8× H200 SXM nodes are in inventory from $3.59/GPU/hr.
Available regions: Asia Pacific · Canada Central · Europe West · India South · US East
GPU.ai prices are read live from our aggregated fleet of 12+ GPU clouds and normalized to a per-GPU hourly rate (a 8× node's price is divided by its GPU count). We charge the provider's raw rate with zero markup and bill per second. Competitor figures are each provider's public on-demand list rate for the closest equivalent SKU — never spot, reserved, or committed-use discounts. Stock counts reflect launchable inventory, not theoretical capacity. Last updated 2026-08-17; this page refreshes hourly.
| Architecture | Hopper |
| VRAM | 141 GB HBM3e |
| Memory bandwidth | 4,800 GB/s |
| FP16 tensor (dense) | 990 TFLOPS |
| CUDA cores | — |
| Power (TDP) | 700 W |
| Interconnect | NVLink 4 (900 GB/s) |
| Released | 2024 |
Minimum H200 SXM count needed to hold popular open models in VRAM, at FP16 and 4-bit quantization.
| Model | Params | FP16 | 4-bit |
|---|---|---|---|
| Llama 3.1 8B | 8B | 1× H200 SXM | 1× H200 SXM |
| Mistral 7B | 7B | 1× H200 SXM | 1× H200 SXM |
| Gemma 2 27B | 27B | 1× H200 SXM | 1× H200 SXM |
| Qwen2.5 32B | 32B | 1× H200 SXM | 1× H200 SXM |
| Llama 3.1 70B | 70B | 2× H200 SXM | 1× H200 SXM |
| Qwen2.5 72B | 72B | 2× H200 SXM | 1× H200 SXM |
| Mixtral 8x22B | 141B MoE | 4× H200 SXM | 1× H200 SXM |
| Llama 3.1 405B | 405B | 8× H200 SXM | 2× H200 SXM |
| FLUX.1 dev | 12B | 1× H200 SXM | 1× H200 SXM |
| SDXL | 3.5B | 1× H200 SXM | 1× H200 SXM |
| Whisper large-v3 | 1.5B | 1× H200 SXM | 1× H200 SXM |
Weights-only estimates with a 20% margin for KV cache and activations at moderate context. Long contexts, large batches, and training need substantially more memory.
H200 SXM cloud instances on GPU.ai currently start at $3.59 per GPU per hour, billed per second. That is the live floor price across every provider in our fleet — we route your launch to the cheapest provider with stock and add zero markup.
The NVIDIA H200 SXM has 141 GB of HBM3e memory with up to 4,800 GB/s of bandwidth. GPU.ai reports the minimum VRAM actually delivered across our fleet, so the figure you see at launch is the figure you get.
Yes — real 8× H200 SXM nodes are launchable right now, from $3.59 per GPU per hour. We only advertise node sizes that exist in live inventory, not theoretical configurations.
GPU.ai aggregates a dozen-plus GPU clouds and passes through each provider's raw price with no markup, so the same silicon is typically far cheaper than hyperscaler list rates. The comparison table on this page shows the current public on-demand list prices side by side.
Billing is per second, starting when your instance is SSH-ready and stopping the moment you terminate. There are no minimum commitments, no reservation fees, and no egress surprises — you pay the listed hourly rate pro-rated to the second.