NVIDIA H100 80GB (SXM): cloud rental cost
Renting one NVIDIA H100 80GB (SXM) around the clock costs from $1,964 a month (Runpod Community Cloud, on demand) to $71,774 (Microsoft Azure, on demand), across 5 providers with a published price. The listed Microsoft Azure and AWS EC2 instances have 8 GPUs, so a single GPU there is billed as 8.
A full eight-GPU setup on demand ranges from $15,710 a month on Runpod Community Cloud to $71,774 on Microsoft Azure. Spot capacity on Microsoft Azure is 82% below its on-demand price, as a snapshot on the date checked. Google Cloud lists this GPU, but no price has been verified yet.
Prices on this page last verified on Sources
1 GPU, 24 hours a day
One GPU serving a model around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | $1,964 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | $2,913 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 1 | $3,570 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | $40,179 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | $71,774 | $13,264 | $45,935billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
8 GPUs, 24 hours a day
A full eight-GPU server running around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 8 | $15,710 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 8 | $23,302 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | $26,806 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | $40,179 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | $71,774 | $13,264 | $45,935billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
1 GPU, 8 hours a day
Development or test work during a working day, switched off overnight. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | $654.57 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | $970.90 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 1 | $1,190 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | $13,393 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | $23,925 | $4,421 | $45,935billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
Every offer and its price
Every listed offer for this GPU. Where a provider sells several instance sizes, the tables above use the cheapest size that fits the GPU count.
| Provider | Instance | Location | GPUs per instance | On demand | Spot | 1-year reserved |
|---|---|---|---|---|---|---|
| AWS EC2 | p5.48xlarge | US East (N. Virginia), Linux | 8 | $55.04per instance-hour | n/a | n/a |
| Microsoft Azure | Standard_ND96isr_H100_v5 | East US, Linux | 8 | $98.32per instance-hour | $18.169536per instance-hour | $551,221.00per instance per 1-year term |
| Google Cloud | a3-highgpu-8g | us-central1 | 8 | n/a | n/a | n/a |
| Lambda | 8x NVIDIA HGX H100 | Lambda Cloud | 8 | $4.59per GPU-hour | Not offered | Not offered |
| Lambda | 4x NVIDIA H100 SXM | Lambda Cloud | 4 | $4.69per GPU-hour | Not offered | Not offered |
| Lambda | 2x NVIDIA H100 SXM | Lambda Cloud | 2 | $4.79per GPU-hour | Not offered | Not offered |
| Lambda | 1x NVIDIA H100 SXM | Lambda Cloud | 1 | $4.89per GPU-hour | Not offered | Not offered |
| Runpod Secure Cloud | H100 SXM | Runpod Secure Cloud | Any | $3.99per GPU-hour | Not offered | Not offered |
| Runpod Community Cloud | H100 SXM | Runpod Community Cloud | Any | $2.69per GPU-hour | Not offered | Not offered |
No verified throughput figure for this GPU yet, so cost per million tokens is not shown.
Your traffic looks different? Enter your own figures in the calculator.
Related pages
Sources
Sources: aws.amazon.com (checked ); b0.p.awsstatic.com (checked ); lambda.com (checked ); learn.microsoft.com (checked ); prices.azure.com (checked ); runpod.io (checked )
Prices are list prices as each provider publishes them, used unchanged. How the figures are calculated: methodology.