NVIDIA H100 80GB (SXM): cloud rental cost
Renting one NVIDIA H100 80GB (SXM) around the clock costs from £1,465 a month (Runpod Community Cloud, on demand) to £53,550 (Microsoft Azure, on demand), across 5 providers with a published price. The listed Microsoft Azure and AWS EC2 instances have 8 GPUs, so a single GPU there is billed as 8.
A full eight-GPU setup on demand ranges from £11,721 a month on Runpod Community Cloud to £53,550 on Microsoft Azure. Spot capacity on Microsoft Azure is 82% below its on-demand price, as a snapshot on the date checked. Google Cloud lists this GPU, but no price has been verified yet.
Prices on this page last verified on Sources
Providers publish these prices in US dollars. Pound figures are converted at £1 = US$1.3403, the Bank of England spot rate for .
1 GPU, 24 hours a day
One GPU serving a model around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | £1,465 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | £2,173 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 1 | £2,663 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | £29,978 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | £53,550 | £9,896 | £34,272billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
8 GPUs, 24 hours a day
A full eight-GPU server running around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 8 | £11,721 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 8 | £17,385 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | £20,000 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | £29,978 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | £53,550 | £9,896 | £34,272billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
1 GPU, 8 hours a day
Development or test work during a working day, switched off overnight. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | £488.37 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | £724.39 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 1 | £887.79 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | £9,993 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | £17,850 | £3,299 | £34,272billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
Every offer and its price
Every listed offer for this GPU. Where a provider sells several instance sizes, the tables above use the cheapest size that fits the GPU count.
| Provider | Instance | Location | GPUs per instance | On demand | Spot | 1-year reserved |
|---|---|---|---|---|---|---|
| AWS EC2 | p5.48xlarge | US East (N. Virginia), Linux | 8 | £41.07per instance-hour | n/a | n/a |
| Microsoft Azure | Standard_ND96isr_H100_v5 | East US, Linux | 8 | £73.36per instance-hour | £13.56per instance-hour | £411,267per instance per 1-year term |
| Google Cloud | a3-highgpu-8g | us-central1 | 8 | n/a | n/a | n/a |
| Lambda | 8x NVIDIA HGX H100 | Lambda Cloud | 8 | £3.42per GPU-hour | Not offered | Not offered |
| Lambda | 4x NVIDIA H100 SXM | Lambda Cloud | 4 | £3.50per GPU-hour | Not offered | Not offered |
| Lambda | 2x NVIDIA H100 SXM | Lambda Cloud | 2 | £3.57per GPU-hour | Not offered | Not offered |
| Lambda | 1x NVIDIA H100 SXM | Lambda Cloud | 1 | £3.65per GPU-hour | Not offered | Not offered |
| Runpod Secure Cloud | H100 SXM | Runpod Secure Cloud | Any | £2.98per GPU-hour | Not offered | Not offered |
| Runpod Community Cloud | H100 SXM | Runpod Community Cloud | Any | £2.01per GPU-hour | Not offered | Not offered |
No verified throughput figure for this GPU yet, so cost per million tokens is not shown.
Your traffic looks different? Enter your own figures in the calculator.
Related pages
Sources
Sources: aws.amazon.com (checked ); b0.p.awsstatic.com (checked ); lambda.com (checked ); learn.microsoft.com (checked ); prices.azure.com (checked ); runpod.io (checked )
Providers publish these prices in US dollars. Pound figures are converted at £1 = US$1.3403, the Bank of England spot rate for .
Prices are list prices as each provider publishes them, used unchanged. How the figures are calculated: methodology.