NVIDIA A100 80GB: cloud rental cost
Renting one NVIDIA A100 80GB around the clock costs from £757.07 a month (Runpod Community Cloud, on demand) to £17,848 (Microsoft Azure, on demand), across 5 providers with a published price. The listed Microsoft Azure, Lambda and AWS EC2 instances have 8 GPUs, so a single GPU there is billed as 8.
A full eight-GPU setup on demand ranges from £6,057 a month on Runpod Community Cloud to £17,848 on Microsoft Azure. Spot capacity on Microsoft Azure is 74% below its on-demand price, as a snapshot on the date checked. Google Cloud lists this GPU, but no price has been verified yet.
Prices on this page last verified on Sources
Providers publish these prices in US dollars. Pound figures are converted at £1 = US$1.3403, the Bank of England spot rate for .
1 GPU, 24 hours a day
One GPU serving a model around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | £757.07 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | £974.93 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | £13,900 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | £14,949 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | £17,848 | £4,598 | £11,423billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
8 GPUs, 24 hours a day
A full eight-GPU server running around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 8 | £6,057 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 8 | £7,799 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | £13,900 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | £14,949 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | £17,848 | £4,598 | £11,423billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
1 GPU, 8 hours a day
Development or test work during a working day, switched off overnight. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | £252.36 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | £324.98 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | £4,633 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | £4,983 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | £5,949 | £1,533 | £11,423billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
Every offer and its price
Every listed offer for this GPU. Where a provider sells several instance sizes, the tables above use the cheapest size that fits the GPU count.
| Provider | Instance | Location | GPUs per instance | On demand | Spot | 1-year reserved |
|---|---|---|---|---|---|---|
| AWS EC2 | p4de.24xlarge | US East (N. Virginia), Linux | 8 | £20.48per instance-hour | n/a | n/a |
| Microsoft Azure | Standard_ND96amsr_A100_v4 | East US, Linux | 8 | £24.45per instance-hour | £6.30per instance-hour | £137,075per instance per 1-year term |
| Google Cloud | a2-ultragpu-8g | us-central1 | 8 | n/a | n/a | n/a |
| Lambda | 8x NVIDIA HGX A100 80GB | Lambda Cloud | 8 | £2.38per GPU-hour | Not offered | Not offered |
| Runpod Secure Cloud | A100 SXM | Runpod Secure Cloud | Any | £1.34per GPU-hour | Not offered | Not offered |
| Runpod Community Cloud | A100 SXM | Runpod Community Cloud | Any | £1.04per GPU-hour | Not offered | Not offered |
No verified throughput figure for this GPU yet, so cost per million tokens is not shown.
Your traffic looks different? Enter your own figures in the calculator.
Related pages
Sources
Sources: aws.amazon.com (checked ); b0.p.awsstatic.com (checked ); lambda.com (checked ); learn.microsoft.com (checked ); prices.azure.com (checked ); runpod.io (checked )
Providers publish these prices in US dollars. Pound figures are converted at £1 = US$1.3403, the Bank of England spot rate for .
Prices are list prices as each provider publishes them, used unchanged. How the figures are calculated: methodology.