NVIDIA A100 80GB: cloud rental cost
Renting one NVIDIA A100 80GB around the clock costs from $1,015 a month (Runpod Community Cloud, on demand) to $23,922 (Microsoft Azure, on demand), across 5 providers with a published price. The listed Microsoft Azure, Lambda and AWS EC2 instances have 8 GPUs, so a single GPU there is billed as 8.
A full eight-GPU setup on demand ranges from $8,118 a month on Runpod Community Cloud to $23,922 on Microsoft Azure. Spot capacity on Microsoft Azure is 74% below its on-demand price, as a snapshot on the date checked. Google Cloud lists this GPU, but no price has been verified yet.
Prices on this page last verified on Sources
1 GPU, 24 hours a day
One GPU serving a model around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | $1,015 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | $1,307 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | $18,630 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | $20,036 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | $23,922 | $6,162 | $15,310billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
8 GPUs, 24 hours a day
A full eight-GPU server running around the clock. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 8 | $8,118 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 8 | $10,454 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | $18,630 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | $20,036 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | $23,922 | $6,162 | $15,310billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
1 GPU, 8 hours a day
Development or test work during a working day, switched off overnight. Monthly cost, cheapest on-demand provider first.
| Provider | GPUs billed | On demand | Spot | 1-year reserved |
|---|---|---|---|---|
| Runpod Community Cloud | 1 | $338.23 | No self-serve price published for this option. | No self-serve price published for this option. |
| Runpod Secure Cloud | 1 | $435.57 | No self-serve price published for this option. | No self-serve price published for this option. |
| Lambda | 8 | $6,210 | No self-serve price published for this option. | No self-serve price published for this option. |
| AWS EC2 | 8 | $6,679 | Price not verified yet. | Price not verified yet. |
| Microsoft Azure | 8 | $7,974 | $2,054 | $15,310billed every hour |
| Google Cloud | Price not verified yet. | Price not verified yet. | Price not verified yet. |
Every offer and its price
Every listed offer for this GPU. Where a provider sells several instance sizes, the tables above use the cheapest size that fits the GPU count.
| Provider | Instance | Location | GPUs per instance | On demand | Spot | 1-year reserved |
|---|---|---|---|---|---|---|
| AWS EC2 | p4de.24xlarge | US East (N. Virginia), Linux | 8 | $27.44705per instance-hour | n/a | n/a |
| Microsoft Azure | Standard_ND96amsr_A100_v4 | East US, Linux | 8 | $32.77per instance-hour | $8.441552per instance-hour | $183,722.00per instance per 1-year term |
| Google Cloud | a2-ultragpu-8g | us-central1 | 8 | n/a | n/a | n/a |
| Lambda | 8x NVIDIA HGX A100 80GB | Lambda Cloud | 8 | $3.19per GPU-hour | Not offered | Not offered |
| Runpod Secure Cloud | A100 SXM | Runpod Secure Cloud | Any | $1.79per GPU-hour | Not offered | Not offered |
| Runpod Community Cloud | A100 SXM | Runpod Community Cloud | Any | $1.39per GPU-hour | Not offered | Not offered |
No verified throughput figure for this GPU yet, so cost per million tokens is not shown.
Your traffic looks different? Enter your own figures in the calculator.
Related pages
Sources
Sources: aws.amazon.com (checked ); b0.p.awsstatic.com (checked ); lambda.com (checked ); learn.microsoft.com (checked ); prices.azure.com (checked ); runpod.io (checked )
Prices are list prices as each provider publishes them, used unchanged. How the figures are calculated: methodology.