inf2.8xlarge
Machine Learning ASIC Instances · inf2 series · AMD EPYC 7R13 Processor
- vCPU
- 32
- Memory
- 128 GiB
- Linux / hour
- $1.97
- Per month
- $1,437
- Per vCPU-hour
- $0.0615
- Per GiB-hour
- $0.0154
Analysis
The inf2.8xlarge is a machine learning asic instances instance in the inf2 series with 32 vCPUs and 128 GiB of memory on AMD EPYC 7R13 (up to 2.95 GHz), which makes it balanced at 4 GiB of memory per vCPU.
Running it in N. Virginia instead of São Paulo saves $1,006 a month per instance: $1.97/hour against $3.35/hour, a 70% spread. It is not offered in Canada Central, so plan around that if you need a presence there.
It carries 1 GPU with 32 GB of GPU memory, so most of the price is the accelerator rather than the CPUs. Storage is EBS only. Network: Up to 25 Gigabit.
It is size 2 of 4 in the inf2 series. Stepping up to the inf2.24xlarge gives 96 vCPUs and 384 GiB for $3,302 more a month. Dropping to the inf2.xlarge saves $883 a month. Unit price is not flat across the series ($0.0615 to $0.1895 per vCPU-hour), so the size changes the rate you pay.
On demand it costs $1.97/hour in US East (N. Virginia), $1,437 a month if left running, which puts it mid-table for machine learning asic instances types at the 35th percentile per vCPU ($0.0615 per vCPU-hour) and the 12th percentile per GiB ($0.0154 per GiB-hour).
Price by region (USD per hour)
| Region | Linux | Windows | 1-yr RI | 3-yr RI | |
|---|---|---|---|---|---|
| N. Virginia us-east-1 | $1.97 | – | $1.24 | $0.8501 | |
| Ohio us-east-2 | $1.97 | – | $1.24 | $0.8501 | |
| Oregon us-west-2 | $1.97 | – | $1.24 | $0.8501 | |
| São Paulo sa-east-1 | $3.35 | – | $2.11 | $1.45 | |
| Ireland eu-west-1 | $2.46 | – | $1.55 | $1.06 | |
| London eu-west-2 | $2.95 | – | $1.86 | $1.36 | |
| Frankfurt eu-central-1 | $2.95 | – | $1.86 | $1.36 | |
| Mumbai ap-south-1 | $2.56 | – | $1.61 | $1.19 | |
| Singapore ap-southeast-1 | $2.75 | – | $1.74 | $1.19 | |
| Sydney ap-southeast-2 | $2.56 | – | $1.61 | $1.11 | |
| Tokyo ap-northeast-1 | $2.95 | – | $1.86 | $1.36 |
Shared tenancy, no pre-installed software. Reserved rates are standard, no upfront, per hour. Prices as of 2026-11-04.
Same shape, other types
| Type | vCPU | Memory | $/hour | vs inf2.8xlarge |
|---|---|---|---|---|
| g4ad.8xlarge AMD EPYC 7R32 | 32 | 128 GiB | $1.73 | -12% |
| g6.8xlarge AMD EPYC 7R13 Processor | 32 | 128 GiB | $2.01 | +2% |
| g4dn.8xlarge Intel Xeon Family | 32 | 128 GiB | $2.18 | +11% |
| g5.8xlarge AMD EPYC 7R32 | 32 | 128 GiB | $2.45 | +24% |
| g7.8xlarge Intel Xeon Scalable (Granite Rapids) | 32 | 128 GiB | $4.09 | +108% |
Cost calculator
Specs
| vCPU | 32 |
|---|---|
| Memory | 128 GiB (4.0 per vCPU) |
| Processor | AMD EPYC 7R13 Processor |
| Clock | 2.95 GHz |
| GPUs | 1 · 32 GB |
| Storage | EBS only |
| Network | Up to 25 Gigabit |
inf2 sizes
| inf2.xlarge | 4 vCPU | $0.7582 |
| inf2.8xlarge | 32 vCPU | $1.97 |
| inf2.24xlarge | 96 vCPU | $6.49 |
| inf2.48xlarge | 192 vCPU | $12.98 |