inf2.24xlarge
Machine Learning ASIC Instances · inf2 series · AMD EPYC 7R13 Processor
- vCPU
- 96
- Memory
- 384 GiB
- Linux / hour
- $6.49
- Per month
- $4,738
- Per vCPU-hour
- $0.0676
- Per GiB-hour
- $0.0169
Analysis
The inf2.24xlarge is a machine learning asic instances instance in the inf2 series with 96 vCPUs and 384 GiB of memory on AMD EPYC 7R13 (up to 2.95 GHz), which makes it balanced at 4 GiB of memory per vCPU.
Compared with the previous generation, it costs 37% more than the inf1.24xlarge on Intel Xeon Platinum 8275CL (Cascade Lake) ($1,292 more a month per instance), in exchange for the newer processor.
Running it in N. Virginia instead of São Paulo saves $3,317 a month per instance: $6.49/hour against $11.03/hour, a 70% spread. It is not offered in Canada Central, so plan around that if you need a presence there.
Nothing else with 96 vCPUs and similar memory is cheaper: among 4 current same-shape types it has the lowest on-demand price.
It carries 6 GPUs with 192 GB of GPU memory, so most of the price is the accelerator rather than the CPUs. Storage is EBS only. Network: 50 Gigabit.
It is size 3 of 4 in the inf2 series. Stepping up to the inf2.48xlarge gives 192 vCPUs and 768 GiB for $4,738 more a month. Dropping to the inf2.8xlarge saves $3,302 a month. Unit price is not flat across the series ($0.0615 to $0.1895 per vCPU-hour), so the size changes the rate you pay.
Price by region (USD per hour)
| Region | Linux | Windows | 1-yr RI | 3-yr RI | |
|---|---|---|---|---|---|
| N. Virginia us-east-1 | $6.49 | – | $4.09 | $2.80 | |
| Ohio us-east-2 | $6.49 | – | $4.09 | $2.80 | |
| Oregon us-west-2 | $6.49 | – | $4.09 | $2.80 | |
| São Paulo sa-east-1 | $11.03 | – | $6.95 | $4.77 | |
| Ireland eu-west-1 | $8.11 | – | $5.11 | $3.50 | |
| London eu-west-2 | $9.74 | – | $6.13 | $4.49 | |
| Frankfurt eu-central-1 | $9.74 | – | $6.13 | $4.49 | |
| Mumbai ap-south-1 | $8.44 | – | $5.32 | $3.93 | |
| Singapore ap-southeast-1 | $9.09 | – | $5.72 | $3.93 | |
| Sydney ap-southeast-2 | $8.44 | – | $5.32 | $3.65 | |
| Tokyo ap-northeast-1 | $9.74 | – | $6.13 | $4.49 |
Shared tenancy, no pre-installed software. Reserved rates are standard, no upfront, per hour. Prices as of 2026-11-04.
Same shape, other types
| Type | vCPU | Memory | $/hour | vs inf2.24xlarge |
|---|---|---|---|---|
| g6.24xlarge AMD EPYC 7R13 Processor | 96 | 384 GiB | $6.68 | +3% |
| g5.24xlarge AMD EPYC 7R32 | 96 | 384 GiB | $8.14 | +25% |
| g7.24xlarge Intel Xeon Scalable (Granite Rapids) | 96 | 384 GiB | $14.26 | +120% |
Cost calculator
Specs
| vCPU | 96 |
|---|---|
| Memory | 384 GiB (4.0 per vCPU) |
| Processor | AMD EPYC 7R13 Processor |
| Clock | 2.95 GHz |
| GPUs | 6 · 192 GB |
| Storage | EBS only |
| Network | 50 Gigabit |
inf2 sizes
| inf2.xlarge | 4 vCPU | $0.7582 |
| inf2.8xlarge | 32 vCPU | $1.97 |
| inf2.24xlarge | 96 vCPU | $6.49 |
| inf2.48xlarge | 192 vCPU | $12.98 |