inf2.48xlarge
Machine Learning ASIC Instances · inf2 series · AMD EPYC 7R13 Processor
- vCPU
- 192
- Memory
- 768 GiB
- Linux / hour
- $12.98
- Per month
- $9,476
- Per vCPU-hour
- $0.0676
- Per GiB-hour
- $0.0169
Analysis
The inf2.48xlarge is a machine learning asic instances instance in the inf2 series with 192 vCPUs and 768 GiB of memory on AMD EPYC 7R13 (up to 2.95 GHz), which makes it balanced at 4 GiB of memory per vCPU.
Running it in N. Virginia instead of São Paulo saves $6,633 a month per instance: $12.98/hour against $22.07/hour, a 70% spread. It is not offered in Canada Central, so plan around that if you need a presence there.
Nothing else with 192 vCPUs and similar memory is cheaper: among 4 current same-shape types it has the lowest on-demand price.
It carries 12 GPUs with 384 GB of GPU memory, so most of the price is the accelerator rather than the CPUs. Storage is EBS only. Network: 100 Gigabit.
It is the largest of the 4 inf2 sizes. Dropping to the inf2.24xlarge saves $4,738 a month. Unit price is not flat across the series ($0.0615 to $0.1895 per vCPU-hour), so the size changes the rate you pay.
On demand it costs $12.98/hour in US East (N. Virginia), $9,476 a month if left running, which puts it mid-table for machine learning asic instances types at the 50th percentile per vCPU ($0.0676 per vCPU-hour) and the 27th percentile per GiB ($0.0169 per GiB-hour).
Price by region (USD per hour)
| Region | Linux | Windows | 1-yr RI | 3-yr RI | |
|---|---|---|---|---|---|
| N. Virginia us-east-1 | $12.98 | – | $8.18 | $5.61 | |
| Ohio us-east-2 | $12.98 | – | $8.18 | $5.61 | |
| Oregon us-west-2 | $12.98 | – | $8.18 | $5.61 | |
| São Paulo sa-east-1 | $22.07 | – | $13.90 | $9.53 | |
| Ireland eu-west-1 | $16.23 | – | $10.22 | $7.01 | |
| London eu-west-2 | $19.47 | – | $12.27 | $8.97 | |
| Frankfurt eu-central-1 | $19.47 | – | $12.27 | $8.97 | |
| Mumbai ap-south-1 | $16.88 | – | $10.63 | $7.85 | |
| Singapore ap-southeast-1 | $18.17 | – | $11.45 | $7.85 | |
| Sydney ap-southeast-2 | $16.88 | – | $10.63 | $7.29 | |
| Tokyo ap-northeast-1 | $19.47 | – | $12.27 | $8.97 |
Shared tenancy, no pre-installed software. Reserved rates are standard, no upfront, per hour. Prices as of 2026-11-04.
Same shape, other types
| Type | vCPU | Memory | $/hour | vs inf2.48xlarge |
|---|---|---|---|---|
| g6.48xlarge AMD EPYC 7R13 Processor | 192 | 768 GiB | $13.35 | +3% |
| g5.48xlarge AMD EPYC 7R32 | 192 | 768 GiB | $16.29 | +25% |
| g7.48xlarge Intel Xeon Scalable (Granite Rapids) | 192 | 768 GiB | $28.51 | +120% |
Cost calculator
Specs
| vCPU | 192 |
|---|---|
| Memory | 768 GiB (4.0 per vCPU) |
| Processor | AMD EPYC 7R13 Processor |
| Clock | 2.95 GHz |
| GPUs | 12 · 384 GB |
| Storage | EBS only |
| Network | 100 Gigabit |
inf2 sizes
| inf2.xlarge | 4 vCPU | $0.7582 |
| inf2.8xlarge | 32 vCPU | $1.97 |
| inf2.24xlarge | 96 vCPU | $6.49 |
| inf2.48xlarge | 192 vCPU | $12.98 |