inf1.24xlarge
Machine Learning ASIC Instances · inf1 series · Intel Xeon Platinum 8275CL (Cascade Lake)
- vCPU
- 96
- Memory
- 192 GiB
- Linux / hour
- $4.72
- Per month
- $3,446
- Per vCPU-hour
- $0.0492
- Per GiB-hour
- $0.0246
Analysis
The inf1.24xlarge is a machine learning asic instances instance in the inf1 series with 96 vCPUs and 192 GiB of memory on Intel Xeon Platinum 8275CL (Cascade Lake), which makes it compute-heavy at 2 GiB of memory per vCPU.
The newer inf2.24xlarge on AMD EPYC 7R13 is 37% dearer at $6.49/hour.
It carries 16 GPUs, so most of the price is the accelerator rather than the CPUs. Storage is EBS only. Network: 100 Gigabit.
Running it in N. Virginia instead of São Paulo saves $2,248 a month per instance: $4.72/hour against $7.80/hour, a 65% spread.
At $4.72/hour on demand in US East (N. Virginia), about $3,446 a month, the inf1.24xlarge is one of the cheaper ways to buy machine learning asic instances capacity: only 19% of the 13 current machine learning asic instances types cost less per vCPU-hour than its $0.0492.
It is the largest of the 4 inf1 sizes. Dropping to the inf1.6xlarge saves $2,585 a month. Unit price is not flat across the series ($0.0452 to $0.0570 per vCPU-hour), so the size changes the rate you pay.
Reserving it for a year with no upfront payment cuts the Linux rate to $2.97/hour, which beats on demand once it runs more than 63% of the time; three years brings it to $2.27/hour, 52% below on demand.
Price by region (USD per hour)
| Region | Linux | Windows | 1-yr RI | 3-yr RI | |
|---|---|---|---|---|---|
| N. Virginia us-east-1 | $4.72 | – | $2.97 | $2.27 | |
| Ohio us-east-2 | $4.72 | – | $2.97 | $2.27 | |
| Oregon us-west-2 | $4.72 | – | $2.97 | $2.27 | |
| Canada Central ca-central-1 | $5.26 | – | $3.31 | $2.53 | |
| São Paulo sa-east-1 | $7.80 | – | $4.91 | $3.75 | |
| Ireland eu-west-1 | $5.26 | – | $3.31 | $2.53 | |
| London eu-west-2 | $5.53 | – | $3.48 | $2.66 | |
| Frankfurt eu-central-1 | $5.90 | – | $3.72 | $2.84 | |
| Mumbai ap-south-1 | $4.96 | – | $3.13 | $2.39 | |
| Singapore ap-southeast-1 | $6.38 | – | $4.02 | $3.45 | |
| Sydney ap-southeast-2 | $5.90 | – | $3.72 | $2.84 | |
| Tokyo ap-northeast-1 | $6.38 | – | $4.02 | $3.06 |
Shared tenancy, no pre-installed software. Reserved rates are standard, no upfront, per hour. Prices as of 2026-11-04.
Cost calculator
Specs
| vCPU | 96 |
|---|---|
| Memory | 192 GiB (2.0 per vCPU) |
| Processor | Intel Xeon Platinum 8275CL (Cascade Lake) |
| GPUs | 16 |
| Storage | EBS only |
| Network | 100 Gigabit |
inf1 sizes
| inf1.xlarge | 4 vCPU | $0.2280 |
| inf1.2xlarge | 8 vCPU | $0.3620 |
| inf1.6xlarge | 24 vCPU | $1.18 |
| inf1.24xlarge | 96 vCPU | $4.72 |