g7.24xlarge

Analysis

The g7.24xlarge is a gpu instance instance in the g7 series with 96 vCPUs and 384 GiB of memory on Intel Xeon Scalable (Granite Rapids) (up to 3.9 GHz), which makes it balanced at 4 GiB of memory per vCPU.

Compared with the previous generation, it costs 114% more than the g6.24xlarge on AMD EPYC 7R13 ($5,534 more a month per instance), in exchange for the newer processor.

Running it in N. Virginia instead of Frankfurt saves $2,607 a month per instance: $14.26/hour against $17.83/hour, a 25% spread. It is not offered in Canada Central, São Paulo, Ireland, London, Mumbai, Singapore, Sydney and Tokyo, so plan around that if you need a presence there.

It carries 4 GPUs with 128 GB of GPU memory, so most of the price is the accelerator rather than the CPUs. It has local instance storage (1x3800 GB NVMe SSD), which is fast but lost when the instance stops. Network: 350 Gigabit.

It is the cheapest of the 2 processor variants AWS sells at this size and generation. The g7e.24xlarge on Intel Xeon Scalable (Emerald Rapids) costs 16% more, and no others also sit above it.

It is size 5 of 6 in the g7 series. Stepping up to the g7.48xlarge gives 192 vCPUs and 768 GiB for $10,407 more a month. Dropping to the g7.12xlarge saves $5,204 a month. Unit price is not flat across the series ($0.1277 to $0.3150 per vCPU-hour), so the size changes the rate you pay.