g7.12xlarge

Analysis

The g7.12xlarge is a gpu instance instance in the g7 series with 48 vCPUs and 192 GiB of memory on Intel Xeon Scalable (Granite Rapids) (up to 3.9 GHz), which makes it balanced at 4 GiB of memory per vCPU.

Compared with the previous generation, it costs 55% more than the g6.12xlarge on AMD EPYC 7R13 ($1,845 more a month per instance), in exchange for the newer processor.

Running it in N. Virginia instead of Frankfurt saves $1,304 a month per instance: $7.13/hour against $8.91/hour, a 25% spread. It is not offered in Canada Central, São Paulo, Ireland, London, Mumbai, Singapore, Sydney and Tokyo, so plan around that if you need a presence there.

It carries 2 GPUs with 64 GB of GPU memory, so most of the price is the accelerator rather than the CPUs. It has local instance storage (1x1900 GB NVMe SSD), which is fast but lost when the instance stops. Network: 175 Gigabit.

It is the cheapest of the 2 processor variants AWS sells at this size and generation. The g7e.12xlarge on Intel Xeon Scalable (Emerald Rapids) costs 16% more, and no others also sit above it.

It is size 4 of 6 in the g7 series. Stepping up to the g7.24xlarge gives 96 vCPUs and 384 GiB for $5,204 more a month. Dropping to the g7.8xlarge saves $2,221 a month. Unit price is not flat across the series ($0.1277 to $0.3150 per vCPU-hour), so the size changes the rate you pay.