g7.48xlarge

Analysis

The g7.48xlarge is a gpu instance instance in the g7 series with 192 vCPUs and 768 GiB of memory on Intel Xeon Scalable (Granite Rapids) (up to 3.9 GHz), which makes it balanced at 4 GiB of memory per vCPU.

Compared with the previous generation, it costs 114% more than the g6.48xlarge on AMD EPYC 7R13 ($11,069 more a month per instance), in exchange for the newer processor.

Running it in N. Virginia instead of Frankfurt saves $5,214 a month per instance: $28.51/hour against $35.66/hour, a 25% spread. It is not offered in Canada Central, São Paulo, Ireland, London, Mumbai, Singapore, Sydney and Tokyo, so plan around that if you need a presence there.

It carries 8 GPUs with 256 GB of GPU memory, so most of the price is the accelerator rather than the CPUs. It has local instance storage (2x3800 GB NVMe SSD), which is fast but lost when the instance stops. Network: 700 Gigabit.

It is the cheapest of the 2 processor variants AWS sells at this size and generation. The g7e.48xlarge on Intel Xeon Scalable (Emerald Rapids) costs 16% more, and no others also sit above it.

It is the largest of the 6 g7 sizes. Dropping to the g7.24xlarge saves $10,407 a month. Unit price is not flat across the series ($0.1277 to $0.3150 per vCPU-hour), so the size changes the rate you pay.