trn1n.32xlarge

Analysis

The trn1n.32xlarge is a machine learning asic instances instance in the trn1n series with 128 vCPUs and 512 GiB of memory on Intel Xeon Scalable (Icelake) (up to 3.5 GHz), which makes it balanced at 4 GiB of memory per vCPU.

Within the same generation and size, the trn1.32xlarge on Intel Xeon Scalable (Icelake) costs $21.50/hour, 13% less ($2,394 a month).

It carries 16 GPUs with 512 GB of GPU memory, so most of the price is the accelerator rather than the CPUs. It has local instance storage (4 x 1900 GB NVMe SSD), which is fast but lost when the instance stops. Network: 1600 Gigabit.

Per vCPU it is one of the dearer machine learning asic instances types: 96% of the 13 current types in the family cost less than its $0.1936 per vCPU-hour. The premium mostly pays for the accelerators. On demand it is $24.78/hour in US East (N. Virginia), or $18,089 for a 730-hour month.

Its price is almost flat across the 3 regions that offer it ($24.78 to $24.78/hour), so latency and data residency should decide where it runs. It is not offered in Canada Central, São Paulo, Ireland, London, Frankfurt, Mumbai, Singapore, Sydney and Tokyo, so plan around that if you need a presence there.