They have the highest prices of any cloud. What happened to “your margin is my opportunity”?
And, as far as I know, customers are unable to allocate a VM with fewer than eight A100, H100, or H200 GPUs. (Please tell me how if I’m wrong.)
So, customers are incentivized to use other cloud products for GPUs in the short term.
They seem to be heavily invested in their own chips in the medium term.
It takes more effort to virtualize SXM5 than individual PCIe cards, so you find availability in 8s in VMs too regardless of provider