zlacker

>>mdp202+(OP)
AWS is so anti-customer with respect to GPUs right now.

They have the highest prices of any cloud. What happened to “your margin is my opportunity”?

And, as far as I know, customers are unable to allocate a VM with fewer than eight A100, H100, or H200 GPUs. (Please tell me how if I’m wrong.)

So, customers are incentivized to use other cloud products for GPUs in the short term.

They seem to be heavily invested in their own chips in the medium term.

>>rytill+Xd1
Meanwhile, I had a hard time last week getting a machine with 8 gpus from azure.

>>lpasse+3g2
Every customer of a 3rd party cloud provider is going to have a hard time getting Nvidia GPU compute from 3rd party cloud providers - not only is the amount of GPUs available limited, but Nvidia themselves are trying to spin up their own cloud provider offering, and unsurprisingly don't want to help a competitor.