zlacker

[return to "Nvidia H100 GPUs: Supply and Demand"]
1. latchk+Sh1[view] [source] 2023-08-01 14:59:05
>>tin7in+(OP)
What nobody is talking about here is that there is no more power available in the US. All the FAANGS have scooped up the space and power contracts.

You can buy all the GPUs you can possibly find. If you want to deploy 10MW+, it just doesn't exist.

These things need redundant power/cooling, real data centers, and can't just be put into chicken farms. Anything less than 10MW isn't enough compute now either for large scale training and you can't spread it across data centers because all the data needs to be in one place.

So yea... good luck.

◧◩
2. tedivm+At1[view] [source] 2023-08-01 15:44:31
>>latchk+Sh1
There are datacenters that are specializing in this, and they exist today.

I highly recommend Colovore in Santa Clara. They got purchased by DR not too long ago, but are run independently as far as I can tell. Their team is great, and they have the highest power density per rack out of anyone. I had absolutely no problem setting up a DGX cluster there.

https://www.colovore.com/

[go to top]