zlacker

[return to "Nvidia H100 GPUs: Supply and Demand"]
1. latchk+Sh1[view] [source] 2023-08-01 14:59:05
>>tin7in+(OP)
What nobody is talking about here is that there is no more power available in the US. All the FAANGS have scooped up the space and power contracts.

You can buy all the GPUs you can possibly find. If you want to deploy 10MW+, it just doesn't exist.

These things need redundant power/cooling, real data centers, and can't just be put into chicken farms. Anything less than 10MW isn't enough compute now either for large scale training and you can't spread it across data centers because all the data needs to be in one place.

So yea... good luck.

◧◩
2. vorpal+Vi1[view] [source] 2023-08-01 15:03:29
>>latchk+Sh1
With things like solar and wind installs becoming more off-the-shelf, is there any path there? What does 10MW of solar/wind look like? Are we talking the size of a big ranch or the size of a small county?
◧◩◪
3. latchk+Ej1[view] [source] 2023-08-01 15:07:31
>>vorpal+Vi1
It doesn't matter, this stuff wants/needs to be deployed yesterday, not in 2-3 years. I'm starting with raw power, but even that isn't the limiting factor... it goes deeper... try to buy a bunch of large transformers, those are year long waitlists.

Texas has a lot of wind. At this scale, it is mostly grid power anyway. Grid is a mixture of everything. Oh and solar has this pesky issue of not working in the evening, so then you have another problem... storage. ;-)

I should add... you want backup generators for your UPS systems? Those are a 4.5 years backlog.

◧◩◪◨
4. vorpal+vk1[view] [source] 2023-08-01 15:10:42
>>latchk+Ej1
I'm sort of assuming this is like most other booms and will last several years. Sure the best time to be ready to jump in was yesterday, the the second best time is to get the ball rolling now even if your lead time is years.

And yes obviously renewables won't cover 24/7 but if I have a choice between no data center and a 60% time data center.. give me the 60%.

◧◩◪◨⬒
5. latchk+Kl1[view] [source] 2023-08-01 15:15:54
>>vorpal+vk1
I've been running large scale GPU deployments (>150k+), for years now... we are absolutely pivoting to this (yes, we took a bit too long).

But it is surprisingly hard to find investors who are willing to wait, even though we know that this stuff is going to last for decades.

username@gmail if anyone would like to have real conversations about this.

[go to top]