zlacker

[parent] [thread] 3 comments
1. xnx+(OP)[view] [source] 2024-01-23 00:09:32
Definitely the right way to look at things.

> If you take the "350,000" H100s that Facebook wants by EOY, each of those can do 700W

Plus ~500W for cooling

replies(1): >>pclmul+78
2. pclmul+78[view] [source] 2024-01-23 01:02:43
>>xnx+(OP)
Less than a 1:1 ratio here is an extremely efficient datacenter. The heat has to get out of the building, not just off the chip.
replies(1): >>xnx+Qb
◧◩
3. xnx+Qb[view] [source] [discussion] 2024-01-23 01:21:26
>>pclmul+78
Oh, wow. I didn't know it was that bad. Google advertises a PUE of 1.1: https://www.google.com/about/datacenters/efficiency/
replies(1): >>pclmul+nd
◧◩◪
4. pclmul+nd[view] [source] [discussion] 2024-01-23 01:29:48
>>xnx+Qb
Just to clarify, PUE of 1.1 means 10% power waste not spent on computing. However, Google datacenters are extremely efficient, and they design everything end-to-end for efficiency. A normal datacenter with less efficient cooling, less efficient power delivery, less efficient buildings, etc. easily adds up to a lot more wasted power.
[go to top]