zlacker

[parent] [thread] 3 comments
1. atty+(OP)[view] [source] 2023-08-01 14:13:26
I think the author has missed a pretty large segment of demand. Non-cloud/non-tech enterprises are also buying large quantities of H100s and A100s for their own machine learning and simulation workloads. Where I work, we are going to have more than 1000 H100s by the end of the year, I am very excited to start benchmarking them soon :)
replies(2): >>tikkun+01 >>YetAno+O71
2. tikkun+01[view] [source] 2023-08-01 14:19:52
>>atty+(OP)
I agree. (I'm the author) Touched on that briefly here >>36955403 . Need help with that research; please email - email is in profile. Had a section on it in early drafts; didn't feel confident enough; removed it.

Would be good to have more on enterprise companies like Pepsi, BMW, Bentley, Lowes, as well as other HPC uses like oil and gas, others in manufacturing, others in automotive, weather forecasting.

3. YetAno+O71[view] [source] 2023-08-01 18:45:39
>>atty+(OP)
Just curious, what price do Nvidia charge enterprises? For $40k, it just doesn't make sense to buying it compared to renting from lambda labs or some other place for $2/hour(or $17k/year).
replies(1): >>atty+WO2
◧◩
4. atty+WO2[view] [source] [discussion] 2023-08-02 04:42:45
>>YetAno+O71
That’s a good question and I can’t give a straight answer, because we are actually on three year lease plans through a vendor (think HPE). I know we get a pretty decent deal in general from them since we have basically an entire data center worth of hardware from them, but I don’t know how good the deal is on the GPUs, since they’re in such high demand.
[go to top]