zlacker

>>tin7in+(OP)
I think the author has missed a pretty large segment of demand. Non-cloud/non-tech enterprises are also buying large quantities of H100s and A100s for their own machine learning and simulation workloads. Where I work, we are going to have more than 1000 H100s by the end of the year, I am very excited to start benchmarking them soon :)

>>atty+G71
Just curious, what price do Nvidia charge enterprises? For $40k, it just doesn't make sense to buying it compared to renting from lambda labs or some other place for $2/hour(or $17k/year).

>>YetAno+uf2
That’s a good question and I can’t give a straight answer, because we are actually on three year lease plans through a vendor (think HPE). I know we get a pretty decent deal in general from them since we have basically an entire data center worth of hardware from them, but I don’t know how good the deal is on the GPUs, since they’re in such high demand.