zlacker

[return to "Nvidia H100 GPUs: Supply and Demand"]
1. zoogen+Lo1[view] [source] 2023-08-01 15:27:47
>>tin7in+(OP)
The real gut-punch for this is a reminder how far behind most engineers are in this race. With web 1.0 and web 2.0 at least you could rent a cheap VPS for $10/month and try out some stuff. There is almost no universe where a couple of guys in their garage are getting access to 1000+ H100s with a capital cost in the multiple millions. Even renting at that scale is $4k/hour. That is going to add up quickly.

I hope we find a path to at least fine-tuning medium sized models for prices that aren't outrageous. Even the tiny corp's tinybox [1] is $15k and I don't know how much actual work one could get done on it.

If the majority of startups are just "wrappers around OpenAI (et al.)" the reason is pretty obvious.

1. https://tinygrad.org/

◧◩
2. latchk+Hu1[view] [source] 2023-08-01 15:48:46
>>zoogen+Lo1
I wouldn't spend a single dollar on George.

The guy could wake up tomorrow and decide he didn't feel like developing this stuff any more and you're going to be stuck with a dead project. In fact, he already did that once when he found a bug in the driver.

People RIP on Google for killing projects all the time and now you want to bet your business on a guy who livestreams in front of a pirate flag? Come on.

Never mind that even in my own personal dealings with him, he's been a total dick and I'm far from the only person who says that.

[go to top]