zlacker

>>convex+(OP)
GPT5 pre-training just ended I believe. Brock, Pachocki, Szymon Sidor, would have likely all been involved.

These are huge losses. Pachocki led pre-training for GPT-4, and probably GPT-5. Brockman is the major engineer responsible for the efficiency improvements that enabled ChatGPT and GPT-4 to be even remotely cost-effective. That is a piece that is often overlooked, but OpenAI's advantage over the competition in compute efficiency is probably even larger than the model itself.

>>aidama+67
"Greg Brockman works 60 to 100 hours per week, and spends around 80% of the time coding. Former colleagues have described him as the hardest-working person at OpenAI."

https://time.com/collection/time100-ai/6309033/greg-brockman...

>>convex+l8
This is like a supervillain origin story, Greg and Sam are 100 % going to start something new now, even if it's just out of spite with how much both seem to have liked their work at OpenAI

>>schlec+99
I don't think its possible, at least for the foreseable future, they were heavily over indexed on Azure offering them discounted compute, not like they're gonna buy that amount of GPU elsewhere

>>GaryNu+dg
I can imagine both Apple and Google happily positioning themselves in the same type of relationship as OpenAI-Microsoft.

>>exitb+Eh
Google had internal efforts, and Anthropic already. They definitely don’t have the compute to spare to split with another organization.

Apple surely doesn’t have a cluster that at all compares with the big cloud giants.

Oracle and AWS are really the only cloud left, and oracle is already renting to Microsoft for GPU compute.

>>vineya+7n
>Apple surely doesn’t have a cluster that at all compares with the big cloud giants.

Apple has a lot of cash to throw at it. Question would be if Apple is even interested in it.

>>nirav7+6q
The problem is that a significant amount of the already-made GPUs are in use. Even if they can afford to throw money at it, where is that money going to go?

The best they can do is out-bid their competitors, for the competitors hardware. I'm sure apple doesn't want to pay Google for GCP resource to train an AI. Again, there may not be enough companies renting out GPUs at all.