zlacker

>>convex+(OP)
GPT5 pre-training just ended I believe. Brock, Pachocki, Szymon Sidor, would have likely all been involved.

These are huge losses. Pachocki led pre-training for GPT-4, and probably GPT-5. Brockman is the major engineer responsible for the efficiency improvements that enabled ChatGPT and GPT-4 to be even remotely cost-effective. That is a piece that is often overlooked, but OpenAI's advantage over the competition in compute efficiency is probably even larger than the model itself.

>>aidama+67
"Greg Brockman works 60 to 100 hours per week, and spends around 80% of the time coding. Former colleagues have described him as the hardest-working person at OpenAI."

https://time.com/collection/time100-ai/6309033/greg-brockman...

>>convex+l8
This is like a supervillain origin story, Greg and Sam are 100 % going to start something new now, even if it's just out of spite with how much both seem to have liked their work at OpenAI

>>schlec+99
I don't think its possible, at least for the foreseable future, they were heavily over indexed on Azure offering them discounted compute, not like they're gonna buy that amount of GPU elsewhere

>>GaryNu+dg
I can imagine both Apple and Google happily positioning themselves in the same type of relationship as OpenAI-Microsoft.

>>exitb+Eh
Google had internal efforts, and Anthropic already. They definitely don’t have the compute to spare to split with another organization.

Apple surely doesn’t have a cluster that at all compares with the big cloud giants.

Oracle and AWS are really the only cloud left, and oracle is already renting to Microsoft for GPU compute.

>>vineya+7n
>Apple surely doesn’t have a cluster that at all compares with the big cloud giants.

Apple has a lot of cash to throw at it. Question would be if Apple is even interested in it.

>>nirav7+6q
They should be. The slight improvements in messaging autocomplete in iOS 17 have made a noticeable difference in my texting. To have an iPhone that understands me, and a Siri that doesn’t say, “Here’s what I found on the web” is extremely valuable.

>>aj7+ws
Idk. It looks like Apple is happy to sell you the hardware to do the image recognition etc on your own device and receive the result. They can claim privacy and save on computation.