zlacker

[return to "OpenAI departures: Why can’t former employees talk?"]
1. thorum+Bu[view] [source] 2024-05-17 23:10:57
>>fnbr+(OP)
Extra respect is due to Jan Leike, then:

https://x.com/janleike/status/1791498174659715494

◧◩
2. adamta+dH[view] [source] 2024-05-18 01:28:01
>>thorum+Bu
Reading that thread it’s really interesting to me. I see how far we’ve come in a short couple of years. But I still can’t grasp how we’ll achieve AGI within any reasonable amount of time. It just seems like we’re missing some really critical… something…

Idk. Folks much smarter than I seem worried so maybe I should be too but it just seems like such a long shot.

◧◩◪
3. jay-ba+FH[view] [source] 2024-05-18 01:32:04
>>adamta+dH
When it comes to AI, as a rule, you should assume that whatever has been made public by a company like OpenAI is AT LEAST 6 months behind what they’ve accomplished internally. At least.

So yes, the insiders very likely know a thing or two that the rest of us don’t.

◧◩◪◨
4. vineya+hI[view] [source] 2024-05-18 01:42:41
>>jay-ba+FH
I understand this argument, but I can't help but feel we're all kidding ourselves assuming that their engineers are really living in the future.

The most obvious reason is costs - if it costs many millions to train foundation models, they don't have a ton of experiments sitting around on a shelf waiting to be used. They may only get 1 shot at the base-model training. Sure productization isn't instant, but no one is throwing out that investment or delaying it longer than necessary. I cannot fathom that you can train an LLM at like 1% size/tokens/parameters to experiment on hyper parameters, architecture, etc and have a strong idea on end-performance or marketability.

Additionally, I've been part of many product launches - both hyped up big-news-events and unheard of flops. Every time, I'd say that 25-50% of the product is built/polished in the mad rush between press event and launch day. For an ML Model, this might be different, but again see above point.

Sure products may be planned month/years out, but OpenAI didn't even know LLMs were going to be this big a deal in May 2022. They had GPT-2 and GPT-3 and thought they were fun toys at that time, and had an idea for a cool tech demo. I think that OpenAI (and Google, etc) are entirely living day-to-day with this tech like those of us on the outside.

◧◩◪◨⬒
5. HarHar+1E1[view] [source] 2024-05-18 14:43:02
>>vineya+hI
> I think that OpenAI (and Google, etc) are entirely living day-to-day with this tech like those of us on the outside.

I agree, and they are also living in a group-think bubble of AI/AGI hype. I don't think you'd be too welcome at OpenAI as a developer if you didn't believe they are on the path to AGI.

[go to top]