zlacker

Perhaps you could argue that he wants to stick with Sam and the others because if they start a company that competes with OpenAI, there’s a real chance they catch up and surpass OpenAI. If you really want to be a voice for safety, it’ll be most effective if you’re on the winning team.

>>MattRi+(OP)
Depends how much research is driven by Ilya…

>>MattRi+(OP)
I dunno, the moat Sam tried to build might make it hard to make a competitor.

>>I_am_u+44
We are about to find out if the moats are indeed that strong.

xAI recently showed that training a decent-ish model is now a multi-month effort. Granted GPT-4 is still farther along than others but curious how many months/resources does that add up when you have the team that built it in the first place

But also, starting another LLM company might be too obvious a thing to do. Maybe Sam has another trick up his sleeve? Though I suspect he is sticking with AI one way or the other

>>MattRi+(OP)
One funny detail is that the OpenAI charter states that, if this happens, they will stop their own work and help the organisation that is closest to achieving OpenAI's stated goal.

>>thekom+X7
really?

>>thekom+X7
Maybe Sam wants to build something for profit?

>>MattRi+(OP)
> If you really want to be a voice for safety, it’ll be most effective if you’re on the winning team.

If an AI said that, we'd be calling it "capability gain" and think it's a huge risk.

>>aryama+8e
https://openai.com/charter

Second paragraph of the "Long-term safety" section.

>>thekom+X7
But now it may be the regulations they've gotten in place will make it harder for any new upstarts to approach them.