zlacker

Instead of outsing Sam A and Greg B, if Ilya really had deep concerns, he should have quit and built his own AGI dedicated research company. His prestige surely would have given him funding.

Like how Hinton left Google so he could speak freely.

IMO inventing AGI is more powerful than nuclear energy. It would be very stupid of humanity to release it out in the wild.

LLMs are a great tool and nowhere near AGI.

I’m of the belief that alignment of AGI is impossible. It’s like asking us to align with lions. Once we compete for the same resources, we lose.

>>nojvek+(OP)
> If Ilya really had deep concerns, he should have quit and built his own AGI dedicated research company.

...

You should look up some history here.

Exactly what you say has already happened and OpenAI is the dedicated research company you are referring to.

He originally left Google deep mind I believe.

> I’m of the belief that alignment of AGI is impossible.

I don't think most people in this space are operating based on beliefs. If there is even a 10% chance that alignment is possible, it is probably still worth pursuing.