* Is there a plausible path to safe AGI regardless of who's executing on it?
* Why do we believe OpenAI is the best equipped to get us there?
Manhattan project is an interesting analogy. But if that's the thinking, shouldn't the government spearhead the project instead of a private entity (so they are, theoretically at least, accountable to the electorate at large rather than just their investors)?
I don't think anyone knows that for sure but the alignment efforts at OpenAI are certainly better than nothing. If you read the GPT-4 technical report the raw model is capable of some really nasty stuff, and that's certainly what we can expect from the kind of models people will be able to run at home in the coming years without any oversight.