zlacker

>>vforgi+(OP)
This feels like theater. Make society fear AI, requiring regulation, so central power controls access to it. I think Osho put it nicely:

"No society wants you to become wise: it is against the investment of all societies. If people are wise they cannot be exploited. If they are intelligent they cannot be subjugated, they cannot be forced in a mechanical life, to live like robots."

>>thelit+Kh1
I agree. Every talk on "AI safety" I've heard given has essentially been some form of "we can be trusted with this power, but someone else might not be, so we should add regulations to ensure that we're the only ones with this power". Examples like "ChatGPT can tell you how to make nerve gas, we can't let people have this tool" seem somewhat hollow given that the detailed chemistry to make Sarin is available on Wikipedia and could be executed by a decently bright high schooler.

"Alignment" is a euphemism for "agrees with me", and building uber-AI systems which become heavily depended on and are protected from competition by regulation, and which are aligned with a select few - who may well not be aligned with me - is a quick path to hell, IMO.

>>cheald+9k1
It's very Lord of the Rings.