zlacker

>>Jimmc4+(OP)
"Superalignment" sounds so much cooler than "output moderation".

>>renega+mi1
Like Emmett Shear says[0], in this discourse we crucially need to separate out the "AI ethics" (like output moderation) from the real problem of "AI NotKillEveryoneism". People are pattern matching "safety" as "those people concerned about AI racism and censoring" when they're orthogonal.

I encourage everyone who is skeptical of superalignment (there's a reason very smart people like Ilya were heading that team) watch Emmett Shear (former OpenAI and Twitch CEOs) talk about this problem in the discourse.

https://youtu.be/jZ2xw_1_KHY?si=Jog7ULmjjNW21ZIf&t=800

>>reduce+4u1
100%. I see them conflated a lot, particularly outside of HN, and I think it really damages the discourse. Censorship for political or brand reasons (and I'm not making a moral judgement by my choice of language) is very different to aligning for safety reasons.