zlacker

>>Jimmc4+(OP)
"Superalignment" sounds so much cooler than "output moderation".

>>renega+mi1
Like Emmett Shear says[0], in this discourse we crucially need to separate out the "AI ethics" (like output moderation) from the real problem of "AI NotKillEveryoneism". People are pattern matching "safety" as "those people concerned about AI racism and censoring" when they're orthogonal.

I encourage everyone who is skeptical of superalignment (there's a reason very smart people like Ilya were heading that team) watch Emmett Shear (former OpenAI and Twitch CEOs) talk about this problem in the discourse.

https://youtu.be/jZ2xw_1_KHY?si=Jog7ULmjjNW21ZIf&t=800

>>reduce+4u1
100%. I see them conflated a lot, particularly outside of HN, and I think it really damages the discourse. Censorship for political or brand reasons (and I'm not making a moral judgement by my choice of language) is very different to aligning for safety reasons.

>>AlexAn+uz1
Yep. And it's lazy to think that the pro-cryogenics, pro-nuclear, pro-engineering people are the same as the ones storming a Tesla factory or causing wildly unexpected Gemini output.

"No no no, this thing though actually, may be a problem. If you're rejecting it because we sound like a bunch of crazies, Just notice that some number of people who are worried about this, I'm on your team, I'm on the techno-optimist team. Its not obvious why its true. It takes a good deal of engagement with the material to see why its true. Because at first, it seems like it shouldn't be that big of a deal, it shouldn't be that big of a problem. but then the more you dig in, actually, oh wait a second, and it is." -Emmett

>>reduce+hB1
"People who support cryonics are sober-minded, reasonable individuals who would surely never be misled by unscientific techno-mysticism."

I am amazed at the Dunning-Kruger syndrome on display here.