zlacker

[return to "Introducing Superalignment"]
1. voldac+sb1[view] [source] 2023-07-05 22:15:29
>>tim_sw+(OP)
>How do we ensure AI systems much smarter than humans follow human intent?

What is human intent? My intents may be very different from most humans. It seems like ClosedAI wants their system to follow the desires of some people and not others, but without describing which ones or why.

◧◩
2. ben_w+kf1[view] [source] 2023-07-05 22:37:12
>>voldac+sb1
You're seeing what you want to see.

They're repeatedly very specific about the whole "this can kill all of us if we do it wrong", so it's more than a little churlish to parrot the name "ClosedAI" when they're announcing hiring a researcher to figure out how to align with anyone, at all, even in principle.

◧◩◪
3. junon+hs1[view] [source] 2023-07-05 23:56:15
>>ben_w+kf1
I'm still a bit hung up on "it can kill all of us". How?
◧◩◪◨
4. ben_w+um2[view] [source] 2023-07-06 07:25:15
>>junon+hs1
Did you ever play the old "Pandemic" flash game? https://tvtropes.org/pmwiki/pmwiki.php/VideoGame/Pandemic

That the origin of COVID is even a question implies we have the tech to do it artificially. An AI today treating real life as that game would be self-destructive, but that doesn't mean it won't happen (reference classes: insanity, cancer).

If the AI can invent and order a von Neumann probe — the first part is the hard part, custom parts orders over the internet is already a thing — that it can upload itself to, then it can block out (and start disassembling) the sun in a matter of decades with reasonable-looking reproduction rates (though obviously we're guessing what "reasonable" looks like as we have only organic VN machines to frame the question against).

AI taking over brain implants and turning against everyone without them like a zombie war (potentially Neuralink depending on how secure the software is, and also a plot device in web fiction serial The Deathworlders, futuristic sci-fi and you may not be OK with sci-fi as a way to explore hypotheticals, but I think it's the only way until we get moon-sized telescopes to watch such things play out on other worlds without going there; in that story the same AI genocides multiple species over millions of years as an excuse for why humans can even take part in the events of the story).

◧◩◪◨⬒
5. antifa+UO2[view] [source] 2023-07-06 11:25:04
>>ben_w+um2
To be realistic, I'm more worried about McDonald's or Musk doing all of that.
[go to top]