zlacker

[parent] [thread] 1 comments
1. jerf+(OP)[view] [source] 2023-03-01 21:28:24
As the complexity of a being increases, the motivations it can have expands. We humans have a hard time looking up the IQ hierarchy, let alone way up the hierarchy, and seeing it that way. We tend to start simplifying because we can't imagine being 1000 times smarter than we are. We tend to think they'll just be Spock or maybe a generic raving lunatic. But it's pretty obvious mathematically that such a being can have more possible states and motivations than we can.

The most likely motivation for an AI to decide to wipe out humanity is one that doesn't even have an English word associated with it, except as a faint trace.

In my opinion, this is actually the greatest danger of AIs, one we can already see manifesting in a fairly substantial way with the GPT-line of transformer babble-bots. We can't help but model them as human. They aren't. There's a vast space of intelligent-but-not-even-remotely-human behaviors out there, and we have a collective gigantic blindspot about that because the only human-level intelligences we've ever encountered are humans. For all the wonderful and fascinating diversity of being human, there's also an important sense in which the genius and the profoundly autistic and the normal guy and the whole collection of human intelligence is all just a tiny point in the space of possibilities, barely distinguishable from each other. AIs are not confined to it in the slightest. They already live outside of there by quite a ways and the distance they can diverge from us only grows larger as their capabilities improve.

In fact people like to talk about how alien aliens could be, but even other biological aliens would be confined by the need to survive in the physical universe and operate on it via similar processes in physically-possible environments. AIs don't even have those constraints. AIs can be far more alien then actual biological aliens.

replies(1): >>SkyMar+fy
2. SkyMar+fy[view] [source] 2023-03-02 01:19:32
>>jerf+(OP)
Excellent observation. Yes we really should be considering AI as an advanced alien intelligence with a completely separate evolutionary (and thus psychological and intellectual) basis than any organic life.
[go to top]