There are multiple risks that people talk about, the most interesting is the intelligence explosion. In that scenario we end up with a super intelligence. I don’t feel confident in my ability to asses the likelihood of that happening, but assuming it is possible, thinking through the consequences is a very interesting exercise. Imagining the capabilities of an alien super intelligence is like trying to imagine a 4th spatial dimension. It can only be approached with analogies. Can it be “switched off”. Maybe not, if it was motivated to prevent itself from being switched off. My dog seems to think she can control my behavior in various predictable ways, like sitting or putting her paw on my leg, and sometimes it works. But if I have other things I care about in that moment, things that she is completely incapable of understanding, then who is actually in control becomes very obvious.