The only real threat is from people willing to trust AI.
Nobody is worried about GM's chat bot.
People are worried that LLMs will be abused and many people will suffer for it.
People are also worried that significantly more advanced forms of AI will cause us to no longer be the dominant species on the planet.
People are worried that maybe your jeans are dangerous and should be regulated.