The only real threat is from people willing to trust AI.
We have no idea where that point is.
It's worth comparing to where we were a century ago. That's where my kid will be when he's grown up compared to now.
Nobody is worried about GM's chat bot.
People are worried that LLMs will be abused and many people will suffer for it.
People are also worried that significantly more advanced forms of AI will cause us to no longer be the dominant species on the planet.
Can't use AI as a crutch, it eventually does the thinking for you.
Agent Smith - I say your civilization, because when we started thinking for you, it really became our civilization.
In some cases, like nuclear proliferation, a concerted effort by powerful actors can slow the spread of certain technologies. Otherwise, your "no" will amount to about as much as the anti-vaxxers.
The point is, exponential progress is incredible, but at some point it ceases to be exponential. And the progress of the last 100 years was fueled by a exponential population growth and exponential energy usage. We're already at +1.5C because of that; how hot will it be when your kid is grown up?
People are worried that maybe your jeans are dangerous and should be regulated.
If you look at the direction, it's not predictable. A very different set of things will come to pass.
A child born today will live O(100 years), and will be in a very different world than I am today. Computation, in particular, is continuing to change. LLMs are a huge change, as is being interconnected, as are many other things. That's not "faster," like Moore's Law of yesteryear, but it is change.
Also: Change isn't always progress.
The concept of *money* and commerce might be a good place to start trying to teach this techno parrot how to actually think.
A 5 year old has way better thinking ability. Maybe we should regulate 5 year olds as being potentially dangerous. You never know --- at "some point" one of them could easily decide to destroy humanity.