Are you suggesting we need government intervention or just saying "damn the consequences"?
We build cars, even though some alcoholics drive drunk. We could make cars safer for them by mandating a steering wheel lock with breathalazyer for every car, but we choose to not do that because it's expensive.
We have horror movies, even though some people really freak out from watching horror movies, to the point where they have to be placed in mental asylums for extended periods of time. We could outlaw horror movies to reduce the strain on these mentally troubled individuals, but we choose to not do that because horror movies are cool.
This is a very naive understanding of what prisons are and who goes in them and why.
But it is, nearly every product, procedure, process is aimed at the lowest common denominator, it's the entire reasoning warning labels exist, or fail safe systems (like airbags) exist.
That's a far cry from saying the sellers are free from any responsibility.
Cars are highly engineered AND regulated because they have a tendency to kill their operators and pedestrians. It does cost more, but you're not allowed to sell a car that can't pass safety standards.
OpenAI have created a shiny new tool with no regulation. Great! It can drive progress or cause harm. I think they deserve credit for both.
But you are allowed to sell a car without a mechanical steering wheel lock connected to a breathalyzer. Remember, this discussion isn't about "should technology be made safe for the average person", this discussion is about "should technology be made safe for the most vulnerable amongst us". In the context of cars, alcoholics are definitely within this "most vulnerable" group. And yet, car safety standards do not require engine startup to check for a breathalyzer result.
> OpenAI have created a shiny new tool with no regulation. Great! It can drive progress or cause harm. I think they deserve credit for both.
I didn't make an argument for "no regulation", so this is not really related to anything I said.