Good point. Look at it this way, though: If such a system ends up stopping a person that is about to eradicate humanity using nuclear weapons, bioweapons or similar, is that a good or bad thing?
>>trasht+(OP)
I don't know. On the one hand there's the idea that humanity should be left to take it's organic path. The machine can't know that guy's grievances. Do we really want to be kept as pets? Or is it just another tool being used to protect people? I guess it really depends on the role it plays in the social structure directly.