Society has already spoken on this matter. It seems that your criteria amount to nothing more than "when I personally dislike the results of the social process, the social process has failed, and we ought to revisit it."
So I ask again the question you've begged: by what formula or philosophy are we to determine when a social decision such as "allow gambling" is bad? Is there anything beyond your personal feelings on a topic that we can turn to as a criterion?