Food, gambling, etc. are all backed by hordes of brilliant well paid people trying to get you to ruin your life so they make money. On the other side is just regular people like us stressed out trying to survive.
This isn't some "freedom" issue, it's an incredibly huge power asymmetry and I think "we the people" need protection from these forces
Where do we stop? Drugs? Medication? News? Elections?
People choose bad things all the time. Thinking you know better is how you end up banning alcohol because it's obviously a terrible vice.