Food, gambling, etc. are all backed by hordes of brilliant well paid people trying to get you to ruin your life so they make money. On the other side is just regular people like us stressed out trying to survive.
This isn't some "freedom" issue, it's an incredibly huge power asymmetry and I think "we the people" need protection from these forces
No thank you, I can protect myself.
That goes for gambling, smoking, prostitution, drinking, drugs, et al.
Education, therapy and taxation are about the only things that have been shown to work reasonably (eg not spurring massive crime outcomes) to introduce effective limiting forces or properly respond to the consequences of excess.
Outlawing gambling is just as insane as outlawing alcohol, smoking, drug use.