But freedom of speech isn't freedom from consequences of that speech.
Like people judging what you say.
I'm a free speech absolutionist, but I still think neo Nazis are assholes. I think they should be allowed to say it (absent violence), but anyone who chooses to say it is going to drastically change the way I think of them.