I know that I have stupidly taken some downvotes personally, but later realized, those comments were maybe not bad by itself, but in that context attracting flamewar OT debates. With some extra words, I would have realized sooner.
And downvoting for merely not liking someones opinion is something I really don't like, but is explicitely allowed here.
It's a totally sane motivation it just doesn't obviously make a messageboard better.
I guess that's probably the best way to summarize this argument - the extraordinary burden demands extraordinary benefit and not even the people who are really into this idea often argue the benefit would be commensurate with the burden.