I don't have an issue with flagging dumb stories.
I have an issue with flagging active and important stories, hiding upvoted comments, silently de-ranking stories without any notification, etc.
Straw-man all you like, there's no justification for this.