I like making a distinction between something that I simply don't find insightful and something that is actually trolling/spammy/false. In HN's case, my lack of an upvote is equivalent of not finding something insightful... my flagging is an indication of the latter.