(I'm not saying HN should do exactly the same thing, but one example is Slashdot's system where a comment can get downvoted in a way that tags it specifically as trolling/offtopic/whatever - https://slashdot.org/faq/mod-metamod.shtml seems to describe it alright)
If I make a factually inaccurate comment, I can expect at least three replies correcting me. We like to joke that they all start with "actually..." Maybe I've also been downvoted, but it's clear I was incorrect about something.
If I'm downvoted without replies, was I being a jerk? This requires some self-reflection, but there's rarely any mystery. Maybe I made a joke that fell flat, wasn't appreciated, or was deemed unsubstantial. Flop on this one badly enough and the mod will let you know by word or act.
Which brings us to the last possibility. If I haven't been incorrect, a jerk, telling dad jokes, or being generally pointless and my comment is still being downvoted, then it means I've said something that some people wish wasn't true. It might not even be a majority, just whoever happened to be passing by. Be proud and don't sweat the fake internet points.