I'd argue that in this case it's also in the interest of the community to downvote, since the comment adds more noise than it contributes to the discussion. In the end it's a ranking; if other comments are better worded and clearer, everything else being equal, they deserve to be higher up.