That's one of my core personal rules before I downvote or upvote -- am I doing this because the comment is objectively good / true / insightful (or the opposites), or because I simply agree with it.
I try and avoid the latter, to the extent humanly possible.