I don't downvote all disagreement, and I'll occasionally upvote or vouch a comment I disagree with that I feel has been excessively downvoted.
But I frequently downvote disagreement where it seems to me that the comment also reduces the overall thread quality.