Cap the number of upvotes that a user gets each day and give explicit feedback on how many upvotes that they have left.
In articles: personally I only upvote only those articles that I really want to see in my "saved stories".
So one might make voting comments clutter something for the voter and I think that most hackers like to keep things beautiful, clean and searchable if possible. Might work better for articles than comments though.