Add a mechanism that encourages people to think before upvoting, like a karmic bank account. Maybe someone could upvote twice for every once they were upvoted. It could reduce the common reflex of upvoting a short/witty comment; with only so many upvotes to give, you'd want to "invest" in comments that really earned it.