I would recommend getting rid of up-voting and positive karma. People make pithy comments in order to get positive karma. Same reason for meme threads.
The real reason for a karma mechanic on HN is to filter out incredibly stupid comments. So keep down-voting. Things that are down-voted should go to the bottom of the stack.