Alternatively, cap downvoting at 1 karma, so that comments can't go below that threshold.
(Repeating from my previous post): Letting karma go below 1 adds bias to the comment for future readers, but that bias doesn't reflect how they might feel.