I suggest that you use the freshness and quality of the whole comment subtree (normalized by the number of comments in the subtree, eg mean) to get those gems higher. Something like the square of points (negatives counting as zeroes) would raise the effect of good comments and lower the effect of bad comments and low-point side discussions.