The point of downvoting a 1-point comment is usually to let someone know their comment was inappropriate. A downvote against a 60-point comment is supposed to mean "This is not that good. It's just hivemind / good placement."
Taking one point away from a 60-point comment doesn't change its position, however. Maybe downvotes should increase its gravity or maybe they should have a greater push-back, even if it's not 1.1*count(downvotes) but rather (count(downvotes))^1.1.