Also when someone does say something I agree with but that does not contribute ("most grass is green") I wouldn't want to reward them with a +1 agree either, just punish with -1 doesn't contribute.
It would probably require hiding comment scores though - otherwise it'd be easy to observe how the multiplier changes and game it.