Really bad comments are not the root of the problem. Simply having large number of mediocre comments crowds out and discourages thoughtful discussion from starting at all.
I'd say:
* create some real cost to making comments
* make bad comments disappear/not display at all with time
* make things less democratic -- to encourage good behavior identify users who have this behavior and make this behavior more prominent programmaticly
Stackexchange kind of does this. You need a certain (low) amount of karma before you can post certain types of submissions.
I think it's important to let new users have a visible voice, but giving older users greater powers for moderation might help preserve the older attitude of the site.