Admit defeat and just use the slashdot system. For all its trolls and failings slashdot still has the best crowdsource comment moderation system on the interwebs.
The Slashdot System
- Comments start at +1 and can range from -1 to +5 only
- Mod points are limited and distributed randomly as needed
- Only members with good karma are eligible for mod points