It shouldn't be too hard to limit abuse. Set appropriate thresholds, give less weight to new accounts with low karma, ignore flags from users who frequently flag inappropriately (this last one could be automated by comparing upvotes from a list of "known good voters" against the flags. For example, if you flag stuff that pg upvotes, you're probably flagging inappropriately).