How about a rotating group of admin users? Every 30 days a new batch of X users with greater than N karma get to bury/downvote/ban poor quality submissions/comments. This group would be forcibly rotated so that you don't get the "entrenched elite" problem.
It would encourage admins to be wise and for others to respect their wisdom.