I assume that was your intention ?
This in turn will give the few people that are very active lots of voting power.
The karma here is not so much 'quality' (though that is a component) as much as it is an odometer.
The main point is to force people to be more cautious with their upvotes and downvotes. My theory is that if you have to pay from your reputation (your karma), you'll mainly upvote/downvote what you're really convinced about.