When you mixed new stories onto the front page, were they clearly marked as new or could they easily be mistaken for upvoted content?
Maybe this could be a karma gated opt-in feature that individual users can enable?