But what is your end goal? What purpose does this caste system serve?
History has shown that once people no longer believe they have a fair chance of achieving prosperity, they revolt. So, even ignoring any other characteristics, your way of social organisation is not stable in the long run.