I think it's true and fair to say that caring more about how people are perceiving you results in drawbacks, and the world we live in where people do watch how their actions effect others isn't a perfect, problem-free world.
It makes intuitive sense to me that sometimes, when we work to raise people up, we do so at some cost to the people who are already at the top. This could be an example of that, I think.