Yes, you can draw a line wherever your moral compass tells you to. My point was not about morality. It is just that regardless of what you think of morals as an individual, these people are all still part of the same society, and parts of both problems and solutions.
And in many parts of the world you have to be lucky not to see/experience poverty from up close.