The underclass? Or the WHITE MALE underclass?
And, that's assuming that the neighborhood in question didn't get bulldozed for a freeway by Robert Moses or any of the dozens of urban planners that used eminent domain to rat fuck minority homeowners out of the meager scraps they had managed to acquire.
And, that's only racial minorities, that's not even going into women who thanks to being largely un-banked and the presumptions that finance was simply over their pretty little heads, and of course that their jobs were chronically underpaid if they even could get them, would be laughed out of a bank entirely if they tried to buy a home.
So like, was it ONLY white men buying homes? Nah. But it was predominantly white men buying all the homes you would actually want to buy and if you weren't a white man, you had an objectively, measurable harder time doing it.