Berlin has a population density ~1/3rd of New York's and a bit more than half of London's. Whether land is used or not is irrelevant, the question is how it's used. Also I'm sure there are a million absurd zoning/building restrictions, they always go hand in hand with the rent controls.