The market has spoken, it's not worthwhile for Apple to produce small phones.
There are a million companies that are not Google that could also produce mini phones and don't for the same exact reason: most people want large screens to enjoy videos and photos.
Nobody cares about small screens and pockets, everyone holds their phones in their hands or purses at all times.