This is part of the issue IMO. Is this size and complexity warranted?
Rust for example; its a complex language, can target pretty much all platforms under the sun, and yet it's configured with just text files, builds with just terminal commands, and works great with any text editor.
I've seen people in big tech work on codebases millions of files big with everything from VSCode to a russian text editor from the 90s. Linus Trovalds is building Linux with MicroEMACS. Why do I need a behemoth like Xcode to build a To Do app? Why does it have to be this "big and complex"?
The point about Xcode being complex, I disagree with. Honestly I could think of so many additional features to make my workflow easier.
Nobody is saying not to use Xcode if you like it, but there should be a choice like there is for almost every other modern platform.