There are still significant limitations, no amount of prompting will get current models to approach abstraction and architecture the way a person does. But I'm finding that these Gemini models are finally able to replace searches and stackoverflow for a lot of my day-to-day programming.
I find this sentiment increasingly worrisome. It's entirely clear that every last human will be beaten on code design in the upcoming years (I am not going to argue if it's 1 or 5 years away, who cares?)
I wished people would just stop holding on to what amounts to nothing, and think and talk more about what can be done in a new world. We need good ideas and I think this could be a place to advance them.
The LLM needs vast amounts of training data. And those data needs to have context that goes beyond a simple task and also way beyond a mere description of the end goal.
To just give one example: in a big company, teams will build software differently depending on the relations between teams and people. So basically, you would need to train the LLM based on the company, the "air" or social atmosphere and the code and other things related to it. It's doable but "in a few years" or so is a stretch. Even a few decades seems ambitious.