I wonder if "lack of data" problem is solvable within LLM. Humans can apply general programming language knowledge when using a new language, but LLMs have to have
lots of concrete source code to work well.
Today these models fall apart very quickly once you step out of js/python/c land to rust/zig/ocaml.
With today LLM tech, feeding it language documentation does not work great.