Also , it's just normal backend work - calling a bunch of APIs. What am I missing here?
Actually making a system like this work seems easy, but isn't really.
(Though with the CURRENT generation or two of models it has gotten "pretty easy" I think. Before that, not so much.)
They he ML frameworks are much closer to implementing the mathematics of neural networks, with some abstractions but much closer to the linear algebra level. It requires an understanding of the underlying theory.
Langchain is a suite of convenience functions for composing prompts to LLMs. I wouldn’t consider there to be some real domain knowledge one would need to use it. There is a learning curve but it’s about learning the different components rather than learning a whole new academic discipline.