They were simple in principle but expensive at scale. Sounds like LLMs.
My understanding was that practical results were indicating your model has to be pretty large before you start getting "magic."