zlacker

"[Yann LeCun] believes [current] LLMs will be largely obsolete within five years."

>>ejang0+(OP)
Obsolete by?

This seems like a broken clock having a good chance of being right.

There's so much progress, it wouldn't be that surprising if something quite different completely overtakes the current trend within 5 years.

>>ejang0+(OP)
> believes [current] LLMs will be largely obsolete within five years

Well yes in that ChatGPT 4 (current) will be replaced by ChatGPT 5 (future) etc...

>>onlyre+41
> Obsolete by

By NN models overcoming the pivot over representing language - according to LeCun in the article. It could be the Joint Embedding Predictive Architecture - we will see.

> There's so much progress, it wouldn't be that surprising

LeCun's point looks like a denunciation over an excessive focus over the LLM idea ("it works, so let's expand that" vs "it probably will not achieve the level of a satisfactory general model, so let us directly try to go beyond it").

>>onlyre+41
Obsolete by price. This technology only scales linearly. All the investment in it had a different growth expectation. I suspect this level of investment will eventually collapse.