zlacker

[return to "Yann LeCun, Pioneer of AI, Thinks Today's LLM's Are Nearly Obsolete"]
1. gsf_em+4d8[view] [source] 2025-04-05 15:45:25
>>alphad+(OP)
Recent talk: https://www.youtube.com/watch?v=ETZfkkv6V7Y

LeCun, "Mathematical Obstacles on the Way to Human-Level AI"

Slide (Why autoregressive models suck)

https://xcancel.com/ravi_mohan/status/1906612309880930641

◧◩
2. gibson+Xd8[view] [source] 2025-04-05 15:52:42
>>gsf_em+4d8
The error with that is that human reasoning is not mathematical. Math is just one of the many tools of reason.
◧◩◪
3. csdvrx+og8[view] [source] 2025-04-05 16:15:53
>>gibson+Xd8
Intransitive preferences is well known to experimental economists, but a hard pill to swallow for many, as it destroys a lot of algorithms (which depends on that) and require more robust tools like https://en.wikipedia.org/wiki/Paraconsistent_logic

> just one of the many tools of reason.

Read https://en.wikipedia.org/wiki/Preference_(economics)#Transit... then read https://pmc.ncbi.nlm.nih.gov/articles/PMC7058914/ and you will see there's a lot of data suggesting that indeed, it's just one of the many tools!

I think it's similar to how many dislike the non-deterministic output of LLM: when you use statistical tools, a non-deterministic output is a VERY nice feature to explore conceptual spaces with abductive reasoning: https://en.wikipedia.org/wiki/Abductive_reasoning

It's a tool I was using at a previous company, mixing LLMs, statistics and formal tools. I'm surprised there aren't more startups mixing LLM with z3 or even just prolog.

◧◩◪◨
4. gsf_em+iu9[view] [source] 2025-04-06 05:50:51
>>csdvrx+og8
Thanks for the links, the "tradeoff" aspect of paraconsistent logic is interesting. I think one way to achieve consensus with your debate partner might be to consider that the language rep is "just" a nondeterministic decompression of "the facts". I'm primed to agree with you but

>>41892090

(It's very common, esp. with educationally traumatized Americans, e.g., to identify Math with "calculation"/"approved tools" and not "the concepts")

"No amount of calculation will model conceptual thinking" <- sounds more reasonable?? (You said you were ok with nondeterministic outputs? :)

Sorry to come across as patronizing

◧◩◪◨⬒
5. 082349+cF9[view] [source] 2025-04-06 08:43:30
>>gsf_em+iu9
if conceptual thinking is manipulating abstract concepts after having been given concrete particulars, I'd say it relies heavily upon projection, which, as generalised "K" (from SKI), sounds awfully like calculation.
[go to top]