zlacker

[return to "Beyond Semantics: Unreasonable Effectiveness of Reasonless Intermediate Tokens"]
1. ngruhn+0o[view] [source] 2025-05-23 19:07:19
>>nyrikk+(OP)
Man that "Unreasonable Effectiveness of ..." pattern is getting a bit overused. With the original paper [1] you could still say that there really is some deeply philosophical mystery. But they now slap that on everything.

[1] https://en.m.wikipedia.org/wiki/The_Unreasonable_Effectivene...

◧◩
2. godels+OD[view] [source] 2025-05-23 21:02:48
>>ngruhn+0o
It's also worth pointing out that Winger's (position) paper[0] is really about something that would sound silly today. He's arguing that we should use math to drive physics. Today, many people think these are indistinguishable things and you'll get into arguments about math being invented or discovered. But Winger is talking about how mathematics provides us with a framework where we can drive physics forward through theory instead of relying purely upon experimentation to poke and prod the universe.

It is rather "unreasonable" to think we can explore the world simply through pen and paper, from the comfort of a chair. You'd think you'd need to go out and touch grass, but incredibly this is not necessary.

  | The first point is that the enormous usefulness of mathematics in the natural sciences is something bordering on the mysterious and that there is no rational explanation for it. Second, it is just this uncanny usefulness of mathematical concepts that raises the question of the uniqueness of our physical theories. 
Which is exactly why a lot of these other things are overused. Hamming's seems like an extension or corollary[1] and I even think Norvig's (Halevy's) is highly appropriate[2]. It is "unreasonable" to think these things would be effective.

  -------------------------------------
With this paper?

I think is fine. It is being used in a similar way to Winger, with similar context.

I can see two camps. One has always interpreted the COT as analogous to a model's internal dialogue. While the other has always thought there's a much larger gap between the manipulations within latent representations and what has been decoded, not necessarily needing be strongly aligned.[3] To the former, the results here would be shocking, while to the latter it is "yes, and?" Clearly they're addressing the former camp. There were plenty of people that Winger did not need to convince.

I'm of the latter camp[4], and I'm happy people are not just asserting and are demonstrating. Honestly, I'm even frequently upset when works get dismissed because they "demonstrate something we already knew" but no one had ever actually demonstrated. The proofs and evidencing is more important than the answer. Quite often we're highly certain about results but they are difficult to even evidence (let alone prove). I mean it would be quite silly to dismiss a proof that P != NP, even though the vast majority of us have long been convinced that this is the relationship we'll end up with. Yet, no one's done it.

  -------------------------------------
[0] https://web.archive.org/web/20210212111540/http://www.dartmo...

[1] https://math.dartmouth.edu/~matc/MathDrama/reading/Hamming.h...

[2] https://static.googleusercontent.com/media/research.google.c...

[3] Both camps can be further broken down too. Lots of nuances and opinions here and the lines really get fuzzy as we try to make it more accurate. I don't want to pretend there's a hard defining line, but the distinction helps the discussion and I think is reasonably accurate enough. Let me know if you think it is a gross mischaracterization.

[4] I can expand more why this side seems "obvious" to me. But a warning, you can probably guess I'm not good at being terse.

[Note]: I'd even go so far as say we should revisit Winger's argument around AI. I'm certain mathematics can be and will be "unreasonably effective." But not enough time has been dedicated to formulate the right type of math to use. We really do have to invent a new kind here. This may sound weird to non-mathematicians, but even physics uses multiple kinds of mathematics. The operations, fields, and algebras you use in one part may not be appropriate in another part. That's okay. But we don't have a TOE yet either, and that's a critical part of finding a TOE, is bringing all this together.

◧◩◪
3. tim333+fN[view] [source] 2025-05-23 22:26:24
>>godels+OD
>It's also worth pointing out that Winger's (position) paper[0] is really about something that would sound silly today. He's arguing that we should use math to drive physics.

I think you misinterpret what it's about. He's pointing out how remarkable it is that the universe obeys laws like E=MC^2 exactly as far as we can tell which is not something you would probably expect just from looking at the world. The pre scientific understanding of the world was it was driven my gods and spirits. The mathematical laws were only discovered by scientific investigation.

Or as he puts it:

>The miracle of the appropriateness of the language of mathematics for the formulation of the laws of physics is a wonderful gift which we neither understand nor deserve.

If he was just saying use maths it would be boring and not a famous paper 65 years on.

◧◩◪◨
4. godels+HS[view] [source] 2025-05-23 23:22:09
>>tim333+fN

  > I think you misinterpret what it's about. He's pointing out how remarkable it is that the universe obeys laws like...
I apologize for not being clear. But we are talking about the same thing.

  > The pre scientific understanding of the world was it was driven my gods and spirits.
Winger's paper was written in 1960. I do not think such claims need have been said. Those arguments were prolific and had been made for centuries. He did not need to convince anyone in the scientific community that the laws of nature were not driven by gods and spirits. By the 1960s the scientific age was already mature and it was well established in the community that the laws of nature are not the domain of gospel.

  | "Well, now you are pushing your joke too far," said the classmate, "surely the population has nothing to do with the circumference of the circle."
The point is made here. It is surprising that math describes reality. It is surprising that a circle has anything to do with a population.

I really did mean it when I said "about something that would sound silly today". We take this for granted now, with 60 years of working under this framework, but this wasn't always so. It seems silly now because much of the math we learn is in science classes and even outside we have a particular focus of teaching math most relating to science, but this is a small portion of a much larger field. Fwiw, I am not saying this as a complete outsider, I have a degree in physics.

It is also worth paying attention to the fact that Wigner helped create Mathematical Physics[0]. "Mathematical Physics" is not a pleonasm.

Don't take it just on my word! The Wiki page says something extremely similar!

  | In it, Wigner observes that a theoretical physics's mathematical structure often points the way to further advances in that theory and to empirical predictions. Mathematical theories often have predictive power in describing nature. [1]

  | Wigner argues that mathematical concepts have applicability far beyond the context in which they were originally developed[1]

  > The mathematical laws were only discovered by scientific investigation.
I should make sure this is clear though (unsure which interpretation you intend). Math and science aren't interchangeable. Physics uses the language of math as its main method for developing theories and logic. But it is also important to stress that it doesn't use the same mathematical language throughout. The frameworks that those working in relativity use are not useful for those that work in quantum mechanics. If the math was uniform, we would not be dedicating so much time to bridge these. Nor is math absolute here, as it is a map, and we still rely heavily on the language of experimental evidence.

Yes, he was saying "use maths". Yes, it sounds silly today, but so do a lot of things that needed be said in the past. I see no reason that the (now) obvious claim by Copernicus would make him any less famous.

[0] https://en.wikipedia.org/wiki/Mathematical_physics

[1] https://en.wikipedia.org/wiki/The_Unreasonable_Effectiveness...

◧◩◪◨⬒
5. tim333+Zk2[view] [source] 2025-05-24 19:01:09
>>godels+HS
I think we agree on all the facts but I disagree on what his message was and whether it sounds silly these days, which is a matter of opinion I guess.

You have "use maths" which sounds silly, I take it as "the appropriateness of maths is a miracle we don't understand" which is deeper and still largely true.

◧◩◪◨⬒⬓
6. godels+pC2[view] [source] 2025-05-24 22:30:24
>>tim333+Zk2
To change your mind, what would I need to demonstrate? I'm providing third party sources, I have personal experience, I can quote from the original source. What is missing that results in being unconvincing? I want to make sure, there are ways to change your opinion, right?

I really encourage you to read that wiki page.

  | The quantum theory of the Lamb shift, as conceived by Bethe and established by Schwinger, is a purely mathematical theory and the only direct contribution of experiment was to show the existence of a measurable effect. The agreement with calculation is better than one part in a thousand."
I think you're missing a lot of context in that physics was highly non-mathematical in the past. Physicists called Einstein a mathematician. It isn't too hard to see when he asserted that his theories were correct and didn't need experimental confirmation.

  | Hamming argues that Albert Einstein's pioneering work on special relativity was largely "scholastic" in its approach. He knew from the outset what the theory should look like (although he only knew this because of the Michelson–Morley experiment), and explored candidate theories with mathematical tools, not actual experiments. Hamming alleges that Einstein was so confident that his relativity theories were correct that the outcomes of observations designed to test them did not much interest him. If the observations were inconsistent with his theories, it would be the observations that were at fault.
Hell, go read Ian Hacking, any metaphysics, or ask ChatGPT. They will confirm what I'm saying. Even some of this is discussed in An Opinionated History of Mathematics[0], though much more focused on math. I'm more mentioning it because it is good and helps provide some of that historical context.

It is kinda crazy that a thing we created, without the specific intent of modeling the world, ended up being so great at modeling the world. That's the unreasonable effectiveness.

In fairness, to change my opinion, you would need to show me some chain of reasoning or a conversation Wigner is clearly responding to that involves religion. Because this is what I see, but around math not being physics, and is what drives my interpretation.

[0] https://intellectualmathematics.com/opinionated-history-of-m...

[go to top]