zlacker

[return to "Remembering Doug Lenat and his quest to capture the world with logic"]
1. dekhn+Nx1[view] [source] 2023-09-06 18:13:32
>>andyjo+(OP)
I recommend reading Norvig's thinking about the various cultures.

https://static.googleusercontent.com/media/research.google.c... and https://norvig.com/chomsky.html

In short, Norvig concludes there are several conceptual approaches to ML/AI/Stats/Scientific analysis. One is "top down": teach the system some high level principles that correspond to known general concepts, and the other is "bottom up": determine the structure from the data itself and use that to generate general concepts. He observes that while the former is attractive to many, the latter has continuously produced more and better results with less effort.

I've seen this play out over and over. I've concluded that Norvig is right: empirically based probabilistic models are a cheaper, faster way to answer important engineering and scientific problems, even if they are possibly less satisfying intellectually. Cheap approximations are often far better than hard to find analytic solutions.

◧◩
2. golol+rB1[view] [source] 2023-09-06 18:27:14
>>dekhn+Nx1
this is the same concept as the bitter lesson, am I correct? I don't see a substantial difference yet.
[go to top]