zlacker

>>mef+(OP)
I recently saw a new LLM that was fooled by "20 pounds of bricks vs 20 feathers". These are not reasoning machines.

>>peterm+B3
Tons of people fall for this too. Are they not reasoning? LLMs can also be bad reasoning machines.

>>HDThor+H4
I dont have much use for a bad reasoning machine.

>>peterm+P4
I could retort with another gotcha argument, but instead of doing that perhaps we can do better than that?

An attempt: They are bad reasoning machines that already are useful in a few domains and they're improving faster than evolutionary speeds. So even if they're not useful today in a domain relevant to you there's a significant possibility they might be in a few months. AlphaEvolve would have been scifi a decade ago.

"It's like if a squirrel started playing chess and instead of "holy shit this squirrel can play chess!" most people responded with "But his elo rating sucks""