zlacker

> truly understanding… when I explain something, I have understood it

When you have that feeling of understanding, it is important to recognize that it is a feeling.

We hope it’s correlated with some kind of ability to reason, but at the end of the day, you can have the ability to reason about things without realising it, and you can feel that you understand something and be wrong.

It’s not clear to me why this feeling would be necessary for superhuman-level general performance. Nor is it clear to me that a feeling of understanding isn’t what being an excellent token predictor feels like from the inside.

If it walks and talks like an AGI, at some point, don’t we have to concede it may be an AGI?

>>trucul+(OP)
Would say understanding usually means ability to connect the dots and see the implications … not feeling.

>>quantu+n9
Okay, what if I put it like this: there is understanding (ability to reason about things), and there is knowing that you understand something.

In people, these are correlated, but one does not necessitate the other.