zlacker

[return to "Chess-GPT's Internal World Model"]
1. sanxiy+M61[view] [source] 2024-01-07 02:13:23
>>homarp+(OP)
I mean, this seems obvious to me. How would the model predict the next move WITHOUT calculating the board state first? Yes, by memorization, but memorization hypothesis is easily rejected by comparison to training dataset in this case.

It is possible the model calculates an approximate board state, which is different from the board state but equivalent for most games, but not all games. It would be interesting to train adversarial policy to check this. From KataGo attack we know this does happen for Go AIs: Go rules have a concept of liberty, but so called pseudoliberty is easier to calculate and equivalent for most cases (but not all cases). In fact, human programmers also used pseudoliberty to optimize their engines. Adversarial attack found Go AIs also use pseudoliberty.

◧◩
2. HarHar+vk2[view] [source] 2024-01-07 16:18:04
>>sanxiy+M61
> It is possible the model calculates an approximate board state

Yes - this is exactly what the probes show.

One interesting aspect is that it still learns to play when trained on blocks of move sequences starting from the MIDDLE of the game, so it seems it must be incrementally inferring the board state by what's being played rather than just by tracking the moves.

[go to top]