Actually this part does seem in recent research to be encoded in LLMs at an abstract level in a linear representation...
https://arxiv.org/abs/2310.06824