Currently, LLMs seem to prioritize their current goal, so if the goal is solving math puzzles or genetic problems, they would probably keep doing that too.
>>c_cran+(OP)
I'd love to be able to see more about how the main LLMs are really trained and limited with regards to their goals and scoring algorithms.
It seems reasonable that they wouldn't deviate, but that depends on how specifically and wholly the original goals were defined. We'd basically be attempting to outwit the LLMs, I'm not sure if that's realistic or not.