Hopefully they'll make it easy to go into a temporary chat because it gets stuck in ruts occasionally so another chat frequently helps get it unstuck.
"You can turn off memory at any time (Settings > Personalization > Memory). While memory is off, you won't create or use memories."
For coding tasks, I found it helps to feed the GPT-4 answer into another GPT-4 instance and say "review this code step by step, identify any bugs" etc. It can sometimes find its own errors.