Some memory might actually be helpful. For example having it know that I have a Mac will give me Mac specific answers to command line questions without me having to add "for the Mac" to my prompt. Or having it know that I prefer python it will give coding answers in Python.
But in all those cases it takes me just a few characters to express that context with each request, and to be honest, I'll probably do it anyway even with memory, because it's habit at this point.