zlacker

[parent] [thread] 4 comments
1. Crespy+(OP)[view] [source] 2024-02-13 18:36:31
Personally, I always expect every "conversation" to be starting from a blank slate, and I'm not sure I'd want it any other way unless I can self-host the whole thing.

Starting clean also has the benefit of knowing the prompt/history is in a clean/"known-good" state, and that there's nothing in the memory that's going to cause the LLM to get weird on me.

replies(4): >>danShu+x2 >>mark_l+96 >>mhink+Sg >>madame+mj
2. danShu+x2[view] [source] 2024-02-13 18:48:59
>>Crespy+(OP)
> Starting clean also has the benefit of knowing the prompt/history is in a clean/"known-good" state, and that there's nothing in the memory that's going to cause the LLM to get weird on me.

This matters a lot for prompt injection/hijacking. Not that I'm clamoring to give OpenAI access to my personal files or APIs in the first place, but I'm definitely not interested in giving a version of GPT with more persistent memory access to those files or APIs. A clean slate is a mitigating feature that helps with a real security risk. It's not enough of a mitigating feature, but it helps a bit.

3. mark_l+96[view] [source] 2024-02-13 19:08:41
>>Crespy+(OP)
I have thought of implementing something like you are describing using local LLMs. Chunk the text of all conversations, use an embeddings data store for search, and for each new conversation calculate an embedding for the new prompt, add context text from previous conversations. This would be maybe 100 lines of Python, if that. Really, a RAG application, storing as chunks previous conversations.
4. mhink+Sg[view] [source] 2024-02-13 19:59:46
>>Crespy+(OP)
Looks like you'll be able to turn the feature off:

> You can turn off memory at any time (Settings > Personalization > Memory). While memory is off, you won't create or use memories.

5. madame+mj[view] [source] 2024-02-13 20:12:24
>>Crespy+(OP)
Memory would be much more useful on a project or topic basis.

I would love if I could have isolated memory windows where it would remember what I am working on but only if the chat was in a 'folder' with the other chats.

I don't want it to blend ideas across my entire account but just a select few.

[go to top]