zlacker

[parent] [thread] 3 comments
1. singul+(OP)[view] [source] 2024-02-13 21:07:08
so far you can't search your whole conversation history, so your tool is relevant for a few more weeks. is it open source?
replies(1): >>luke-s+gw
2. luke-s+gw[view] [source] 2024-02-14 00:35:45
>>singul+(OP)
I'll share the core bit that took a while to figure out the right format, my main script is a hot mess using embeddings with SentenceTransformer, so I won't share that yet. E.g: last night I did a PR for llama-cpp-python that shows how Phi might be used with JSON only for the author to write almost exactly the same code at pretty much the same time. https://github.com/abetlen/llama-cpp-python/pull/1184 But you can see how that might work. Here is the core parser code: https://gist.github.com/lukestanley/eb1037478b1129a5ca0560ee...
replies(1): >>luke-s+466
◧◩
3. luke-s+466[view] [source] [discussion] 2024-02-15 18:22:23
>>luke-s+gw
The ChatGPT dump format is not intuitive so I used a tree search algo to print it up to a defined depth level then gave ChatGPT 4 the extract and you it what the expected output parts were.
replies(1): >>luke-s+Kd8
◧◩◪
4. luke-s+Kd8[view] [source] [discussion] 2024-02-16 08:08:21
>>luke-s+466
* and told it what the expected output parts were.
[go to top]