zlacker

[parent] [thread] 2 comments
1. Sai_+(OP)[view] [source] 2023-11-18 12:50:57
Yeah, the assistants api is pretty great. Curious if you’ve faced issues with certain things not working out of the blue forcing you to re-run threads?

For example, i have an assistant which is supposed to parse an uploaded file and extract useful info from it. To use this assistant, I create a thread and a run and attach it to the assistant with a different file-id. About half the time, the assistant simply throws up its hands and says it can’t parse the file I supplied with the thread. Retrying a few times seems to do the trick.

replies(1): >>sbroth+J7
2. sbroth+J7[view] [source] 2023-11-18 13:37:42
>>Sai_+(OP)
The assistants API is fantastic; I was just getting started with it. This news makes me reconsider -- but I also think it's inevitable that a compatible API will be released with open source underlying LLMs. I've deployed the OpenAI-compatible completions API over Llama2 in production with vLLM, and it works perfectly.

Do you know if there are any projects working on this? Even something like a high quality json-tuned base model would go a huge way toward replicating OpenAI's current product.

replies(1): >>Sai_+Ab
◧◩
3. Sai_+Ab[view] [source] [discussion] 2023-11-18 14:02:31
>>sbroth+J7
Sorry, no idea if what you’re looking for exists. For now, I was looking at integrating with OpenAI and productising some th ing but this situation is making me nervous.
[go to top]