zlacker

[parent] [thread] 1 comments
1. sbroth+(OP)[view] [source] 2023-11-18 13:37:42
The assistants API is fantastic; I was just getting started with it. This news makes me reconsider -- but I also think it's inevitable that a compatible API will be released with open source underlying LLMs. I've deployed the OpenAI-compatible completions API over Llama2 in production with vLLM, and it works perfectly.

Do you know if there are any projects working on this? Even something like a high quality json-tuned base model would go a huge way toward replicating OpenAI's current product.

replies(1): >>Sai_+R3
2. Sai_+R3[view] [source] 2023-11-18 14:02:31
>>sbroth+(OP)
Sorry, no idea if what you’re looking for exists. For now, I was looking at integrating with OpenAI and productising some th ing but this situation is making me nervous.
[go to top]