zlacker

[return to "Mistral 7B Fine-Tune Optimized"]
1. xrd+Hi[view] [source] 2023-12-20 21:36:22
>>tosh+(OP)
We've tried to sell variants of the open source models to our existing enterprise customers.

I think the adage about "a solution needs to be 10x other solutions to make someone switch" applies here.

Saying something performs slightly better than the industry standard offerings (OpenAI) means that OpenAI is going to laugh all the way to the bank. Everyone will just use their APIs over anything else.

I'm excited about the LLM space and I can barely keep up with the model names, much less all the techniques for fine tuning. A customer is going to have an even worse time.

No one will ever get fired for buying OpenAI (now that IBM is dead, and probably sad Watson never made a dent).

I do use Mistral for all my personal projects but I'm not sure that is going to have the same effect on the industry as open source software did in the past.

◧◩
2. oceanp+Pk[view] [source] 2023-12-20 21:49:57
>>xrd+Hi
> I think the adage about "a solution needs to be 10x other solutions to make someone switch" applies here.

It's already superior to OpenAI because it doesn't require an API. You can run the model on your own hardware, in your own datacenter, and your data is guaranteed to remain confidential. Creating a one-off fine-tune is a different story than permanently joining your company at the hip to OpenAI.

I know in our bubble, in the era of Cloud, it's easy to send confidential company data to some random API on the Internet and not worry about it, but that's absolutely not the case for anyone in Healthcare, Government, or even normal companies that are security conscious. For them, OpenAI was never a valid consideration in the first place.

◧◩◪
3. moneyw+3l[view] [source] 2023-12-20 21:51:13
>>oceanp+Pk
what is the most prominent use case for private LLMs, doctor notes?
◧◩◪◨
4. mrinte+Vn[view] [source] 2023-12-20 22:08:08
>>moneyw+3l
Proprietary and sensitive information. Personally, I use a self-hosted LLM because I don't trust how my conversations with hosted generative AI services will be used.
◧◩◪◨⬒
5. aussie+vA[view] [source] 2023-12-20 23:31:39
>>mrinte+Vn
This. I also use open source self hosted LLMs for exactly this reason.

Sure, I use OpenAI APIs for certain heavy lifting tasks that don't involve sensitive information, but for anything sensitive it's self hosted LLMs all the way.

[go to top]