zlacker

[return to "Mistral 7B Fine-Tune Optimized"]
1. xrd+Hi[view] [source] 2023-12-20 21:36:22
>>tosh+(OP)
We've tried to sell variants of the open source models to our existing enterprise customers.

I think the adage about "a solution needs to be 10x other solutions to make someone switch" applies here.

Saying something performs slightly better than the industry standard offerings (OpenAI) means that OpenAI is going to laugh all the way to the bank. Everyone will just use their APIs over anything else.

I'm excited about the LLM space and I can barely keep up with the model names, much less all the techniques for fine tuning. A customer is going to have an even worse time.

No one will ever get fired for buying OpenAI (now that IBM is dead, and probably sad Watson never made a dent).

I do use Mistral for all my personal projects but I'm not sure that is going to have the same effect on the industry as open source software did in the past.

◧◩
2. oceanp+Pk[view] [source] 2023-12-20 21:49:57
>>xrd+Hi
> I think the adage about "a solution needs to be 10x other solutions to make someone switch" applies here.

It's already superior to OpenAI because it doesn't require an API. You can run the model on your own hardware, in your own datacenter, and your data is guaranteed to remain confidential. Creating a one-off fine-tune is a different story than permanently joining your company at the hip to OpenAI.

I know in our bubble, in the era of Cloud, it's easy to send confidential company data to some random API on the Internet and not worry about it, but that's absolutely not the case for anyone in Healthcare, Government, or even normal companies that are security conscious. For them, OpenAI was never a valid consideration in the first place.

◧◩◪
3. moneyw+3l[view] [source] 2023-12-20 21:51:13
>>oceanp+Pk
what is the most prominent use case for private LLMs, doctor notes?
◧◩◪◨
4. sergio+Fl[view] [source] 2023-12-20 21:54:03
>>moneyw+3l
You could use it to query against any kind of B2B customer information and provide insight, citations and context without any of the data leaving your private server.

When building something similar powered by OpenAI I had a real pain in the ass anonymizing the data, then de-anonymizing the answers before showing it to the customer.

Also in my example, I'm sure using a string like "Pineapple Cave Inc." instead of the real business name hurt the AI's ability to contextualize the information and data and that hurt the LLM somewhat -- right?

[go to top]