zlacker

[return to "Fine-tune your own Llama 2 to replace GPT-3.5/4"]
1. divbze+HE[view] [source] 2023-09-12 19:30:20
>>kcorbi+(OP)
Is Llama 2 currently the way to go for fine-tuning your own models? Are there other open-source LLMs worth considering?
◧◩
2. loudma+lN[view] [source] 2023-09-12 19:57:49
>>divbze+HE
The Huggingface Leaderboard is mostly dominated by Llama 2 variants: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...

It depends a lot on what you're trying to do. If have a focused use case of the type of fine-tuning you want, you can probably get away with one of the smaller models.

Another thing to look out for is Retrieval Augmented Generation (RAG). I don't see it in wide use yet, but it may turn out to more useful than fine tuning for a lot of situations.

◧◩◪
3. 0x008+U8x[view] [source] 2023-09-22 13:08:36
>>loudma+lN
RAG is THE rage right now. Everybody is talking about it in enterprise world because they want to make all their legacy documents searchable.
[go to top]