zlacker

[parent] [thread] 2 comments
1. behnam+(OP)[view] [source] 2023-09-13 03:33:59
Has anyone done such fine tuning on llama though? Afaik most projects like llama.cpp use grammars instead.
replies(1): >>Arctic+v7
2. Arctic+v7[view] [source] 2023-09-13 04:53:05
>>behnam+(OP)
Yep! The linked notebook includes an example of exactly that (fine-tuning a 7b model to match the syntax of GPT-4 function call responses): https://github.com/OpenPipe/OpenPipe/blob/main/examples/clas...
replies(1): >>behnam+7j1
◧◩
3. behnam+7j1[view] [source] [discussion] 2023-09-13 14:03:28
>>Arctic+v7
Thanks!
[go to top]