zlacker

[return to "Mistral 7B Fine-Tune Optimized"]
1. laweij+YB[view] [source] 2023-12-20 23:43:22
>>tosh+(OP)
is it possible to fine tune something like Mistral 7B on a large PDF (i’m thinking like multi-hundred page spec/standard docs) and ask it questions on the topic?
◧◩
2. reqo+RC[view] [source] 2023-12-20 23:49:53
>>laweij+YB
I believe RAG is more appropriate for this! While you can certainly fine tune on a pdf, you are essentially fine turning with batch size == 1, so you should not expect good results! Also you need a label (for example summary) in order to fine-tune!
[go to top]