zlacker

[parent] [thread] 0 comments
1. jay-ba+(OP)[view] [source] 2023-12-21 04:26:29
In my experience, Llama 2 (70B) can semi-reliably provide JSON output when provided with clear instructions and various distinct but similarly structured examples. It goes from “semi-reliably” to “consistently” when fine-tuned.

The primary issue I’ve run into is exhausting the context window much sooner than I’d like. Fine-tuning tends to mostly fix this issue though.

[go to top]