zlacker

[parent] [thread] 2 comments
1. Tostin+(OP)[view] [source] 2023-11-20 21:57:05
No, like the other comment said, it's just using the `n` parameter in an OpenAI style API. For example, vLLM and llamacpp have support for it.
replies(1): >>stavro+B
2. stavro+B[view] [source] 2023-11-20 22:00:23
>>Tostin+(OP)
Ah, it's the same model, multiple runs, then? Not actually N different models?
replies(1): >>Tostin+q2
◧◩
3. Tostin+q2[view] [source] [discussion] 2023-11-20 22:11:02
>>stavro+B
Correct.
[go to top]