zlacker
[parent]
[thread]
3 comments
1. stavro+(OP)
[view]
[source]
2023-11-20 21:31:41
Isn't that textbook MoE?
replies(1):
>>Tostin+G5
◧
2. Tostin+G5
[view]
[source]
2023-11-20 21:57:05
>>stavro+(OP)
No, like the other comment said, it's just using the `n` parameter in an OpenAI style API. For example, vLLM and llamacpp have support for it.
replies(1):
>>stavro+h6
◧◩
3. stavro+h6
[view]
[source]
[discussion]
2023-11-20 22:00:23
>>Tostin+G5
Ah, it's the same model, multiple runs, then? Not actually N different models?
replies(1):
>>Tostin+68
◧◩◪
4. Tostin+68
[view]
[source]
[discussion]
2023-11-20 22:11:02
>>stavro+h6
Correct.
[go to top]