zlacker

[parent] [thread] 1 comments
1. xfalco+(OP)[view] [source] 2025-12-06 18:20:18
We have vLLM for running text LLMs in production. What is the equivalent for this model?
replies(1): >>mh-+Ia
2. mh-+Ia[view] [source] 2025-12-06 19:42:41
>>xfalco+(OP)
I would say there's isn't an equivalent. Some people will probably tell you ComfyUI - you can expose workflows via API endpoints and parameterize them. This is how e.g. Krita AI Diffusion uses a ComfyUI backend.

For various reasons, I doubt there are any large scale SaaS-style providers operating this in production today.

[go to top]