zlacker

[parent] [thread] 1 comments
1. jusonc+(OP)[view] [source] 2024-06-27 15:59:37
What are some real world use cases you see customers using this for?
replies(1): >>gabrie+aD
2. gabrie+aD[view] [source] 2024-06-27 19:53:34
>>jusonc+(OP)
Folks are using us for long-lived tasks traditionally considered background jobs, as well as near-real-time background jobs. Our latency is acceptable for requests where users may still be waiting, such as LLM/GPU inference. Some concrete examples:

1. Repository/document ingestion and indexing fanout for applications like code generation or legal tech LLM agents

2. Orchestrating cloud deployment pipelines

3. Web scraping and post-processing

4. GPU inference jobs requiring multiple steps, compute classes, or batches

[go to top]