zlacker

[return to "On SQS"]
1. plasma+Jb[view] [source] 2019-05-27 09:14:31
>>mpweih+(OP)
Anyone run a multi-tenant SaaS and handle fairness with jobs “fairly”?

Occasionally we use to have all workers tied up on a single customers long running tasks, we mitigated by using a throttler we wrote that can defer a job if too many resources are in use by the customer, but it’s not ideal.

I’d love a priority based, customer throttled (eg max concurrent tasks) queue.

We can prioritize by low/medium/high using separate queues, and could make a set of queues per customer; but that is starting to explode how many queues we have and feels unmanageable.

◧◩
2. rtpg+Tj[view] [source] 2019-05-27 11:00:30
>>plasma+Jb
Using a database lets you make much better decisions on this space

Tbh purpose-built queues are taken way too eagerly by programmers who later end up needing the flexibility offered by a more general data store.

[go to top]