zlacker

[return to "Choose Postgres queue technology"]
1. levkk+05[view] [source] 2023-09-24 21:00:40
>>bo0tzz+(OP)
Running this exact implementation with 47M jobs processed and counting. SKIP LOCKED is great for VACUUM, and having durable storage with indexes make otherwise expensive patterns like delayed jobs, retries, status updates, "at least once", etc. really easy to implement.
◧◩
2. dlisbo+58[view] [source] 2023-09-24 21:24:10
>>levkk+05
Do you have some idea of how many jobs per minute or hour do you have? Just want to compare with what we have on Redis at work.

Do you also have any idea on the concurrency? How many workers you have pulling from Postgres.

I’ve used this approach before (ages ago) when Redis wasn’t even a thing, though not at high throughout requirements.

◧◩◪
3. dilyev+ik[view] [source] 2023-09-24 23:21:00
>>dlisbo+58
I’ve seen it used for up to 1000 jobs per second with concurrency of 3-12
[go to top]