zlacker

[return to "Choose Postgres queue technology"]
1. MattIP+Zo[view] [source] 2023-09-25 00:13:26
>>bo0tzz+(OP)
We process around 1 million events a day using a queue like this in Postgres, and have processed over 400 million events since the system this is used in went live. Only issue we've had was slow queries due to the table size, as we keep an archive of all the events processed, but some scheduled vacuums every so often kept that under control.
◧◩
2. djbusb+At[view] [source] 2023-09-25 01:19:44
>>MattIP+Zo
Active Queue table and then archive jobs to a JobDone table? I do that. Queue table is small but archive goes back many months
◧◩◪
3. MattIP+Bw[view] [source] 2023-09-25 01:47:53
>>djbusb+At
We just have a single table, with a column indicating if the job has been taken by a worker or not. Probably could get a bit more performance out of it by splitting into two tables, but it works as it is for now.
[go to top]