zlacker

[return to "Choose Postgres queue technology"]
1. mianos+It[view] [source] 2023-09-25 01:21:25
>>bo0tzz+(OP)
Skype used postgres as queue with a small plugin to process all their CDR many years ago. I have no idea if it used these days but it was 'web scale', 10 years ago. Just working, while people on the internet argued about using a database as a queue is an anti-pattern.

Having transactions is quite handy.

https://wiki.postgresql.org/wiki/SkyTools

I did a few talks on this at Sydpy as I used it at work quite a bit. It's handy when you already have postgresql running well and supported.

This said, I'd use a dedicated queue these days. Anything but RabbitMQ.

◧◩
2. lmm+QA[view] [source] 2023-09-25 02:40:40
>>mianos+It
> Skype used postgres as queue with a small plugin to process all their CDR many years ago. I have no idea if it used these days but it was 'web scale', 10 years ago. Just working, while people on the internet argued about using a database as a queue is an anti-pattern.

It works great until it doesn't, and the way it breaks puts you in a state that's very difficult to recover from. And if your excuse for using a database as a queue was that you were already running a database, that cuts both ways: congratulations, your queue mess has now brought down your primary datastore too.

◧◩◪
3. dventi+WC[view] [source] 2023-09-25 03:01:20
>>lmm+QA
I wonder if it would be possible to have more than just one PostgreSQL database.
◧◩◪◨
4. lmm+vE[view] [source] 2023-09-25 03:19:36
>>dventi+WC
It is, but it comes with a lot of the same costs as having a PostgreSQL database and a proper queue system.
◧◩◪◨⬒
5. mianos+RE[view] [source] 2023-09-25 03:23:48
>>lmm+vE
No, you already know how to run and manager a postgres database.

If have you large teams, for sure, pick a proper queue that someone in the team knows well.

◧◩◪◨⬒⬓
6. dventi+mK[view] [source] 2023-09-25 04:36:53
>>mianos+RE
Now, you're making a different argument.
[go to top]