zlacker

[return to "Postgres is a great pub/sub and job server (2019)"]
1. montro+Ec[view] [source] 2021-12-18 00:08:15
>>anonu+(OP)
This is fantastic for relatively low volume queues with intensive work to be done by a small number of workers. For these types of use cases, I'll take this approach over RabbitMQ or Kafka all day long.

But once you get even just up to say, 40 messages per second with 100 worker processes, you're now up to 4000 updates per second just to see which worker got to claim which job, and up from there becomes untenable.

◧◩
2. ramraj+ee[view] [source] 2021-12-18 00:19:19
>>montro+Ec
Why jump from Postgres to Kafka? Celery + rabbitmq or redis is a great middle ground.
[go to top]