zlacker

[return to "Postgres is a great pub/sub and job server (2019)"]
1. petilo+tb[view] [source] 2021-12-18 00:00:03
>>anonu+(OP)
Just because something can be used to do something doesn't mean it should. Kafka is specifically designed for this purpose, it is free, and it is easy to learn and use. If "starting with Postgres and then switching out when the time comes" saves money then I can understand. Otherwise use the right tool for the right job, right from the start.
◧◩
2. static+Rf[view] [source] 2021-12-18 00:31:14
>>petilo+tb
Kafka is not a queue. Kafka's parallelism is limited by the number of partitions you allocate, and you have to be sure to avoid head of line blocking.

Not the case with a queue.

◧◩◪
3. fnord7+XG[view] [source] 2021-12-18 04:56:35
>>static+Rf
what is "head of line" blocking?
◧◩◪◨
4. static+Uk2[view] [source] 2021-12-18 20:15:58
>>fnord7+XG
A single partition is intended to be processed, more or less, in by a single worker. If one of those messages, for whatever reason, ends up being really expensive, or flaky, you can't move on until you've handled it.

That's head of line blocking.

[go to top]