zlacker

[parent] [thread] 3 comments
1. jedber+(OP)[view] [source] 2022-09-06 04:55:11
Like the VM/Instance/Machine dies with its disk.
replies(1): >>welder+d2
2. welder+d2[view] [source] 2022-09-06 05:14:31
>>jedber+(OP)
Yes, I don't know any distributed task queue that stays online or backs up tasks when the broker dies. Maybe one could be built on CockroachDB? My implementation is designed to process tasks fast and if the Redis server dies (hasn't happened in 10 years) you just boot up a new one. I try to design my tasks to expect some failures and be able to re-run safely.
replies(1): >>jedber+w2
◧◩
3. jedber+w2[view] [source] [discussion] 2022-09-06 05:18:56
>>welder+d2
RabbitMQ and SQS both have redundancy built in.

There's nothing wrong with the trade off you made, but when I read distributed I assumed that you meant the task broker was distributed and therefore redundant, not the consumers.

replies(1): >>welder+za
◧◩◪
4. welder+za[view] [source] [discussion] 2022-09-06 06:32:05
>>jedber+w2
Sorry about the confusion. Btw, we've met in person once in Mountain View some years back. Nice to see you here :)
[go to top]