zlacker

[return to "Show HN: WakaQ - a Python distributed task queue"]
1. jedber+2G[view] [source] 2022-09-06 03:56:47
>>welder+(OP)
Since Redis is the data store, if your Redis instance goes away, do all of your tasks go away too?
◧◩
2. belthe+dM[view] [source] 2022-09-06 04:56:50
>>jedber+2G
This is still a pretty common misconception (and one that I held until recently when looking at Redis configuration options again), but Redis does have durable operating modes to reload the datastore after going offline (which do significantly trade off speed for durability). If your task queue requires a high enough volume of workload that running Redis in a durable fashion is insufficient, then it's probably time to think about a different queuing system than WakaQ.
◧◩◪
3. jedber+uM[view] [source] 2022-09-06 04:59:52
>>belthe+dM
I'm talking about if the VM/Instance/Disk goes away. It looks like Redis is a single point of failure unless you run Redis in a redundant way, but skimming the code it looks like that is at best left as an exercise to the reader. ie. Redundancy in the data store doesn't appear to be handled by this code.
[go to top]