only vaguely related - but I've been recently trying out dagster and I'm pretty impressed so far. I've run large scale data-processing from Hadoop onwards and was expecting the usual crumminess whenever you hit and edge case.
Instead I found a system that seems to be thoughtfully designed and, crucially, easy to debug.