zlacker

There are other men in the arena who arent tripping on their own feet

>>samrus+(OP)
Like who? Which large tech company doesn't have outages?

>>usrnm+A1
It's not about outages. It's about the why. Hardware can fail. Bugs can happen. But to continue a roll out despite warning sings and without understanding the cause and impact is on another level. Especially if it is related to the same problem as last time.

>>usrnm+A1
"tripping on their own feet" == "not rolling back"

>>k8sToG+Z2
And yet, it's always clownflare breaking everything. Failures are inevitable, which is widely known, therefore we build resilience systems to overcome the inevitable

>>usrnm+A1
Google does pretty good.

>>udev40+2e
It is healthy for tech companies to have outages, as they will build experience in resolving them. Success breeds complacency.

>>nish__+te
Google docs was just down a couple weeks ago almost the whole day.

>>deadba+Ek
You don't need outages to build experience in resolving them, if you identify conditions that increase the risk of outages. Airlines can develop a lot of experience resolving issues that would lead to plane crashes, without actually crashing any planes.