zlacker

[parent] [thread] 5 comments
1. liquid+(OP)[view] [source] 2018-05-25 07:37:12
Long time no see man! =)
replies(1): >>evanwe+K
2. evanwe+K[view] [source] 2018-05-25 07:48:02
>>liquid+(OP)
You too! Hope Zookeeper isn't still keeping you up.
replies(1): >>liquid+x1
◧◩
3. liquid+x1[view] [source] [discussion] 2018-05-25 08:00:58
>>evanwe+K
Funny thing is that the place I am at now uses Zookeeper.. luckily it has not been trouble for us though. =)
replies(1): >>evanwe+W1
◧◩◪
4. evanwe+W1[view] [source] [discussion] 2018-05-25 08:06:27
>>liquid+x1
It's saving it up for you...remember deleting thousands of Nagios notifications on the bus? Those were the days.
replies(1): >>liquid+m3
◧◩◪◨
5. liquid+m3[view] [source] [discussion] 2018-05-25 08:26:09
>>evanwe+W1
I remember all those iPhone suckers having to download special apps to remove conversations in the early days since it only allowed you to delete them one at a time. =)

I also remember getting on a bend to make all fake alerting go away after I started only to find that like 50% of the configured alerts couldn't ever succeed and had been paging every 10 minutes for over a year. We got that stuff sorted out pretty quick. Once we started getting good visibility it helped us make much better decisions about where the problems actually were.

The first six months felt like everything was just on fire constantly and nobody know what was going on, but then things started falling in place and it felt like everything was still on fire, but some people actually had fire extinguishers for a change. =)

replies(1): >>Vector+C62
◧◩◪◨⬒
6. Vector+C62[view] [source] [discussion] 2018-05-26 01:18:14
>>liquid+m3
The best monitoring system was the TV in the Ops area scrolling a constantly updating search for #failwhale.
[go to top]