this post was submitted on 07 Sep 2023
121 points (96.9% liked)
Sysadmin
7682 readers
14 users here now
A community dedicated to the profession of IT Systems Administration
No generic Lemmy issue posts please! Posts about Lemmy belong in one of these communities:
!lemmy@lemmy.ml
!lemmyworld@lemmy.world
!lemmy_support@lemmy.ml
!support@lemmy.world
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I bet at one time they had a functional threshold alerting system. Then someone missed something (because they're human) and management ordered more alerts "so it doesn't happen again." Wash, rinse, repeat over the course of years (combined with VM sprawl and acquiring competitors) until there's no semblance of sanity left, having gone far past notification fatigue and well into "my job is just checking email and updating tickets now." But management insists that all of those alerts are needed because Joe Bob missed an email... which there are now exponentially more of... and the board is permanently half red anyway because the CTO (bless his sociopathic heart) decreed that 80% is the company standard for alerts and a bunch of stuff just lives there happily so good luck seeing something new.
...I was not expecting to process that particular trauma this evening.