[08:23:56] did Logstash dashboards get cleaned up at some point? there are some rarely-used dashboards I distinctly remember existing but can't find anymore [08:37:25] FIRING: SystemdUnitFailed: report2drive-quarter_detail.service on grafana1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [08:37:36] ^^ it's me [09:22:25] RESOLVED: SystemdUnitFailed: report2drive-quarter_detail.service on grafana1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [14:41:25] FIRING: SystemdUnitFailed: rsync-vopsbot-sync-db.service on alert2002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [14:43:40] ^^ probably due to some planned network work... let's wait a bit to see if it resolves itself. [14:46:25] RESOLVED: SystemdUnitFailed: rsync-vopsbot-sync-db.service on alert2002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [14:46:54] It did!! 🙌🏻