[10:11:21] this might be a "don't stare at dashboards" thing, but I was looking at the thanos-swift dashboard again (keeping an eye on the gradually loading of the new backends), and the GET/206 rate jumped from around the 22/s mark to around 131/s at about 17:35 yesterday and has remained thus ever since... https://grafana.wikimedia.org/goto/KIuN0mSHg?orgId=1 [10:47:54] thank you Emperor, yes that's an effect of https://gerrit.wikimedia.org/r/c/operations/puppet/+/1102346 which we're looking into [18:47:10] FIRING: SystemdUnitFailed: statograph_post.service on alert1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [18:49:15] RESOLVED: SystemdUnitFailed: statograph_post.service on alert1002:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed