[00:46:52] 10netops, 06Infrastructure-Foundations, 06SRE, 06Traffic, 07Wikimedia-Incident: 503 Service Unavailable No server is available to handle this request. - https://phabricator.wikimedia.org/T418392#11652803 (10AlexisJazz) 05Open→03Resolved [03:14:25] FIRING: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [03:40:56] 10netops, 06Infrastructure-Foundations, 06SRE: Update esams network pop diagrams - https://phabricator.wikimedia.org/T368084#11652966 (10Papaul) @ayounsi The new diagram is now on Wikitech. For the Wikimedia Amsterdam DCs, IP layer do you want for us to update it or just delete it. [05:00:51] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqsin, 06SRE: EQSIN:New switch setup/configuration - https://phabricator.wikimedia.org/T418439 (10Papaul) 03NEW [06:20:41] 10netops, 06Infrastructure-Foundations, 06SRE: Update esams network pop diagrams - https://phabricator.wikimedia.org/T368084#11653051 (10ayounsi) Updating them would be great. Thanks [07:14:40] FIRING: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [09:13:24] 10CAS-SSO, 06Infrastructure-Foundations, 13Patch-For-Review: IDP: add policy to release given name - https://phabricator.wikimedia.org/T338214#11653361 (10SLyngshede-WMF) 05Open→03In progress a:03SLyngshede-WMF [09:14:25] RESOLVED: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [11:28:27] o/ if an account is disabled in bitu (in the case of a lost laptop for example), does the email parameter get unset? We're dealing with a recent case where an account was disabled and the email attribute was nulled out (which broke the ldap->grafana sync script which assumes the mail field should be set) [11:28:39] just want to be sure we're behaving properly and removing/adding users as is expected [11:28:47] https://phabricator.wikimedia.org/T418118 is the related issue [11:28:55] cc tappof [11:33:03] it depends, but the sync should definitely handle a no-exising email attribute [11:33:13] the block functionality in Bitu has an option to remove an email address [11:33:37] for the case of a stolen laptop it doesn't seem useful to apply this, though [11:33:53] since we only want to prevent someone logs in with stolen credentials [11:34:21] the intent of the "remove email address" option is more to really shut down malicious accounts [11:34:54] like someone signing up with buy-foobar-nft@dubious-blockchain.corp [11:35:47] from the perspective of the sync maybe a non-existent email address should lead to the user also being removed from the internal Grafana DB [11:36:00] since it will be reinstated once the email gets readded [11:36:04] that makes sense to me [11:37:01] are there other criteria we should be checking for the bitu block functionality? [11:37:38] for the grafana user-sync I can't think of any [11:37:51] the uid will remain as-is with the block [11:38:07] the affected attributes other than the mail one won't affect the grafana user sync [11:41:44] cool [16:01:25] FIRING: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [20:01:40] FIRING: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [22:01:25] RESOLVED: SystemdUnitFailed: update-ubuntu-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed