[09:22:20] Amir1: can I start https://phabricator.wikimedia.org/T397163 ? [10:01:17] federico3: sure [10:35:39] Amir1: uhm I'm not getting the button to +2 here https://gerrit.wikimedia.org/r/c/operations/puppet/+/1160096 [10:36:03] federico3: rebase? [10:36:25] also I think it's the wrong account? [10:36:30] I did rebase "Patch Set 1 was rebased on behalf of Gerrit maintenance bot" [10:36:30] https://gerrit.wikimedia.org/r/q/owner:federico.ceratto@gmail.com [10:36:47] O_O what happened there [10:45:12] Amir1: ok, I'm ready to start the rolling restart (without manually depooling the host first) [10:45:32] we can monitor it to see if anything strange happens [10:45:36] sure [10:46:19] yet currently it's pooled but with a weight of 0 [12:08:09] I have a few restorations and backups ongoing, will pause me being around and will return later, when complete [12:09:49] \o I have been changing some a username (see https://gerrit.wikimedia.org/r/c/labs/private/+/1163739) for Thanos-Swift. Ok for me to roll-restart the Thanos Swift FEs as indicated by https://wikitech.wikimedia.org/wiki/Swift/How_To#Create_a_new_swift_account_(Thanos_Cluster) ? [13:22:18] Emperor: --^ [13:30:33] he's OOO today [13:39:56] back [13:42:40] 1,555,766 / 6,117,027 files restored 🙄 [13:59:36] klausman: then I think you can proceed [13:59:46] it should be harmless [14:01:50] roger dodger [14:13:15] and done. [14:15:25] FIRING: SystemdUnitFailed: swift_ring_manager.service on thanos-fe1004:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed [14:50:25] RESOLVED: SystemdUnitFailed: swift_ring_manager.service on thanos-fe1004:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed