[01:42:03] FIRING: PuppetDisabled: Puppet disabled on aqs1012:9100 - https://wikitech.wikimedia.org/wiki/Puppet/Runbooks#Puppet_Disabled - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet?var-cluster=aqs&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DPuppetDisabled [05:42:04] FIRING: PuppetDisabled: Puppet disabled on aqs1012:9100 - https://wikitech.wikimedia.org/wiki/Puppet/Runbooks#Puppet_Disabled - https://grafana.wikimedia.org/d/yOxVDGvWk/puppet?var-cluster=aqs&viewPanel=14 - https://alerts.wikimedia.org/?q=alertname%3DPuppetDisabled [07:17:48] marostegui I'm starting the schema change on s6-codfw [07:19:32] That host has puppet disabled apropos the (closed) T396970 ; I'll downtime it for a few hours until u.random is around [07:19:33] T396970: Degraded RAID on aqs1012 - https://phabricator.wikimedia.org/T396970 [08:03:03] federico3: great thanks [08:58:01] marostegui: I have a little script that could help https://gitlab.wikimedia.org/repos/sre/schema-changes/-/merge_requests/42 [13:19:19] Emperor: thanks [13:19:29] that was a mistake, I forgot :( [13:23:47] urandom: no worries, these things happen [13:24:11] (hence having an alert to remind us) [14:45:46] marostegui: can I go on with auto schema on s2?