[04:17:08] <wikibugs>	 10Gerrit, 10Release-Engineering-Team, 10SRE, 10serviceops-collab, 10Patch-For-Review: gerrit1003 service implementation task - https://phabricator.wikimedia.org/T326368 (10Dzahn) >>! In T326368#8829791, @hashar wrote: > I'd like the new host to be added first as a replica rather than an entirely new prim...
[07:48:55] <jelto>	 GitLab needs a short maintenance break in one hour
[08:59:19] <wikibugs>	 10GitLab (Integrations), 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Phabricator does not degrade properly when GitLab is unavailable - https://phabricator.wikimedia.org/T333347 (10Jelto) >>! In T333347#8827402, @brennen wrote: > Fix deployed. This //should// now be robust against an unavail...
[15:30:09] <icinga-wm>	 PROBLEM - Check systemd state on doc1002 is CRITICAL: CRITICAL - degraded: The following units failed: rsync-doc-doc2001.codfw.wmnet.service,rsync-doc-doc2002.codfw.wmnet.service https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[15:53:42] <wikibugs>	 10Phabricator: Reports: RuntimeException due to wrong assumption that boards have more columns than default Backlog - https://phabricator.wikimedia.org/T336105 (10Aklapper) p:05Triage→03High
[15:55:53] <wikibugs>	 10Phabricator, 10Patch-For-Review: Reports: RuntimeException due to wrong assumption that boards have more columns than default Backlog - https://phabricator.wikimedia.org/T336105 (10Aklapper) https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/3/
[16:26:25] <icinga-wm>	 RECOVERY - Check systemd state on doc1002 is OK: OK - running: The system is fully operational https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state
[18:56:46] <wikibugs>	 (03PS1) 10Superpes15: [zuul] Add MdsShakil to trusted users [integration/config] - 10https://gerrit.wikimedia.org/r/916793
[19:04:06] <wikibugs>	 (03PS2) 10Superpes15: zuul: Add MdsShakil to allowlist [integration/config] - 10https://gerrit.wikimedia.org/r/916793
[21:25:37] <wmf-insecte>	 maintenance-disconnect-full-disks build 488857 integration-agent-docker-1039 (/: 29%, /srv: 95%, /var/lib/docker: 46%): OFFLINE due to disk space
[21:30:37] <wmf-insecte>	 maintenance-disconnect-full-disks build 488858 integration-agent-docker-1039 (/: 29%, /srv: 79%, /var/lib/docker: 47%): RECOVERY disk space OK
[21:40:30] <wmf-insecte>	 maintenance-disconnect-full-disks build 488860 integration-agent-docker-1029 (/: 28%, /srv: 98%, /var/lib/docker: 53%): OFFLINE due to disk space
[21:45:33] <wmf-insecte>	 maintenance-disconnect-full-disks build 488861 integration-agent-docker-1029 (/: 28%, /srv: 27%, /var/lib/docker: 48%): RECOVERY disk space OK
[23:30:40] <wmf-insecte>	 maintenance-disconnect-full-disks build 488882 integration-agent-docker-1027 (/: 29%, /srv: 100%, /var/lib/docker: 52%): OFFLINE due to disk space
[23:35:32] <wmf-insecte>	 maintenance-disconnect-full-disks build 488883 integration-agent-docker-1027 (/: 29%, /srv: 6%, /var/lib/docker: 48%): RECOVERY disk space OK