[00:13:25] <jinxer-wm>	 RESOLVED: MirrorHighLag: Mirrors - /srv/mirrors/ubuntu synchronization lag - https://wikitech.wikimedia.org/wiki/Mirrors - https://grafana.wikimedia.org/d/dbd8a904-eab2-48d1-a3b9-fa1851ef3ed2/mirrors?orgId=1 - https://alerts.wikimedia.org/?q=alertname%3DMirrorHighLag
[02:34:25] <jinxer-wm>	 FIRING: SystemdUnitFailed: update-tails-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[04:34:25] <jinxer-wm>	 RESOLVED: SystemdUnitFailed: update-tails-mirror.service on mirror1001:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_systemd_state - https://grafana.wikimedia.org/d/g-AaZRFWk/systemd-status - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitFailed
[07:31:40] <XioNoX>	 "We are planning to release trixie on August 9th."
[16:35:39] <wikibugs>	 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-codfw, 06SRE: Link errors: ssw1-d1-codfw <-> ssw1-f1-codfw - https://phabricator.wikimedia.org/T400253#11035362 (10Jhancock.wm) i cleaned the fiber port and optic. last error was at 16:20 UTC. ish. Gonna let it sit and see if it goes off again. I'll...
[16:41:19] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE: Inaccurate stats reported by cr2-codfw - https://phabricator.wikimedia.org/T400205#11035388 (10cmooney) JTAC 2025-0725-789575 opened
[17:10:09] <wikibugs>	 10netbox, 10netops, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: Decom cookbook: delete virtual interfaces from device - https://phabricator.wikimedia.org/T398412#11035461 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by cmooney@cumin2002 for host sretest2005.codfw.w...
[17:26:58] <wikibugs>	 10netbox, 10netops, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: Decom cookbook: delete virtual interfaces from device - https://phabricator.wikimedia.org/T398412#11035493 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by cmooney@cumin2002 for host sretest2005.codfw.wmnet...
[17:32:27] <wikibugs>	 10netbox, 10netops, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: Decom cookbook: delete virtual interfaces from device - https://phabricator.wikimedia.org/T398412#11035506 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by cmooney@cumin2002 for host sretest2005.codfw.w...
[18:14:21] <wikibugs>	 10Mail, 06Infrastructure-Foundations, 06SRE, 10SRE-Access-Requests: Access Request to DMarcDigests - https://phabricator.wikimedia.org/T399976#11035641 (10jhathaway) 05Open→03Resolved a:03jhathaway
[18:35:29] <wikibugs>	 10netbox, 10netops, 06Infrastructure-Foundations, 06SRE, 13Patch-For-Review: Decom cookbook: delete virtual interfaces from device - https://phabricator.wikimedia.org/T398412#11035699 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by cmooney@cumin2002 for host sretest2005.codfw.wmnet...