[12:46:33] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE: cr3-ulsfo incident 22 Sep 2024 - https://phabricator.wikimedia.org/T375345 (10cmooney) 03NEW p:05Triage→03High
[12:48:18] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE: cr3-ulsfo incident 22 Sep 2024 - https://phabricator.wikimedia.org/T375345#10166125 (10cmooney)
[13:16:45] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE: cr3-ulsfo incident 22 Sep 2024 - https://phabricator.wikimedia.org/T375345#10166128 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=5186e097-9b87-468b-abf6-b7a7fcd918c6) set by cmooney@cumin1002 for 1 day, 0:00:00 on 3 host(s) and their servi...
[13:18:12] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE: cr3-ulsfo incident 22 Sep 2024 - https://phabricator.wikimedia.org/T375345#10166129 (10cmooney) This is after re-occuring, approx 44 minutes after the first time, first logs mention this: ` Sep 22 12:58:28  cr3-ulsfo fpc0 listmgr_host_xtxn_idle(1526): EA[0:0].ll...
[13:21:10] <wikibugs>	 10netops, 06Infrastructure-Foundations, 06SRE: cr3-ulsfo incident 22 Sep 2024 - https://phabricator.wikimedia.org/T375345#10166131 (10cmooney) Logs from second time are in P69385