[00:37:27] <wikibugs>	 (03CR) 10Lars SG: [C:03+2] Add double opt-in activity from email change [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1240025 (https://phabricator.wikimedia.org/T407442) (owner: 10Ejegg)
[00:39:51] <wikibugs>	 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Prevent test email addresses from being MSL-ed in Acoustic - https://phabricator.wikimedia.org/T418011#11637843 (10Lars)
[00:54:41] <jinxer-wm>	 FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown
[00:58:24] <wikibugs>	 (03PS12) 10Wfan: Assign location type for 3rd party donaiton [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1237617 (https://phabricator.wikimedia.org/T416052)
[01:04:54] <wikibugs>	 10fundraising-tech-ops: Deactivate fundraising accounts for ewhite - https://phabricator.wikimedia.org/T418034 (10Dwisehaupt) 03NEW
[01:15:31] <dwisehaupt>	 !log updating localsettings from 71c98072 to 534fbf34 and syncing civicrm to push update for large_donation_notifications
[01:15:32] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL
[01:18:05] <wikibugs>	 10fundraising-tech-ops: Deactivate fundraising accounts for ewhite - https://phabricator.wikimedia.org/T418034#11637869 (10Dwisehaupt)
[01:18:51] <wikibugs>	 10fundraising-tech-ops: Deactivate fundraising accounts for ewhite - https://phabricator.wikimedia.org/T418034#11637870 (10Dwisehaupt) 05Open→03Resolved a:03Dwisehaupt Certificate had naturally expired on 20260217-190935. All other steps completed as needed.
[04:54:41] <jinxer-wm>	 FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown
[06:17:09] <icinga-wm>	 PROBLEM - check_memory on fransw2001 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (1978579) = 97.2% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory
[06:22:09] <icinga-wm>	 PROBLEM - check_memory on fransw2001 is CRITICAL: CRIT Memory 98% used. Largest process: trino-server-co (1978579) = 97.2% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory
[06:27:09] <icinga-wm>	 PROBLEM - check_memory on fransw2001 is CRITICAL: CRIT Memory 95% used. Largest process: trino-server-co (1978579) = 94.8% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory
[06:32:09] <icinga-wm>	 PROBLEM - check_memory on fransw2001 is CRITICAL: CRIT Memory 95% used. Largest process: trino-server-co (1978579) = 94.8% https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory
[06:37:09] <icinga-wm>	 RECOVERY - check_memory on fransw2001 is OK: OK Memory 86% used https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fransw2001&service=check_memory
[08:45:20] <wikibugs>	 (03CR) 10Reedy: [C:03+2] tests: Remove separate include of vendor autoload.php [extensions/FundraisingEmailUnsubscribe] - 10https://gerrit.wikimedia.org/r/1239390 (owner: 10Umherirrender)
[08:49:18] <wikibugs>	 (03Merged) 10jenkins-bot: tests: Remove separate include of vendor autoload.php [extensions/FundraisingEmailUnsubscribe] - 10https://gerrit.wikimedia.org/r/1239390 (owner: 10Umherirrender)
[08:54:41] <jinxer-wm>	 FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown
[12:54:41] <jinxer-wm>	 FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown
[16:54:42] <jinxer-wm>	 FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown
[20:54:42] <jinxer-wm>	 FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:reth2 (fasw1-f5 2x25G) - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown