[00:18:16] nice work! [15:50:09] FIRING: LVSHighRX: Excessive RX traffic on lvs2013:9100 (eno12399np0) - https://bit.ly/wmf-lvsrx - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=lvs2013 - https://alerts.wikimedia.org/?q=alertname%3DLVSHighRX [16:10:09] RESOLVED: LVSHighRX: Excessive RX traffic on lvs2013:9100 (eno12399np0) - https://bit.ly/wmf-lvsrx - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=lvs2013 - https://alerts.wikimedia.org/?q=alertname%3DLVSHighRX [16:13:08] 10netops, 06Infrastructure-Foundations, 06SRE: Productionize gnmic network telemetry pipeline - https://phabricator.wikimedia.org/T369384#10409969 (10cmooney) Just a few notes on this. Firstly we are now getting the AE/LAG interface stats for our core routers since they were all upgraded to a more recent Ju... [18:02:00] FIRING: [4x] PurgedHighEventLag: High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [18:07:00] FIRING: [16x] PurgedHighEventLag: High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [18:12:00] RESOLVED: [32x] PurgedHighEventLag: High event process lag with purged on cp5017:2112 - https://wikitech.wikimedia.org/wiki/Purged#Alerts - https://alerts.wikimedia.org/?q=alertname%3DPurgedHighEventLag [18:26:08] 06Traffic, 10conftool, 13Patch-For-Review: support the haproxy silent-drop hysteresis gadget from requestctl - https://phabricator.wikimedia.org/T371144#10410370 (10CDanis) >>! In the task description, I wrote: > > -- Requestctl can persist the meaning of the array numbers, likely as extra state in etcd. >... [18:48:05] 10Wikimedia-Apache-configuration: Wikimedia wikis serve different 404 responses for URLs that end with .php and URLs that don't - https://phabricator.wikimedia.org/T382357 (10matmarex) 03NEW [18:48:09] 10Wikimedia-Apache-configuration: Do we still need the RW_PROTO env variable in wiki Apache configs? - https://phabricator.wikimedia.org/T382358 (10matmarex) 03NEW [19:01:55] 10Wikimedia-Apache-configuration, 06Infrastructure-Foundations, 06Security-Team, 13Patch-For-Review, 07Security: https://www.mediawiki.org/.well-known/change-password redirects to HTTP - https://phabricator.wikimedia.org/T381625#10410533 (10matmarex) 05In progress→03Resolved a:03Tgr [19:33:38] 10Wikimedia-Apache-configuration, 06Infrastructure-Foundations: Do we still need the RW_PROTO env variable in wiki Apache configs? - https://phabricator.wikimedia.org/T382358#10410712 (10sbassett) [21:36:15] 10Wikimedia-Apache-configuration, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Wikimedia wikis serve different 404 responses for URLs that end with .php and URLs that don't - https://phabricator.wikimedia.org/T382357#10411145 (10Krinkle)