[00:25:44] <wikibugs>	 10Traffic, 10MobileFrontend, 10Operations, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Do not cache the beta version of the mobile site - https://phabricator.wikimedia.org/T228861 (10Jdlrobson)
[02:05:49] <wikibugs>	 10netops, 10Operations, 10observability: Prometheus logs showing errors for routinator - https://phabricator.wikimedia.org/T225108 (10ayounsi) 05Open→03Resolved Fixed with the latest upgrade of Routinator
[02:05:53] <wikibugs>	 10netops, 10Operations, 10Patch-For-Review: RPKI Validation - https://phabricator.wikimedia.org/T220669 (10ayounsi)
[02:06:21] <wikibugs>	 10netops, 10Operations: AS63541's session down reported by cr1-eqsin - https://phabricator.wikimedia.org/T228617 (10ayounsi) 05Open→03Resolved a:03ayounsi Peer removed, cf. emails to peering@
[06:33:46] <wikibugs>	 10netops, 10Analytics, 10Analytics-Kanban, 10Operations: Allow analytics VLAN to reach eventgate-analytics.discovery.wmnet:31192 - https://phabricator.wikimedia.org/T228882 (10elukey) 05Open→03Resolved a:03elukey ` +      term eventgate { +          from { +              destination-address { +...
[18:33:09] <wikibugs>	 10Traffic, 10MediaWiki-extensions-CentralAuth, 10Operations, 10TimedMediaHandler, and 3 others: Consistent HTTP 503 Error on some urls for some logged-in users (CentralAuth Set-Cookie storm) - https://phabricator.wikimedia.org/T226840 (10TheDJ) Is this fixed now ?
[19:16:48] <wikibugs>	 10Traffic, 10DC-Ops, 10Operations, 10decommission: Decommission lvs100[123456] - https://phabricator.wikimedia.org/T228671 (10RobH) 05Open→03Declined This seems to be a duplicate of T224223
[20:09:31] <wikibugs>	 10Traffic, 10DC-Ops, 10Operations, 10decommission, 10ops-eqiad: decommission lvs100[123456].wikimedia.org - https://phabricator.wikimedia.org/T224223 (10RobH)
[20:16:00] <wikibugs>	 10Traffic, 10DC-Ops, 10Operations, 10decommission, 10ops-eqiad: decommission lvs100[123456].wikimedia.org - https://phabricator.wikimedia.org/T224223 (10ops-monitoring-bot) cookbooks.sre.hosts.decommission executed by robh@cumin1001 for hosts: `lvs[1001-1006].wikimedia.org` -  lvs1004.wikimedia.org   - R...
[20:29:33] <wikibugs>	 10Traffic, 10DC-Ops, 10Operations, 10decommission, 10ops-eqiad: decommission lvs100[123456].wikimedia.org - https://phabricator.wikimedia.org/T224223 (10RobH)
[22:08:04] <wikibugs>	 10netops, 10Operations: Standardize cross confederation BGP policies - https://phabricator.wikimedia.org/T227808 (10ayounsi) Confirmed working as expected, eg. esams still show the customer prefixes, plus now BGP advertised prefixes (LVS/Anycast). Will let it sit before rolling out to all sites.
[22:13:18] <wikibugs>	 10Traffic, 10Operations: Roll out Anycast RecDNS to more servers - https://phabricator.wikimedia.org/T228190 (10BBlack) All the LVSes are now using the anycasted recdns, which gets rid of the LVS<->recdns dependency loop and simplifies recdns server downtime processes: https://wikitech.wikimedia.org/w/index.ph...