[05:19:26] 10Traffic, 10Operations, 10ops-eqsin: cp5012 memory errors - https://phabricator.wikimedia.org/T251219 (10Vgutierrez) [05:19:56] 10Traffic, 10Operations, 10ops-eqsin: cp5012 memory errors - https://phabricator.wikimedia.org/T251219 (10Vgutierrez) p:05Triage→03Medium [06:57:40] 10netops, 10Operations, 10observability: Upgrade LibreNMS to 1.63 - https://phabricator.wikimedia.org/T251222 (10ayounsi) p:05Triage→03Low [07:27:02] 10Traffic, 10Operations, 10ops-eqsin: cp5012 memory errors - https://phabricator.wikimedia.org/T251219 (10Vgutierrez) [07:58:22] 10Traffic, 10DNS, 10Operations, 10WMF-Annual-Report (TransparencyReport): Move "transparency.wikimedia.org/private" to "transparency-private.wikimedia.org" - https://phabricator.wikimedia.org/T188362 (10Dzahn) @APalmer_WMF @Prtksxna Hi! I just got back to this ticket because we need to move the transparen... [08:04:58] 10netops, 10Operations: OSPF metrics - https://phabricator.wikimedia.org/T200277 (10ayounsi) >>! In T200277#6084500, @faidon wrote: > Interesting idea! Couple of notes: > - What do you mean by "virtual links" and Netbox not supporting them? Is that VLANs for our transports over the PtMP VPLS? Yes, both PtMP VP... [08:22:15] 10netops, 10Operations: Configure management-instance on routers with Junos > 17.3 - https://phabricator.wikimedia.org/T247073 (10ayounsi) [09:59:13] I haven't checked if this is our PURGE record, probably not, but yesterday we got very close to 10K rps: https://grafana.wikimedia.org/d/RvscY1CZk/purged?orgId=1&from=1587839140697&to=1588067880533 [10:43:00] 10Traffic, 10Operations: High CPU usage for ats-be ET_NET thread handling PURGE requests on cache_text - https://phabricator.wikimedia.org/T241232 (10ema) 05Open→03Resolved a:03ema Fixed by moving to purged (T249583). [10:45:44] 10Traffic, 10MediaWiki-Cache, 10Operations, 10Page Content Service, and 3 others: cache_text cluster consistently backlogged on purge requests - https://phabricator.wikimedia.org/T249325 (10ema) 05Open→03Resolved a:03ema The cache_text cluster has now been running purged instead of vhtcpd for the pas... [10:45:54] 10Traffic, 10Operations, 10Availability (MediaWiki-MultiDC), 10Patch-For-Review, 10Performance-Team (Radar): Make CDN purges reliable - https://phabricator.wikimedia.org/T133821 (10ema) [15:26:56] 10Traffic, 10MediaWiki-Cache, 10Operations, 10serviceops, and 5 others: Stop sending purges for `action=history` for linked pages. - https://phabricator.wikimedia.org/T250261 (10Krinkle) [17:50:56] 10Traffic, 10Operations, 10ops-eqsin: cp5012 memory errors - https://phabricator.wikimedia.org/T251219 (10wiki_willy) a:03Cmjohnson Checked Netbox and the server looks like it's still under warranty until October of this year. [20:49:21] 10Traffic, 10MediaWiki-API, 10Operations, 10Wikidata, and 2 others: wikidata.org handles GET MWAPI requests, but silently fails on POST - https://phabricator.wikimedia.org/T230051 (10CCicalese_WMF) 05Open→03Resolved a:03CCicalese_WMF Marking as Resolved as it is in the Done column. Feel free to reope... [20:59:26] 10Traffic, 10Operations, 10Parsoid, 10RESTBase, 10Core Platform Team Workboards (Clinic Duty Team): HTTP 400 Error when trying to save an edit on English Wikipedia: Error contacting the Parsoid/RESTBase server - https://phabricator.wikimedia.org/T250815 (10Pchelolo) p:05Medium→03High RESTBase correct... [21:47:24] 10Traffic, 10Android-app-Bugs, 10Operations, 10Page Content Service, and 4 others: Incorrect language variant returned for PCS endpoints - https://phabricator.wikimedia.org/T249284 (10Pchelolo) Tagging #traffic - seems like Varnish/ATS layer no longer unsets 'cache-control: no-cache' header on requests to...