[01:06:26] 10Traffic, 10ArchCom-RfC, 10Operations, 10Services (designing): Make API usage limits easier to understand, implement, and more adaptive to varying request costs / concurrency limiting - https://phabricator.wikimedia.org/T167906#3389372 (10Anomie) You can't propose limiting concurrency based on IP while de... [07:41:51] 10Traffic, 10Discovery, 10Maps, 10Operations, 10Interactive-Sprint: Rate-limit browsers without referers - https://phabricator.wikimedia.org/T154704#2921080 (10Gehel) After some discussion with @ema and @BBlack: //TL;DR - there's lots of fancy thoughts to have about the long term, but pragmatically ther... [08:04:21] 10Traffic, 10Varnish, 10Operations, 10Performance-Team: Collect Backend-Timing in Graphite - https://phabricator.wikimedia.org/T131894#3389745 (10Gilles) a:05Gilles>03None [11:56:29] 10Traffic, 10Operations, 10Pybal, 10User-Joe: Pybal not happy with DNS delays - https://phabricator.wikimedia.org/T154759#3390493 (10faidon) From what I understand, this happened again today during asw-a-codfw's upgrade (T168462), i.e. similar circumstances -> similar symptoms. We should probably prioritiz... [12:22:27] 10Traffic, 10netops, 10Operations, 10Patch-For-Review, 10User-Joe: codfw row A switch upgrade - https://phabricator.wikimedia.org/T168462#3390519 (10ayounsi) 05Open>03Resolved Upgrade has been completed in ~1h45min. Notable events: - NSSU bug, where members a4 and a5 were not passing traffic after b... [14:36:36] 10Traffic, 10Discovery, 10Maps, 10Operations, 10Interactive-Sprint: Rate-limit browsers without referers - https://phabricator.wikimedia.org/T154704#3390940 (10debt) [14:37:04] 10Traffic, 10Analytics, 10Operations, 10Patch-For-Review: Implement Varnish-level rough ratelimiting - https://phabricator.wikimedia.org/T163233#3390943 (10debt) [14:38:27] 10Traffic, 10Analytics, 10Operations, 10Patch-For-Review: Implement Varnish-level rough ratelimiting - https://phabricator.wikimedia.org/T163233#3190763 (10debt) [14:38:32] 10Traffic, 10Discovery, 10Maps, 10Operations, 10Interactive-Sprint: Rate-limit browsers without referers - https://phabricator.wikimedia.org/T154704#2921080 (10debt) 05Open>03Resolved Closing, per new work detailed in T169175 [14:41:10] 10HTTPS, 10Traffic, 10Operations, 10Patch-For-Review: Add CAA records to our domains - https://phabricator.wikimedia.org/T155806#3390977 (10BBlack) ssllabs confirms the expected changes above. The sslmate generator doesn't allow for custom entries to get globalsign.com in early (as a likely guess for when... [15:56:03] 10netops, 10Office-IT, 10Operations: Some BGP sessions to the SF Office down - https://phabricator.wikimedia.org/T167281#3391437 (10ayounsi) 05Open>03Resolved Figured it out over IRC, broken hardware has been replaced. [17:24:51] 10Wikimedia-Apache-configuration, 10Wikidata, 10Wikimedia-Site-requests, 10Patch-For-Review, and 3 others: [RFC] should wikidata.org/entity/Q12345 do content negotiation, instead of redirecting to wikidata.org/wiki/Special:EntityData/Q36661 first? - https://phabricator.wikimedia.org/T119536#3391786 (10danie... [20:56:38] 10Traffic, 10Operations, 10Performance-Team, 10Reading-Infrastructure-Team-Backlog, and 3 others: Deploy TemplateStyles to WMF production - https://phabricator.wikimedia.org/T133410#3392775 (10Jdlrobson) [20:56:39] 10Traffic, 10Operations, 10Performance-Team, 10Reading-Infrastructure-Team-Backlog, and 3 others: Deploy TemplateStyles to WMF production - https://phabricator.wikimedia.org/T133410#3392775 (10Jdlrobson) [21:01:46] 10Traffic, 10MobileFrontend, 10Operations, 10Patch-For-Review, 10Reading-Web-Backlog (Tracking): Remove disableImages handling from VCL - https://phabricator.wikimedia.org/T168013#3392786 (10Jdlrobson) [21:01:51] 10Traffic, 10MobileFrontend, 10Operations, 10Patch-For-Review, 10Reading-Web-Backlog (Tracking): Remove disableImages handling from VCL - https://phabricator.wikimedia.org/T168013#3392786 (10Jdlrobson)