[10:14:38] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Evaluate/Deploy TCP BBR when available (kernel 4.9+) - https://phabricator.wikimedia.org/T147569#3294214 (10Gilles) There is an apparent performance improvement that coincides in timing, but on a simulated slow internet connection: {T166373}... [10:24:04] 10Traffic, 10MediaWiki-General-or-Unknown, 06Operations, 06Security-Team: Mediawiki replies with 500 on wrongly formatted CSP report - https://phabricator.wikimedia.org/T166229#3294216 (10fgiunchedi) @Anomie yeah I don't know either what would happen in that case, I think we can turn it into a 400 for now... [12:48:22] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Evaluate/Deploy TCP BBR when available (kernel 4.9+) - https://phabricator.wikimedia.org/T147569#3294387 (10Gilles) @bblack one way to verify that the performance improvement we're seeing is "real" would be to turn BBR off for a bit. That bei... [13:18:06] 10Traffic, 06Operations, 10Phabricator, 13Patch-For-Review: phab.wmfusercontent.org "homepage" yields a 500 - https://phabricator.wikimedia.org/T166120#3294429 (10fgiunchedi) @mmodell ok thanks! I gave it a try with https://gerrit.wikimedia.org/r/355769 for all server aliases, if that's too broad we can p... [13:20:30] 10Traffic, 06Operations, 10Phabricator, 13Patch-For-Review, 15User-fgiunchedi: phab.wmfusercontent.org "homepage" yields a 500 - https://phabricator.wikimedia.org/T166120#3294447 (10fgiunchedi) [13:20:40] 10Traffic, 10MediaWiki-General-or-Unknown, 06Operations, 06Security-Team, and 2 others: Mediawiki replies with 500 on wrongly formatted CSP report - https://phabricator.wikimedia.org/T166229#3294448 (10fgiunchedi) [13:33:43] 10Traffic, 10DBA, 06Operations, 06Performance-Team, 10Wikidata: Cache invalidations coming from the JobQueue are causing lag on several wikis - https://phabricator.wikimedia.org/T164173#3294468 (10jcrespo) While contention is bad in general- it is the opposite of lag- more contention would create less la... [15:29:11] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Evaluate/Deploy TCP BBR when available (kernel 4.9+) - https://phabricator.wikimedia.org/T147569#2696835 (10Peter) That said, the navigation timing metrics from the real world doesn't give us the best measurements for user experience so I thi... [17:07:09] 10Traffic, 10DBA, 06Operations, 06Performance-Team, 10Wikidata: Cache invalidations coming from the JobQueue are causing lag on several wikis - https://phabricator.wikimedia.org/T164173#3295071 (10aaron) p:05Triage>03Normal [21:47:50] 10Traffic, 06Operations, 10Phabricator, 13Patch-For-Review, 15User-fgiunchedi: phab.wmfusercontent.org "homepage" yields a 500 - https://phabricator.wikimedia.org/T166120#3295761 (10mmodell) p:05Triage>03Normal