[00:40:01] Krinkle: did you see https://phabricator.wikimedia.org/T249325#6026716 [00:42:08] cdanis: not yet. [00:42:17] 10h for purge is... a lot :) [00:42:46] we probably haven't had complaints because it doesn't affect logged-in users, except for static content like Urbanecm noted [01:36:50] right yeah [09:20:17] bblack: yes, I think establishing multiple TCP connections to port 3128 would help [15:52:58] 10Traffic, 10MediaWiki-Cache, 10Operations, 10Page Content Service, and 2 others: esams cache_text cluster consistently backlogged on purge requests - https://phabricator.wikimedia.org/T249325 (10CDanis) [18:24:12] 10Traffic, 10Operations, 10Wikimedia-General-or-Unknown: Different age of history logged in and out when from the EU (but not SF office) - https://phabricator.wikimedia.org/T246185 (10DB111) > Was it was 22:xx GMT when you made that request? Because the date response header says the response was generated at... [18:27:01] 10Traffic, 10Operations, 10Wikimedia-General-or-Unknown: Different age of history logged in and out when from the EU (but not SF office) - https://phabricator.wikimedia.org/T246185 (10Count_Count) >> If it happens again, it might be a good idea to check the timestamps and if the same cache machine is involve... [18:29:11] 10Traffic, 10Operations, 10Wikimedia-General-or-Unknown: Different age of history logged in and out when from the EU (but not SF office) - https://phabricator.wikimedia.org/T246185 (10DB111) https://de.wikipedia.org/wiki/Wikipedia:Technik/Werkstatt I don't see the new section after our discussion. [18:29:48] 10Traffic, 10Operations, 10Wikimedia-General-or-Unknown: Different age of history logged in and out when from the EU (but not SF office) - https://phabricator.wikimedia.org/T246185 (10Count_Count) > date: Sat, 04 Apr 2020 10:27:00 GMT > last-modified: Sat, 04 Apr 2020 09:46:05 GMT > server: mw1369.eqiad.wmne... [18:33:24] 10Traffic, 10Operations, 10Wikimedia-General-or-Unknown: Different age of history logged in and out when from the EU (but not SF office) - https://phabricator.wikimedia.org/T246185 (10DB111) Now (18:31 UTC); age: 29053 date: Sat, 04 Apr 2020 10:27:00 GMT last-modified: Sat, 04 Apr 2020 09:46:05 GMT server:... [18:39:28] 10Traffic, 10Operations, 10Wikimedia-General-or-Unknown: Different age of history logged in and out when from the EU (but not SF office) - https://phabricator.wikimedia.org/T246185 (10Count_Count) Interesting, this is what I get right now: ` $ while [ 1 ]; do curl --verbose https://de.wikipedia.org/wiki/Wiki... [18:53:48] 10Traffic, 10Operations, 10Wikimedia-General-or-Unknown: Different age of history logged in and out when from the EU (but not SF office) - https://phabricator.wikimedia.org/T246185 (10CDanis) [18:53:52] 10Traffic, 10MediaWiki-Cache, 10Operations, 10Page Content Service, and 2 others: esams cache_text cluster consistently backlogged on purge requests - https://phabricator.wikimedia.org/T249325 (10CDanis) [18:54:37] 10Traffic, 10MediaWiki-Cache, 10Operations, 10Page Content Service, and 2 others: esams cache_text cluster consistently backlogged on purge requests - https://phabricator.wikimedia.org/T249325 (10CDanis) p:05Triage→03High [19:29:17] 10Traffic, 10MediaWiki-Cache, 10Operations, 10Page Content Service, and 3 others: esams cache_text cluster consistently backlogged on purge requests - https://phabricator.wikimedia.org/T249325 (10Krinkle) [20:20:07] 10Traffic, 10MediaWiki-Cache, 10Operations, 10Page Content Service, and 3 others: esams cache_text cluster consistently backlogged on purge requests - https://phabricator.wikimedia.org/T249325 (10Urbanecm) @CDanis @BBlack T169894 is likely the same (or similar) issue. https://en.wikipedia.org/wiki/User:Geo... [20:57:53] 10Traffic, 10MediaWiki-Cache, 10Operations, 10Page Content Service, and 3 others: esams cache_text cluster consistently backlogged on purge requests - https://phabricator.wikimedia.org/T249325 (10CDanis) Thanks. The reports from 2017 are cannot be due to the same cause; however, the reports from other use... [22:58:35] 10Traffic, 10Varnish, 10MediaWiki-General, 10Operations: Requests with utf-8 in the URL return a outdated page revision - https://phabricator.wikimedia.org/T23027 (10Krinkle) 05Open→03Resolved a:03tstarling Since 2013, we have VCL code in place that normalises these characters in Wikimedia's caching... [22:58:58] 10Traffic, 10Varnish, 10MediaWiki-General, 10Operations: Requests with utf-8 in the URL return a outdated page revision - https://phabricator.wikimedia.org/T23027 (10Krinkle) [22:59:39] 10HTTPS, 10Security-Team, 10Wikimedia-General-or-Unknown: Check all wikis for inclusions of http resources on https - https://phabricator.wikimedia.org/T36670 (10Krinkle) [23:00:09] 10HTTPS, 10Security-Team, 10Wikimedia-General-or-Unknown: Check all wikis for inclusions of http resources on https - https://phabricator.wikimedia.org/T36670 (10Krinkle) This is probably obsolete nowadays. But will let Security Team triage and keep, merge or close accordingly :) [23:01:52] 10Traffic, 10MediaWiki-ResourceLoader, 10Operations, 10Performance-Team: Support ESI for ResourceLoader - https://phabricator.wikimedia.org/T78963 (10Krinkle) 05Open→03Declined Obsolete per 96fc60533fb5 / . [23:07:56] 10Domains, 10Traffic, 10Operations, 10WMF-Legal: wikipedia.lol - https://phabricator.wikimedia.org/T88861 (10Krinkle) 05Open→03Resolved a:03Dzahn The domain is registered to WMF and parked in DNS. There is no need for a redirect at this time as it is new and highly unlikely to be accidentally used by... [23:10:13] 10Traffic, 10Varnish, 10Operations, 10RESTBase, and 2 others: Fix RESTBase support for wikitech.wikimedia.org - https://phabricator.wikimedia.org/T102178 (10Krinkle) 05Open→03Declined Closing in favour of T237773. There is no particular need for it on its own, but the inconsistency will naturally be re... [23:31:06] 10Traffic, 10Operations: Configure varnish to use "Unconfigured domain" page for 404 Not Served (instead of generic error) - https://phabricator.wikimedia.org/T112316 (10Krinkle) @ema Would it be possible (and acceptable) to add a condition somewhere in VCL that for the built-in error of `Unconfigured domain`... [23:31:21] 10Traffic, 10Operations: Configure varnish to use "Unconfigured domain" page for 404 Not Served (instead of generic error) - https://phabricator.wikimedia.org/T112316 (10Krinkle) a:03Krinkle