[03:22:00] 10Traffic, 10MediaWiki-Cache, 06Operations, 05MW-1.28-release-notes, and 3 others: Cached outdated revisions served to logged-out users - https://phabricator.wikimedia.org/T141687#2510875 (10aaron) Thumbail deferred updates were also post-send for the last few days by oversight, which was fixed/deployed in... [07:42:38] 10Wikimedia-Apache-configuration, 06Operations, 07HHVM, 07Wikimedia-log-errors: Fix Apache proxy_fcgi error "Invalid argument: AH01075: Error dispatching request to" (Causing HTTP 503) - https://phabricator.wikimedia.org/T73487#2510990 (10elukey) Checked if a 304 response would return the body with the new... [11:59:33] 10Wikimedia-Apache-configuration, 06Operations, 07HHVM, 07Wikimedia-log-errors: Fix Apache proxy_fcgi error "Invalid argument: AH01075: Error dispatching request to" (Causing HTTP 503) - https://phabricator.wikimedia.org/T73487#2511360 (10elukey) >>! In T73487#2510990, @elukey wrote: > So the new version o... [14:02:53] 10Traffic, 06Operations: Support TLS chacha20-poly1305 AEAD ciphers - https://phabricator.wikimedia.org/T131908#2511537 (10BBlack) Initial run at an equal-pref patch for openssl-1.1.0 uploaded to github: https://github.com/blblack/openssl/commit/3c88126a9814be08d100f1d14e660d31b7fece75 I haven't really tested... [14:15:24] 10Traffic, 06Operations: Age header reset to 0 after 24 hours on varnish frontends - https://phabricator.wikimedia.org/T141373#2511553 (10ema) I've started looking for an upper bound when it comes to the value of Age coming out of backends and frontends in eqiad sampling 5 minutes of traffic. Objects with Age... [14:22:54] 10Traffic, 06Operations: Age header reset to 0 after 24 hours on varnish frontends - https://phabricator.wikimedia.org/T141373#2511583 (10BBlack) It will probably take significantly longer to get the same statistical certainty on the backend, due to the reduced request rate there. [14:25:15] 10Traffic, 06Operations: Age header reset to 0 after 24 hours on varnish frontends - https://phabricator.wikimedia.org/T141373#2511584 (10ema) >>! In T141373#2511583, @BBlack wrote: > It will probably take significantly longer to get the same statistical certainty on the backend, due to the reduced request rat... [14:58:34] 10Traffic, 06Operations, 10Wikimedia-Planet: mixed-content issues on planet.wikimedia.org - https://phabricator.wikimedia.org/T141480#2511673 (10ema) p:05Triage>03Normal [15:23:16] 10Traffic, 06Operations: Support TLS chacha20-poly1305 AEAD ciphers - https://phabricator.wikimedia.org/T131908#2511727 (10BBlack) OpenSSL upstream confirms equal-pref ciphers groups won't make 1.1, and they're looking to revamp ciphersuite selection stuff more significantly in the long term in light of TLSv1.... [16:39:08] 10Traffic, 06Operations: TLS stats regression related to Chrome/41 on Windows - https://phabricator.wikimedia.org/T141786#2512057 (10BBlack) [16:41:02] 10Traffic, 06Operations: TLS stats regression related to Chrome/41 on Windows - https://phabricator.wikimedia.org/T141786#2512073 (10BBlack) [16:41:12] 10Traffic, 06Operations: TLS stats regression related to Chrome/41 on Windows - https://phabricator.wikimedia.org/T141786#2512057 (10BBlack) [18:34:18] 10Traffic, 06Operations: TLS stats regression related to Chrome/41 on Windows - https://phabricator.wikimedia.org/T141786#2512718 (10BBlack) The DHE-related Windows bugfix is deployed, and so far doesn't seem to have any effect on this (which I kinda expected, but had to check!). This bug was only supposed to... [19:18:30] 10Traffic, 10Varnish, 06Operations, 13Patch-For-Review: Convert upload cluster to Varnish 4 - https://phabricator.wikimedia.org/T131502#2512853 (10ema) There are a few Range-related things we need to test before starting the upgrade: 1) User1 requests range 1-10 of a 1GB object. We want to make sure that... [19:39:08] 10Traffic, 10DNS, 06Operations: Set up compat redirect stats.wikipedia.org -> stats.wikimedia.org - https://phabricator.wikimedia.org/T21353#2512888 (10Krinkle) [21:24:34] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513172 (10BBlack) Yeah. As a first pass, we could simply strip URLs with `?.*$`. If `shortcode` is a pretty restricted subset, it might make more sense just g... [21:40:51] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513218 (10Legoktm) The shortcode set is `23456789ABCDEFGHJKLMNPQRSTUVWXYZabcdefghijkmnopqrstuvwxyz$_`. It's basically static and won't be changing once we enabl... [21:41:21] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513219 (10BBlack) Looks like base36 in the specs, up to 9 total characters (3x wiki id, 6x article id). We could restrict legal urls to `^/[0-9A-Z]{0,9}$`. Is... [21:42:03] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513221 (10BBlack) Simul-edit! So it's not base36? [21:43:29] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513225 (10Legoktm) It is `[0-9A-Za-z$\-]` with 0, O, I, l, and 1 removed because they're visually confusing when written down. And yes, it is case-sensitive. [21:44:38] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513226 (10Legoktm) Oh, and there is no max length, we'll keep generating longer ids as people keep shortening new URLs... [21:45:38] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513227 (10BBlack) Ok I basically get it. But in the two different explanations, one has `-` and one has `_` ...? [21:46:23] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513228 (10Legoktm) Oops sorry, I meant `_`. My bad. [21:48:26] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513231 (10BBlack) Ok. Either way, when I count up both representations, I get 59 total characters, does that sound right? [21:50:04] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513234 (10Legoktm) ``` >>> len('23456789ABCDEFGHJKLMNPQRSTUVWXYZabcdefghijkmnopqrstuvwxyz$_') 59 ``` Yep! [21:50:09] base59 heh [22:55:10] 10Traffic, 10MediaWiki-extensions-UrlShortener, 06Operations: Strip query parameters from w.wiki domain - https://phabricator.wikimedia.org/T141170#2513539 (10BBlack) 05Open>03Resolved a:03BBlack [23:02:40] 10Traffic, 06Operations: TLS stats regression related to Chrome/41 on Windows - https://phabricator.wikimedia.org/T141786#2513575 (10BBlack) Looks like buggy Microsoft updates (similar/related to the one(s) linked before) are the culprit. Some related reporting: http://www.infoworld.com/article/3099109/micro... [23:17:53] 10Traffic, 06Operations: TLS stats regression related to Chrome/41 on Windows - https://phabricator.wikimedia.org/T141786#2513661 (10BBlack) "KB 3161639" is an interesting search term. That's what's most-often cited in related bug reports. Some of the reports sound like this actually *is* related to the inte... [23:22:34] bblack: is it going to take a while to rollout? the example in the bug (https://w.wiki/?search=X) still works [23:37:55] legoktm: good question, I don't know why that still works [23:38:08] unless puppet's not updating, etc...