[01:35:19] 10Traffic, 06Operations: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262310 (10Krenair) [02:08:09] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262326 (10Danny_B) [02:08:21] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262293 (10Danny_B) [02:15:05] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262335 (10Danny_B) @AxelBoldt Please specify exact IE and Windows version (ie. including build #), thanks. In IE 11.0.9600.17914 @ Win7 U... [02:16:23] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262293 (10brion) Works for me in IE 11 on a Win7 vm. [02:20:31] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262293 (10BBlack) >>! In T134332#2262335, @Danny_B wrote: > @AxelBoldt Please specify exact IE and Windows version (ie. including build #)... [02:26:02] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262356 (10Danny_B) >>! In T134332#2262351, @BBlack wrote: >>>! In T134332#2262335, @Danny_B wrote: >> @AxelBoldt Please specify exact IE a... [02:31:43] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262358 (10BBlack) That's fascinating. Is it only commons and meta like the original description, or all our sites? Probably completely u... [02:45:19] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262363 (10AxelBoldt) My information: IE Version 11.0.9600.18282CO, Windows 7 Enterprise 64bit Service Pack 1, build 7601, 7601.23391.amd64... [02:50:19] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262365 (10Danny_B) Any add-ons by any chance? [02:51:30] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262366 (10Danny_B) @AxelBoldt To clarify: by "Wikimedia sites" you mean only *.wikimedia.org, right? [02:56:40] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262368 (10BBlack) It's a bit perplexing that this is only affecting sites in `wikimedia.org` for you. That's not really a technical disti... [02:57:39] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262369 (10AxelBoldt) Yes, I mean only *.wikimedia.org sites. There is in fact one suspicious add-on enabled: "DefaultTab Browser Helper"... [02:58:42] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262370 (10Krenair) @AxelBoldt, would you mind giving wikitech.wikimedia.org and gerrit.wikimedia.org a try? [03:13:11] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262389 (10AxelBoldt) None of maps.wikimedia.org, stats.wikimedia.org, phabricator.wikimedia.org, meta.wikimedia.org, commons.wikimedia.org... [03:17:31] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262390 (10Krenair) Did it get stuck with "Waiting for commons.wikimedia.org" or return you a funny error on those two? [03:18:22] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262397 (10BBlack) >>! In T134332#2262389, @AxelBoldt wrote: > DNS problems should apply to all browsers equally, no? Well, sure, but so s... [03:24:50] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262401 (10AxelBoldt) I just reinstalled the browser and all Wikimedia sites work fine now. I am sorry for having wasted everybody's time. [03:25:22] 10Traffic, 06Operations, 07Browser-Support-Internet-Explorer, 07TestMe: Internet Explorer 11.0 hangs on wikimedia.org sites - https://phabricator.wikimedia.org/T134332#2262402 (10AxelBoldt) 05Open>03Invalid [08:52:17] 10netops, 06DC-Ops, 06Operations, 10ops-eqiad: asw-d-eqiad SNMP failures - https://phabricator.wikimedia.org/T112781#2262790 (10fgiunchedi) I just noticed JNX_ALARMS flapping in icinga with "no response from remote host" and asw-d-eqiad, possibly related to this too? ```lines=5 neon:/var/log/icinga$ fgrep... [08:56:58] 10Traffic, 07Varnish, 10Beta-Cluster-Infrastructure, 06Operations: varnish text on beta is unreachable / stuck - https://phabricator.wikimedia.org/T134346#2262798 (10hashar) [09:10:22] 07Varnish, 10Wikimedia-General-or-Unknown: hitting 502 errors on en.wikipedia.org - https://phabricator.wikimedia.org/T127227#2262857 (10Aklapper) [09:13:32] 10Traffic, 07Varnish, 10Beta-Cluster-Infrastructure, 06Operations, 13Patch-For-Review: Beta cluster varnish sets overly broad domain on GeoIP cookie - https://phabricator.wikimedia.org/T133936#2262859 (10Aklapper) [09:13:35] 10Traffic, 07Varnish, 06Operations, 10Wikidata: Varnish seems to sometimes mangle uncompressed API results - https://phabricator.wikimedia.org/T133866#2262861 (10Aklapper) [09:13:38] 10Traffic, 07Varnish, 10Wikimedia-Apache-configuration, 06Operations: Data passed to HHVM ($_SERVER variables) is a mixed bag of already-decoded and non-decoded nonsense - https://phabricator.wikimedia.org/T132629#2262864 (10Aklapper) [09:13:41] 10Traffic, 07Varnish, 10Analytics-EventLogging, 06Operations, and 3 others: RESTBase should handle the X-Analytics header - https://phabricator.wikimedia.org/T133139#2262863 (10Aklapper) [09:13:51] 10Traffic, 07Varnish, 10MobileFrontend, 06Operations, and 2 others: Stop default redirecting Samsung Smart TVs to mobile web - https://phabricator.wikimedia.org/T127021#2262871 (10Aklapper) [09:13:52] 10Traffic, 07Varnish, 06Operations, 06Performance-Team: Understand and improve streaming behaviour from Varnish - https://phabricator.wikimedia.org/T126015#2262873 (10Aklapper) [09:14:03] 10Traffic, 07Varnish, 10MediaWiki-API, 06Operations: Evaluate the feasibility of cache invalidation for the action API - https://phabricator.wikimedia.org/T122867#2262880 (10Aklapper) [09:19:23] bblack: FYI: I've also restarted various lowlevel services using libssl/libcrypto on the cp* hosts (e.g. nrpe, ssh, ntp) [09:20:02] 10Traffic, 10Varnish, 10Beta-Cluster-Infrastructure, 06Operations: varnish text on beta is unreachable / stuck - https://phabricator.wikimedia.org/T134346#2262964 (10hashar) The flow of traffic comes from deployment-changeprop, which hit restbase02 and then the text cache frontend. Marko has stopped the c... [09:30:12] 10Traffic, 10Varnish, 10Beta-Cluster-Infrastructure, 06Operations: varnish text on beta is unreachable / stuck - https://phabricator.wikimedia.org/T134346#2263008 (10hashar) p:05Unbreak!>03Normal So the root cause is apparently change prop sending too many updates that ends up overloading the varnish t... [09:35:46] 10Traffic, 10Varnish, 10Beta-Cluster-Infrastructure, 06Operations: varnish text on beta is unreachable / stuck - https://phabricator.wikimedia.org/T134346#2262742 (10mobrovac) >>! In T134346#2263008, @hashar wrote: > So the root cause is apparently change prop sending too many updates that ends up overload... [10:42:39] 10Traffic, 10Beta-Cluster-Infrastructure, 06Operations: beta cluster varnish cache can't apt-get upgrade nginx-full: nginx: [emerg] unknown "spdy" variable - https://phabricator.wikimedia.org/T134362#2263236 (10hashar) [10:43:09] 10Traffic, 10Beta-Cluster-Infrastructure, 06Operations: beta cluster varnish cache can't apt-get upgrade nginx-full: nginx: [emerg] unknown "spdy" variable - https://phabricator.wikimedia.org/T134362#2263249 (10hashar) ``` # grep -n spdy /etc/nginx/sites-enabled/unified 6: listen [::]:443 default_server def... [10:48:38] 10Traffic, 10Beta-Cluster-Infrastructure, 06Operations, 07WorkType-Maintenance: beta cluster varnish cache can't apt-get upgrade nginx-full: nginx: [emerg] unknown "spdy" variable - https://phabricator.wikimedia.org/T134362#2263270 (10hashar) 05Open>03Resolved a:03hashar I have moved out the config f... [10:48:45] easy spam ^^ fixed [10:49:15] all because nginx package is installed/upgraded before the /etc/nginx/ conf are updated [11:06:33] 10Traffic, 06Operations: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263360 (10Danny_B) p:05High>03Low WFM. @YmKavishwar Does it still not work for you? [11:06:46] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263363 (10Danny_B) [11:10:49] 10Traffic, 06Operations: confctl: give regexen more freedom - https://phabricator.wikimedia.org/T134323#2263373 (10MoritzMuehlenhoff) p:05Triage>03Low [11:10:58] 10Traffic, 06Operations: confctl select needs a -y flag? - https://phabricator.wikimedia.org/T134324#2263375 (10MoritzMuehlenhoff) p:05Triage>03Low [11:13:29] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263386 (10YmKavishwar) still its not working. i have try to open my lapton and mobile both but its not work. [11:15:28] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263387 (10YmKavishwar) @Danny_B webise not open means its really need high priority. [11:16:53] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2262627 (10KartikMistry) Works for me. [11:19:46] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263393 (10YmKavishwar) >>! In T134343#2263389, @KartikMistry wrote: > Works for me. good. still not working for me. [11:20:13] 10Traffic, 10Beta-Cluster-Infrastructure, 06Operations, 07WorkType-Maintenance: beta cluster varnish cache can't apt-get upgrade nginx-full: nginx: [emerg] unknown "spdy" variable - https://phabricator.wikimedia.org/T134362#2263396 (10BBlack) 05Resolved>03Open This is because we're halfway through the... [11:20:48] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263399 (10Dereckson) p:05Low>03Triage @YmKavishwar Could you copy/paste the full message of the errors you have? [11:21:08] 10Traffic, 10Beta-Cluster-Infrastructure, 06Operations, 07WorkType-Maintenance: beta cluster varnish cache can't apt-get upgrade nginx-full: nginx: [emerg] unknown "spdy" variable - https://phabricator.wikimedia.org/T134362#2263401 (10BBlack) Oh, I see now also that puppet auto-upgraded the package for you... [11:28:50] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263408 (10YmKavishwar) >>! In T134343#2263399, @Dereckson wrote: > @YmKavishwar Could you copy/paste the full message of the errors you have? Exception encountered, of type "InvalidArgumentExcept... [11:36:41] 10Traffic, 10MediaWiki-ResourceLoader, 06Operations: commons.wikimedia.org home page has 404s loaded from JS (RL?) - https://phabricator.wikimedia.org/T134368#2263419 (10BBlack) [11:43:29] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263454 (10YmKavishwar) its true not working only for me. after logout its acceced, after login its not acceced. iam only one contributer and local sysop here. [11:51:22] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263464 (10Danny_B) Ah, so there are other pre-conditions necessary to replicate... Please provide as //complete// as possible description of what you have done right before it stopped working for... [11:56:12] bblack: good morning! [11:56:20] hi [11:56:22] bblack: I have sorted out the nginx upgrade on beta cluster varnish :} [11:56:36] haven't investigated up to tlsproxy::localssl::do_spdy [11:56:51] but eventually clearing out the nginx.conf having spdy made puppet to upgrade the package just fine [11:56:54] well reverting to default nginx config might get puppet ok, but it's not going to actually work :) [11:56:58] then craft the conf file [11:57:38] If you've gotten past the chicken and egg thing, IMHO just set the do_spdy:true flag in hieradata for labs [11:57:43] or beta cluster [11:58:13] I thought nginx was generally broken there anyways since we still haven't solved the cert issues? [11:58:17] seems true is the default? $do_spdy = hiera('tlsproxy::localssl::do_spdy', true) [11:58:26] sorry [11:58:41] ... IMHO just set the do_spdy:false flag in hieradata for labs [11:58:45] ;-} [12:00:12] bblack: so we are phasing out spdy is that correct? [12:00:48] yes [12:01:06] back when we first phased in spdy, do_spdy:false was default, and do_spdy:true turned on spdy [12:01:17] then we were all-spdy for a while and the flag was effectively a no-op [12:01:34] now it's used in reverse: do_spdy:true == SPDY/3 but not HTTP/2, and do_spdy:false == HTTP/2 but not SPDY/3 [12:01:49] (to shortly become a no-op and removed again, once all on HTTP/2) [12:02:42] did a hiera change and running puppet [12:05:22] 10Traffic, 10Beta-Cluster-Infrastructure, 06Operations, 13Patch-For-Review, 07WorkType-Maintenance: beta cluster varnish cache can't apt-get upgrade nginx-full: nginx: [emerg] unknown "spdy" variable - https://phabricator.wikimedia.org/T134362#2263549 (10hashar) Based on @bblack input patch set `tlsproxy... [12:05:36] it is magic https://phabricator.wikimedia.org/T134362#2263549 [12:06:28] then nginx on beta is not used since there is no ssl cert [12:07:16] but that is a different topic [12:08:05] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263567 (10YmKavishwar) i have try to internet explorer, chrome and UC Browser (on mobile). after logout its worked. no problem with other wikiproject. my mediawiki usernamne is YmKavishwar. this p... [12:12:22] all good and nginx run (albeit with some self signed cert) [12:12:23] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263571 (10YmKavishwar) i have try to login this wiki with AWB but login failed. error mesage: you have provide ileage username. [12:12:41] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2262627 (10Luke081515) @YmKavishwar If you got this error message, mediawiki should always show the stack trace. Can you post that too? [12:13:54] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263588 (10Danny_B) >>! In T134343#2263571, @YmKavishwar wrote: > i have try to login this wiki with AWB but login failed. error mesage: you have provide ileage username. Did you type your name ma... [12:15:19] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263602 (10YmKavishwar) maybe its problem related with this page ? https://gu.wikiquote.org/wiki/%E0%AA%AE%E0%AB%80%E0%AA%A1%E0%AA%BF%E0%AA%AF%E0%AA%BE%E0%AA%B5%E0%AA%BF%E0%AA%95%E0%AA%BF:Newuserme... [12:15:54] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263603 (10YmKavishwar) >>! In T134343#2263588, @Danny_B wrote: >>>! In T134343#2263571, @YmKavishwar wrote: >> i have try to login this wiki with AWB but login failed. error mesage: you have provi... [12:20:18] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263608 (10Danny_B) I logged in with admin rights and it worked for me as well. [12:23:19] 10Traffic, 06Operations, 07TestMe: gu.wikiquote.org URL Do Not work - https://phabricator.wikimedia.org/T134343#2263610 (10Aklapper) Can you please provide a screenshot of the problem? [13:34:18] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2263903 (10BBlack) text and upload have been converted now as well, so all cache clusters have made the HTTP/2 switch. I've also done a last-minute fixup to the varnishxcps script (it... [13:58:25] ---^ bblack are we serving wikipedia with h2 option then?? [13:58:36] oh yes [13:58:38] woooooooo [14:09:20] 10Traffic, 06Operations, 06Zero, 13Patch-For-Review: Use Text IP for Mobile hostnames to gain SPDY/H2 coalesce between the two - https://phabricator.wikimedia.org/T124482#2264028 (10BBlack) It's been 8.8 days since 10-minute TTL expiry, and the rates are low enough that we definitely don't have any kind o... [14:10:32] elukey: yes :) [14:28:17] <_joe_> bblack: \o/ [15:19:00] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2264271 (10Jdforrester-WMF) \o/ [15:26:16] 10Traffic, 06Operations, 06Zero, 13Patch-For-Review: Use Text IP for Mobile hostnames to gain SPDY/H2 coalesce between the two - https://phabricator.wikimedia.org/T124482#2264298 (10BBlack) Checked watchmouse + catchpoint, didn't find any hardcoded IP refs there (but did find a bits.wm.o ref to kill in wat... [15:58:56] 10Traffic, 06DC-Ops, 06Operations, 10ops-codfw: lvs2002 Embedded Flash/SD-CARD iLO errors - https://phabricator.wikimedia.org/T126321#2264512 (10Papaul) @BBlack Oaky please let me know when you want to do this. Thanks. [16:12:46] 10Traffic, 06Operations, 07Performance: missing SPDY coalesce for upload.wm.o for images ref'd in projects' page outputs - https://phabricator.wikimedia.org/T116132#2264583 (10BBlack) [16:15:18] 10Traffic, 06Analytics-Kanban, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2264602 (10Ottomata) [16:15:31] 10Traffic, 06Analytics-Kanban, 10DNS, 06Operations: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2197243 (10Ottomata) a:03Ottomata [16:30:37] just discovered that ema will talk before phk in Amsterdam [16:30:38] https://www.eventbrite.co.uk/e/varnishcon-amsterdam-2016-tickets-24616882759 [16:31:08] ema++ [16:36:15] 10Traffic, 10Varnish, 06Operations: Upgrade all cache clusters to Varnish 4 - https://phabricator.wikimedia.org/T131499#2264652 (10BBlack) [16:36:17] 07HTTPS, 10Traffic, 10Varnish, 06Operations: Outbound HTTPS for varnish backend instances - https://phabricator.wikimedia.org/T109325#2264651 (10BBlack) [16:36:35] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2264653 (10ori) Thanks so much, @bblack. Rolling this out at this pace with no significant interruptions is very impressive. [16:47:31] 10Traffic, 06Operations, 05codfw-rollout: Varnish support for active:active backend services - https://phabricator.wikimedia.org/T134404#2264674 (10BBlack) [16:48:41] 10Traffic, 06Operations, 05codfw-rollout: Varnish support for active:active backend services - https://phabricator.wikimedia.org/T134404#2264708 (10BBlack) [16:48:43] 10Traffic, 06Operations, 05codfw-rollout: Enable VCL source-DC switching via confd - https://phabricator.wikimedia.org/T127482#2264707 (10BBlack) [16:49:10] 10Traffic, 06Operations, 05codfw-rollout: Varnish support for active:active backend services - https://phabricator.wikimedia.org/T134404#2264674 (10BBlack) [16:49:29] 10Traffic, 06Operations, 05codfw-rollout: Enable VCL applayer datacenter-switch via confd - https://phabricator.wikimedia.org/T127485#2264709 (10BBlack) [16:50:12] 07HTTPS, 10Traffic, 10Varnish, 06Operations, 05codfw-rollout: Outbound HTTPS for varnish backend instances - https://phabricator.wikimedia.org/T109325#2264715 (10BBlack) [16:50:25] 07HTTPS, 10Traffic, 10Wikimedia-Apache-configuration, 06Operations, 05codfw-rollout: Enable HTTPS on internal MediaWiki appserver virtual service hostnames - https://phabricator.wikimedia.org/T109315#2264716 (10BBlack) [16:50:54] 07HTTPS, 10Traffic, 06Operations, 05codfw-rollout: HTTPS for internal service traffic - https://phabricator.wikimedia.org/T108580#2264717 (10BBlack) [17:11:00] hashar: https://gerrit.wikimedia.org/r/#/c/286821/ should be abandonable now, after the next round of timely puppet runs anyways (the conditional is gone in the puppet code, it assumes h2 now) [17:16:03] 10Traffic, 06Operations, 07Performance: missing SPDY coalesce for upload.wm.o for images ref'd in projects' page outputs - https://phabricator.wikimedia.org/T116132#2264938 (10BBlack) [17:16:21] 10Traffic, 06Operations, 06Performance-Team, 13Patch-For-Review: Support HTTP/2 - https://phabricator.wikimedia.org/T96848#2264936 (10BBlack) 05Open>03Resolved a:03BBlack [17:18:06] 10Traffic, 06Operations, 07Performance: missing H2 coalesce for upload.wm.o for images ref'd in projects' page outputs - https://phabricator.wikimedia.org/T116132#2264939 (10BBlack) [21:46:45] 07HTTPS, 10Traffic, 06Operations: letsencrypt puppetization: upgrade for scalability - https://phabricator.wikimedia.org/T134447#2265856 (10BBlack) [21:55:07] 10Traffic, 06Analytics-Kanban, 10DNS, 06Operations, 13Patch-For-Review: Create analytics.wikimedia.org - https://phabricator.wikimedia.org/T132407#2265931 (10Ottomata)