[00:05:26] 10Traffic, 6Operations, 5codfw-rollout, 3codfw-rollout-Jan-Mar-2016: Varnish support for shutting users out of a DC - https://phabricator.wikimedia.org/T129424#2105320 (10BBlack) [00:16:12] 10Traffic, 10DNS, 6Discovery, 10Maps: Redirect wikimaps.org to maps.wikimedia.org - https://phabricator.wikimedia.org/T129428#2105349 (10Yurik) [00:54:36] 10Traffic, 10MobileFrontend, 6Operations, 3Reading-Web-Sprint-67-If, Then, Else...?, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2105424 (10Jdlrobson) @D... [01:05:43] 10Traffic, 10DNS, 6Discovery, 10Maps, 6Operations: Redirect wikimaps.org to maps.wikimedia.org - https://phabricator.wikimedia.org/T129428#2105485 (10MaxSem) Per IRC discussion we don't really need/want it? [01:06:54] 10Traffic, 10DNS, 6Discovery, 10Maps, 6Operations: Redirect wikimaps.org to maps.wikimedia.org - https://phabricator.wikimedia.org/T129428#2105487 (10Yurik) 5Open>3declined Better not have it yet :) [01:21:37] 10Traffic, 10MobileFrontend, 6Operations, 3Reading-Web-Sprint-67-If, Then, Else...?, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2105539 (10MaxSem) I sti... [05:53:42] 10Traffic, 6Discovery, 10Maps, 6Operations, and 2 others: allow maps cluster Varnish cache purging - https://phabricator.wikimedia.org/T112836#2105869 (10Yurik) [06:29:49] 10Traffic, 10MobileFrontend, 6Operations, 3Reading-Web-Sprint-67-If, Then, Else...?, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2105907 (10Jdlrobson) Ca... [06:46:30] 10Traffic, 10MobileFrontend, 6Operations, 3Reading-Web-Sprint-67-If, Then, Else...?, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2105913 (10MaxSem) Cache... [08:11:17] paravoid: thank you! :) [08:14:21] the script itself is quite straightforward, the tricky part was identifying the right libssl functions to hook into [08:14:59] (or nginx even) [08:24:18] moritzm: 4.4.5 is coming \o/ [08:28:14] 10Traffic, 10ArchCom-RfC, 6Commons, 10MediaWiki-File-management, and 13 others: Use content hash based image / thumb URLs & define an official thumb API - https://phabricator.wikimedia.org/T66214#2106020 (10Gilles) >>! In T66214#2105088, @brion wrote: > Currently this requires either an extra HTTPS round-t... [08:30:38] already merged: https://gerrit.wikimedia.org/r/276411 (won't build it yet, waiting for at least 4.4.6) [08:34:21] 10Traffic, 10ArchCom-RfC, 6Commons, 10MediaWiki-File-management, and 13 others: Use content hash based image / thumb URLs & define an official thumb API - https://phabricator.wikimedia.org/T66214#2106026 (10Gilles) >>! In T66214#2105215, @brion wrote: >similar to how not-yet-cached thumbnail URLs are route... [09:18:13] 10Traffic, 6Analytics-Kanban, 6Operations, 13Patch-For-Review: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2106071 (10elukey) Update: 1) completed the porting of the new tags. After a chat with Brandon and Ema we decided to use only the "client" tags... [09:55:45] 10Traffic, 10ArchCom-RfC, 6Commons, 10MediaWiki-File-management, and 13 others: Use content hash based image / thumb URLs & define an official thumb API - https://phabricator.wikimedia.org/T66214#2106089 (10Tgr) >>! In T66214#2106020, @Gilles wrote: > What data is fetched and used before knowing what thumb... [10:18:13] 10Traffic, 10ArchCom-RfC, 6Commons, 10MediaWiki-File-management, and 13 others: Use content hash based image / thumb URLs & define an official thumb API - https://phabricator.wikimedia.org/T66214#2106182 (10Tgr) >>! In T66214#2106026, @Gilles wrote: > Which means that a default implementation in mediawiki... [11:18:08] 10Traffic, 10MediaWiki-Cache, 10MediaWiki-JobQueue, 10MediaWiki-JobRunner, and 3 others: Investigate massive increase in htmlCacheUpdate jobs in Dec/Jan - https://phabricator.wikimedia.org/T124418#2106324 (10Addshore) For easy access from the ticket the dashboard for the above patchset is at https://grafan... [12:03:47] 10Traffic, 6Operations, 13Patch-For-Review: Port varnishlog.py to new VSL API - https://phabricator.wikimedia.org/T128788#2106494 (10ema) varnishreqstats seems to be relatively easy to port: https://phabricator.wikimedia.org/P2736 The only part I'm not really sure about is the fact that ReqEnd is now gone.... [13:15:18] all right, it will need a lot of testing but the first draft of vk-4 is ready: https://gerrit.wikimedia.org/r/#/c/276439 [13:19:28] elukey: awesome! [13:33:11] bblack: hope that your eyes won't burn while reviewing my code :D [13:33:31] I haven't written C in a while [13:39:17] I haven't looked yet, so no eye damage so far :) [13:39:23] :) [14:02:58] 10Traffic, 10ArchCom-RfC, 6Commons, 10MediaWiki-File-management, and 13 others: Use content hash based image / thumb URLs & define an official thumb API - https://phabricator.wikimedia.org/T66214#2106748 (10faidon) >>! In T66214#2105088, @brion wrote: > Quick note from IRC regarding the thumb-URL needs for... [14:10:29] daily wtf: varnishreqstats was not working fine with varnishlog4. Turns out there was a null byte at the end of value strings stored in cbd['data'] [14:10:41] debugging with print didn't help much there [14:15:48] 10netops, 10Continuous-Integration-Infrastructure, 6Operations: install/setup/deploy cobalt as replacement for gallium - https://phabricator.wikimedia.org/T95959#2106820 (10hashar) [14:47:04] heh [15:58:45] bblack: so we seem to have a little problem with VTC tests and dynamic directors [15:58:58] we currently override the backends in our vtc test cases [15:59:21] with dynamic directors though, the backend names depend on the instance [15:59:59] one easy way out of this would be not including "directors.<%= @inst %>.vcl" from wikimedia-common.inc.vcl.erb [16:00:25] (for the VCL file under /usr/share/varnish/tests/ of course) [16:01:00] so something like: [16:01:07] define varnish::wikimedia_vcl($varnish_testing, $template_path) { [16:01:07] if $varnish_testing { [16:01:07] $varnish_include_path = '/usr/share/varnish/tests/' [16:01:07] $use_dynamic_directors = false [16:01:07] } [16:02:00] alternatively, in the VCL file: [16:02:02] if @use_dynamic_directors and @dynamic_directors and not @varnish_testing -%> [16:02:06] include "directors.<%= @inst %>.vcl"; [16:03:40] bblack: any preferences? Any reason to avoid doing this at all? [16:12:12] ema: either way is fine I guess in general, but I think use_dynamic_directors is going away, so it will have to be its own conditional on varnish_testing eventually [16:12:49] what I mean by "use_dynamic_directors is going away" is that basically everything will always use_dyanmic_directors, so I'll probably remove the complexity of having that always-true condition [16:14:00] so I guess what I mean is the latter one is probably better in the long run, or something [16:14:12] since we can keep "and not @varnish_testing" there after use_dynamic_directors dies [16:17:51] it's possible we can remove it now actually, I'm just not 100% sure till I try it in CI against all the clusters+tiers [16:38:26] bblack: done [16:38:27] https://gerrit.wikimedia.org/r/#/c/276493/ [16:38:31] https://puppet-compiler.wmflabs.org/2015/cp1043.eqiad.wmnet/ [16:55:58] bblack: nice! Now tests are even passing :P [16:56:14] awesome [16:56:21] now we can bug hashar to integrate them in jenkins [16:56:44] so that I can move forward from half my commits being broken in subtle stupid ways that I don't find out until puppet-compiler and/or deploy [16:56:46] yes, I'll point out on the phab task that this does not depend on varnish4 [16:56:52] to half my commits getting immediate jenkins -1 [16:56:59] :) [16:57:58] at the moment we just have two stupid tests for maps backend/frontend but I guess we can already start working on jenkins integration and then add more tests eventually [16:58:53] 10Traffic, 10Continuous-Integration-Infrastructure, 6Operations, 13Patch-For-Review: Make CI run Varnish VCL tests - https://phabricator.wikimedia.org/T128188#2107637 (10ema) [17:02:40] 10Traffic, 10Continuous-Integration-Infrastructure, 6Operations, 13Patch-For-Review: Make CI run Varnish VCL tests - https://phabricator.wikimedia.org/T128188#2107662 (10ema) Please note that there is no dependency on varnish 4 for this, we have already started adding VTC tests: https://gerrit.wikimedia.or... [17:05:31] 10Traffic, 10MobileFrontend, 6Operations, 3Reading-Web-Sprint-67-If, Then, Else...?, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2107669 (10Jdlrobson) >>... [17:11:52] 10Traffic, 10Continuous-Integration-Infrastructure, 6Operations, 13Patch-For-Review: Make CI run Varnish VCL tests - https://phabricator.wikimedia.org/T128188#2107677 (10hashar) @ema and @hashar going to pair on this and seek to get a proof of concept. [17:16:15] 10Traffic, 10ArchCom-RfC, 6Commons, 10MediaWiki-File-management, and 13 others: Use content hash based image / thumb URLs & define an official thumb API - https://phabricator.wikimedia.org/T66214#2107694 (10brion) >>! In T66214#2106748, @faidon wrote: > This isn't currently possible with the existing tech... [18:26:04] 7HTTPS, 10Traffic, 6Operations, 6WMF-Communications, 7Security-Other: Server certificate is classified as invalid on government computers - https://phabricator.wikimedia.org/T128182#2108187 (10Florian) [18:54:49] 10Traffic, 10MediaWiki-Uploading, 6Multimedia, 6Operations, 10Wikimedia-Video: Uploading 1.2GB ogv results in 503 - https://phabricator.wikimedia.org/T128358#2071563 (10Bawolff) >>! In T128358#2098525, @zhuyifei1999 wrote: > A possible workaround is to use async chunked uploading, but pywikibot does not... [19:35:48] 10Traffic, 10Wikimedia-Apache-configuration, 10DNS, 6Operations, and 4 others: Move oldwikisource on www.wikisource.org to mul.wikisource.org - https://phabricator.wikimedia.org/T64717#2108583 (10Dzahn) since www.wikisource.org and mul.wikisource.org both already exist in DNS and that seemed to be the only... [19:36:21] 10Traffic, 10Wikimedia-Apache-configuration, 6Operations, 10Wikimedia-Site-Requests, and 3 others: Move oldwikisource on www.wikisource.org to mul.wikisource.org - https://phabricator.wikimedia.org/T64717#2108584 (10Dzahn) [19:36:35] 10Wikimedia-Apache-configuration, 10Wikimedia-Site-Requests, 6Wikisource, 7Community-consensus-needed, 13Patch-For-Review: Move oldwikisource on www.wikisource.org to mul.wikisource.org - https://phabricator.wikimedia.org/T64717#2108587 (10Dzahn) [20:22:23] 10Traffic, 10Continuous-Integration-Infrastructure, 6Operations, 13Patch-For-Review: Make CI run Varnish VCL tests - https://phabricator.wikimedia.org/T128188#2108997 (10hashar) The Nodepool instances now have the `varnish` package at whatever version is defined by apt conf. which should be 3.x since it is... [20:35:43] 10Traffic, 10Continuous-Integration-Infrastructure, 6Operations, 13Patch-For-Review: Make CI run Varnish VCL tests - https://phabricator.wikimedia.org/T128188#2109049 (10BBlack) As long as they're jessie machines that pull from the wikimedia package repos, it'll be the right version. [20:46:46] 10Traffic, 10Continuous-Integration-Infrastructure, 6Operations, 13Patch-For-Review: Make CI run Varnish VCL tests - https://phabricator.wikimedia.org/T128188#2109087 (10hashar) The Nodepool instances are indeed Jessie and reuse apt configuration from operations/puppet.git. I can confirm 3.x is installed... [21:58:53] 10Traffic, 10MobileFrontend, 6Operations, 3Reading-Web-Sprint-67-If, Then, Else...?, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2063073 (10Redrose64) So...