[07:13:23] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2071421 (10Legoktm) ``` 2016-02-29 02:49:07 mw110... [08:25:10] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2071506 (10Legoktm) a:5Legoktm>3None Unassign... [08:27:57] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2071510 (10Elitre) FWIW I'm hearing at it.wp this... [10:38:55] 10Traffic, 6Operations, 10ops-eqiad, 13Patch-For-Review: eqiad cache cluster re-arrangements - https://phabricator.wikimedia.org/T125486#2071672 (10ema) p:5Triage>3Normal a:3Christopher [10:39:44] 10Traffic, 6Operations, 10ops-eqiad, 13Patch-For-Review: eqiad cache cluster re-arrangements - https://phabricator.wikimedia.org/T125486#1988833 (10ema) a:5Christopher>3Cmjohnson [13:44:10] 10Traffic, 10Analytics, 6Operations: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2072057 (10elukey) Summary of my findings so far: Varnish logs various kind of data (statistics, requests handled, etc..) in a shared memory file rather than in a file to a... [14:09:23] 10Traffic, 10Analytics, 6Operations: Sort out analytics service dependency issues for cp* cache hosts - https://phabricator.wikimedia.org/T128374#2072088 (10BBlack) [14:10:24] 10Traffic, 10Analytics, 6Operations: Sort out analytics service dependency issues for cp* cache hosts - https://phabricator.wikimedia.org/T128374#2072101 (10BBlack) [14:42:29] 10Traffic, 6Operations: Investigate TCP Fast Open for tlsproxy - https://phabricator.wikimedia.org/T108827#2072135 (10BBlack) As of when the caches switch to Linux 4.4.2 kernels (coming soon), they'll have the updates for the real (not experimental) TCP Fast Open IANA option code from [[ https://tools.ietf.org... [14:49:03] 10Traffic, 10Analytics, 6Operations: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2072177 (10Ottomata) OH awesome! Does the Varnish Utils lib have a similar ABI enough to just work with existing varishkafka code? [14:53:02] 10Traffic, 10netops, 6Operations: Consider per-route DCTCP for dc-local traffic on jessie hosts - https://phabricator.wikimedia.org/T128377#2072179 (10BBlack) [15:03:46] 10Traffic, 6Operations, 13Patch-For-Review: openssl-1.0.2f introduced minor bug with nginx - https://phabricator.wikimedia.org/T126616#2072215 (10BBlack) 5Open>3Resolved @MoritzMuehlenhoff 's nginx package update deployed everywhere, and the openssl-related logspam is gone! [15:10:24] ^ also dropped the nginx patch author a note that the patch works fine in production [15:27:51] 10Traffic, 10Analytics, 6Operations: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2072286 (10elukey) @Ottomata not sure yet, but it would be nice to have a single source code branch. The next step is for me and @ema to figure out if and how we could use... [15:43:41] 10Traffic, 10Analytics, 6Operations: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2072350 (10ema) Although it would be great for libvarnishtools to be a proper shared library, that is apparently not going to happen anytime soon in varnish itself, maybe fo... [15:44:51] 10Wikimedia-Apache-configuration: Redirect with a question mark '?' in the title treats everything following it as URL query part when updating the URL - https://phabricator.wikimedia.org/T128380#2072367 (10matmarex) I can't reproduce this issue locally. It must be some kind of a problem with Wikimedia wikis' co... [15:46:29] 10Traffic, 10Analytics, 6Operations: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2072374 (10elukey) So the plan would be to create two separate branches: 1) 3.X containing the current codebase 2) 4.X containing the vut.c/.h files to leverage the tools l... [15:55:34] 10Wikimedia-Apache-configuration: Redirect with a question mark '?' in the title treats everything following it as URL query part when updating the URL - https://phabricator.wikimedia.org/T128380#2072301 (10Joe) This probably doesn't have to do with the apache config. Requesting this url to an appserver directl... [16:09:03] 10Wikimedia-Apache-configuration: Redirect with a question mark '?' in the title treats everything following it as URL query part when updating the URL - https://phabricator.wikimedia.org/T128380#2072420 (10Joe) Testing this on one machine after turning off HHVM and intercepting the data with `nc -l 9000`. I fou... [16:33:24] 10Wikimedia-Apache-configuration: Redirect with a question mark '?' in the title treats everything following it as URL query part when updating the URL - https://phabricator.wikimedia.org/T128380#2072465 (10matmarex) MediaWiki code in Article::showRedirectedFromHeader() just does this: ``` // Construct a URL fo... [16:36:37] 10Traffic, 10Analytics, 6Operations: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2072492 (10Ottomata) Sounds good. Let’s make a new 3.x branch now, and make master be for 4.x support. [16:38:34] 10Traffic, 10Analytics, 6Operations: varnishkafka integration with Varnish 4 for analytics - https://phabricator.wikimedia.org/T124278#2072493 (10Ottomata) Would it be helpful to build a varnish utils .deb package instead of directly adding sources? If so, I can help with that. [17:13:01] 10Traffic, 10Analytics, 6Operations: Sort out analytics service dependency issues for cp* cache hosts - https://phabricator.wikimedia.org/T128374#2072088 (10Milimetric) p:5Triage>3Normal [17:16:34] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2072680 (10ssastry) @tstarling and @aaron might b... [17:26:59] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2072737 (10ssastry) >>! In T124356#2072680, @ssas... [17:45:01] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2072819 (10ssastry) So, the extension hooks were... [17:46:34] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2072828 (10ssastry) @legoktm .. I wonder if the '... [18:01:57] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2072881 (10Danny_B) For the record: not all wikis... [18:07:44] 10Traffic, 10MediaWiki-Uploading, 6Multimedia, 6Operations, 10Wikimedia-Video: Uploading 1.2GB ogv results in 503 - https://phabricator.wikimedia.org/T128358#2072890 (10BBlack) [18:10:55] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Fix all http-only tools in tools.wmflabs.org - https://phabricator.wikimedia.org/T102457#1364862 (10Krinkle) >>! In T102457#1391885, @yuvipanda wrote: > I can also help the maintainer of stats.grok.de setup SSL, if so desired. Or maybe Magnus' tool sho... [18:15:24] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2072907 (10ssastry) @Danny_B, FlaggedRevs is just... [19:07:47] 10Traffic, 10MobileFrontend, 6Operations, 5MW-1.27-release, and 5 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2073125 (10ssastry) >>! In T124356#2072907, @ssas... [20:41:31] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Fix all http-only tools in tools.wmflabs.org - https://phabricator.wikimedia.org/T102457#2073490 (10Nemo_bis) >>! In T102457#2072902, @Krinkle wrote: > Or maybe Magnus' tool should use the new [Page View API](https://wikitech.wikimedia.org/wiki/Analytic... [20:42:42] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Fix all http-only tools in tools.wmflabs.org - https://phabricator.wikimedia.org/T102457#1364862 (10Dzahn) >>! In T102457#2073490, @Nemo_bis wrote: > This bug is fixed as regards Magnus tools, I think; and it's probably too generic for the whole of Tool... [20:50:07] 7HTTPS, 10Traffic, 6Labs, 10Tool-Labs: Detect tools.wmflabs.org tools which are HTTP-only - https://phabricator.wikimedia.org/T128409#2073537 (10Nemo_bis) [20:50:48] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Fix all http-only tools in tools.wmflabs.org - https://phabricator.wikimedia.org/T102457#2073559 (10Nemo_bis) >>! In T102457#2073493, @Dzahn wrote: > Use as a tracking ticket. Make subtasks for individual tools who are still http-only.? We need a list... [20:51:15] 7HTTPS, 10Traffic, 6Labs, 6Operations, and 2 others: Migrate tools.wmflabs.org to https only (and set HSTS) - https://phabricator.wikimedia.org/T102367#2073569 (10Nemo_bis) [20:51:17] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Make Magnus tools on tools.wmflabs.org work in HTTPS - https://phabricator.wikimedia.org/T102457#2073566 (10Nemo_bis) 5Open>3Resolved a:3Magnus [20:51:30] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Make Magnus tools on tools.wmflabs.org work in HTTPS - https://phabricator.wikimedia.org/T102457#1364862 (10Nemo_bis) [20:59:26] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Detect tools.wmflabs.org tools which are HTTP-only - https://phabricator.wikimedia.org/T128409#2073607 (10Ricordisamoa) [20:59:55] 10Traffic, 6Operations, 10RESTBase, 6Services, 3Mobile-Content-Service: Split slash decoding from general percent normalization in Varnish VCL - https://phabricator.wikimedia.org/T127387#2073608 (10BBlack) Status update: I'm refactoring the above patch a bit to try to eliminate the code duplication, shou... [21:16:34] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Detect tools.wmflabs.org tools which are HTTP-only - https://phabricator.wikimedia.org/T128409#2073537 (10scfc) I don't think it is feasible to detect those tools this way because there would be way too many code paths that are only triggered under spec... [21:25:32] 10Traffic, 10DNS, 10Internet-Archive, 6Operations, 10Wikimedia-Video: Please set up a CNAME for videoserver.wikimedia.org to Video Editing Server - https://phabricator.wikimedia.org/T99216#1287289 (10Dzahn) also see T124127 [21:33:58] 7HTTPS, 10Traffic, 6Labs, 6Operations, 10Tool-Labs: Detect tools.wmflabs.org tools which are HTTP-only - https://phabricator.wikimedia.org/T128409#2073765 (10Dzahn) step 0. figure out which instance(s) are "on the proxy" step 1. what is the relevant role class? i think "dynamicproxy" module but no role...