[00:00:44] 7HTTPS, 10Wikimedia-Fundraising, 7Blocked-on-Fundraising-Tech: links.email.donate.wikimedia.org should offer HTTPS - https://phabricator.wikimedia.org/T74514#2050207 (10Nemo_bis) >>! In T74514#2040989, @CCogdill_WMF wrote: > Reopening (and resolving) this task to say Fundraising Tech has successfully set up... [01:05:48] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Broken mobile edit section links are showing up in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2050230 (10Danny_B) p:5High>3Unbreak! P... [02:06:51] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Broken mobile edit section links are showing up in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2050285 (10Danny_B) Not only headline conte... [02:07:56] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2050286 (10Danny_B) [02:14:18] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2050287 (10Danny_B) [14:32:27] 10Traffic, 6Operations, 13Patch-For-Review: openssl-1.0.2f introduced minor bug with nginx - https://phabricator.wikimedia.org/T126616#2051007 (10MoritzMuehlenhoff) This was fixed upstream at http://hg.nginx.org/nginx/rev/062c189fee20 and I built a 1.9.4+wmf2 package on copper with that patch (not copied to... [14:46:11] moritzm: welcome! :) [14:47:25] bblack, ema: ok to install the new nginx 1.9.4+wmf2 package on cp1008? https://phabricator.wikimedia.org/T126616#2051007 [15:05:54] moritzm: yes, please. I assume if it basically-works, you'll send the updates to our nginx repo too right? [15:06:34] I think they can just be further commits on https://github.com/wikimedia/operations-software-nginx/tree/wmf-1.9.4-1 for now, no need for new branch [15:07:25] oh, I wasn't aware it was maintained in operations/software/nginx, I thought it was a case of a locally applied patch. sure, will merge [15:08:03] thanks! [15:09:24] basically our "master" tracks debian's repo for the nginx package, and then we branch off wmf-1.9.x-N branches to apply our own debian/ patches on top [15:09:38] but all of that became frozen with regard to upstream after 1.9.4, basically [15:09:49] so better to just treat this as another local debian/ patch for now [15:10:42] ok, will do [15:13:02] thanks! :) [15:32:40] 10Traffic, 6Operations, 10Parsoid, 10VisualEditor, and 2 others: Decom parsoid-lb.eqiad.wikimedia.org entrypoint - https://phabricator.wikimedia.org/T110474#2051184 (10BBlack) 24 hour log run, with pre-filtering for internal monitoring requests and definite random crawler/junk/noise traffic: * 206x (avg 8.... [15:37:36] 10Traffic, 6Operations, 10Parsoid, 10VisualEditor, and 2 others: Decom parsoid-lb.eqiad.wikimedia.org entrypoint - https://phabricator.wikimedia.org/T110474#2051211 (10BBlack) Does anyone have a handle on what the random low-traffic labs usages are at the bottom of the list above? As for `parsoid-prod.wmf... [15:39:00] 10Traffic, 6Operations, 10Parsoid, 10VisualEditor, and 2 others: Decom parsoid-lb.eqiad.wikimedia.org entrypoint - https://phabricator.wikimedia.org/T110474#2051212 (10BBlack) I should note, my inclination is to just shut this down today so that we can move on with other related/blocked work. We're past o... [15:43:57] 10Traffic, 6Operations, 10Parsoid, 10VisualEditor, and 2 others: Decom parsoid-lb.eqiad.wikimedia.org entrypoint - https://phabricator.wikimedia.org/T110474#2051238 (10BBlack) Another way to think of the stats: ignoring `parsoid-prod.wmflabs.org` crazy proxy thing, and ignoring this one oddball Russian IP,... [15:44:16] 10Traffic, 6Operations, 10Parsoid, 10VisualEditor, and 2 others: Decom parsoid-lb.eqiad.wikimedia.org entrypoint - https://phabricator.wikimedia.org/T110474#2051239 (10Jdforrester-WMF) Do it. [15:51:23] 10Traffic, 6Operations, 10RESTBase, 6Services, 3Mobile-Content-Service: Split slash decoding from general percent normalization in Varnish VCL - https://phabricator.wikimedia.org/T127387#2051279 (10GWicke) > it's clear that [?&#] aren't in the set because MW still cares about those delimiters for query/f... [15:57:41] 10Traffic, 6Operations, 10RESTBase, 6Services, 3Mobile-Content-Service: Split slash decoding from general percent normalization in Varnish VCL - https://phabricator.wikimedia.org/T127387#2051304 (10BBlack) >>! In T127387#2051279, @GWicke wrote: >> it's clear that [?&#] aren't in the set because MW still... [16:03:51] 7HTTPS, 10Wikimedia-Fundraising, 7Blocked-on-Fundraising-Tech: links.email.donate.wikimedia.org should offer HTTPS - https://phabricator.wikimedia.org/T74514#2051351 (10CCogdill_WMF) Sure @Nemo_bis, here's a sample link from an email that went out last week: https://donate.wikimedia.org/?utm_campaign=C1516_... [16:12:18] 7HTTPS, 6Research-and-Data, 10The-Wikipedia-Library, 10Wikimedia-General-or-Unknown, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276#2051366 (10Jdforrester-WMF) 5Open>3Resolved Hurrah. [16:28:31] 10Traffic, 6Operations, 10RESTBase, 6Services, 3Mobile-Content-Service: Split slash decoding from general percent normalization in Varnish VCL - https://phabricator.wikimedia.org/T127387#2051489 (10GWicke) > Well for that matter, since parsing stops on the first unescape ? for the query part, and the fra... [16:50:15] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2051627 (10ssastry) @Danny_B How many pages... [17:21:33] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2051770 (10ssastry) After looking at T125841... [17:22:28] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2051785 (10PeterBowman) I'm seeing this now... [18:13:26] bblack: o/ Before starting with the tests for varnish 4 we'd like to move forward with https://gerrit.wikimedia.org/r/#/c/230173/ for varnish-kafka [18:14:01] it is a feature that we'll likely need very soon so I was wondering if we could have a chat about how to test it properly [18:14:44] I am still reviewing the code but since I am not familiar with it I'd like also to test it properly [18:23:38] elukey: re that patch, honestly I have no idea. I haven't looked at it since back in Nov when otto was reporting segfaults, and I don't think I have time to debug and fix it myself anytime soon. [18:24:36] bblack: yep completely understandable, I will try to do most of the work under your supervision if you wish to help expedite ema's work once done. [18:24:57] the issues should be fixed but I'll need to test it properly [18:25:20] you mean you've already fixed beyond the PS11 that was updated in Nov? [18:25:37] s/updated/uploaded/ [18:26:07] (I'm assuming the segfaults were due to bad code in the actual https://gerrit.wikimedia.org/r/#/c/230173/ itself) [18:27:46] oh looking a little deeper now, the last segfault report was PS9. I guess it's possible otto already fixed that in PS10/11 [18:28:23] from what I know segfaults should have been fixed, but I want to test this new code in two scenarios: 1) actual settings in which we don't "segment" any big varnish segment like text/upload/etc.. and 2) with smaller topics on kafka (for example breaking down text) [18:28:53] ok [18:29:23] after that, I'll try to help ema in migrating it to varnish 4's api and log format [18:30:18] so if you like the idea, I can try to test it in labs during the next days, but I was wondering if there is an already built environment/project to use [18:37:45] yeah that makes sense, I just don't know where/how yet, other than to go down the road of making your own labs VM just for this testing [18:39:12] all right, I'll talk with andrew and figure out how to proceed :) [18:43:41] 7HTTPS, 6Research-and-Data, 10The-Wikipedia-Library, 10Wikimedia-General-or-Unknown, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276#2052282 (10Krinkle) 5Resolved>3Open This was wrongly configured and doesn't w... [18:45:44] 7HTTPS, 6Research-and-Data, 10The-Wikipedia-Library, 10Wikimedia-General-or-Unknown, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276#2052299 (10DarTar) p:5Low>3High [18:53:16] 7HTTPS, 6Research-and-Data, 10The-Wikipedia-Library, 10Wikimedia-General-or-Unknown, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276#2052321 (10DarTar) Indeed, the correct value to use in the meta tag should be `or... [18:53:19] 7HTTPS, 6Research-and-Data, 10The-Wikipedia-Library, 10Wikimedia-General-or-Unknown, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276#2052322 (10csteipp) Header should have been 'origin-when-crossorigin' [19:01:51] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2052375 (10Legoktm) a:3Legoktm Grumble gru... [19:25:39] 10domains, 6Operations: traffic stats for typo domains - https://phabricator.wikimedia.org/T124237#2052479 (10Dzahn) voyagewiki.com/org also removing. traffic absolutely minimal, the only mention it got was during the naming process where it lost against "wikivoyage" https://meta.wikimedia.org/wiki/Wikivoyag... [20:41:19] 10Traffic, 6Operations, 7Mobile: Investigate if www.m.wikipedia.org needs to stay around - https://phabricator.wikimedia.org/T120143#2052763 (10Dzahn) [20:41:32] 10Traffic, 6Operations, 7Mobile: Investigate if login.m.wikipedia.org needs to stay around - https://phabricator.wikimedia.org/T123431#2052764 (10Dzahn) [20:45:18] 10Traffic, 6Operations, 7Mobile: Investigate if login.m.wikimedia.org needs to stay around - https://phabricator.wikimedia.org/T123431#2052772 (10Dzahn) [20:45:53] 10Traffic, 6Operations, 7Mobile: Investigate if login.m.wikimedia.org needs to stay around - https://phabricator.wikimedia.org/T123431#1929602 (10Dzahn) renaming ticket, seems this should have been about wikimedia.org all this time and never wikipedia.org, unlike the linked "www.m" ticket which actually wiki... [21:37:11] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2053064 (10Legoktm) The links changed becaus... [21:45:04] 10Traffic, 10MediaWiki-Interface, 6Operations, 5MW-1.27-release, and 3 others: Incorrect TOC and section edit links rendering in Vector due to ParserCache corruption via ParserOutput::setText( ParserOutput::getText() ) - https://phabricator.wikimedia.org/T124356#2053096 (10Legoktm) Oh, and that change made... [22:07:58] 7HTTPS, 6Research-and-Data, 10The-Wikipedia-Library, 10Wikimedia-General-or-Unknown, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276#2053177 (10DarTar) Per discussion with @BBlack, @csteipp and @Krinkle on [[ http... [22:25:52] 10Traffic, 6Operations, 6Phabricator, 7Blocked-on-Operations: Phabricator needs to expose notification daemon (websocket) - https://phabricator.wikimedia.org/T112765#2053318 (10MBinder_WMF) @chasemp just tagging you because your comment was last. Know of any progress towards the plan to unblock this? [22:45:02] 7HTTPS, 6Research-and-Data, 10The-Wikipedia-Library, 10Wikimedia-General-or-Unknown, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276#2053394 (10Krinkle)