[00:13:57] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T155526#3007833 (10thcipriani) [01:05:51] fyi, i amended andre's change and then merged it [01:05:57] https://gerrit.wikimedia.org/r/#/c/334683/ [01:06:06] blocking some IPs for abuse of phab [04:05:30] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #290: 04FAILURE in 9 min 29 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/290/ [07:00:40] Project selenium-Wikibase » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #263: 04FAILURE in 2 hr 20 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/263/ [07:40:44] Hi all, is there anybody who can deploy 336582 right now? It's for lately announced T154312. The event is at 10:30 UTC+5:30 which already was. Or should I abandon the patch? I'll ask at -releng too. [07:41:52] Oops, my message was copied from -operations. Instead of "I'll ask at -releng" there should be "I asked at -operations" [09:08:05] 10Continuous-Integration-Infrastructure, 10Release Pipeline: Mathoid CI Container Image POC - https://phabricator.wikimedia.org/T157469#3008491 (10hashar) The Service runner had a patch ( https://github.com/wikimedia/service-runner/commit/f552b183ce9beaab7dff9417cad2c9c7d90f1872 ) to support generating the Doc... [09:20:10] !log deployment-fluorine02 upgraded packages, deleted old files from /srv/mw-log/archive [09:20:13] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:19:30] * mafk greets tto [11:19:45] mafk: G'day [12:21:34] (03PS1) 10Addshore: Add TwoColConflict deps [integration/config] - 10https://gerrit.wikimedia.org/r/336613 [12:23:12] (03CR) 10jerkins-bot: [V: 04-1] Add TwoColConflict deps [integration/config] - 10https://gerrit.wikimedia.org/r/336613 (owner: 10Addshore) [12:24:10] (03PS2) 10Addshore: Add TwoColConflict deps [integration/config] - 10https://gerrit.wikimedia.org/r/336613 [12:25:24] (03PS1) 10Addshore: DNM add phan template to TwoColConflict [integration/config] - 10https://gerrit.wikimedia.org/r/336615 [13:13:45] 10Beta-Cluster-Infrastructure: Request for sysop user rights on beta-cluster to test a script - https://phabricator.wikimedia.org/T157458#3005866 (10Aklapper) 05Open>03declined Alright. I'm going to decline this request. :) See https://test.wikipedia.org/wiki/Main_Page for how to request rights on test.wikip... [13:20:46] 10Beta-Cluster-Infrastructure: Request for sysop user rights on beta-cluster to test a script - https://phabricator.wikimedia.org/T157458#3008926 (104shadoww) Okay. Thank you anyway. [13:45:21] (03PS6) 10Hashar: (WIP) mediawiki-releases job [integration/config] - 10https://gerrit.wikimedia.org/r/333280 [13:45:42] (03Abandoned) 10Hashar: (WIP) MediaWiki tests with composer (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/315942 (owner: 10Hashar) [13:49:09] PROBLEM - Puppet run on buildlog is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [13:50:14] (03CR) 10Hashar: "recheck" [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 (owner: 10Hashar) [13:50:28] (03CR) 10jerkins-bot: [V: 04-1] .gitreview: swap defaultbranch for track [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 (owner: 10Hashar) [13:53:59] (03PS2) 10Hashar: .gitreview: swap defaultbranch for track [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 [13:54:17] (03CR) 10Hashar: "Trying with:" [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 (owner: 10Hashar) [14:01:15] (03PS3) 10Hashar: .gitreview: swap defaultbranch for track [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 [14:04:58] (03CR) 10Hashar: "And remove .gitreview from the source tarball by passing:" [integration/uprightdiff] (debian) - 10https://gerrit.wikimedia.org/r/326821 (owner: 10Hashar) [14:06:31] (03Abandoned) 10Hashar: (WIP) experiment with makefile (WIP) [integration/config] - 10https://gerrit.wikimedia.org/r/313998 (owner: 10Hashar) [14:14:45] !log integration-slave-jessie-1001 upgrading cowbuilder [14:14:48] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:33:39] (03CR) 10Hashar: [C: 032] Add TwoColConflict deps [integration/config] - 10https://gerrit.wikimedia.org/r/336613 (owner: 10Addshore) [14:39:07] 10Browser-Tests-Infrastructure, 10Wikidata, 15User-Tobi_WMDE_SW, 15User-zeljkofilipin: Increase in failures caused by Saucelabs - https://phabricator.wikimedia.org/T152963#3009268 (10zeljkofilipin) > Albert Sison (Sauce Labs Help Center) > > Feb 3, 1:20 PM PST > Hello, > > Thanks for writing in to Sauce... [14:42:48] (03Merged) 10jenkins-bot: Add TwoColConflict deps [integration/config] - 10https://gerrit.wikimedia.org/r/336613 (owner: 10Addshore) [14:43:35] (03PS1) 10Hashar: extension-unittests-composer use php5 pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/336629 [14:45:07] (03CR) 10Hashar: [C: 032] extension-unittests-composer use php5 pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/336629 (owner: 10Hashar) [14:47:12] (03Merged) 10jenkins-bot: extension-unittests-composer use php5 pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/336629 (owner: 10Hashar) [14:48:21] ^^ less instances to spawn :} [14:57:22] 10Browser-Tests-Infrastructure, 10Wikidata, 15User-Tobi_WMDE_SW, 15User-zeljkofilipin: Increase in failures caused by Saucelabs - https://phabricator.wikimedia.org/T152963#3009335 (10zeljkofilipin) > Date: Wed, 8 Feb 2017 15:55:55 +0100 > > Hi Albert, > > This Jenkins job has 211 tests and runs once a... [15:21:50] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: castor rsyncd spam logs with forward name lookup for ci-trusty-wikimedia-95202.contintcloud.eqiad.wmflabs failed: Name or service not known - https://phabricator.wikimedia.org/T136276#3009445 (10hashar) 05Open>03Resolved a:03hashar [15:35:43] 10Browser-Tests-Infrastructure, 10Wikidata, 13Patch-For-Review, 15User-Tobi_WMDE_SW, 15User-zeljkofilipin: Increase in failures caused by Saucelabs - https://phabricator.wikimedia.org/T152963#3009531 (10zeljkofilipin) Test jobs are created and running: - Windows: https://integration.wikimedia.org/ci/job... [15:44:40] Yippee, build fixed! [15:44:40] Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #318: 09FIXED in 22 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/318/ [15:45:22] 10Continuous-Integration-Infrastructure, 10Release Pipeline, 15User-mobrovac: Mathoid CI Container Image POC - https://phabricator.wikimedia.org/T157469#3009569 (10mobrovac) For production, `npm install --production` should be used. Since `npm install` installs developments dependencies as well (which we don... [18:09:34] 10Gerrit: Gerrit upload-pack send ALL references causing massive network I/O on common operations - https://phabricator.wikimedia.org/T103990#1404827 (10Orgads) Hi, Does this solution work for you? I tried settings these, but it didn't change anything. I'm using latest gerrit 2.13. [18:19:12] twentyafterfour: I kinda think we should open up phurl as buyer beware? It's useful I think and though I'm the most obnoxious voice for keeping beta things locked down I admit it was ok w/ the calendar [18:19:14] just a thought [18:20:06] Isn't Phurl already open? [18:20:18] Yeah, https://phabricator.wikimedia.org/phurl/ [18:20:43] Oh, admins only [18:22:22] yeah, I thought it was open tbh [18:22:31] and have used it a few times, it's pretty usable imo [18:22:59] I think the call is for you / twentyafterfour / greg [18:23:04] but I'm in favor fwiw :) [18:24:09] I guess my only fear is the same one we had with the ShortUrl extension...people redirecting to a malicious resource we can't control. [18:24:23] Having whitelisted domains would be ideal [18:25:08] nda ppl only? [18:25:11] for admin I mean [18:25:24] or a self moderated group like repo admins [18:25:57] I mean all-or-none is best here [18:26:14] Oh, admins is all nda'd, yes [18:27:14] a cool hack on it would be to limit the redirection urls to certain domains [18:27:21] but that's just me talking / pie in the sky [19:15:18] I'm pro phurl, honestly. Having it locked down makes it not useful because the redirects don't work for non-admins [19:15:42] phurl = phab url shortener? [19:15:48] yes [19:16:21] The thing I like about phurl is that you can reference phurl links with (LinkName) in remarkup [19:16:34] 10Gerrit, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: setup/install gerrit2001/WMF6408 - https://phabricator.wikimedia.org/T152525#3010396 (10Dzahn) @demon @20after4 and @catrope can now SSH to gerrit2001 and have root like on the current prod server [19:16:38] twentyafterfour: I thougth the link worked but they couldn't make new ones / manage links? [19:16:47] atm [19:17:32] chasemp: I'm not 100% sure, that may be true but I thought I tested and it didn't work at all [19:17:36] chasemp: It makes me login when I try to load one, so presumably [19:19:41] I would prefer it to only redirect to *.wikimedia.org or *.wikipedia.org (and all those other ones ;) ) [19:20:05] Also, I'd like Admins to be able to edit phurls created by others, I can't seem to do that(?) [19:27:18] hm, much like pastes etc I imagine it follows the "custodian" as admins model [19:27:25] we could always ./bin destroy them [19:29:05] A "x delete" UI button for admins to delete Pastes, Mocks, Pholios, etc... would be useful [19:30:58] general rule of thumb is phab never lets you actually destroy anything via the UI, but I can image a "hide this from all but admins" [19:36:18] 10Continuous-Integration-Config, 06Release-Engineering-Team, 06Front-end-Standards-Group: Ensure for extension repos that ResourceLoader modules load without errors - https://phabricator.wikimedia.org/T144862#3010539 (10Jdlrobson) 05Open>03declined This can be addressed on a case by case basis. Every ext... [19:50:18] is there a way to force wiki's to run maintenance scripts using a particular branch? I'm trying to work out a plan for the elasticsearch 2-> 5 upgrade and we will need to use the code for 5 to rebuild the autocomplete indices before that code is shipped live on-wiki [19:51:41] the plan is for the code to ride the train with some mediawik-config hackery to switch the search cluster depending on the active branch. We could do the rebuild on a tuesday after the train has started, but need to do it before it goes live the wed+thurs train [19:58:59] "hackery" ==> RainbowSprinkles :) [20:04:07] ebernhar|lunch: It'll use the maintenance script for the wiki you're running the script on [20:37:19] 10Gerrit: Gerrit upload-pack send ALL references causing massive network I/O on common operations - https://phabricator.wikimedia.org/T103990#3010929 (10Orgads) Ok, I found out that I need a trailing / on each of them. [20:41:03] 03Scap3, 10Parsoid: Saying yes (y) continues to all groups - https://phabricator.wikimedia.org/T156839#3010954 (10dduvall) 05Open>03Resolved [20:41:35] Project selenium-Echo » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #298: 04FAILURE in 34 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/298/ [20:41:38] Project selenium-Echo » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #298: 04FAILURE in 37 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/298/ [20:48:08] thanks a bunch thcipriani :) [20:48:54] jdlrobson: thanks for the quick fix, really appreciate it! Trying to get better about stopping new log messages as part of new branch rollout :) [20:48:56] Sorry for the work my team seems to be creating for you this week! [20:49:08] UBN really gets our attention :) [20:49:17] heh, noticed :) [20:49:29] thcipriani: i assume you have you verified the fix? [20:49:32] cool, feel free to close -- it's now live on group0 [20:49:39] ok great [20:49:45] nothing needed for the other groups right [20:49:53] right [20:50:19] I'm getting ready to roll wmf.11 forward to group1 so was hoping to get the fix in before that, so worked out well. [20:50:22] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T155526#3010971 (10Jdlrobson) [20:50:45] it's just reinforced my feelings that variables in "php $strings are the devil" :) [20:51:02] :D [21:12:29] have a good night! [21:29:05] can changes in mediawiki/extensions/* be in swat windows? [21:29:15] in this case, extension "Collection" [21:29:40] changing a URL from http to https [21:30:32] I think the change for SWAT would be the setting in wmf-config [21:30:58] so I would expect it to be a yes [21:31:10] RainbowSprinkles: i know it will, but i'm wondering is if there is some hackery i can do to rebuild the indices with the new version before it rolls forward [21:31:14] Allowed types of patches: Simple config changes (that don't turn on any new features) [21:31:49] it would be nice that someone approved it on extension trunk first, though [21:32:02] RainbowSprinkles: basically when the train rolls forward on wikipedias it will switch from eqiad (running es2) to codfw (running es5). The completion suggester indices are not forward compatible, so i need to rebuild them on codfw before the train rolls forward and switches traffic [21:32:02] What Platonides said ^ [21:32:27] ebernhardson: Hmm, tough one... [21:32:42] Platonides: https://wikitech.wikimedia.org/w/index.php?title=Deployments&type=revision&diff=1480106&oldid=1478688 [21:36:02] mutante: 336342 doesn't affect the wikis [21:36:21] CommonSettings.php overrides $wgCollectionMWServeURL [21:37:26] completely unrelated question, how to i get a repo created in gerrit synced to github? [21:37:27] so you are saying a third one should be added? [21:39:29] I'm saying 336342 is not needed [21:39:38] (for deployment) [21:39:59] ebernhardson: What repo? [21:40:08] I'm seeing, $wgCollectionMWServeURL ends up set to 'http://ocg.svc.eqiad.wmnet:8000' [21:40:38] even for codfw [21:40:54] RainbowSprinkles: search/ltr [21:41:09] its our next elasticsearch plugin for learning to rank [21:41:58] https://github.com/wikimedia/search-ltr [21:42:36] Platonides: got it, ok. ye, no OCG cluster in codfw [21:44:05] ebernhardson: When the repo has content on gerrit it'll start automagically [21:44:12] (now [21:44:59] RainbowSprinkles: hmm, it should have content on gerrit. there are a few merged patches and ~10k lines of code [21:45:11] Hmm [21:45:16] Ah, after next thing happens [21:45:20] I'll force a sync [21:46:12] All done [21:51:54] RainbowSprinkles: sweet, thanks! [21:52:00] yw [21:57:13] Project selenium-Core » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #307: 04FAILURE in 5 min 12 sec: https://integration.wikimedia.org/ci/job/selenium-Core/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/307/ [22:07:21] RainbowSprinkles im wondering what is causing this https://phabricator.wikimedia.org/T157621 as i see no code changes in timedmediahandler in the last two weeks that could cause that + i carn't reproduce locally. [22:07:32] But i can reproduce on the linked website (commons) [22:07:35] please [22:09:17] I have no idea about TMH [22:09:20] And I'm busy [22:10:27] ok [22:10:44] paladox i get status code 200 from the get request [22:11:01] oh [22:11:04] maybe commons needs a special page purge [22:13:08] What's a special page purge? [22:13:45] Zppix ^^ [22:13:46] the updatescript.php [22:13:51] wow [22:13:51] Thats not a purge [22:13:58] That updates the db [22:14:05] thats not what i meant [22:14:08] oh [22:14:13] i meant the update specialpage php [22:14:30] god i cannot mutitask for the life of me today [22:14:42] I doint see that in the maint folder of mediawiki. [22:14:47] hold on [22:16:13] You're thinking query pages [22:16:16] Which TMH isn't one [22:18:22] I think i found the problem RainbowSprinkles, it's when you doint have permission to view the page [22:18:23] you get a 404 [22:18:35] oh [22:18:36] never mind [22:18:36] updateSpecialPages.php [22:20:18] Zppix: Like I said, that's for query pages [22:20:26] Which Special:TimedMediaHandler isn't [22:21:08] Project selenium-CentralAuth » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #298: 04FAILURE in 1 min 6 sec: https://integration.wikimedia.org/ci/job/selenium-CentralAuth/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/298/ [22:22:11] It's an OOM [22:22:33] oh [22:22:55] if you cleared cache up could that fix it? [22:23:09] There is no cache for the 80th time [22:23:25] Its this [22:23:26] [0e81126f] PHP Fatal Error: request has exceeded memory limit [22:23:27] oh ya duh wow my brain isnt on today... [22:23:33] paladox: I'm way ahead of you [22:23:38] Oh [22:23:40] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.11 deployment blockers - https://phabricator.wikimedia.org/T155526#3011260 (10mmodell) [22:23:46] paladox thats okay im way behind i guess [22:24:05] Updated [22:24:07] lol, twentyafterfour got me that :) [22:24:43] Mid air collision heh [22:25:58] yep, two same logs :) [22:26:14] !log mobileapps deployed 0efa7b8 in the beta cluster [22:26:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:41:32] 06Release-Engineering-Team, 10PageImages, 07Wikimedia-log-errors: PageImages/initImageData managed to load wmf.5 code, caused stacktrace - https://phabricator.wikimedia.org/T157631#3011338 (10demon) [23:20:28] 06Release-Engineering-Team, 10PageImages, 07Wikimedia-log-errors: PageImages/initImageData managed to load wmf.5 code, caused stacktrace - https://phabricator.wikimedia.org/T157631#3011338 (10EBernhardson) This looks to be a tmux session i forgot about. The code from wmf.5 had a bug where the init image data... [23:20:35] 06Release-Engineering-Team, 10PageImages, 07Wikimedia-log-errors: PageImages/initImageData managed to load wmf.5 code, caused stacktrace - https://phabricator.wikimedia.org/T157631#3011454 (10EBernhardson) 05Open>03Resolved a:03EBernhardson [23:24:47] 06Release-Engineering-Team, 10PageImages, 13Patch-For-Review, 07Wikimedia-log-errors: PageImages/initImageData managed to load wmf.5 code, caused stacktrace - https://phabricator.wikimedia.org/T157631#3011483 (10demon) Ok, thanks for clarifying. This got me scared generally, so I'm adding some extra protec... [23:41:08] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T157638#3011563 (10greg) [23:41:29] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.12 deployment blockers - https://phabricator.wikimedia.org/T155527#2946208 (10greg) [23:42:09] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T157639#3011581 (10greg) [23:42:22] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.29.0-wmf.13 deployment blockers - https://phabricator.wikimedia.org/T157638#3011563 (10greg)