[00:12:58] !log Cherry-picked https://gerrit.wikimedia.org/r/#/c/299825/ to deployment-puppetmaster so wdqs nginx log parsing can be tested [00:13:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [01:16:21] Hi it seems postmerge is frozen see https://integration.wikimedia.org/zuul/ please [02:41:56] Yippee, build fixed! [02:41:56] Project selenium-CirrusSearch » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #91: 09FIXED in 55 sec: https://integration.wikimedia.org/ci/job/selenium-CirrusSearch/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/91/ [02:47:26] (03PS1) 1020after4: PSHH - Paralell SH Hell [tools/release] - 10https://gerrit.wikimedia.org/r/300211 [02:48:18] (03CR) 10jenkins-bot: [V: 04-1] PSHH - Paralell SH Hell [tools/release] - 10https://gerrit.wikimedia.org/r/300211 (owner: 1020after4) [03:11:37] there's an issue with beta cluster and jenkins talking together [03:18:11] !log had to do https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update twice, seems to be back [03:18:16] paladox: should be fixed ^ [03:18:18] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [03:28:00] Project beta-update-databases-eqiad build #10051: 04FAILURE in 13 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/10051/ [03:52:33] (03Abandoned) 1020after4: PSHH - Paralell SH Hell [tools/release] - 10https://gerrit.wikimedia.org/r/300211 (owner: 1020after4) [04:20:02] Project beta-update-databases-eqiad build #10052: 04STILL FAILING in 1.9 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/10052/ [04:33:31] 10Beta-Cluster-Infrastructure: `composer update` in beta-update-databases? - https://phabricator.wikimedia.org/T140969#2482780 (10greg) [05:04:28] 10Beta-Cluster-Infrastructure: `composer update` in beta-update-databases? - https://phabricator.wikimedia.org/T140969#2482811 (10Legoktm) 05Open>03Resolved a:03Legoktm It was because wasn't merged yet, all CI stuff was also failing. Should fix itself once that patch... [05:11:57] legoktm: thanks [05:12:10] np [05:21:04] Yippee, build fixed! [05:21:04] Project beta-update-databases-eqiad build #10053: 09FIXED in 1 min 2 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/10053/ [05:48:57] Project mediawiki-core-code-coverage build #2149: 04STILL FAILING in 2 hr 48 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/2149/ [06:02:50] 05:48:45 ...Trying to @cover or @use not existing method "Balancer::balance". [06:44:47] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.15 deployment blockers - https://phabricator.wikimedia.org/T140971#2482849 (10greg) [06:45:30] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T139217#2423047 (10greg) [06:59:27] Project beta-code-update-eqiad build #113762: 04FAILURE in 6 min 26 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113762/ [07:09:27] Project beta-code-update-eqiad build #113763: 04STILL FAILING in 6 min 26 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113763/ [07:19:38] Project beta-code-update-eqiad build #113764: 04STILL FAILING in 6 min 37 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113764/ [07:30:05] Project beta-code-update-eqiad build #113765: 04STILL FAILING in 7 min 3 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113765/ [07:31:51] is it me or is gerrit slow? [07:37:13] Nikerabbit: I remember somebody talking about search being slow for a while [07:37:23] rebuilding indexes or something [07:37:28] not sure if it is now [07:39:43] zeljkof: might be dns/network problem for me [07:39:52] just loading any page takes time sometimes [07:40:22] Project beta-code-update-eqiad build #113766: 04STILL FAILING in 7 min 21 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113766/ [07:40:36] Nikerabbit: same here, but then I am tethering from my phone... so that could be it [07:44:46] Project beta-code-update-eqiad build #113767: 04STILL FAILING in 1 min 45 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113767/ [07:54:29] Yippee, build fixed! [07:54:30] Project beta-code-update-eqiad build #113768: 09FIXED in 1 min 28 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113768/ [08:24:52] 10Beta-Cluster-Infrastructure, 06Operations, 13Patch-For-Review: Unify ::production / ::beta roles for *oid - https://phabricator.wikimedia.org/T86633#2482954 (10hashar) There is still role::parsoid::beta left over. We probably want to audit what is left in puppet.git but afaik there is nothing left to do. [08:40:26] 10Beta-Cluster-Infrastructure, 06Labs, 07Blocked-on-Operations, 13Patch-For-Review, 07Puppet: /etc/puppet/puppet.conf keeps getting double content - first for labs-wide puppetmaster, then for the correct puppetmaster - https://phabricator.wikimedia.org/T132689#2482979 (10hashar) I havent seen that occurr... [08:52:48] 06Release-Engineering-Team, 10Monitoring, 06Operations: Monitoring and alerts for "business" metrics - https://phabricator.wikimedia.org/T140942#2483038 (10Gehel) p:05Triage>03Low Triaging this as low priority to match T117470. [09:00:53] 10Continuous-Integration-Config, 06Release-Engineering-Team, 07Regression: mediawiki-core coverage missing ("Error: Empty directory!") - https://phabricator.wikimedia.org/T140917#2483050 (10hashar) Yeah that is a problem. I clearly remember we had a past occurence of the suite failing and an empty coverage r... [09:15:27] 10Continuous-Integration-Config, 06Release-Engineering-Team, 07Regression: mediawiki-core coverage missing ("Error: Empty directory!") - https://phabricator.wikimedia.org/T140917#2480904 (10Legoktm) https://gerrit.wikimedia.org/r/300237 should fix the current issue. [09:19:14] 10Continuous-Integration-Config, 06Release-Engineering-Team, 07Regression: mediawiki-core coverage missing ("Error: Empty directory!") - https://phabricator.wikimedia.org/T140917#2483067 (10hashar) a:03hashar Job config has been changed by myself via a JJB update on 2016-07-12_11-30-57 which is related to... [09:21:50] 10Continuous-Integration-Config, 06Release-Engineering-Team, 07Regression: mediawiki-core coverage missing ("Error: Empty directory!") - https://phabricator.wikimedia.org/T140917#2483072 (10hashar) And the root cause is that mediawiki-core-code-coverage ignores the exit code of PHPUnit since random tests ten... [11:26:44] 07Browser-Tests, 10Continuous-Integration-Config, 10MediaWiki-extensions-RelatedArticles, 06Reading-Web-Backlog: RelatedArticles browser tests should run on a commit basis - https://phabricator.wikimedia.org/T120715#2483192 (10Jhernandez) @bmansurov @zeljkofilipin Any thoughts on the state of this task? [11:29:57] 07Browser-Tests, 10MobileFrontend, 06Reading-Web-Backlog, 03Reading-Web-Sprint-78-T, 07Technical-Debt: Wikidata description browser tests do not run anywhere - https://phabricator.wikimedia.org/T137756#2483195 (10Jhernandez) I'd rather have them fixed if they provide value. I'm bringing it to 77 given w... [11:30:20] 07Browser-Tests, 10MobileFrontend, 06Reading-Web-Backlog, 03Reading-Web-Sprint-77-Segmentation-fault, 07Technical-Debt: Wikidata description browser tests do not run anywhere - https://phabricator.wikimedia.org/T137756#2483197 (10Jhernandez) [11:30:55] 07Browser-Tests, 10MobileFrontend, 06Reading-Web-Backlog, 03Reading-Web-Sprint-77-Segmentation-fault, and 2 others: Wikidata description browser tests do not run anywhere - https://phabricator.wikimedia.org/T137756#2377830 (10Jhernandez) [11:44:31] 10Beta-Cluster-Infrastructure, 06Operations, 13Patch-For-Review: Unify ::production / ::beta roles for *oid - https://phabricator.wikimedia.org/T86633#2483220 (10mobrovac) https://gerrit.wikimedia.org/r/#/c/300067/ addresses this. Will amend the commit to link it to this bug too. [11:53:28] greg-g thanks, and sorry for late response. [11:59:08] 10Beta-Cluster-Infrastructure, 06Labs, 07Blocked-on-Operations, 13Patch-For-Review, 07Puppet: /etc/puppet/puppet.conf keeps getting double content - first for labs-wide puppetmaster, then for the correct puppetmaster - https://phabricator.wikimedia.org/T132689#2206880 (10AlexMonk-WMF) I saw it just a few... [12:31:36] hashar hi, your recheck patch for gate is ready now, ive tested and works as long as there is a +2 from code review. I made some changes like it is now recheck gate to prevent it from checking both pipelines [13:41:11] PROBLEM - App Server Main HTTP Response on deployment-mediawiki01 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:43:34] 10Deployment-Systems, 10scap, 10Analytics, 10Analytics-Cluster, and 3 others: Deploy analytics-refinery with scap3 - https://phabricator.wikimedia.org/T129151#2483356 (10Ottomata) The problem with pwstore is this same as I had here: https://phabricator.wikimedia.org/T132177#2341946 The last I checked up o... [13:46:02] RECOVERY - App Server Main HTTP Response on deployment-mediawiki01 is OK: HTTP OK: HTTP/1.1 200 OK - 43537 bytes in 1.039 second response time [13:48:31] Yippee, build fixed! [13:48:31] Project mediawiki-core-code-coverage build #2150: 09FIXED in 3 hr 24 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/2150/ [13:56:51] hashar omg i had another bt broadband fault http://www.bbc.co.uk/news/technology-36854916 [13:57:03] second day in a row, i hope we getting something for free. [13:57:46] (03PS1) 10Hashar: (DO NOT MERGE) test Gear logging reduction in Zuul test [integration/config] - 10https://gerrit.wikimedia.org/r/300274 [14:00:21] (03CR) 10jenkins-bot: [V: 04-1] (DO NOT MERGE) test Gear logging reduction in Zuul test [integration/config] - 10https://gerrit.wikimedia.org/r/300274 (owner: 10Hashar) [14:00:35] bah [14:01:01] Oh [14:01:49] Tobi_WMDE_SW: https://integration.wikimedia.org/ci/job/selenium-Wikidata-300269/ [14:01:53] testing your patch [14:02:26] RECOVERY - Free space - all mounts on deployment-jobrunner01 is OK: OK: All targets OK [14:03:34] !log integration/zuul.git bumping upstream branch: git push d34e0b4:upstream [14:03:37] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [14:03:47] hashar :) [14:03:48] :) [14:04:11] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/300274 (owner: 10Hashar) [14:04:37] OpenStack's Zuul's gear server is spending most of its time dealing [14:04:38] with function registration (800 nodes, 20k functions each). [14:04:39] huhu [14:05:41] they are hijacking the gearman protocol to add a new method :D [14:05:59] zeljkof: cool, thx! from which directory are the tests executed? [14:06:14] Tobi_WMDE_SW: repository root [14:06:36] zeljkof: ok, then the paths in env.rb need adjustment I guess [14:06:50] I'll upload a follow-up [14:06:52] Tobi_WMDE_SW: I think so, it was a while [14:07:02] do you know how to update and rerun the job? [14:07:21] * zeljkof is looking for docs [14:08:06] https://www.mediawiki.org/wiki/Reading/Web/QA#Simulating_browser_test_run_on_an_unmerged_patchset. [14:08:52] but in short, go to https://integration.wikimedia.org/ci/job/selenium-Wikidata-300269/configure [14:09:04] Oh [14:09:11] git > advanced [14:09:29] change "refs/changes/69/300269/1" to "refs/changes/69/300269/2" [14:09:35] hashar does that mean it makes zuul slow [14:09:39] please notice /1 changed to /2 [14:09:40] at picking up changes. [14:12:23] zeljkof: I've uploaded a new change depending on the first one - not a new patchset.. so can I just change it to the new change? [14:13:37] zeljkof: just tried it.. let's see :) [14:15:44] Tobi_WMDE_SW: yes, just get the refspec from gerrit [14:15:55] it should work, there is no magic :) [14:17:58] zeljkof: tests are running.. no path error anymore [14:18:08] I think I can stop them again [14:21:04] Tobi_WMDE_SW: if you stop them, you will not know if something else failed [14:22:08] zeljkof: I'll re-run them again once I'm done.. which will be any minute.. :) [14:23:26] Tobi_WMDE_SW: ping me if you need help [14:25:17] 10Continuous-Integration-Infrastructure, 06Operations, 10Zuul, 07Blocked-on-Operations: Upgrade Zuul on scandium.eqiad.wmnet (Jessie zuul-merger) - https://phabricator.wikimedia.org/T140894#2483419 (10Paladox) >>! In T140894#2482428, @demon wrote: > Let's do this tomorrow morning maybe? :) [14:28:25] (03PS5) 10Zfilipin: WIP Run language screenshots script for VisualEditor in Jenkins [integration/config] - 10https://gerrit.wikimedia.org/r/300035 (https://phabricator.wikimedia.org/T139613) [14:29:25] Project language-screenshots-VisualEditor » firefox,beta,Linux,ci-jessie-wikimedia build #3: 04FAILURE in 20 sec: https://integration.wikimedia.org/ci/job/language-screenshots-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia/3/ [14:33:10] hashar: castor does not want to play :( [14:33:13] https://gerrit.wikimedia.org/r/#/c/300035/4..5/jjb/job-templates-language-screenshots.yaml,unified [14:33:18] https://integration.wikimedia.org/ci/job/language-screenshots-VisualEditor/3/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia/console [14:33:29] ZUUL_PROJECT: unbound variable [14:34:06] ZUUL_PROJECT (and probably something other) is not set since the job is not triggered by zuul/gerrit [14:39:41] (03PS1) 10Hashar: test: pass a config to Zuul.Scheduler() [integration/config] - 10https://gerrit.wikimedia.org/r/300280 [14:39:48] hashar https://review.openstack.org/#/c/343562/ was +2 but wasent merged, when we update integration/zuul we could problem add that to it please. [14:39:49] :) [14:41:50] (03CR) 10Paladox: [C: 031] "Thanks." [integration/config] - 10https://gerrit.wikimedia.org/r/300280 (owner: 10Hashar) [14:42:02] (03PS2) 10Hashar: (DO NOT MERGE) test Gear logging reduction in Zuul test [integration/config] - 10https://gerrit.wikimedia.org/r/300274 [14:42:04] (03PS1) 10Hashar: test: add a temporary directory for zuul.state_dir [integration/config] - 10https://gerrit.wikimedia.org/r/300281 [14:42:21] zeljkof: ZUUL_* env variables are emitted by Zuul when it trigger a job [14:42:45] zeljkof: and since that job is triggered by Jenkins scheduler, it does not have them [14:42:52] (03CR) 10jenkins-bot: [V: 04-1] (DO NOT MERGE) test Gear logging reduction in Zuul test [integration/config] - 10https://gerrit.wikimedia.org/r/300274 (owner: 10Hashar) [14:43:03] hashar: should I just hardcode them? [14:43:07] zeljkof: the aim is to namespace the caches per (project, branch, jobname) [14:43:29] see jjb/castor.yaml [14:43:30] (03CR) 10Paladox: [C: 031] test: add a temporary directory for zuul.state_dir [integration/config] - 10https://gerrit.wikimedia.org/r/300281 (owner: 10Hashar) [14:44:12] zeljkof: that is all about crafting a namespace under $CASTOR_NAMESPACE . Ideally we would want to add the ability to override it on a per job basis [14:44:38] and thus if the job has CASTOR_NAMESPACE set, have the builder "castor-define-namespace" to skip entirely [14:45:13] hashar A 10 sec delay from upstream would cause zuul to be even slower [14:45:22] your upstream patch fixes this :) [14:45:27] paladox: I got a patch for that [14:45:38] hashar yep i saw that [14:45:42] and it had a +2 [14:45:46] hashar: what I am asking is, for language-screenshots job, can I just hardcode ZUUL_* env variables to some values [14:45:50] zeljkof: so yeah easy fix for now is to add to your job the ZUUL variables as build parameters [14:46:05] hashar waiting for it to be merged which may be a long time so we should just include it as a debian patch. [14:46:09] hashar: my thoughts exactly, will try [14:46:13] when ever we update integration/zuul [14:46:15] ;) [14:46:17] :) [14:46:49] Hashar this one https://review.openstack.org/#/c/343562/ ? [14:47:05] zeljkof: you would need both ZUUL_PROJECT and ZUUL_BRANCH [14:47:20] zeljkof: the last one that is required is JOB_NAME but that is set by Jenkins already [14:47:27] hashar: great, will do [14:47:34] will just hardcode them to something for now [14:47:37] paladox: yes sir! [14:47:45] Thanks :) :) [14:47:49] hashar: VisualEditor and master [14:47:57] paladox: and it had a +2 by Joshua would did the Zuul connections refactoring :} [14:48:00] zeljkof: sounds good [14:48:12] hashar yay [14:48:17] but it hasent been merged [14:48:20] zeljkof: would want to verify what JOB_NAME is set to in matrix jobs [14:48:22] which i doint know why [14:48:31] i thought +2 would have merged it. [14:48:32] zeljkof: all the sub jobs should probably share the same namespace [14:49:01] paladox: na you need two reviews by "core" reviewers i.e. 2 CR+2 [14:49:04] hashar: yes, there should be no differences in dependencies [14:49:07] Oh [14:49:20] paladox: then the change get approved, potentially by the same person that did the 2nd CR+2. That is done via the Workflow vote [14:49:24] hashar: and I think jenkins will set JOB_NAME [14:49:26] by default [14:49:31] oh [14:49:32] paladox: so a patch needs 2 x CR+2 and 1 x Workflow+1 [14:49:32] Thanks for explaning, i guess we can include it as a debian patch. [14:49:39] Ah [14:49:56] zeljkof: can you try creating a matrix job that spawn two different sub jobs and just echo $JOB_NAME ? [14:50:11] hashar: sure [14:50:32] hashar now /me has to figure out how i merge in upstream. [14:50:35] zeljkof: I am wondering whether it will be 'selenium-VisualEditor' for both or ( 'selenium-VisualEditor&lang=en' , 'selenium-VisualEditor&lang=fr' ) [14:50:43] I will probly just copy and paste [14:50:49] so i can build a dpkg. [14:50:51] and test [14:50:55] hashar: you think it will mess up the paths? [14:51:02] But then i doint know what to put as the version in changelog [14:51:04] hashar ^^ [14:51:38] paladox: in patch-queue/debian/precise-wikimedia cherry pick it with: git fetch https://git.openstack.org/openstack-infra/zuul refs/changes/62/343562/2 && git cherry-pick FETCH_HEAD [14:51:50] hashar ah thanks [14:51:51] paladox: then rebuild the serie of patch with gbp pq export [14:51:55] Ah [14:52:00] but that will target the debian/precise-wikimedia branch [14:52:05] Time for me test that with my bash [14:52:20] so has to later cherry pick or merge to debian/jessie-wikimedia and rebuild [14:52:35] in /mnt/c/Users/patrick/zuul [14:53:38] hashar ^^ [14:53:38] :) [14:53:38] hashar: https://integration.wikimedia.org/ci/job/language-screenshots-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia/4/console [14:53:44] my path in bash. [14:53:54] 00:00:09.077 + echo language-screenshots-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia [14:54:06] echo $JOB_NAME [14:54:27] * paladox is running git fetch https://git.openstack.org/openstack-infra/zuul refs/changes/62/343562/2 && git cherry-pick FETCH_HEAD now [14:54:33] not the best $JOB_NAME :) [14:55:19] (03CR) 10Hashar: [C: 032] "Looks legit, missed when we did some refactoring :}" [integration/config] - 10https://gerrit.wikimedia.org/r/300280 (owner: 10Hashar) [14:56:11] (03Merged) 10jenkins-bot: test: pass a config to Zuul.Scheduler() [integration/config] - 10https://gerrit.wikimedia.org/r/300280 (owner: 10Hashar) [14:56:22] * paladox is apt-get install git-package in bash on windows. [14:56:25] (03CR) 10Hashar: "Failure is unrelated. That upstream code requires a zuul.state_dir in the zuul.conf. That is fixed via https://gerrit.wikimedia.org/r/#/c" [integration/config] - 10https://gerrit.wikimedia.org/r/300274 (owner: 10Hashar) [14:57:08] (03Abandoned) 10Hashar: (DO NOT MERGE) test Gear logging reduction in Zuul test [integration/config] - 10https://gerrit.wikimedia.org/r/300274 (owner: 10Hashar) [14:59:09] :) [15:00:11] hashar im getting resolve path error [15:00:17] (03PS2) 10Hashar: test: add a temporary directory for zuul.state_dir [integration/config] - 10https://gerrit.wikimedia.org/r/300281 [15:00:20] but it isent telling me what needs resolving [15:05:14] zeljkof: thank you, you helped a lot already! restarted it now.. let's see [15:06:42] Yippee, build fixed! [15:06:43] Project language-screenshots-VisualEditor » firefox,beta,Linux,ci-jessie-wikimedia build #5: 09FIXED in 5 min 59 sec: https://integration.wikimedia.org/ci/job/language-screenshots-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia/5/ [15:07:25] Project language-screenshots-VisualEditor » firefox,beta,Linux,ci-jessie-wikimedia build #6: 04FAILURE in 19 sec: https://integration.wikimedia.org/ci/job/language-screenshots-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia/6/ [15:07:52] (03CR) 10Hashar: [C: 032] "No side effect with the current Zuul version. PS1 showed it works with a more recent version." [integration/config] - 10https://gerrit.wikimedia.org/r/300281 (owner: 10Hashar) [15:08:32] (03Merged) 10jenkins-bot: test: add a temporary directory for zuul.state_dir [integration/config] - 10https://gerrit.wikimedia.org/r/300281 (owner: 10Hashar) [15:12:42] (03PS1) 10Paladox: Testing me [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/300289 [15:12:48] hashar ^^ [15:12:50] I did it [15:12:55] :) [15:12:55] :) [15:13:01] !log integration/zuul.git .Updated upstream branch: 06770a85fcff810fc3e1673120710100fc7b0601:upstream [15:13:03] All using git for windows and git in bash [15:13:04] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [15:14:23] (03PS1) 10Hashar: (DO NOT MERGE) run tests with Zuul@06770a85f [integration/config] - 10https://gerrit.wikimedia.org/r/300290 [15:15:04] Yippee, build fixed! [15:15:04] Project language-screenshots-VisualEditor » firefox,beta,Linux,ci-jessie-wikimedia build #7: 09FIXED in 6 min 2 sec: https://integration.wikimedia.org/ci/job/language-screenshots-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia/7/ [15:16:02] zeljkof: + echo language-screenshots-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=ci-jessie-wikimedia [15:16:04] zeljkof: bah :(((( [15:17:58] hashar https://phabricator.wikimedia.org/rCIZU1bb62ec16873e2471b8cd7dea0fde74e548055a5 [15:18:49] paladox: huhu [15:18:54] paladox: that 0011-Merge.patch is wrong for sure :} [15:18:58] Yep [15:19:02] Really ig [15:19:03] big [15:19:07] it had merge conflicts [15:19:12] so i named it just merge [15:20:36] hashar: I have an idea, will try it out [15:21:02] zeljkof: the issue is that each sub build will end up with its own cache :/ [15:21:33] hashar: but environment variables can be changed, right? ;) [15:21:40] they are not constants [15:22:03] hm, but it is not in shell :| [15:22:20] hashar if you time could you upload the patch that brings in upstream please [15:22:31] Seems mine just edited everyone single zuul file [15:23:32] zeljkof: basename `echo "job_name/foo/bar/last"|rev`|rev [15:23:41] zeljkof: that yields "job_name" :} [15:24:26] and didnt even bring in upstream since i doint see any ansible files [15:24:41] should I change castor to cut the job name? [15:25:39] running out of time, time for 1:1 with greg-g [15:31:42] (03Abandoned) 10Hashar: (DO NOT MERGE) run tests with Zuul@06770a85f [integration/config] - 10https://gerrit.wikimedia.org/r/300290 (owner: 10Hashar) [15:34:53] hashar: hi! I was wondering - is there a way to refresh the workspace from the jenkins UI? [15:35:18] madhuvishy: nop :/ [15:35:27] madhuvishy: have to ssh to the salve and delete it [15:35:37] hashar i seem to have generated [15:35:42] everysingle patch [15:35:45] from scratch [15:36:00] hashar: hmmm are there any reasons why the workspace doesn't sync when the git repo is updated? [15:36:16] Im not sure how to do this since it seems to have generated the wrong thing [15:36:21] (i know I can clean the workspace from UI, I would like it to just refresh though) [15:40:35] Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #86: 04FAILURE in 18 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/86/ [15:41:50] madhuvishy: I am not sure on which slave that cleans it though [15:44:12] hashar: hmmm [15:44:18] ostriches: have you just deleted mediawiki/extensions/WikibaseQuery and mediawiki/extensions/ContactPageFundraiser ? [15:44:58] I marked them as hidden. [15:44:58] hashar: okay - I'll see what to do. Can we update our copy of JJB with latest commits from upstream? I can file a task too [15:45:09] Per tasks on Phab asking for them to be outright deleted. [15:45:18] ok :) cleaning out the ci conf [15:46:25] (03PS1) 10Hashar: Delete ContactPageFundraiser and WikibaseQuery [integration/config] - 10https://gerrit.wikimedia.org/r/300295 [15:48:41] Whoops. I'll have to remember to check there next time :) [15:49:00] Yippee, build fixed! [15:49:01] Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #86: 09FIXED in 26 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/86/ [15:52:05] (03CR) 10Hashar: [C: 032] Delete ContactPageFundraiser and WikibaseQuery [integration/config] - 10https://gerrit.wikimedia.org/r/300295 (owner: 10Hashar) [15:52:44] (03Merged) 10jenkins-bot: Delete ContactPageFundraiser and WikibaseQuery [integration/config] - 10https://gerrit.wikimedia.org/r/300295 (owner: 10Hashar) [15:55:35] madhuvishy: has JJB received any update you might need ? :) [15:55:40] madhuvishy: will be happy to bump it [15:56:08] hashar: ha ha yeah they merged my patch [15:56:09] madhuvishy: I usually generate the config with the current version, update the copy, generate config and then look at the diff [15:56:14] ah the maven release one? [15:56:17] Yes [15:56:26] That will let my patch compile [15:56:33] Then they can be merged [15:56:43] (To integration/config) [16:03:47] !sal [16:03:47] https://tools.wmflabs.org/sal/releng [16:04:18] integration/zuul.git .Updated upstream branch:bc58ea34125f11eb353abc3e5b96ac1efad06141 finally caught up with upstream \O/ [16:04:23] !log integration/zuul.git .Updated upstream branch:bc58ea34125f11eb353abc3e5b96ac1efad06141 finally caught up with upstream \O/ [16:04:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:04:58] (03PS1) 10Paladox: Testing [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/300297 [16:05:14] hashar ^^ [16:05:27] (03PS2) 10Ejegg: Quit testing DonationInterface against REL1_25 [integration/config] - 10https://gerrit.wikimedia.org/r/299940 [16:05:45] madhuvishy: doing the diff run / comparison [16:06:12] hashar: Thank you! [16:06:19] hashar i used the downloads from gerrit [16:06:28] much easy to copy and paste [16:09:25] I think you may have to do it since i seem to not be getting it right [16:09:28] madhuvishy: the fast forward is not that easy :( [16:09:40] madhuvishy: but I can surely cherry pick the patch you wrote. Should have done that earllier [16:09:41] hashar ^^ [16:09:53] ostriches, thciprianiIf I'm asking for a gerrit repo to host python wheels for a scap3 deploy, should it be merge review or open push (or does it really matter)? [16:10:10] whitespace fail for pinging thcipriani ^ [16:10:44] (03PS5) 10Hashar: Add partial support for maven-release-plugin [integration/jenkins-job-builder] - 10https://gerrit.wikimedia.org/r/286788 (owner: 10Madhuvishy) [16:10:51] hashar: I'm not in a total hurry if it just takes a bit of time. But I'm fine either way https://review.openstack.org/#/c/313196 [16:11:03] The patch in our gerrit is not updated [16:11:58] !log Updated our JJB fork cherry picking f74501e781f by madhuvishy. Was made to support the maven release plugin. Branch bump is 10f2bcd..6fcaf39 [16:12:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [16:12:08] madhuvishy: I have picked the patch from upstream [16:12:18] (03PS3) 10Ejegg: Quit testing DonationInterface against REL1_25 [integration/config] - 10https://gerrit.wikimedia.org/r/299940 [16:12:55] (03CR) 10Hashar: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/290597 (https://phabricator.wikimedia.org/T132182) (owner: 10Madhuvishy) [16:13:03] (03CR) 10Ejegg: "OK awight, I added php53lint in there" [integration/config] - 10https://gerrit.wikimedia.org/r/299940 (owner: 10Ejegg) [16:13:18] (03CR) 10Hashar: "Our jjb fork has been updated with Madhuvishy JJB patch ( f74501e781f )" [integration/config] - 10https://gerrit.wikimedia.org/r/290597 (https://phabricator.wikimedia.org/T132182) (owner: 10Madhuvishy) [16:13:32] hashar: oh cool thank you [16:13:56] paladox: I will rebuild them tonight :) [16:14:05] madhuvishy: as for JDK8 madness, I haven't looked at it yet :( [16:14:06] hashar yay thanks :) [16:14:17] hashar ive been trying today but seems your very good at this [16:14:28] hashar but you can download from gerrit [16:14:34] paladox: it is just that the process is really a mess / complicated [16:14:42] Yep [16:14:48] (03PS5) 10Hashar: Add maven release job template and analytics-refinery-release project [integration/config] - 10https://gerrit.wikimedia.org/r/290597 (https://phabricator.wikimedia.org/T132182) (owner: 10Madhuvishy) [16:14:56] madhuvishy: https://gerrit.wikimedia.org/r/#/c/290597/ pass !! ;) [16:15:05] ostriches you know you said you disabled downloads in gitblit, well gerrit 2.12 now has downloads. [16:15:35] (03CR) 10Hashar: "Aced!!!" [integration/config] - 10https://gerrit.wikimedia.org/r/290597 (https://phabricator.wikimedia.org/T132182) (owner: 10Madhuvishy) [16:15:40] (03CR) 10Hashar: [C: 032] "Aced!!!" [integration/config] - 10https://gerrit.wikimedia.org/r/290597 (https://phabricator.wikimedia.org/T132182) (owner: 10Madhuvishy) [16:15:53] hashar: yay thanks! :) [16:16:44] (03CR) 10Madhuvishy: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/290640 (https://phabricator.wikimedia.org/T130123) (owner: 10Madhuvishy) [16:16:46] (03Merged) 10jenkins-bot: Add maven release job template and analytics-refinery-release project [integration/config] - 10https://gerrit.wikimedia.org/r/290597 (https://phabricator.wikimedia.org/T132182) (owner: 10Madhuvishy) [16:16:48] paladox: Ugh really? Gonna have to disable.... [16:17:05] Generating tars on demand--dubious utility at best--definite DoS vector... [16:17:07] (03CR) 10jenkins-bot: [V: 04-1] Add job that allows for updating analytics refinery artifacts with latest source jars [integration/config] - 10https://gerrit.wikimedia.org/r/290640 (https://phabricator.wikimedia.org/T130123) (owner: 10Madhuvishy) [16:17:46] hashar: ^ this is the other patch. looks like i need to manually rebase, will do [16:18:02] madhuvishy: yeah. Will try to look at them tonight [16:18:45] ostriches actually seems to be less spam [16:18:46] now [16:18:55] ostriches openstack uses it [16:18:58] has it enabled [16:19:01] What does spam have to do with it? [16:19:07] And good for them :p [16:19:15] ostriches it is hidden [16:19:18] under download [16:19:33] What difference does that make? The endpoint and DoS vector are there. [16:19:35] unless bots learn that it is under there, there shoulden be any attacks [16:20:14] I'm not worried about scraper bots like google or bing, it's about $random_user who either doesn't know or doesn't care and hammers us. [16:20:16] ostriches i doint think you can disable it [16:20:23] Well that's dumb. [16:20:29] we can black list them at apache level I guess [16:20:39] hashar: Yeah, but playing whack a mole is lame :p [16:20:47] ostriches they generate all types of files too, [16:21:07] Patch-File [16:21:07] 9f16d52.diff.base64 | 9f16d52.diff.zip [16:21:07] [16:21:07] Archive [16:21:07] tar | tbz2 | tgz | txz [16:21:08] [16:21:12] ostriches ^^ [16:21:13] Ah, it can be disabled. [16:21:17] Oh [16:21:24] "If download.archive is not specified defaults to all archive commands. Set to off or empty string to disable." [16:21:56] ostriches, oh, yeh we have a workaround any way [16:21:58] use github mirror [16:22:05] which we link directly in phabricator [16:22:17] as long as the github mirror is set in the repos [16:22:27] Yeah, I prefer to let github do that :p [16:22:46] Yep [16:22:47] :) [16:23:03] So for high profile repo's we should start switching it on [16:23:24] though one problem mw core and operations/puppet have trouble pushing refs/changes/ [16:23:30] ostriches ^^ [16:24:30] (03PS5) 10Madhuvishy: Add job that allows for updating analytics refinery artifacts with latest source jars [integration/config] - 10https://gerrit.wikimedia.org/r/290640 (https://phabricator.wikimedia.org/T130123) [16:24:37] We can't configure it on a per-repo basis. [16:25:01] Also: heads and tags are already on github from Gerrit replication, so people can do their tars/etc of those. [16:25:15] Just not of individual diffs, which I think is even less useful than doing it for a branch or tag :) [16:25:27] ostriches actually we can [16:26:06] ostriches https://gerrit.wikimedia.org/r/#/c/295011/ [16:26:25] (03CR) 10Madhuvishy: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/290640 (https://phabricator.wikimedia.org/T130123) (owner: 10Madhuvishy) [16:26:40] paladox: That's not what I meant. I meant we can't configure the archive downloads on a per-repo basis. [16:26:47] ostriches oh [16:26:50] is that in gerrit [16:27:00] we carn't do it or are we talking about phabricator [16:27:03] ostriches ^^ [16:27:37] I'm talking about on Gerrit right now. [16:27:39] Ok [16:27:50] Yeh would have been great on per repo basis too. [16:28:39] ostriches but would you be able to review https://gerrit.wikimedia.org/r/#/c/295011/ please. [16:28:53] Since i would like to get the github mirrors working in those repos on phabricator [16:29:08] Why don't we just work around it like we said before then we can avoid the hack? [16:29:19] (iterate and push the changes all 1 by 1) [16:29:23] Oh [16:29:33] Then it'll Just Work from then on out [16:29:33] But im not sure who would do that [16:29:42] Write me up a quick script and I can run it :) [16:29:49] Be careful though i broke my github repo [16:30:01] Github repos can be easily fixed, they're just replicas :) [16:30:09] Actually not [16:30:09] delete -> recreate -> retry [16:30:10] lol [16:30:14] i made my repo turn 500 [16:30:16] error [16:30:23] and had to email github to fix it [16:30:31] hashar: https://gerrit.wikimedia.org/r/#/c/290640/ verified too (this was CR-ed by Jan before and +1-ed also) [16:30:44] ostriches i coulden delete the repo do to 500 error. [16:31:00] :D [16:31:04] We can figure something out hehe [16:31:09] Let's try! [16:31:14] No point in not trying [16:31:22] Ok [16:31:23] anyone mind if i push out a CirrusSearch patch to fix an itwiki UBN? [16:31:24] yes please [16:31:25] :) [16:31:44] ebernhardson: Lemme see the patch, but provisionally {{approved}} :) [16:31:57] ostriches: its an s/private/protected/ patch :) sec [16:32:23] hashar: around? [16:32:26] ostriches: https://gerrit.wikimedia.org/r/#/c/300168/ [16:32:32] ostriches are you doing that now? [16:32:53] I have 2 patches where the gate submit just seems to vanish for :/ https://gerrit.wikimedia.org/r/#/c/300300/ and https://gerrit.wikimedia.org/r/#/c/300303/ [16:32:57] ebernhardson: Go forth and conquer! [16:33:27] ostriches but i did run many tests [16:33:38] with what i did was created many repos to test it and it works [16:33:49] :) [16:33:53] so it should work [16:33:53] :) [16:33:57] ostriches ^^ [16:37:38] addshore: I guess gate-and-submit has no job to run [16:37:42] oh :/ [16:37:48] but wait, *looks at the last thing* [16:38:01] ostriches are you running that script today? [16:38:17] hashar: https://gerrit.wikimedia.org/r/#/c/300299/ it merged this one in the same repo :/ [16:38:18] addshore: yeah it only has php55lint job and that job only triggers when .php files are changed [16:38:23] ohhhhhhhh [16:38:32] we need a shell linter :-} [16:38:45] do we have one? ;D [16:39:15] paladox: I don't have a script yet, I'm just doing it by hand right now :) [16:39:22] (03PS1) 10Hashar: [analytics/wmde/scripts] add noop to gate-and-submit [integration/config] - 10https://gerrit.wikimedia.org/r/300308 [16:39:23] addshore: ^^^ [16:39:28] ostriches oh, yay :) [16:39:43] (03CR) 10Addshore: [C: 031] [analytics/wmde/scripts] add noop to gate-and-submit [integration/config] - 10https://gerrit.wikimedia.org/r/300308 (owner: 10Hashar) [16:39:48] hashar: could also add it to test? [16:39:49] addshore: in python word there is https://pypi.python.org/pypi/bashate/ :) [16:40:00] / check-voter? [16:40:01] style check enforcements for bash ! [16:40:13] paladox: We *should* however bring your patch back. We should block refs/cache-automerge/* from replicating for *all* repos. It's a dumb ref :) [16:40:21] (03CR) 10Hashar: [C: 032] [analytics/wmde/scripts] add noop to gate-and-submit [integration/config] - 10https://gerrit.wikimedia.org/r/300308 (owner: 10Hashar) [16:40:24] Oh i already done [16:40:25] that [16:40:27] ostriches ^^ [16:40:35] Ah ok nvm then [16:40:36] :) [16:40:39] At least i blocked it for phabricator [16:40:42] 20after4 [16:40:42] addshore: check-voter yeah hmm. Well if a change has no .php file changed, nothing will be reported back :D [16:40:52] hashar: let me know when it is deployed and I will re +2 them! [16:41:00] twentyafterfour wrote the patch, but i brought it to his attention :) [16:41:02] ostriches ^^ [16:41:10] (03Merged) 10jenkins-bot: [analytics/wmde/scripts] add noop to gate-and-submit [integration/config] - 10https://gerrit.wikimedia.org/r/300308 (owner: 10Hashar) [16:41:27] ostriches upstream really need to block that ref by default, that deffitly caused problems. [16:41:30] hashar we will soon be able to view open changes on github [16:41:40] for mw-core repo and operations/puppet [16:41:41] :) [16:41:54] Or just not replicate it :) [16:42:03] No point in even trying, not telling upstream to block it [16:42:14] Oh [16:42:20] I am off [16:42:25] But then everyone who uses gerrit will have the problem [16:42:36] * addshore wonders if that thing got deployed.. :P [16:42:49] unless they come accross twentyafterfour patch [16:43:05] it did, woo! [16:43:19] ostriches https://phabricator.wikimedia.org/D285 [16:43:44] I also blocked refs/drafts and refs/notes/ since they use too much space and well no one needs them [16:44:08] Not all refs/notes/ are bad, but yeah, the extra stuff from post-merge is annoying. [16:45:11] Everyone who uses gerrit? Like our users or random other users? [16:45:18] (random third parties, I mean) [16:46:27] ostriches yep [16:48:09] They'd already be dealing with Gerrit + Github issues with or without our Phab setup [16:48:19] I think we're the only ones using Gerrit + Phab + Github ;-) [16:48:24] (Also: not our problem!) [16:48:57] Oh ha [16:50:46] (most people only replicate refs/heads/* and refs/tags* to github too) [16:54:07] Yep [16:54:18] PROBLEM - Free space - all mounts on deployment-stream is CRITICAL: CRITICAL: deployment-prep.deployment-stream.diskspace._var.byte_percentfree (<10.00%) [16:54:42] But now we have refs/changes/* :) [16:56:21] ostriches ^^ :) [16:57:08] 10Deployment-Systems, 10scap, 10Analytics-Cluster, 06Analytics-Kanban, and 2 others: Deploy analytics-refinery with scap3 - https://phabricator.wikimedia.org/T129151#2096617 (10Nuria) [16:57:51] * paladox bt had another fault today. [16:57:55] ostriches ^^ [16:58:03] 2nd day ina row [16:58:06] in a [16:59:45] Good thing I don't use BT :) [16:59:57] 10Continuous-Integration-Config, 06Analytics-Kanban, 13Patch-For-Review: Add JJB support for Jenkins Maven Release Plugin {hawk} - https://phabricator.wikimedia.org/T132175#2190696 (10madhuvishy) This is merged upstream, and also cherry-picked and available in our version of JJB. [17:00:15] Hehe, one liner to turn packed-refs into a list of push commands: [17:00:21] gawk -i inplace '{ r = gensub(/^([a-z0-9]+) (.+)$/, "git push origin \\1:\\2;", "g") }; { print r };' packed-refs-test [17:00:25] That was fun to write :p [17:00:46] Ha [17:01:21] ostriches But i found it was much faster then sky, plus they doint block you to leave. [17:01:31] They are like comcast in america. [17:01:38] But illegally do it [17:01:48] so easy pieces just theaten them with ofcom. [17:02:22] Comcast can't stop you from leaving, they just try to annoy you into staying :p [17:02:38] did not read any context but "like comcast" -> "literally the devil" [17:02:47] Oh, ha, sky they say they have a good deal and say they get to you by a certain date [17:02:55] and you wait but then they doint ring you [17:02:58] the trick is to NOT call them first that you want to leave [17:03:10] ha what will really tick them off is if you threaten to leave the tv. [17:03:12] but to bring first bring the hardware back in person [17:03:16] and then stop talking to them [17:03:18] basically [17:03:21] They give you the most genous deal [17:03:43] 10Deployment-Systems, 10MediaWiki-extensions-WikimediaMaintenance, 06Operations, 13Patch-For-Review: WikimediaMaintenance refreshMessageBlobs: wmf-config/wikitech.php requires non existing /etc/mediawiki/WikitechPrivateSettings.php - https://phabricator.wikimedia.org/T140889#2484106 (10Dereckson) [17:03:46] 10Deployment-Systems, 06Labs, 10wikitech.wikimedia.org: /etc/mediawiki/WikitechPrivateSettings.php not found on tin - https://phabricator.wikimedia.org/T139917#2484108 (10Dereckson) [17:03:47] ostriches time to poke bt for some free stuff or compensation [17:03:48] ha [17:03:49] ostriches: that line looks nice :) [17:05:05] ostriches: gerrit hangs? [17:05:30] and it's over [17:06:15] oh [17:07:44] 10Deployment-Systems, 10MediaWiki-extensions-WikimediaMaintenance, 06Operations, 13Patch-For-Review: WikimediaMaintenance refreshMessageBlobs: wmf-config/wikitech.php requires non existing /etc/mediawiki/WikitechPrivateSettings.php - https://phabricator.wikimedia.org/T140889#2479747 (10demon) Why on earth... [17:08:12] mutante: Um, not sure why it'd hang.... [17:08:36] see -operations :) [17:09:03] ostriches: it's working but just got slow [17:09:05] noticably [17:09:11] it was normal before [17:10:06] I can't even connect. [17:10:09] times out [17:10:13] Andway, -operations [17:13:37] 07Browser-Tests, 10MobileFrontend, 06Reading-Web-Backlog, 03Reading-Web-Sprint-77-Segmentation-fault, and 3 others: Wikidata description browser tests do not run anywhere - https://phabricator.wikimedia.org/T137756#2484216 (10Jdlrobson) [17:13:46] 07Browser-Tests, 10MobileFrontend, 06Reading-Web-Backlog, 03Reading-Web-Sprint-77-Segmentation-fault, and 3 others: Spike [2hrs] Wikidata description browser tests do not run anywhere - https://phabricator.wikimedia.org/T137756#2484219 (10MBinder_WMF) [17:15:58] 10Deployment-Systems, 10MediaWiki-extensions-WikimediaMaintenance, 06Operations, 13Patch-For-Review: WikimediaMaintenance refreshMessageBlobs: wmf-config/wikitech.php requires non existing /etc/mediawiki/WikitechPrivateSettings.php - https://phabricator.wikimedia.org/T140889#2479747 (10AlexMonk-WMF) Histor... [17:16:23] Project beta-code-update-eqiad build #113824: 04FAILURE in 3 min 22 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113824/ [17:17:53] PROBLEM - Puppet run on integration-slave-jessie-1002 is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [17:17:53] ostriches but what is funny is if the internet goes down in london, it causes the whole uk to go down with it. [17:18:36] But caused plusnet to go down too. [17:18:41] and banks too. [17:19:46] ha [17:24:37] Yippee, build fixed! [17:24:38] Project beta-code-update-eqiad build #113825: 09FIXED in 1 min 36 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/113825/ [17:26:36] 10Beta-Cluster-Infrastructure, 10ContentTranslation-Deployments, 10Parsoid, 06Services, 03Language-Q4-2016-Sprint 2: Migrate BetaCluster Node.JS services to Jessie and Node 4.3 - https://phabricator.wikimedia.org/T125003#2484329 (10greg) [17:34:32] 10Deployment-Systems, 10MediaWiki-extensions-WikimediaMaintenance, 06Operations, 13Patch-For-Review: WikimediaMaintenance refreshMessageBlobs: wmf-config/wikitech.php requires non existing /etc/mediawiki/WikitechPrivateSettings.php - https://phabricator.wikimedia.org/T140889#2484392 (10demon) I'd prefer ju... [17:49:27] 06Release-Engineering-Team, 06Developer-Relations (Jul-Sep-2016), 15User-greg: Write blog post highlighting recent Phabricator improvements - https://phabricator.wikimedia.org/T137727#2484464 (10greg) >>! In T137727#2481194, @mmodell wrote: > Are we happy with the current version? The formatting looks good... [17:52:52] RECOVERY - Puppet run on integration-slave-jessie-1002 is OK: OK: Less than 1.00% above the threshold [0.0] [17:57:57] (03CR) 10EBernhardson: [C: 04-1] "needs a rebase before gerrit can merge" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/295895 (owner: 10Lethexie) [18:09:58] hey, can someone review https://gerrit.wikimedia.org/r/#/c/299697/ please? [18:12:53] 06Release-Engineering-Team, 10Monitoring, 06Operations: Monitoring and alerts for "business" metrics - https://phabricator.wikimedia.org/T140942#2484595 (10ori) p:05Low>03High >>! In T140942#2483038, @Gehel wrote: > Triaging this as low priority to match T117470. No, this should definitely have a higher... [18:20:24] PROBLEM - Host deployment-upload is DOWN: CRITICAL - Host Unreachable (10.68.16.189) [18:34:18] ostriches, it would be really funny if bt have another outrage tomarror mornning [18:35:14] Plus they control all our infurstructure, but are stricly monotored by ofcom, there being threatened with being split from bt openreach. [18:35:21] ostriches ^^ [18:36:30] 06Release-Engineering-Team, 06Developer-Relations (Jul-Sep-2016), 15User-greg: Write blog post highlighting recent Phabricator improvements - https://phabricator.wikimedia.org/T137727#2484703 (10Aklapper) Etherpad LGTM. (I'd only remove one of the two "helpful"s about the task dependency graphs.) Again thank... [18:37:16] 06Release-Engineering-Team, 06ArchCom, 06Developer-Relations, 10Phabricator: Consider alternative processes for Unbreak Now bugs, especially those which cross-cut components - https://phabricator.wikimedia.org/T140207#2484712 (10Quiddity) [18:37:31] hashar thanks for working on zuul :) [18:40:43] (03Abandoned) 10Paladox: Testing [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/300297 (owner: 10Paladox) [18:40:51] (03Abandoned) 10Paladox: Testing me [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/300289 (owner: 10Paladox) [18:57:39] Krenair Hi, i found duplicates translations for project namespaces im not sure if it was done on purpose or not and doint even know which translation it is for. [18:57:42] But for newiki [18:57:47] 06Release-Engineering-Team, 06ArchCom, 06Developer-Relations, 10Phabricator: Consider alternative processes for Unbreak Now bugs, especially those which cross-cut components - https://phabricator.wikimedia.org/T140207#2484794 (10Danny_B) [18:58:19] paladox, hi, what are you talking about? [18:59:06] can you provide a link or something? [18:59:07] Krenair let me paste it [18:59:09] ok [18:59:23] Krenair https://phabricator.wikimedia.org/P3540 [18:59:25] please [18:59:37] I found duplicates for NS_USER, NS_PROJECT and other's [19:00:11] NS_USER is done three times, woulden it just be overwritten. [19:03:52] paladox, no [19:03:57] Oh [19:03:59] paladox, the idea is to have multiple aliases for the namespaces [19:04:04] Oh [19:04:15] Thanks for telling me that :) [19:04:16] keys would overwrite each other, but these keys are all unique [19:04:19] the values can be the same [19:04:23] Oh [20:07:39] hashar :) [20:18:53] ostriches https://twitter.com/donasarkar/status/756209381264416768 she is a work a holic [20:19:00] and works for microsoft. [20:19:22] I guess being the head of windows insiders is a tough job, having to deal with 10+ million insiders. [20:20:29] hashar ^^ [20:22:30] * paladox is not on twitter but reads that feeds for some info on when windows 10 new builds are released to insiders. But i am on facebook. :) [20:38:19] 06Release-Engineering-Team, 10Monitoring, 06Operations, 13Patch-For-Review: Monitoring and alerts for "business" metrics - https://phabricator.wikimedia.org/T140942#2485115 (10ori) [20:43:03] Project selenium-Echo » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #92: 04FAILURE in 2 min 2 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/92/ [20:43:08] Project selenium-Echo » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #92: 04FAILURE in 2 min 6 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/92/ [20:49:58] ostriches http://www.trustedreviews.com/how-tos/how-to-complain-bt-vodafone-sky-talktalk-ofcom-uk [21:08:06] 06Release-Engineering-Team, 10Monitoring, 06Operations, 13Patch-For-Review: Monitoring and alerts for "business" metrics - https://phabricator.wikimedia.org/T140942#2485278 (10Tgr) Thinking about this more, not sure if login/signup metrics are worth the effort. One of the strengths of Wikimedia is the stro... [21:26:46] paladox: been busy tonight and havent rebuild the zuul package with latest version :( [21:26:53] that will be for tomorrow now! [21:27:19] hashar ok, thanks [21:27:20] :) [21:28:05] hashar thanks for working on zuul tomarror, i will be able to help test too :) [21:28:07] tomarror [21:28:24] 06Release-Engineering-Team, 10Monitoring, 06Operations, 13Patch-For-Review: Monitoring and alerts for "business" metrics - https://phabricator.wikimedia.org/T140942#2485421 (10Jdforrester-WMF) >>! In T140942#2485278, @Tgr wrote: > Thinking about this more, not sure if login/signup metrics are worth the eff... [21:30:41] hashar https://lists.wikimedia.org/pipermail/wikitech-l/2016-July/086105.html :) [21:35:46] 06Release-Engineering-Team, 10LDAP-Access-Requests, 06Operations, 10Ops-Access-Requests, and 3 others: Determine a core set or a checklist of permissions for deployment purpose - https://phabricator.wikimedia.org/T140270#2485435 (10greg) [21:38:10] paladox: yup I have proof read it :] [21:38:24] (and original draft was flawless) [21:38:40] Oh [21:38:43] :) [21:38:59] hashar i tryed to merge upstream [21:39:02] today [21:39:09] but didnt work quite as well though [21:39:44] I will handle that tomorrow [21:39:53] Ok thanks [21:39:53] maybe update the tutorial while at it [21:39:54] :) [21:40:00] Oh [21:40:02] :) :) :) [22:14:51] 06Release-Engineering-Team, 15User-greg: Identify RelEng projects 'worthy' of a tech lead - https://phabricator.wikimedia.org/T139540#2485589 (10greg) I started making lists, deleting, changing, and so on, but now I'm not sure I had the right idea at the beginning. I *think* what might actually be useful is a... [23:13:24] 06Release-Engineering-Team, 15User-greg: Identify "responsible parties" for "all" components deployed on Wikimedia servers - https://phabricator.wikimedia.org/T141066#2485829 (10greg) [23:19:13] 06Release-Engineering-Team, 15User-greg: Identify "responsible parties" for "all" components deployed on Wikimedia servers - https://phabricator.wikimedia.org/T141066#2485848 (10greg) [23:19:26] ostriches: so we have 32G of RAM in lead it seems. and currently 20g heap limit. up to 28? [23:22:21] Trying to figure it out. Wanna leave some space for FS cache. [23:22:27] Was thinking 26 or 28 yeah [23:26:25] there are about 11 free right now ytterbium maybe 10 [23:36:50] :) [23:40:53] (03CR) 10Awight: [C: 031] "Good call on the lint! I would merge and deploy if I had the permmies..." [integration/config] - 10https://gerrit.wikimedia.org/r/299940 (owner: 10Ejegg) [23:51:03] ostriches: i merged "simplify directory management".. got a problem [23:51:15] "You cannot specify a remote recursion without a source [23:51:34] no gerrit breakage though [23:52:13] why the compiler not catch it .. [23:52:25] i did see the link and read it [23:54:21] 10Continuous-Integration-Config, 06Release-Engineering-Team, 07Regression: mediawiki-core coverage missing ("Error: Empty directory!") - https://phabricator.wikimedia.org/T140917#2485932 (10Krinkle) 05Open>03Resolved