[00:00:07] (03CR) 10Legoktm: [C: 032] "Deploying 'citoid-deploy-npm-node-4 cxserver-deploy-npm-node-4 graphoid-deploy-npm-node-4 mathoid-deploy-npm-node-4 mediawiki-core-npm-nod" [integration/config] - 10https://gerrit.wikimedia.org/r/304068 (owner: 10Paladox) [00:01:29] (03Merged) 10jenkins-bot: Rename npm-node-4.3 to npm-node-4 [integration/config] - 10https://gerrit.wikimedia.org/r/304068 (owner: 10Paladox) [00:01:37] (03CR) 10Paladox: "We may want to keep the -jessie part due to we add things in parameter_function and may break if we drop the -Jessie part" [integration/config] - 10https://gerrit.wikimedia.org/r/304588 (owner: 10Legoktm) [00:01:41] (03CR) 10Paladox: [C: 04-1] Move tox-jessie & co. off of nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/304588 (owner: 10Legoktm) [00:01:54] legoktm we need to keep -jessie for ^^ [00:01:58] just the prefix [00:02:38] (03CR) 10Legoktm: "The code in parameter_functions is needed because they currently run on nodepool. So I renamed them so that code doesn't run, because it's" [integration/config] - 10https://gerrit.wikimedia.org/r/304588 (owner: 10Legoktm) [00:02:38] But then again it dosent look like we need -jessie [00:02:54] (03CR) 10Paladox: [C: 031] "Ah thanks for explaning." [integration/config] - 10https://gerrit.wikimedia.org/r/304588 (owner: 10Legoktm) [00:03:02] That can be merged now ^^ [00:03:05] thanks for working on it [00:03:06] :) [00:06:02] !log deploying https://gerrit.wikimedia.org/r/304068 [00:06:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [00:06:17] (03PS2) 10Legoktm: Move tox-jessie & co. off of nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/304588 [00:06:32] (03CR) 10Legoktm: [C: 032] Move tox-jessie & co. off of nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/304588 (owner: 10Legoktm) [00:07:32] (03Merged) 10jenkins-bot: Move tox-jessie & co. off of nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/304588 (owner: 10Legoktm) [00:08:54] !log deploying https://gerrit.wikimedia.org/r/304588 [00:08:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [00:16:56] * paladox goes back to watching tv :) 01:16am bst here. [00:18:00] o/ [00:18:05] the node change looks like it went through well [00:18:42] :) [00:20:12] * paladox http://www.tobycarvery.co.uk/ :) [00:23:33] legoktm: getting closer. I've got to run but I'll work on it tomorrow [00:23:46] bd808: \o/ and no worries :) [00:24:09] legoktm have you ever herd of http://www.tobycarvery.co.uk/ :). [00:25:27] 10Continuous-Integration-Infrastructure: Create another jessie slave with 2 executor slots - https://phabricator.wikimedia.org/T142891#2549948 (10Legoktm) [00:25:35] paladox: nope... [00:25:39] I live in the uS [00:25:40] US* [00:25:55] Oh, i am american too [00:26:11] I can now order from target and have it delivered to the uk [00:26:17] for £25+ delivery [00:27:01] 10Continuous-Integration-Infrastructure: Create another jessie slave with 2 executor slots - https://phabricator.wikimedia.org/T142891#2549962 (10Paladox) p:05Triage>03High Changing to high since nodepool is deftly unstable. [00:27:34] legoktm ^^ [00:29:29] 10Continuous-Integration-Config: Move npm-node-4 jobs off of nodepool - https://phabricator.wikimedia.org/T142892#2549966 (10Legoktm) [00:29:31] 10Continuous-Integration-Config: Move npm-node-4 jobs off of nodepool - https://phabricator.wikimedia.org/T142892#2549979 (10Legoktm) [00:29:33] 10Continuous-Integration-Infrastructure: Create another jessie slave with 2 executor slots - https://phabricator.wikimedia.org/T142891#2549980 (10Legoktm) [00:29:59] * legoktm afk [04:06:43] Yippee, build fixed! [04:06:43] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #107: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/107/ [05:29:52] PROBLEM - SSH on integration-slave-trusty-1014 is CRITICAL: Server answer [05:34:50] RECOVERY - SSH on integration-slave-trusty-1014 is OK: SSH OK - OpenSSH_6.6.1p1 Ubuntu-2ubuntu2.7 (protocol 2.0) [07:13:51] (03PS1) 1020after4: use gerrit command over ssh to vote code-review +2 on the wikiversion bump [tools/release] - 10https://gerrit.wikimedia.org/r/304604 [07:56:12] 10Continuous-Integration-Config, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: wikimedia/fundraising/civicrm-buildkit repo needs to V+2 itself - https://phabricator.wikimedia.org/T142901#2550186 (10awight) [09:46:58] Project beta-scap-eqiad build #115266: 04FAILURE in 24 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115266/ [09:51:32] Project beta-scap-eqiad build #115267: 04STILL FAILING in 24 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115267/ [09:55:04] Project beta-scap-eqiad build #115268: 04STILL FAILING in 28 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115268/ [10:05:09] Project beta-scap-eqiad build #115269: 04STILL FAILING in 26 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115269/ [10:15:01] Project beta-scap-eqiad build #115270: 04STILL FAILING in 26 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115270/ [10:21:06] RECOVERY - Long lived cherry-picks on puppetmaster on deployment-puppetmaster is OK: OK: Less than 100.00% above the threshold [0.0] [10:25:05] Project beta-scap-eqiad build #115271: 04STILL FAILING in 27 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115271/ [10:31:23] that'll be me [10:50:16] Yippee, build fixed! [10:50:16] Project beta-scap-eqiad build #115272: 09FIXED in 17 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115272/ [10:52:19] Project beta-scap-eqiad build #115273: 04FAILURE in 25 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115273/ [10:55:00] Project beta-scap-eqiad build #115274: 04STILL FAILING in 25 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115274/ [11:12:52] Yippee, build fixed! [11:12:52] Project beta-scap-eqiad build #115275: 09FIXED in 16 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115275/ [11:14:50] Project beta-scap-eqiad build #115276: 04FAILURE in 24 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115276/ [11:16:47] Project beta-scap-eqiad build #115277: 04STILL FAILING in 23 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115277/ [11:36:51] Yippee, build fixed! [11:36:51] Project beta-scap-eqiad build #115278: 09FIXED in 17 min: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/115278/ [14:33:59] Yippee, build fixed! [14:34:00] Project selenium-WikiLove » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #111: 09FIXED in 1 min 59 sec: https://integration.wikimedia.org/ci/job/selenium-WikiLove/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/111/ [14:58:30] PROBLEM - Puppet run on deployment-sca02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [14:59:14] PROBLEM - Puppet run on deployment-sca01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:57:56] PROBLEM - Puppet run on integration-slave-trusty-1013 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [17:45:13] PROBLEM - Puppet run on deployment-db01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [18:19:37] * paladox goes back to ordering dominos :) [19:22:27] (03PS2) 10BryanDavis: Make rules for footer contents less strict [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/304496 (https://phabricator.wikimedia.org/T142804) [19:30:20] (03CR) 10BryanDavis: Make rules for footer contents less strict (033 comments) [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/304496 (https://phabricator.wikimedia.org/T142804) (owner: 10BryanDavis) [19:53:47] 05Gitblit-Deprecate, 10Diffusion: Redirect git.wikimedia.org HEAD URLs to Diffusion - https://phabricator.wikimedia.org/T141965#2550654 (10Dereckson) [20:51:19] (03PS3) 10BryanDavis: Make rules for footer contents less strict [integration/commit-message-validator] - 10https://gerrit.wikimedia.org/r/304496 (https://phabricator.wikimedia.org/T142804) [21:11:27] Project selenium-MultimediaViewer » chrome,beta,OS X 10.9,contintLabsSlave && UbuntuTrusty build #107: 15ABORTED in 17 hr: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=contintLabsSlave%20&&%20UbuntuTrusty/107/ [21:31:48] PROBLEM - Puppet run on deployment-aqs01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:34:37] PROBLEM - Puppet run on integration-slave-precise-1012 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:35:42] PROBLEM - Puppet run on integration-slave-precise-1011 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [21:46:20] 10Beta-Cluster-Infrastructure, 10Shinken, 13Patch-For-Review, 07Wikimedia-Incident, 07Wikimedia-log-errors: Shinken alert for beta error rate - https://phabricator.wikimedia.org/T141785#2551142 (10Nemo_bis) [21:58:59] Yippee, build fixed! [21:58:59] Project selenium-PageTriage » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #113: 09FIXED in 58 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/113/ [21:59:05] Yippee, build fixed! [21:59:05] Project selenium-PageTriage » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #113: 09FIXED in 1 min 4 sec: https://integration.wikimedia.org/ci/job/selenium-PageTriage/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/113/ [23:16:02] !log cherry-picking 304678/1 into the puppetmaster [23:16:06] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [23:22:18] PROBLEM - SSH on deployment-kafka03 is CRITICAL: Server answer [23:25:47] 10Beta-Cluster-Infrastructure, 10Shinken, 13Patch-For-Review, 07Wikimedia-Incident: Shinken alert for beta error rate - https://phabricator.wikimedia.org/T141785#2551331 (10greg) The log errors project is for actual errors, not infrastructure to deal with them. [23:27:17] RECOVERY - SSH on deployment-kafka03 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0)