[01:04:03] ACKNOWLEDGEMENT - BetaLabs: Puppet freshness check on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki02.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-mediawiki03.puppetagent.time_since_last_run.value (100.00%) deployment-prep.deployment-mediawiki01.puppetagent.time_since_last_run.value (100.00%) daniel_zahn bd808: [03:11:53] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce build #147: FAILURE in 7 min 51 sec: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce/147/ [03:20:52] Project browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce build #64: FAILURE in 8 min 32 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce/64/ [04:20:28] Project browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce build #206: FAILURE in 46 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/206/ [04:54:26] Yippee, build fixed! [04:54:27] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce build #159: FIXED in 1 min 29 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce/159/ [05:16:54] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #225: FAILURE in 44 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/225/ [05:31:27] 3Wikimedia / 3Continuous integration: JSON duplicate key is not flagged - 10https://bugzilla.wikimedia.org/71284 (10Yuri Astrakhan) 3NEW p:3Unprio s:3normal a:3None json files may not contain duplicate keys, yet Jenkns does not detect it. https://gerrit.wikimedia.org/r/#/c/160541/9/languages/i18n/qq... [06:07:38] Project browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce build #189: FAILURE in 49 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce/189/ [06:28:09] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #63: FAILURE in 8 min 48 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/63/ [06:51:54] 3Wikimedia / 3Continuous integration: hphpize inject $PWD used at time of building to HHVM_INCLUDE_DIRS - 10https://bugzilla.wikimedia.org/68944#c10 (10Giuseppe Lavagetto) 5NEW>3RESO/FIX A new package for hhvm-3.3.0 is in our apt repo. I just confirmed this bug is fixed [07:01:00] Project browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce build #203: FAILURE in 20 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce/203/ [07:05:13] Project browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce build #172: FAILURE in 37 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce/172/ [07:54:20] zeljkof: judging by the last comment, at the fonts bug, does it seem to be fixed? [07:54:26] legoktm: ping poke hey :-] [07:54:43] aharoni: yes, for the local firefox [07:54:56] legoktm: I have more or less finished my pet project "zuul cloner", so I got some bandwidth to review / pair the patch to produce extensions code coverage :] [07:55:08] aharoni: we can work on moving all screenshot jobs to local firefox today [07:55:16] yay [07:55:18] aharoni: japanese / chinese (and others) fonts are available on the Jenkins slaves since yesterday :D zeljkof made me fix it :] [07:55:33] tl;dr we were missing the puppet class mediawiki::packages::fonts on the jenkins boxes [07:55:46] kart_: zeljkof: hashar - so if we shall need more fonts, is it just a matter of installing the packages? [07:55:54] aharoni: yup [07:55:55] because it's quite possible that we shall need more fonts :) [07:55:59] cool. [07:56:05] I'll open bugs as the need arises. [07:56:10] Thank you very much for fixing this. [07:56:13] somewhere in puppet, the file is probably modules/mediawiki/packages/fonts.pp [07:56:31] though that will install it on all Wikimedia application servers and might have unwanted side effects [07:56:51] a new font, could take over a previous font used for math rendering or stuff like that [08:02:55] hashar: creating new module for fonts like cjk is another good idea to avoid load. [08:03:04] aharoni: ^ [08:03:12] not sure how good it is :) [08:03:43] kart_: do you mean a new puppet module? [08:03:55] there is one for multimedia I think [08:04:01] something like mediawiki::multimedia::fonts [08:04:27] hashar: yes. I mean fonts-cjk fonts-indic etc [08:04:52] !log attempting to rebase beta cluster puppet master. Currently at 74036376 [08:04:54] Logged the message, Master [08:10:56] !log beta: dropped a patch that reverted OCG LVS configuration ( https://gerrit.wikimedia.org/r/#/c/146860/ ), it has been fixed by https://gerrit.wikimedia.org/r/#/c/148371/ [08:10:58] Logged the message, Master [08:15:15] !log beta: puppetmaster rebased [08:15:16] Logged the message, Master [09:25:09] (03CR) 10Hashar: "Replying to Dan:" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/160983 (owner: 10Hashar) [09:30:26] PROBLEM - BetaLabs: Puppet failure events on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki04.puppetagent.failed_events.value (100.00%) deployment-prep.deployment-sca01.puppetagent.failed_events.value (100.00%) [11:06:17] (03CR) 10Hashar: [C: 04-1] "That is a good start :-] Unfortunately I largely refactored the way we clone mediawiki and extensions during september. You will need to" (033 comments) [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/154757 (https://bugzilla.wikimedia.org/69685) (owner: 10Legoktm) [11:06:31] bah puppet [11:09:23] hashar: the fonts are merged! :) https://gerrit.wikimedia.org/r/#/c/162604/ [11:09:30] zeljkof: \LO/ [11:09:56] zeljkof: you can thanks godog in #wikimedia-operations [11:10:16] hashar: :) [11:10:35] I am off for lunch [11:10:46] will have some kind of board meeting later in the afternoon [11:30:06] * zeljkof is out to lunch [12:04:53] aharoni: I am in the hangout [12:21:57] (03PS2) 10Zfilipin: WIP Running language screenshot job using local Firefox [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162225 (https://bugzilla.wikimedia.org/69535) [12:22:51] (03CR) 10Zfilipin: "Hashar: Chinese and Japanese fonts are not supported at Sauce Labs. I have reported the problem to them, until they fix it we are running " [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162225 (https://bugzilla.wikimedia.org/69535) (owner: 10Zfilipin) [12:29:03] (03PS1) 10Zfilipin: Running language screenshot job using local Firefox [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162869 (https://bugzilla.wikimedia.org/69535) [12:32:09] (03Abandoned) 10Zfilipin: WIP Running language screenshot job using local Firefox [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162225 (https://bugzilla.wikimedia.org/69535) (owner: 10Zfilipin) [12:58:24] Project browsertests-VisualEditor-language-screenshot-linux-firefox » fr,contintLabsSlave && UbuntuPrecise build #5: FAILURE in 9 min 38 sec: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=fr,label=contintLabsSlave%20&&%20UbuntuPrecise/5/ [13:07:04] Project browsertests-VisualEditor-language-screenshot-linux-firefox » cs,contintLabsSlave && UbuntuPrecise build #5: FAILURE in 18 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=cs,label=contintLabsSlave%20&&%20UbuntuPrecise/5/ [13:16:10] 3Wikimedia / 3Quality Assurance: Visual editor screenshot job fails - 10https://bugzilla.wikimedia.org/71298 (10Željko Filipin) 3NEW p:3Unprio s:3normal a:3None Most of the language jobs fail with the same errors. This is example for cs[1]. The parent job is [2]. ... 00:18:18.444 Failing Scenarios:... [13:16:48] Project browsertests-VisualEditor-language-screenshot-linux-firefox » zh-hant,contintLabsSlave && UbuntuPrecise build #5: FAILURE in 28 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=zh-hant,label=contintLabsSlave%20&&%20UbuntuPrecise/5/ [13:23:04] Project browsertests-VisualEditor-language-screenshot-linux-firefox » en,contintLabsSlave && UbuntuPrecise build #5: ABORTED in 34 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=en,label=contintLabsSlave%20&&%20UbuntuPrecise/5/ [13:34:18] Yippee, build fixed! [13:34:19] Project browsertests-VisualEditor-language-screenshot-linux-firefox » fr,contintLabsSlave && UbuntuPrecise build #6: FIXED in 11 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=fr,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [13:42:35] Yippee, build fixed! [13:42:35] Project browsertests-VisualEditor-language-screenshot-linux-firefox » cs,contintLabsSlave && UbuntuPrecise build #6: FIXED in 19 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=cs,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [13:53:35] Yippee, build fixed! [13:53:35] Project browsertests-VisualEditor-language-screenshot-linux-firefox » zh-hant,contintLabsSlave && UbuntuPrecise build #6: FIXED in 30 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=zh-hant,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [14:01:25] Project browsertests-VisualEditor-language-screenshot-linux-firefox » en,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 38 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=en,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [14:11:05] Project browsertests-VisualEditor-language-screenshot-linux-firefox » pt,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 47 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=pt,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [14:20:02] Yippee, build fixed! [14:20:03] Project browsertests-VisualEditor-language-screenshot-linux-firefox » yue,contintLabsSlave && UbuntuPrecise build #6: FIXED in 56 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=yue,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [14:30:47] Project browsertests-VisualEditor-language-screenshot-linux-firefox » es,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 1 hr 7 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=es,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [14:40:52] 3Wikimedia / 3Quality Assurance: Issue with Selenium and Firefox in MobileFrontend test - 10https://bugzilla.wikimedia.org/71238#c2 (10Chris McMahon) 5NEW>3RESO/WOR this is working again as of 25 September [14:40:57] Project browsertests-VisualEditor-language-screenshot-linux-firefox » sv,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 1 hr 17 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=sv,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [14:50:07] 3Wikimedia / 3Quality Assurance: Issue with Selenium and Firefox in MobileFrontend test - 10https://bugzilla.wikimedia.org/71238#c3 (10Chris McMahon) 5RESO/WOR>3RESO/FIX update to FF version 32 fixed this [14:51:08] Project browsertests-VisualEditor-language-screenshot-linux-firefox » ast,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 1 hr 27 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=ast,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [15:01:20] Project browsertests-VisualEditor-language-screenshot-linux-firefox » uk,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 1 hr 38 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=uk,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [15:01:43] 3Wikimedia Labs / 3deployment-prep (beta): Convert puppetmaster sync cronjob to Jenkins job - 10https://bugzilla.wikimedia.org/71305 (10Bryan Davis) 3NEW p:3Unprio s:3enhanc a:3None The beta cluster uses a cron job introduced in to fetch the latest operati... [15:02:53] 3Wikimedia / 3Quality Assurance: Cucumber step should fail if pending RSpec expectation no longer fails - 10https://bugzilla.wikimedia.org/56243#c20 (10Željko Filipin) Thanks Dan, I have tested this and it works great! :) [15:12:32] Project browsertests-VisualEditor-language-screenshot-linux-firefox » fi,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 1 hr 49 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=fi,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [15:19:12] (03PS1) 10Zfilipin: Created job to run Core browser tests on test2 [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162893 [15:19:52] (03PS2) 10Zfilipin: Create job to run Core browser tests on test2 [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162893 [15:21:28] (03CR) 10Cmcmahon: [C: 032] Create job to run Core browser tests on test2 [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162893 (owner: 10Zfilipin) [15:23:47] Project browsertests-VisualEditor-language-screenshot-linux-firefox » ilo,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 2 hr 0 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=ilo,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [15:25:21] (03Merged) 10jenkins-bot: Create job to run Core browser tests on test2 [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162893 (owner: 10Zfilipin) [15:28:05] (03PS1) 10Zfilipin: Revert "Create job to run Core browser tests on test2" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162895 [15:28:42] (03CR) 10Cmcmahon: [C: 032] Revert "Create job to run Core browser tests on test2" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162895 (owner: 10Zfilipin) [15:33:41] Project browsertests-Core-test2.wikipedia.org-linux-firefox-sauce build #1: FAILURE in 13 min: https://integration.wikimedia.org/ci/job/browsertests-Core-test2.wikipedia.org-linux-firefox-sauce/1/ [15:33:49] (03Merged) 10jenkins-bot: Revert "Create job to run Core browser tests on test2" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162895 (owner: 10Zfilipin) [15:38:42] Project browsertests-VisualEditor-language-screenshot-linux-firefox » nb,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 2 hr 15 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=nb,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [15:39:39] 3Wikimedia / 3Continuous integration: Add json linting (eg: duplicate keys) in Jenkins - 10https://bugzilla.wikimedia.org/71284 (10Greg Grossmeier) p:5Unprio>3Normal [15:43:09] 3Wikimedia Labs / 3deployment-prep (beta): Convert puppetmaster sync cronjob to Jenkins job - 10https://bugzilla.wikimedia.org/71305#c1 (10Greg Grossmeier) p:5Unprio>3Normal (+1 to alerting both #-qa and #-operations) [15:43:09] 3Wikimedia / 3Continuous integration: Add json linting (eg: duplicate keys) in Jenkins - 10https://bugzilla.wikimedia.org/71284#c1 (10James Forrester) Hmm. According to the config file, jsonlint is run as part of the jslint job, along with jshint, for mwcore… http://git.wikimedia.org/blob/integration%2Fjenk... [15:45:08] 3Wikimedia / 3Continuous integration: Add json linting (eg: duplicate keys) in Jenkins - 10https://bugzilla.wikimedia.org/71284#c2 (10Greg Grossmeier) I don't see output from any of those on https://gerrit.wikimedia.org/r/#/c/160541/9 [15:46:22] greg-g: … ah. It probably only runs if there are *.js files (and not just *.json files) in the change or something "clever". [15:46:37] * greg-g shrugs [15:48:05] Also, I don't see a test for duplicate keys in jsonlint. [15:48:14] So it's possibly an upstream request anyway. [15:49:40] Project browsertests-VisualEditor-language-screenshot-linux-firefox » it,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 2 hr 26 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=it,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [15:49:51] James_F: ah, good looking [15:50:43] I should probably note this on the bug. :-) [15:50:58] indeed :) [15:52:37] 3Wikimedia / 3Continuous integration: Add json linting (eg: duplicate keys) in Jenkins - 10https://bugzilla.wikimedia.org/71284#c3 (10James Forrester) (In reply to Greg Grossmeier from comment #2) > I don't see output from any of those on > https://gerrit.wikimedia.org/r/#/c/160541/9 Yeah, good point. Also... [15:55:37] 3Wikimedia / 3Continuous integration: Augment jsonlint test with a test for duplicate keys - 10https://bugzilla.wikimedia.org/71284#c4 (10James Forrester) s:5normal>3enhanc (In reply to James Forrester from comment #3) > (In reply to Greg Grossmeier from comment #2) > > I don't see output from any of tho... [15:58:00] James_F: jsonlint apparently has support for duplicate key checks -- https://github.com/Seldaek/jsonlint/commit/8c8400785b3d161802dbf7c9d98d729dfea75936 [15:58:32] Project browsertests-VisualEditor-language-screenshot-linux-firefox » zh-hans,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 2 hr 35 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=zh-hans,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [15:58:37] bd808: Huh. [15:58:47] bd808: Oh, that's php-jsonlint. [15:58:53] bd808: This is for node-jsonlint. [15:59:17] heh. I didn't notice that either :) [15:59:36] bd808: Maybe I'll do an upstream patch if I'm bored [16:00:03] Project browsertests-VisualEditor-language-screenshot-linux-firefox » ro,contintLabsSlave && UbuntuPrecise build #6: FAILURE in 2 hr 36 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=ro,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [16:00:48] checking qqq.json for dup keys would be nice. I have seen them sneak in there more than once. [16:09:26] Project browsertests-VisualEditor-language-screenshot-linux-firefox » de,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 2 hr 46 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=de,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [16:20:44] Yippee, build fixed! [16:20:44] Project browsertests-VisualEditor-language-screenshot-linux-firefox » ja,contintLabsSlave && UbuntuPrecise build #6: FIXED in 2 hr 57 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=ja,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [16:22:31] Project browsertests-VisualEditor-language-screenshot-linux-firefox » hr,contintLabsSlave && UbuntuPrecise build #6: FAILURE in 2 hr 59 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=hr,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [16:33:00] Project browsertests-VisualEditor-language-screenshot-linux-firefox » mk,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 3 hr 9 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=mk,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [16:35:42] (03PS1) 10Zfilipin: WIP cleaning up core [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162910 [16:43:37] 3Wikimedia / 3Continuous integration: Augment jsonlint test with a test for duplicate keys - 10https://bugzilla.wikimedia.org/71284#c5 (10Antoine "hashar" Musso) The script is in integration/jenkins.git bin/json-lint.php It uses PHP json_decode() to parse the json. And with PHP 5.4.24: php > var_dump( js... [16:43:40] Project browsertests-VisualEditor-language-screenshot-linux-firefox » pl,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 3 hr 20 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=pl,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [16:46:37] 3Wikimedia / 3Continuous integration: Augment jsonlint test with a test for duplicate keys - 10https://bugzilla.wikimedia.org/71284#c6 (10Antoine "hashar" Musso) python 2.7.8 has the same behavior: > Repeated names within an object are accepted, and only the value of the > last name-value pair is used. htt... [16:53:22] 3Wikimedia / 3Continuous integration: Augment jsonlint test with a test for duplicate keys - 10https://bugzilla.wikimedia.org/71284#c7 (10Yuri Astrakhan) Tell you the truth, I would much rather have jenkins throw an error and reject it, and let user override it manually. Can't imagine any reason to allow dup... [16:54:00] Project browsertests-VisualEditor-language-screenshot-linux-firefox » sl,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 3 hr 30 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=sl,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [16:56:09] 3Wikimedia / 3Continuous integration: (Voting) -npm pipeline broken for MediaWiki-core, VisualEditor, (? other) repos - 10https://bugzilla.wikimedia.org/71314 (10James Forrester) 3ASSI p:3Unprio s:3blocke a:3Krinkle https://integration.wikimedia.org/ci/job/mediawiki-core-npm/2469/console https://int... [17:02:57] Project browsertests-VisualEditor-language-screenshot-linux-firefox » kn,contintLabsSlave && UbuntuPrecise build #6: FAILURE in 3 hr 39 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=kn,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [17:09:37] 3Wikimedia / 3Continuous integration: (Voting) -npm pipeline broken for MediaWiki-core, VisualEditor, (? other) repos - 10https://bugzilla.wikimedia.org/71314#c1 (10Bryan Davis) I depooled integration-slave1006.eqiad.wmflabs and a rebuild of the last failed mediawiki-core-npm job succeeded: https://integrati... [17:11:07] bd808: Hm.. indeed. [17:12:37] Project browsertests-VisualEditor-language-screenshot-linux-firefox » ru,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 3 hr 49 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=ru,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [17:12:42] Krinkle: I just got wikitech superpowers so I can login and look if you don't have time. [17:22:42] Project browsertests-VisualEditor-language-screenshot-linux-firefox » vi,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 3 hr 59 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=vi,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [17:32:27] Project browsertests-VisualEditor-language-screenshot-linux-firefox » he,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 4 hr 9 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=he,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [17:36:39] Yippee, build fixed! [17:36:40] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #226: FIXED in 46 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/226/ [17:42:46] Project browsertests-VisualEditor-language-screenshot-linux-firefox » gl,contintLabsSlave && UbuntuPrecise build #6: SUCCESS in 4 hr 19 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=gl,label=contintLabsSlave%20&&%20UbuntuPrecise/6/ [18:17:27] Yippee, build fixed! [18:17:27] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce build #148: FIXED in 13 min: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce/148/ [18:31:13] Yippee, build fixed! [18:31:13] Project browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce build #65: FIXED in 13 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce/65/ [19:50:47] Yippee, build fixed! [19:50:47] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #15: FIXED in 41 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/15/ [20:08:25] Yippee, build fixed! [20:08:25] Project browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce build #207: FIXED in 1 hr 3 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/207/ [20:08:37] gah, bryan's too fast [20:17:27] Yippee, build fixed! [20:17:27] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce build #27: FIXED in 46 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce/27/ [20:22:59] \0/ \o/ \0/ \o/ \0/ \o/ nice to see the Flow builds green again [20:41:00] Yippee, build fixed! [20:41:00] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #220: FIXED in 41 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/220/ [21:00:56] Reedy: I think when I asked this before the answer was yes, but 12:00 UTC is an ok time for you on Tuesday to do the non-wikipedias deploy? [21:11:22] 3Wikimedia / 3Continuous integration: Augment jsonlint test with a test for duplicate keys - 10https://bugzilla.wikimedia.org/71284#c8 (10Antoine "hashar" Musso) What I really meant is that neither PHP json_decode() or python json decoder let us detects duplicate key. So one needs to find an implementation t... [21:50:31] bd808: https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=1&host=labmon1001 [21:50:36] eh wrong, link [21:50:47] i mean: puppet breakage on beta [21:50:57] w00t. which hosts? [21:51:22] deployment-prep.deployment-mediawiki04. and deployment-prep.deployment-mediawiki02 [21:51:51] deployment-prep.deployment-sca .. hmm it chanes [21:52:03] not it says on 03 [21:52:05] now [21:53:38] someone has disabled mediawiki02. I think that was tonythomas and Jeff_Green earlier today. [21:53:59] disabled puppet there. no reason given but that's unfortunately normal [21:54:34] but also mediawiki03 and mediawiki04 ? [21:54:39] ssh to deployment-sca.eqiad.wmflabs is failing so probably a bigger issue there [21:55:05] mediawiki03 has puppet disabled too [21:55:44] Checking 04 now. I didn't even know we had an 04 [21:56:54] 04 says: "No such file or directory - /usr/local/apache" among other failures [21:57:24] * bd808 double checks which puppetmaster 04 is pointed to [21:59:01] oh. 04 is the box that jeremyb setup to mess around with puppet/salt on when we were having lots of failures a few weeks ago [21:59:30] It's not pooled as far as I know and probably could just be shutdown [22:01:59] so.. all 4 or more boxes are some special case :) [22:02:23] hmmm [22:03:03] i think the root fix would be to remove thins from the monitoring check if they are in the "setup to mess around" category [22:03:17] they shouldn't all be! [22:03:18] but i don't know how.. [22:03:28] * greg-g is slightly scared all of a sudden ;) [22:03:33] :( [22:04:14] I think sca01 was the box that Roan was trying to setup citoid on? [22:04:26] Not sure though. It surely has a horrible name [22:04:49] it mimics prod: (S)ervice (C)luster (A) [22:04:54] society for creative anachronism 01? [22:05:17] * bd808 grew up with a different SCA apparently [22:05:31] ditto :) [22:05:55] 03 is the security testing box. Not sure why puppet is disabled there? marxarelli? [22:06:23] 02 has some live hack for mail applied [22:06:34] 04 is ??? for jeremyb [22:07:14] If only we had a good system to track the state of each host and it fed into all of the other tools... [22:07:23] etcd can't come too soon [22:08:13] the second beta cluster? [22:08:58] 04 is unknown [22:09:40] but it does act strangely: http://people.wikimedia.org/~gjg/betacluster/graphs.html [22:12:06] jeremyb built 04 that day/night that puppet was broken everywhere and then he broke salt everywhere [22:12:43] yeah [22:12:56] I think it's just eating cpu and ram now [22:13:27] jeremyb: what's up with mediawiki04 in the Beta Cluster? Can we decom? [22:13:44] bd808: not sure why 03 would have puppet disabled [22:13:52] maybe it just crapped out? [22:14:15] ack! Something bad happened to the puppet repo on the master [22:14:20] :( [22:14:25] "have 10 and 27 different commits each," [22:18:56] !log puppet repo on deployment-salt out of whack. I will try to fix. [22:18:58] Logged the message, Master [22:20:59] greg-g: btw, puppet errors on 3 machines in betacluster for... a while [22:21:08] oh, I see it's being handled [22:21:14] !log cleaned up puppet repo with `git rebase origin/production; git submodule update --init --recursive` [22:21:16] Logged the message, Master [22:35:35] Yippee, build fixed! [22:35:36] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #175: FIXED in 43 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/175/ [22:36:36] !log Trying to reduce the number of untracked changes in puppet repo. Expect some short term breakage. [22:36:38] Logged the message, Master [22:40:10] Yippee, build fixed! [22:40:10] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #64: FIXED in 12 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/64/ [23:10:11] !log removed cherry-pick of abandoned https://gerrit.wikimedia.org/r/#/c/156223/; if beta wikis stop working this would be a likely culprit [23:10:14] Logged the message, Master [23:35:37] !log Done messing with puppet repo. Replaced 2 local commits with proper gerrit cherry picks. Removed a cherry-pick that had been rearranged and merged. Removed a cherry-pick that had been abandoned in gerrit. [23:35:39] Logged the message, Master