[01:00:10] !log integration-publisher and integration-zuul-server were rebooted by me yesterday. Seems they only show up in graphite now. Maybe they were shutdown or had puppet stuck. [01:00:12] Logged the message, Master [01:01:59] Hmpf, Nagf sounds a bit like Nagios (like nagging). Missed that connotation. Glad it's back :) [01:08:21] !log Setting up integration-slave1009 ({{bug|72014}} fixed}}) [01:08:23] !log Pooled integration-slave1009 [01:08:24] Logged the message, Master [01:08:26] Logged the message, Master [04:06:38] Yippee, build fixed! [04:06:38] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #121: FIXED in 9 min 34 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/121/ [04:40:29] Yippee, build fixed! [04:40:29] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #262: FIXED in 33 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/262/ [05:20:23] Yippee, build fixed! [05:20:23] Project browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce build #140: FIXED in 1 min 2 sec: https://integration.wikimedia.org/ci/job/browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce/140/ [06:31:31] Yippee, build fixed! [06:31:31] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce build #67: FIXED in 6 min 48 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_7-internet_explorer-9-sauce/67/ [07:27:48] Yippee, build fixed! [07:27:49] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #221: FIXED in 23 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/221/ [08:16:53] 3Wikimedia / 3Quality Assurance: QA: mediawiki_api doesn't report HTTP errors - 10https://bugzilla.wikimedia.org/72056#c4 (10Željko Filipin) S, did the change solve the problem? [09:18:13] (03CR) 10Hashar: [C: 04-1] "Can you keep the logic around and just drop the pmtpa case? We have a new datacenter coming and might well end up having slaves running t" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/166529 (owner: 10Krinkle) [09:40:18] (03CR) 10Hashar: [C: 032] "Good catch :)" [integration/config] - 10https://gerrit.wikimedia.org/r/166548 (owner: 10Zfilipin) [09:43:40] (03Merged) 10jenkins-bot: Update documentation on how to use jenkins-jobs [integration/config] - 10https://gerrit.wikimedia.org/r/166548 (owner: 10Zfilipin) [09:52:38] (03CR) 10Hashar: "Zuul layout check verify whether all triggered jobs are defined in Jenkins. It thus dies out with:" [integration/config] - 10https://gerrit.wikimedia.org/r/166074 (owner: 10Jforrester) [09:53:59] (03PS2) 10Hashar: Create a demos-publish task for OOjs UI [integration/config] - 10https://gerrit.wikimedia.org/r/166074 (owner: 10Jforrester) [09:56:32] (03CR) 10jenkins-bot: [V: 04-1] Create a demos-publish task for OOjs UI [integration/config] - 10https://gerrit.wikimedia.org/r/166074 (owner: 10Jforrester) [10:04:39] (03CR) 10Hashar: [C: 04-1] "will amend" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/166074 (owner: 10Jforrester) [10:08:24] (03PS3) 10Hashar: Create a demos-publish task for OOjs UI [integration/config] - 10https://gerrit.wikimedia.org/r/166074 (owner: 10Jforrester) [10:12:26] (03CR) 10Hashar: [C: 04-1] "PS3: I removed the /dist/ which does not exist in the git repository." [integration/config] - 10https://gerrit.wikimedia.org/r/166074 (owner: 10Jforrester) [10:27:24] !sal [10:27:24] https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:50:39] (03PS12) 10Zfilipin: Run rubocop, Ruby linter, for all repositories that have Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) [10:51:37] hashar: I think this ^ is _the_ final commit for rubocop [10:51:53] waiting for gerrit to run all checks [10:52:33] what happens when it gets merged? I mean: how to make sure the jobs are non-voting? [10:53:16] hashar: wait, have to check if all repos are included, I think ZeroPortal might be missing from the commit, so there will be one more commit after this "final" one [10:53:50] (03CR) 10jenkins-bot: [V: 04-1] Run rubocop, Ruby linter, for all repositories that have Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [11:14:06] (03PS13) 10Zfilipin: Run rubocop, Ruby linter, for all repositories that have Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) [11:17:31] RuboCop! \o/ "Four... three... two... one... I am now authorized to use physical force! " [11:20:19] Tobi_WMDE_SW: :) [11:20:29] I will have to rewatch the movie [11:20:59] ok, gerrit no longer complains, looks like I have managed to craft a nice commit [11:21:13] now just to check if all repositories are included [11:47:50] (03PS14) 10Zfilipin: Run rubocop, Ruby linter, for all repositories that have Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) [11:50:59] (03CR) 10jenkins-bot: [V: 04-1] Run rubocop, Ruby linter, for all repositories that have Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [11:53:16] (03PS15) 10Zfilipin: Run rubocop, Ruby linter, for all repositories that have Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) [11:53:50] Tobi_WMDE_SW, hashar: ok, this ^ should be _the final_ (tm) change to the rubocop commit [11:54:03] the only thing I am not sure how to do is how to make the jobs non-voting for now [11:54:32] and how to make them run for WikidataBrowserTests, since it is not hosted in gerrit [12:08:15] hashar: welcome back :) [12:08:21] I think this is now ready https://gerrit.wikimedia.org/r/#/c/166563/ [12:08:29] but I am not sure how to make the jobs non-voting [12:14:07] zeljkof: helllo [12:14:20] voting is handled by zuul so that is in zuul/layout.yaml [12:14:31] need a regex that match the job then set voting: false [12:17:52] hashar: all the jobs end with bundle-rubocop [12:18:07] but I am not sure how to use a regex to set all of them to false? [12:18:22] is there an example in the file? (looking...) [12:19:10] hashar: ok, something like this? https://github.com/wikimedia/integration-config/blob/master/zuul/layout.yaml#L334 [12:25:32] Project beta-scap-eqiad build #25615: FAILURE in 1 min 9 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/25615/ [12:27:51] !log about half an hour ago, updated salt-master and salt-minion on the deployment-salt host _only_ to 2014.1.11 (using salt ppa for now) [12:28:23] now how do I tell if logging is working [12:28:48] * zeljkof is out of lunch [12:29:35] !log bot reply! [12:29:39] apergos: bot is dead :/ [12:29:48] hahaha [12:29:53] that just figures [12:33:18] the bot must be on tools labs or something [12:35:41] Yippee, build fixed! [12:35:42] Project beta-scap-eqiad build #25616: FIXED in 1 min 19 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/25616/ [12:36:24] so where's the wki page, I'll just log it there... [12:46:48] wm-bot: ping [15:38:58] (03PS16) 10Hashar: rubocop and lint for all repos having Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [15:43:35] (03CR) 10Hashar: "PS16 make them all non voting ( https://gerrit.wikimedia.org/r/#/c/166563/15..16/zuul/layout.yaml,unified )" [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [15:43:45] (03PS17) 10Hashar: rubocop and lint for all repos having Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [15:46:03] hashar: can this be merged now? ^ [15:46:21] yeah [15:46:23] though hmm [15:46:28] I have no clue how long rubocop takes :] [15:47:03] yeah seems fast enough [15:47:39] zeljkof: have you seen how to make them non voting ? :-] [15:47:42] https://gerrit.wikimedia.org/r/#/c/166563/15..16/zuul/layout.yaml,unified [15:48:00] (03CR) 10Hashar: [C: 032] "All fine ™" [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [15:50:59] hashar: yes, well, I would know how to do _that_ :) [15:51:14] I thought you wanted a fancy regex solution [15:51:29] (03Merged) 10jenkins-bot: rubocop and lint for all repos having Ruby code [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [15:52:04] and this is better, we will make rubocop voting repo by repo, I think cirrus can be voting now [15:53:32] (03CR) 10Zfilipin: "recheck" [selenium] - 10https://gerrit.wikimedia.org/r/166549 (owner: 10Zfilipin) [15:54:46] so yeah explicitly making them non voting [15:54:52] so we can have them +vote one by one [15:55:04] reloading zuul [15:57:25] zeljkof: reloaded. Please announce rubocop on wikitech-l and QA mailing list [15:57:47] zeljkof: another concern I have is that most repos are using ruby1.9.x whereas the bundle macro has been made to use ruby2.0 [15:57:53] hashar: woohooo sending mail [15:57:57] so maybe rubocop will complain about valid 1.9.x ruby code [15:58:02] hashar: no [15:58:09] hence maybe :D [15:58:25] I do not think there is almost any code that we have that is ruby 2.0 specific [15:58:32] most of our code is even 1.8 valid [15:58:46] we use 1.9 style hashes, that is all (I think) [15:59:03] anyway, we can fix it if it proves to be a problem [16:03:21] hashar: how come rubocop job is not running here? https://gerrit.wikimedia.org/r/#/c/163993/ [16:06:52] we screwed :-] [16:07:28] hashar: :) [16:07:34] trying on a dummy change https://gerrit.wikimedia.org/r/#/c/86118/ [16:07:46] bah [16:07:48] anything that can be fixed quickly, or should we leave it for tomorrow? [16:09:14] zeljkof: I forgot to git pull on Zuul server hehe [16:09:35] https://integration.wikimedia.org/ci/job/mwext-Flow-bundle-rubocop/3/ [16:09:36] :D [16:09:43] hashar: let me know when it is ready, I have the mail ready, I just need an example rubocop job :) [16:10:25] zeljkof: I guess the repositories now need to depends on the rubocop gem [16:10:32] so bundle install actually install it hehe [16:10:36] hashar: :) [16:10:41] ok, will fix per repo then [16:10:45] i guess [16:10:51] then iterate till they are all voting [16:10:59] might want to write down some rubocop related documentation on the wiki [16:11:23] YuviPanda: sca-01 still living btw? [16:11:35] JohnLewis: no idea, but icinga is quiet [16:11:46] YuviPanda: that works for me :) [16:11:51] JohnLewis: :D yay [16:11:56] hashar: got to go, see you tomorrow [16:12:16] same here [16:18:09] 3Wikimedia / 3Continuous integration: Jenkins: Convert mwext qunit from grunt-contrib-qunit (PhanttomJS) to grunt-karma (Chromium) - 10https://bugzilla.wikimedia.org/72063 (10James Forrester) p:5Unprio>3High s:5normal>3enhanc a:3Krinkle [18:22:55] (03CR) 10Umherirrender: "FYI: Seems not working for mediawiki/core: failure under https://integration.wikimedia.org/ci/job/mediawiki-core-bundle-rubocop/8/console" [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [19:24:38] (03CR) 10Hashar: "@Umherirrender yup indeed the rubocop jobs are not working yet. We thought it would be a good idea to trigger them right now though as a " [integration/config] - 10https://gerrit.wikimedia.org/r/166563 (https://bugzilla.wikimedia.org/69245) (owner: 10Zfilipin) [19:42:09] (03PS1) 10Hashar: zuul: move rubocop jobs to experimental [integration/config] - 10https://gerrit.wikimedia.org/r/166805 [19:43:31] (03CR) 10Hashar: [C: 032] zuul: move rubocop jobs to experimental [integration/config] - 10https://gerrit.wikimedia.org/r/166805 (owner: 10Hashar) [19:43:40] (03CR) 10jenkins-bot: [V: 04-1] zuul: move rubocop jobs to experimental [integration/config] - 10https://gerrit.wikimedia.org/r/166805 (owner: 10Hashar) [19:44:54] (03CR) 10Zfilipin: [C: 04-1] "Please do not merge this, I have another idea on how to solve the RuboCop problem." [integration/config] - 10https://gerrit.wikimedia.org/r/166805 (owner: 10Hashar) [19:46:38] (03PS2) 10Hashar: zuul: move rubocop jobs to experimental [integration/config] - 10https://gerrit.wikimedia.org/r/166805 (https://bugzilla.wikimedia.org/69245) [19:47:07] (03CR) 10Hashar: [C: 04-2] "Cancelled just in time :D" [integration/config] - 10https://gerrit.wikimedia.org/r/166805 (https://bugzilla.wikimedia.org/69245) (owner: 10Hashar) [19:47:08] chrismcmalunch, (hashar): from the new icinga status for 'deployment-prep', it looks like the beta cluster is 43 machines, would a deployment-staging cluster also be ~40 machines 8-) [19:48:19] zeljkof: bah I wanted to self merge the rubocop change supposing you were asleep / away :D [19:48:21] shame on me! [19:48:50] hashar: don't do it! :) [19:49:22] watching research meeting now, then need some sleep, will fix rubocop in the morning [19:51:41] hashar: good night [19:51:49] yeah [20:08:36] spagewmf: I would assume yes. afaik, a second beta cluster would differ from the original beta cluster only in config, not in architecture [20:10:39] ooh; things actually progressing for a second cluster? [20:19:41] (03CR) 10Hashar: "The integration jobs pass and I trust them. So I guess I am going to merge that during european morning and poke Wikidata team about it (" [integration/phpunit] - 10https://gerrit.wikimedia.org/r/164683 (owner: 10BryanDavis) [20:22:55] spagewmf: marxarelli a couple of updates to the Flow tests if you'd like to look them over https://gerrit.wikimedia.org/r/#/c/166767/ and https://gerrit.wikimedia.org/r/#/c/166780/ should be fairly straightforward [20:23:07] * chrismcmahon is a refactoring machine [20:26:39] (03CR) 10Hashar: "Will deploy tomorrow morning (Oct 16th ~8am UTC). Announced on wikitech-l https://lists.wikimedia.org/pipermail/wikitech-l/2014-October/0" [integration/phpunit] - 10https://gerrit.wikimedia.org/r/164683 (owner: 10BryanDavis) [20:27:24] 3Wikimedia / 3Quality Assurance: QA: update Gemfile.lock of extensions to pick up improved mediawiki_api - 10https://bugzilla.wikimedia.org/72090 (10spage) 3NEW p:3Unprio s:3normal a:3None Since bug 72056 was fixed, mediawiki_api 0.3.0 reports HTTP failures, yay. AFAICT, to bask in the nicer error r... [20:28:09] 3Wikimedia / 3Quality Assurance: QA: mediawiki_api doesn't report HTTP errors - 10https://bugzilla.wikimedia.org/72056#c5 (10spage) 5ASSI>3RESO/FIX I renamed api.php locally, did bundle update, ran Echo's features/notifications_userrights.feature , and it quickly failed with unexpected HTTP respon... [20:29:37] chrismcmahon: the 2nd test cluster has been bring up during the SoS [20:30:13] chrismcmahon: I think Greg told me we could use multi versions on the same infrastructure. That would probably save us from having to maintain a 2nd cluster :D [21:23:22] 3Wikimedia / 3Continuous integration: Jenkins: Convert mwext qunit from grunt-contrib-qunit (PhanttomJS) to grunt-karma (Chromium) - 10https://bugzilla.wikimedia.org/72063 (10Krinkle) 5NEW>3ASSI [22:00:34] (03CR) 10Addshore: "Will do when I find the time :)" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156568 (owner: 10Addshore) [22:00:54] 3Wikimedia / 3Quality Assurance: QA: browser tests don't detect or report HTTP response errors - 10https://bugzilla.wikimedia.org/72098 (10spage) 3NEW p:3Unprio s:3enhanc a:3None Browser tests explicitly load pages and click buttons that load pages. Neither seems to detect outright page load failure... [22:22:52] 3Wikimedia / 3Quality Assurance: QA: browser tests don't detect or report HTTP response errors - 10https://bugzilla.wikimedia.org/72098#c1 (10Chris McMahon) It's nothing to do with watir, the Selenium maintainers have been explicit from the very beginning that Selenium will never read HTTP response codes. I... [22:30:52] 3Wikimedia / 3Quality Assurance: QA: browser tests don't detect or report HTTP response errors - 10https://bugzilla.wikimedia.org/72098#c2 (10Chris McMahon) 5NEW>3RESO/WON marking WONTFIX, see https://code.google.com/p/selenium/issues/detail?id=141 and http://lmgtfy.com/?q=selenium+webdriver+http+respons... [22:37:44] (03PS1) 10Krinkle: tools: Update dev packages [integration/jenkins] - 10https://gerrit.wikimedia.org/r/166900 [22:38:10] (03CR) 10Krinkle: "Needs to be recompiled on a precise node." [integration/jenkins] - 10https://gerrit.wikimedia.org/r/166900 (owner: 10Krinkle) [22:43:38] 3Wikimedia / 3Continuous integration: Jenkins: set jobs to use web proxy to let git access github repositories - 10https://bugzilla.wikimedia.org/60164#c6 (10Krinkle) Do these still run on the production slaves? If so, what would it take to have them run on the labs slaves? [22:44:07] 3Wikimedia / 3Continuous integration: Jenkins: Use web proxy to let git access repositories on from GitHub (e.g. submodules) - 10https://bugzilla.wikimedia.org/60164 (10Krinkle) p:5Normal>3Low [22:49:27] PROBLEM - BetaLabs: Low disk space on /var on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-bastion.diskspace._var.byte_avail.value (10.00%) [22:53:38] !log cleaned up acct and atop logs in deployment-bastion [22:58:05] (03PS2) 10Krinkle: tools: Update dev packages [integration/jenkins] - 10https://gerrit.wikimedia.org/r/166900 [23:00:07] (03CR) 10Krinkle: "Recompiled on integration-slave1003 (Ubuntu Precise; node@v0.8.2; npm@1.4.28)" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/166900 (owner: 10Krinkle) [23:03:37] RECOVERY - BetaLabs: Low disk space on /var on labmon1001 is OK: OK: All targets OK