[01:34:27] (03PS1) 10BryanDavis: Add git submodule update to hhvm build [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129090 [01:37:59] (03CR) 10BryanDavis: "Edit applied manually in Jenkins starting with build #997." [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129090 (owner: 10BryanDavis) [03:08:17] Project browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox build #11: SUCCESS in 1 min 16 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox/11/ [03:21:08] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox build #14: STILL FAILING in 6 min 7 sec: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox/14/ [03:21:09] l10n-bot: Localisation updates from https://translatewiki.net. [03:31:58] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox build #13: STILL FAILING in 12 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox/13/ [03:36:38] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox build #19: STILL FAILING in 23 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/19/ [03:36:38] * Alex Monk: Show notice if user is globally blocked [03:36:39] * l10n-bot: Localisation updates from https://translatewiki.net. [03:36:39] * esanders: Update built html files [03:36:40] Project browsertests-Translate-sandbox.translatewiki.net-linux-firefox build #12: STILL FAILING in 4 min 37 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-sandbox.translatewiki.net-linux-firefox/12/ [03:36:40] * l10n-bot: Localisation updates from https://translatewiki.net. [03:36:41] * siebrand: Replace deprecated methods [03:37:54] Yippee, build fixed! [03:37:55] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox build #14: FIXED in 53 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox/14/ [03:37:55] neverett: Easier browsertests against vagrant [03:49:52] Project browsertests-Translate-meta.wikimedia.org-linux-firefox build #12: SUCCESS in 51 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-meta.wikimedia.org-linux-firefox/12/ [03:49:52] * l10n-bot: Localisation updates from https://translatewiki.net. [03:49:53] * siebrand: Replace deprecated methods [03:53:42] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox build #14: FAILURE in 41 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox/14/ [03:53:43] neverett: Easier browsertests against vagrant [09:37:27] zeljkof: finally there sorry [09:40:22] hashar: no problem [09:40:27] ping me when you are ready [09:41:45] zeljkof: I am [09:41:54] or I will start triaging my emails and thus disappears hehe [09:42:21] hashar: creating hangout right now :) [09:43:34] hashar: this should work https://plus.google.com/hangouts/_/wikimedia.org/amusso-zfilipin?authuser=1 [09:43:48] joining [10:33:24] (03PS1) 10Zfilipin: Fixed "File name too long" error message [selenium] - 10https://gerrit.wikimedia.org/r/129141 [10:35:03] kart_: could you please take a look and merge? https://gerrit.wikimedia.org/r/#/c/129141/1 [10:46:11] (03PS1) 10Zfilipin: Fix ZeroRatedMobileAccess job so it works on Wikimedia Jenkins [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129142 [10:47:24] (03PS2) 10Zfilipin: Fix ZeroRatedMobileAccess job so it works on Wikimedia Jenkins [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129142 [10:54:07] Project browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs build #1: FAILURE in 18 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs/1/ [10:59:18] (03CR) 10Hashar: [C: 032] Fixed "File name too long" error message [selenium] - 10https://gerrit.wikimedia.org/r/129141 (owner: 10Zfilipin) [10:59:20] (03Merged) 10jenkins-bot: Fixed "File name too long" error message [selenium] - 10https://gerrit.wikimedia.org/r/129141 (owner: 10Zfilipin) [11:00:15] (03CR) 10Hashar: "Tagged 0.2.22" [selenium] - 10https://gerrit.wikimedia.org/r/129141 (owner: 10Zfilipin) [11:06:36] Project browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs build #2: STILL FAILING in 15 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs/2/ [11:08:15] (03PS1) 10Hashar: Trigger tests for ZeroRatedMobileAccess [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/129145 [11:08:46] Project browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs build #3: STILL FAILING in 11 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs/3/ [11:09:56] (03CR) 10Hashar: [C: 032] Trigger tests for ZeroRatedMobileAccess [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/129145 (owner: 10Hashar) [11:10:04] (03Merged) 10jenkins-bot: Trigger tests for ZeroRatedMobileAccess [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/129145 (owner: 10Hashar) [11:13:21] (03PS3) 10Zfilipin: Moved ZeroRatedMobileAccess to Wikimedia Jenkins [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129142 [11:14:57] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232 (10Željko Filipin) 5NEW>3ASS a:3Željko Filipin [11:15:33] (03PS1) 10Hashar: ZeroRatedMobileAccess depends on MobileFrontend [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129147 [11:16:07] (03CR) 10Hashar: [C: 032] "Update the job and tests are passing: https://integration.wikimedia.org/ci/job/mwext-ZeroRatedMobileAccess-testextensions-master/2/console" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129147 (owner: 10Hashar) [11:17:25] (03Merged) 10jenkins-bot: ZeroRatedMobileAccess depends on MobileFrontend [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129147 (owner: 10Hashar) [11:19:26] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232#c2 (10Željko Filipin) Documentation[1] says: "Have your Jenkins administrator place the script inside JENKINS_HOME\email-templates." 1: https://wiki.jenkins-ci.... [11:36:15] (03PS1) 10Zfilipin: Added wikimedia.template file [integration/jenkins] - 10https://gerrit.wikimedia.org/r/129151 [11:36:53] (03CR) 10Hashar: [C: 032] Added wikimedia.template file [integration/jenkins] - 10https://gerrit.wikimedia.org/r/129151 (owner: 10Zfilipin) [11:36:56] (03Merged) 10jenkins-bot: Added wikimedia.template file [integration/jenkins] - 10https://gerrit.wikimedia.org/r/129151 (owner: 10Zfilipin) [11:37:56] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232#c3 (10Željko Filipin) See https://gerrit.wikimedia.org/r/#/c/129151/ [11:40:56] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232#c4 (10Gerrit Notification Bot) Change 129152 had a related patch set uploaded by Hashar: contint: symlink for Jenkins email templates https://gerrit.wikimedia.or... [11:40:57] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232 (10Gerrit Notification Bot) 5ASS>3PAT [11:42:26] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232#c5 (10Antoine "hashar" Musso) I have deployed the integration/jenkins.git repository on gallium using git-deploy and created the symlink myself (it is pending in... [11:44:10] Project browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs build #4: STILL FAILING in 9.7 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs/4/ [11:45:26] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232#c6 (10Antoine "hashar" Musso) 5PAT>3RES/FIX Verified to be working properly \O/ [11:47:50] (03PS1) 10Zfilipin: Moved wikimedia.template to integration/jenkins repository [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129154 [11:48:11] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232 (10Gerrit Notification Bot) 5RES/FIX>3PAT [11:48:11] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232#c7 (10Gerrit Notification Bot) Change 129154 had a related patch set uploaded by Zfilipin: Moved wikimedia.template to integration/jenkins repository https://ger... [11:48:26] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232 (10Željko Filipin) 5PAT>3RES/FIX [11:50:02] (03CR) 10Hashar: [C: 032] "And deployed :-] One less bug!" [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129154 (owner: 10Zfilipin) [11:50:13] (03CR) 10jenkins-bot: [V: 04-1] Moved wikimedia.template to integration/jenkins repository [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129154 (owner: 10Zfilipin) [11:50:43] (03CR) 10Hashar: "recheck" [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129154 (owner: 10Zfilipin) [11:52:31] (03CR) 10Hashar: [C: 032] Moved wikimedia.template to integration/jenkins repository [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129154 (owner: 10Zfilipin) [11:53:15] (03Merged) 10jenkins-bot: Moved wikimedia.template to integration/jenkins repository [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129154 (owner: 10Zfilipin) [11:53:26] 3Wikimedia / 3Continuous integration: E-mail template needs to be copied to $JENKINS_HOME/email-templates - 10https://bugzilla.wikimedia.org/64232#c8 (10Gerrit Notification Bot) Change 129154 merged by jenkins-bot: Moved wikimedia.template to integration/jenkins repository https://gerrit.wikimedia.org/r/129... [11:53:33] (03PS4) 10Zfilipin: Take a screenshot when a test fails [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/127899 [11:53:45] (03CR) 10Zfilipin: Take a screenshot when a test fails (031 comment) [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/127899 (owner: 10Zfilipin) [11:53:58] (03PS5) 10Zfilipin: Take a screenshot when a test fails [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/127899 [11:54:23] (03CR) 10jenkins-bot: [V: 04-1] Take a screenshot when a test fails [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/127899 (owner: 10Zfilipin) [11:56:00] (03CR) 10Hashar: "recheck" [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/127899 (owner: 10Zfilipin) [11:57:32] (03CR) 10Hashar: [C: 032] "Good! Zeljkof deployed / refreshed all the jobs." [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/127899 (owner: 10Zfilipin) [11:57:53] (03Merged) 10jenkins-bot: Take a screenshot when a test fails [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/127899 (owner: 10Zfilipin) [11:58:35] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox build #1: FAILURE in 4.3 sec: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox/1/ [11:58:36] Project browsertests-Flow-test2.wikipedia.org-linux-firefox build #1: FAILURE in 4.3 sec: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-firefox/1/ [11:58:48] Project browsertests-CentralAuth-test2.wikipedia.org-linux-firefox build #1: FAILURE in 20 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralAuth-test2.wikipedia.org-linux-firefox/1/ [11:58:50] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox build #1: FAILURE in 11 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox/1/ [11:58:54] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox build #1: FAILURE in 21 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox/1/ [11:59:00] Project browsertests-MobileFrontend-en.m.wikipedia.org-linux-firefox build #1: FAILURE in 25 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.org-linux-firefox/1/ [11:59:02] Project browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox build #1: FAILURE in 26 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox/1/ [11:59:18] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox build #1: FAILURE in 24 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox/1/ [11:59:19] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox build #2: STILL FAILING in 13 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox/2/ [12:00:04] Project browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox build #1: FAILURE in 1 min 12 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox/1/ [12:01:09] zeljkof, hashar Thanks :) [12:04:21] Project browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox build #1: FAILURE in 5 min 52 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox/1/ [12:05:30] (03PS1) 10Hashar: Avoid error when creating vendor directory [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129156 [12:05:35] kart_: a lot of work done today, including nice e-mail messages [12:05:37] :) [12:05:44] (03CR) 10Hashar: [C: 032] Avoid error when creating vendor directory [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129156 (owner: 10Hashar) [12:06:05] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox build #2: STILL FAILING in 13 sec: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox/2/ [12:06:07] (03Merged) 10jenkins-bot: Avoid error when creating vendor directory [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129156 (owner: 10Hashar) [12:08:52] Project browsertests-test2.wikipedia.org-linux-firefox build #1: FAILURE in 10 min: https://integration.wikimedia.org/ci/job/browsertests-test2.wikipedia.org-linux-firefox/1/ [12:11:16] (03PS1) 10Zfilipin: Split long line into several shorter ones [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129157 [12:13:24] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #1: SUCCESS in 23 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/1/ [12:13:41] (03PS1) 10Hashar: Tweak git scm to keep the workspace between build [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129158 [12:14:16] (03CR) 10Hashar: "That slightly speeds up the jobs startup overhead" [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129158 (owner: 10Hashar) [12:14:21] (03CR) 10Hashar: [C: 032] Tweak git scm to keep the workspace between build [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129158 (owner: 10Hashar) [12:14:21] Project browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox build #1: FAILURE in 15 min: https://integration.wikimedia.org/ci/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox/1/ [12:14:57] (03Merged) 10jenkins-bot: Tweak git scm to keep the workspace between build [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129158 (owner: 10Hashar) [12:15:42] Project browsertests-VisualEditor-test2.wikipedia.org-linux-firefox build #1: ABORTED in 16 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-firefox/1/ [12:15:43] Project browsertests-VisualEditor-production-linux-firefox build #1: ABORTED in 16 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-production-linux-firefox/1/ [12:15:54] they are all failing :-( [12:23:34] (03PS2) 10Hashar: Split long line into several shorter ones [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129157 (owner: 10Zfilipin) [12:24:40] (03CR) 10Hashar: [C: 032] "Refreshed jobs." [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129157 (owner: 10Zfilipin) [12:25:02] (03Merged) 10jenkins-bot: Split long line into several shorter ones [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129157 (owner: 10Zfilipin) [12:41:04] (03Abandoned) 10Addshore: DNM Send coverage info to Coveralls [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/115951 (owner: 10Addshore) [12:41:48] hashar: ^^ [12:42:07] "thanks" (kind of) [12:42:39] so addshore on https://wiki.jenkins-ci.org/display/JENKINS/Clover+PHP+Plugin [12:42:41] there is a trend report [12:42:47] it is not showing up for us though :-(((( [12:43:49] hmm, that sucks! [12:43:53] I wonder why [12:43:59] might rely on another plugin [12:44:47] hmmmm [12:45:03] had any chance to look at the composer stuff yet? :P [12:45:37] also https://integration.wikimedia.org/ci/view/MediaWiki/job/mediawiki-core-code-coverage/cloverphp/trendGraph/png?width=500&height=200 [12:45:44] it does try to load it it would seem [12:46:11] hashar: the graph takes a good 30 seconds + to render [12:46:33] http://new.tinygrab.com/1becbe2e786a6703f4a6996a6e7e6fb329fd8def39.png [12:47:02] ah that is why [12:47:10] the good old jenkins history is painfully slow [12:47:15] :D [12:48:32] the builds history are a bunch of XML files [12:48:48] so it ends up parsing hundred (if not thousands) of them [12:49:23] urgh :P [12:49:31] so thats only going to get slower and slower :P [12:50:24] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #2: SUCCESS in 32 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/2/ [12:55:20] Project UploadWizard-api-commons.wikimedia.org build #1: FAILURE in 36 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/1/ [14:27:40] hashar: have you seen Zeljko today? [14:42:10] chrismcmahon: of course! [14:42:23] chrismcmahon: mail triage this morning and we paired together for like 3 hours or so [14:42:43] chrismcmahon: we fixed a bunch of things such as using the HTML email templates from cloudbees [14:42:47] and got all jobs deployed on wikimedia [14:43:03] Yippee, build fixed! [14:43:03] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox build #20: FIXED in 19 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/20/ [14:43:04] https://integration.wikimedia.org/ci/view/BrowserTests/ [14:43:27] bunch of tests are having issues though most probably because mediawiki selenium gem is outdated in their repo :-( [14:44:01] hashar: no problem, I figured out what happened to the MobileFrontend builds. I thought Zeljko might have broken them, but it was the MF trying to use jsduck that broke all the builds. [14:44:13] hashar: sent you email just now [14:46:15] chrismcmahon: have you got it fixed ? :) [14:46:33] hashar: no, I'm going to let the MF team fix it [14:46:51] sounds good [14:47:25] make sure to bug fill it / ping them :] [14:49:14] hashar: any idea why this is not running? https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/lastCompletedBuild/consoleFull [14:49:32] hashar: I don't see any sign of an error in that log [14:50:11] 3Wikimedia / 3Quality Assurance: Move jobs from Cloudbees Jenkins to WMF Jenkins - 10https://bugzilla.wikimedia.org/58040#c37 (10Gerrit Notification Bot) Change 128467 merged by jenkins-bot: Do not display link to Sauce Labs when using local browser https://gerrit.wikimedia.org/r/128467 [14:50:41] 3Wikimedia / 3Quality Assurance: Move jobs from Cloudbees Jenkins to WMF Jenkins - 10https://bugzilla.wikimedia.org/58040#c38 (10Gerrit Notification Bot) Change 128466 merged by jenkins-bot: Do not display link to Sauce Labs when using local browser https://gerrit.wikimedia.org/r/128466 [14:52:32] hashar: looks like it didn't create logs properly on the build finishing. seems like the tests ran and passed though. compare to https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/17/consoleFull [14:53:54] chrismcmahon: looking [14:54:03] ah man [14:54:07] Zeljkof was right damn [14:54:20] seems like it is not taking any screenshot [14:54:24] and we need to create the log dir [15:02:29] (03PS1) 10Hashar: Make sure we have a '/log' directory [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129184 [15:08:18] (03PS1) 10Hashar: Explode a long line in ZeroRatedMobileAccess [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129186 [15:08:21] (03PS1) 10Hashar: Write junit report under /log/junit/ [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129187 [15:08:40] hashar: so if the log dir exists, that VE build should go green then? [15:08:46] yup [15:08:51] I am redeploying all the jobs [15:09:08] we should pair together one day so I can introduce you to JJB :] [15:09:36] hashar: I just kicked off the VE build [15:09:59] (03CR) 10Hashar: [C: 032] "Super straightforward. The archiver would fail because /log/ did not exist." [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129184 (owner: 10Hashar) [15:10:12] hashar: what about next week sometime? I am going to be working from the eastern US, 3 or 4 timezones closer to you [15:10:20] (03Merged) 10jenkins-bot: Make sure we have a '/log' directory [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129184 (owner: 10Hashar) [15:10:48] (03CR) 10Hashar: [C: 032] "We talked about it with Zeljkof. Sounds like a good code hygiene." [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129186 (owner: 10Hashar) [15:10:56] chrismcmahon: that is awesome (the TZ) [15:11:13] (03Merged) 10jenkins-bot: Explode a long line in ZeroRatedMobileAccess [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129186 (owner: 10Hashar) [15:11:36] chrismcmahon: any day will work. What about monday? [15:11:54] just invite my wikimedia email amusso at wikimedia.org :] [15:12:53] (03CR) 10Hashar: [C: 032] "This is needed to fix up the VE build which fails because there is no Junit report :-(" (031 comment) [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129187 (owner: 10Hashar) [15:12:56] hashar: OK [15:13:23] (03Merged) 10jenkins-bot: Write junit report under /log/junit/ [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129187 (owner: 10Hashar) [15:14:05] chrismcmahon: if you feel brave, you can have a look at https://www.mediawiki.org/wiki/CI/JJB :] [15:14:24] that should give all the instruction to install and configure jjb on your machine [15:25:04] chrismcmahonbrb: we will have to find a way to speed up the tests [15:25:13] to run them more often 8) [15:28:25] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox build #21: STILL FAILING in 19 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/21/ [15:31:56] 3Wikimedia / 3Quality Assurance: Move jobs from Cloudbees Jenkins to WMF Jenkins - 10https://bugzilla.wikimedia.org/58040#c39 (10Gerrit Notification Bot) Change 128464 merged by jenkins-bot: Do not display link to Sauce Labs when using local browser https://gerrit.wikimedia.org/r/128464 [15:37:31] (03CR) 10Chad: [C: 032] Add git submodule update to hhvm build [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129090 (owner: 10BryanDavis) [15:48:44] hashar: it is possible to run tests in parallel, but I question the need to run them much more often than they run right now. [15:52:55] chrismcmahon: okkk [15:52:58] and https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/21/console failled :( [15:55:21] hashar: [15:55:22] 15:28:25 No test report files were found. Configuration error? 15:28:25 Build step 'Publish JUnit test result report' changed build result to FAILURE [15:56:22] (03PS1) 10Hashar: Use YAML anchors and alias to maintain emails lists [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129200 [15:56:24] yeah looking at it [15:56:49] (03CR) 10jenkins-bot: [V: 04-1] Use YAML anchors and alias to maintain emails lists [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129200 (owner: 10Hashar) [15:57:17] (03CR) 10Hashar: "recheck" [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129200 (owner: 10Hashar) [15:59:20] (03CR) 10Hashar: "Zeljkof, Chris: the use of aliases looks easier to me and would let us trivially add new addresses to multiple jobs. The diff is a noop :" [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129200 (owner: 10Hashar) [16:01:16] chrismcmahon: ah you triggered the VE job just before the conf got updated :-] [16:01:25] rebuilding it [16:01:29] hashar: argh. thanks [16:20:42] Yippee, build fixed! [16:20:42] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox build #22: FIXED in 19 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/22/ [16:24:49] chrismcmahon: fixed! [16:24:52] hashar: nice! ^^ and it's really fast compared to Cloudbees too [16:24:54] the XML files are captured [16:25:18] https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/22/testReport/(root)/VisualEditor%20Bullets,%20Numbering/ :D [16:25:25] well I am pretty sure we can make them faster [16:25:54] wife & daughter back home [16:25:58] * hashar eescapes [16:26:24] might be there tonight, nothing sure though :] [16:36:53] chrismcmahon: "FAILURE: … 0 failed, 0 skipped". I'm confused. :-) [16:37:21] James_F: sorry, I should take your email off the build. That [16:37:38] (03CR) 10Nikerabbit: "Yes I should." [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/129200 (owner: 10Hashar) [16:37:52] chrismcmahon: No, I'm happy to get them, just a bit confused. :-) [16:37:53] James_F: that is the headless Firefox build being tweaked earlier today: https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/ [16:37:58] * James_F nods. [16:38:35] James_F: the builds weren't logging properly there for a while so you'd get all tests pass but the build fail [16:38:42] Aha. [16:39:02] Roan was poking around the browser tests finding ways to speed them up. [16:39:57] James_F: yes, we saved 5s per test the other day. also, just running from WMF Jenkins is hugely faster than Cloudbees, and once we have some real parallel stuff going it'll be more [16:40:18] chrismcmahon: The new don't-show-warning-on-exit-without-saving option? [16:40:30] James_F: yes [16:40:35] * James_F nods. [16:40:37] honoring that preference [18:06:50] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox build #3: STILL FAILING in 6.3 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox/3/ [18:08:36] Project browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox build #12: SUCCESS in 52 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox/12/ [18:08:37] zeljko.filipin: Features should have unique names [18:12:31] Project browsertests-MobileFrontend-en.m.wikipedia.org-linux-firefox build #2: STILL FAILING in 4 min 48 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.org-linux-firefox/2/ [18:12:32] * jrobson: CSS Regression: Restore blue tutorial button in beta/alpha Special:Uploads [18:12:32] * jrobson: QA: Restore correct Gemfile [18:23:05] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox build #15: STILL FAILING in 7 min 21 sec: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox/15/ [18:23:06] zeljko.filipin: Do not display link to Sauce Labs when using local browser [18:24:43] chrismcmahon: Would you be available to tak about VE browser testing stuff at 2pm PDT today? [18:24:44] (I would convert to your local timezone but I've lost track of where you are when) [18:25:07] RoanKattouw: sure. (I'm the same as PDT right now, in Tucson AZ) [18:25:45] Aah OK [18:26:51] Last I heard you lived in Durango, CO :) [18:27:45] Project browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs build #5: STILL FAILING in 1.2 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroRatedMobileAccess-en.m.wikipedia.org-linux-phantomjs/5/ [18:29:17] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox build #14: STILL FAILING in 9 min 31 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox/14/ [18:29:17] zeljko.filipin: Features should have unique names [18:29:49] Project browsertests-VisualEditor-test2.wikipedia.org-linux-firefox build #2: FAILURE in 17 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-firefox/2/ [18:30:45] Project browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox build #2: STILL FAILING in 2 min 1 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox/2/ [18:33:48] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox build #23: FAILURE in 20 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/23/ [18:35:51] Project browsertests-Flow-test2.wikipedia.org-linux-firefox build #2: STILL FAILING in 7.3 sec: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-firefox/2/ [18:35:51] * git: Remove unused uses [18:35:52] * amir.aharoni: Removing an unnecessary GENDER clause [18:36:51] Project browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox build #2: STILL FAILING in 6 min 51 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox/2/ [18:36:52] * santhosh.thottingal: Add html to wikitext conversion [18:36:52] * amire80: Update version [18:36:53] * santhosh: Add new lines for improving readability [18:37:52] Project browsertests-Translate-sandbox.translatewiki.net-linux-firefox build #13: STILL FAILING in 5 min 8 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-sandbox.translatewiki.net-linux-firefox/13/ [18:37:52] zeljko.filipin: Do not display link to Sauce Labs when using local browser [18:40:22] Project browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox build #2: STILL FAILING in 18 min: https://integration.wikimedia.org/ci/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox/2/ [18:40:54] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox build #15: FAILURE in 3 min 10 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox/15/ [18:40:54] * zeljko.filipin: Do not display link to Sauce Labs when using local browser [18:40:55] * neverett: Get browser tests passing for new highlighter [18:40:55] * neverett: Extra defensiveness around reindex timeout [18:40:56] * neverett: When testing force job updates on page views [18:42:48] Project browsertests-CentralAuth-test2.wikipedia.org-linux-firefox build #2: STILL FAILING in 4.4 sec: https://integration.wikimedia.org/ci/job/browsertests-CentralAuth-test2.wikipedia.org-linux-firefox/2/ [18:42:57] reee [18:43:51] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox build #3: STILL FAILING in 7.6 sec: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox/3/ [18:43:52] * git: Remove unused uses [18:43:52] * amir.aharoni: Removing an unnecessary GENDER clause [18:44:49] bd808: I am not sure why the beta jenkins jobs are stalling :/ [18:45:15] (pending—Waiting for next available executor on deployment-bastion.eqiad) [18:45:17] stupid jenkins [18:45:18] really [18:45:52] hashar: Me neither. :( I've tried killing the client twice and am now playing whack-a-mole with the jobs [18:46:07] so there is a crazy bug somewhere [18:46:14] most probably in Jenkins [18:46:28] the master apparently see the slave as 5 executors [18:46:35] but somehow consider all of them busycurrently [18:46:44] (I am looking at https://integration.wikimedia.org/ci/computer/deployment-bastion.eqiad/ ) [18:47:18] manybubbles: are you hacking on beta labs now? http://en.wikipedia.beta.wmflabs.org/w/index.php?search=used+by+selenium&title=Special%3ASearch&go=Go [18:47:52] bd808: that might be due to the Gearman plugin though [18:47:53] no [18:48:06] let me ping reedy - it might be him that busted it because he's been playing there [18:48:08] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #3: SUCCESS in 24 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/3/ [18:48:24] hashar: It seems to fall down during a run of the database update matrix job each time [18:48:33] But that's just anidotal [18:48:50] anecdotal [18:48:59] thanks manybubbles [18:50:18] Project browsertests-Translate-meta.wikimedia.org-linux-firefox build #13: SUCCESS in 35 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-meta.wikimedia.org-linux-firefox/13/ [18:50:19] zeljko.filipin: Do not display link to Sauce Labs when using local browser [18:51:59] hashar: This all seemed to start when we added the job spawning steps to the update jobs. Maybe I should rethink that. [18:52:10] they would block each other ? [18:52:21] i.e. the config-update running might be blocking the scap job somehow [18:52:35] we can do the upstream -> downstream in Zuul [18:52:49] i.e. zuuli would run the config update, then if it works trigger the scap one with the same parameters [18:52:55] chain them like: [18:53:21] postmerge: [18:53:21] - beta-mediawiki-config-update-eqiad: [18:53:21] - beta-scap-eqiad [18:53:37] Project browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox build #2: STILL FAILING in 29 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox/2/ [18:53:38] * jrobson: CSS Regression: Restore blue tutorial button in beta/alpha Special:Uploads [18:53:38] * jrobson: QA: Restore correct Gemfile [18:54:26] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox build #15: STILL FAILING in 42 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox/15/ [18:54:26] * zeljko.filipin: Do not display link to Sauce Labs when using local browser [18:54:26] * neverett: Get browser tests passing for new highlighter [18:54:27] * neverett: Extra defensiveness around reindex timeout [18:54:28] * neverett: When testing force job updates on page views [18:54:53] reedy is on the case [18:54:59] That would work for the mw-config job; we'd need something else for the mw-core job [18:55:03] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox build #2: STILL FAILING in 19 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox/2/ [18:55:04] Project UploadWizard-api-commons.wikimedia.org build #2: STILL FAILING in 20 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/2/ [19:04:13] Project browsertests-test2.wikipedia.org-linux-firefox build #2: STILL FAILING in 5 min 29 sec: https://integration.wikimedia.org/ci/job/browsertests-test2.wikipedia.org-linux-firefox/2/ [19:08:04] hashar: It's a lock conflict of some sort. [19:08:16] bd808: have you done anything? [19:08:36] bd808: that might just be a bug in the gearman server which is in between zuul and jenkins [19:08:39] I just manually changed the configs in Jenkins to spawn the scap as a post-build step instead of as a build step [19:08:52] oh [19:09:04] Then I got some "I can't start because downstream is running" errors [19:09:18] I kept killing jobs until that cleared [19:09:40] what do you think about having both jobs triggered from Zuul ? [19:09:43] So I created a deadlock somehow with the 3 jobs [19:09:46] instead of Jenkins downstream mecanism? [19:10:21] We'd need to add a zuul trigger for beta-code-update-eqiad too I think [19:11:05] Right now beta-code-update-eqiad > beta-scap-eqiad && beta-mediawiki-config-update-eqiad > beta-scap-eqiad [19:12:22] mw-config is fired from zuul, but the code-update job is just on a cron timer [19:12:59] sorry kid alarm [19:13:07] If it was triggered from zuul it wold have to watch all extensions and core I guess which seems potentially fragile [19:13:37] ah yeah [19:13:39] I remember about that [19:14:05] Zuul could make use of some wildcard to trigger a job on a bunch of repos [19:14:10] like mediawiki/extensions/* [19:15:50] What I think we really want there is "run this job if something has changed in mw-core or wm/ext/* but only run once every N minutes"? [19:16:13] Which... I have no idea if zuul can do such a thing [19:17:35] on top of my head, I dont think [19:17:45] the mediawiki/ext/* wildcard, definitely not [19:17:50] but that can be implemented [19:18:45] Can we leave things with the post-build trigger setup for a couple of days and see if the lockup problem goes away? [19:19:04] sure :) [19:19:41] the only drawback is that if scap fails, the job will stil be a success [19:20:23] Yeah. I'll setup the email alert on scap again. I think that qa-l is holding the emails from jenkins in a moderation queue somewhere too. [19:21:09] But technically, the update jobs are done once the update the stage dir :) From there it's a scap problem to update the working copies. [19:28:59] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox build #2: STILL FAILING in 37 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox/2/ [19:28:59] * jrobson: CSS Regression: Restore blue tutorial button in beta/alpha Special:Uploads [19:29:00] * jrobson: QA: Restore correct Gemfile [19:29:00] * maxsem.wiki: Fix fatal in Special:MobileLanguages [20:35:41] 3Wikimedia / 3Quality Assurance: Move jobs from Cloudbees Jenkins to WMF Jenkins - 10https://bugzilla.wikimedia.org/58040#c40 (10Gerrit Notification Bot) Change 128470 merged by jenkins-bot: [Browser tests] Do not display link to Sauce Labs when using local browser https://gerrit.wikimedia.org/r/128470 [20:38:03] chrismcmahon: I may show up a bit later than 2 if that's OK, because right now is my only opportunity today to have lunch [20:38:15] sure RoanKattouw_away take your time [20:38:37] Thanks man [21:00:52] (03PS2) 10Hashar: Add git submodule update to hhvm build [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129090 (owner: 10BryanDavis) [21:01:47] (03CR) 10Hashar: [C: 04-1] "You can instruct the git plugin to fetch submodules (it doesn't by default) and set the recursive option to be safe (I have no idea what i" (031 comment) [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/129090 (owner: 10BryanDavis) [22:01:08] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox build #24: STILL FAILING in 21 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox/24/ [22:01:08] * roan.kattouw: [Browser tests] Move "I can click the X on the save box" to shared_steps.rb [22:01:09] * roan.kattouw: [Browser tests] Fix typo in file name [22:01:09] * jforrester: [Browser tests] Do not display link to Sauce Labs when using local browser [22:01:10] * krenair: Check cascade protection and show notice if relevant [22:01:10] * jforrester: Update jquery.uls from 601a5256b8 To 1932de9e347d [22:01:11] * roan.kattouw: Unbreak badtoken recovery on mobile [22:01:11] * krenair: Apply PST when generating diff [22:01:12] * l10n-bot: Localisation updates from https://translatewiki.net. [22:01:26] phooey [22:02:35] eh, only one failure, and that is likely performance [22:06:31] chrismcmahon: Hey, are you OK postponing till 4? I got held up and now I'm in a meeting :S [22:07:36] RoanKattouw_away: I'm good :-) just touring the chaos that is WMF Jenkins browsertests setting up targets for tomorrow [22:08:54] Yeah I figured you were having plenty of fun from the wmf-insecte output