[00:00:17] (03CR) 10Krinkle: "Compiled and pushed to Jenkins, https://integration.wikimedia.org/ci/job/mwext-DonationInterface-npm/" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156193 (owner: 10Jforrester) [00:05:17] beta should be normal again [00:19:19] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #190: ABORTED in 5 min 23 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/190/ [00:29:39] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #219: ABORTED in 15 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/219/ [00:46:30] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #595: SUCCESS in 29 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/595/ [00:53:30] Project UploadWizard-api-commons.wikimedia.org build #477: SUCCESS in 29 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/477/ [01:01:19] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #220: STILL FAILING in 31 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/220/ [01:16:53] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #191: STILL FAILING in 57 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/191/ [01:38:39] 3Wikimedia Labs / 3deployment-prep (beta): mwdeploy user has shell /bin/bash in labs LDAP and /bin/false in production/Puppet - 10https://bugzilla.wikimedia.org/65591#c10 (10Tim Landscheidt) Ah. And that seems to relate to the subversion module where users apparently were only allowed to execute "svnserve -... [02:05:30] Project beta-scap-eqiad build #18795: FAILURE in 1 min 35 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18795/ [02:15:02] Yippee, build fixed! [02:15:02] Project beta-scap-eqiad build #18796: FIXED in 1 min 4 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18796/ [03:05:10] Project browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs build #99: STILL FAILING in 9.7 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs/99/ [03:13:46] Project browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce build #3: SUCCESS in 7 min 45 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce/3/ [03:14:00] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce build #96: STILL FAILING in 10 min: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce/96/ [03:14:30] Yippee, build fixed! [03:14:30] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #67: FIXED in 43 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/67/ [03:15:54] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #123: SUCCESS in 1 min 52 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/123/ [03:19:20] Project browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce build #124: STILL FAILING in 1 min 20 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce/124/ [03:31:08] Yippee, build fixed! [03:31:09] Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #129: FIXED in 11 min: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/129/ [03:32:13] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce build #134: STILL FAILING in 1 min 4 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce/134/ [03:33:17] Yippee, build fixed! [03:33:18] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #100: FIXED in 1 min 3 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/100/ [03:41:54] Project browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce build #109: STILL FAILING in 40 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce/109/ [03:46:51] Yippee, build fixed! [03:46:51] Project browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce build #40: FIXED in 50 sec: https://integration.wikimedia.org/ci/job/browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce/40/ [03:53:37] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #180: STILL FAILING in 39 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/180/ [03:54:47] Project browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce build #96: SUCCESS in 1 min 9 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce/96/ [04:02:44] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #16: STILL FAILING in 7 min 55 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/16/ [04:32:59] Project browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce build #145: STILL FAILING in 51 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/145/ [04:37:41] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #159: STILL FAILING in 34 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/159/ [04:38:45] Yippee, build fixed! [04:38:45] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #56: FIXED in 1 min 2 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/56/ [04:39:27] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce build #140: STILL FAILING in 1 hr 6 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce/140/ [04:51:29] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #141: STILL FAILING in 12 min: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/141/ [04:53:34] Yippee, build fixed! [04:53:35] Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #100: FIXED in 2 min 4 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/100/ [04:53:36] Project browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce build #85: STILL FAILING in 1.7 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce/85/ [05:01:49] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #3: STILL FAILING in 8 min 11 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/3/ [05:02:45] Project browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce build #124: SUCCESS in 54 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce/124/ [05:04:02] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce build #99: SUCCESS in 1 min 16 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce/99/ [05:04:46] Yippee, build fixed! [05:04:47] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #67: FIXED in 44 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/67/ [05:05:00] Project beta-scap-eqiad build #18815: FAILURE in 1 min 2 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18815/ [05:14:57] Yippee, build fixed! [05:14:58] Project beta-scap-eqiad build #18816: FIXED in 1 min 2 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18816/ [05:30:13] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #164: STILL FAILING in 50 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/164/ [05:33:26] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #221: STILL FAILING in 1 hr 0 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/221/ [06:00:47] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #192: STILL FAILING in 56 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/192/ [06:15:28] (03CR) 10Hashar: [C: 032] "As you said yesterday :)" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/156197 (owner: 10Addshore) [06:15:31] (03Merged) 10jenkins-bot: Remove wdj-apply-settings.sh [integration/jenkins] - 10https://gerrit.wikimedia.org/r/156197 (owner: 10Addshore) [06:18:14] Project browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce build #129: STILL FAILING in 48 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce/129/ [06:32:30] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #169: STILL FAILING in 59 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/169/ [06:34:44] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #124: SUCCESS in 2 min 12 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/124/ [06:41:37] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #114: STILL FAILING in 40 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/114/ [06:43:22] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #125: SUCCESS in 1 min 44 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/125/ [06:43:58] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #3: SUCCESS in 9 min 13 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/3/ [06:46:15] Project browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce build #111: STILL FAILING in 27 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce/111/ [06:48:49] Project browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce build #126: SUCCESS in 2 min 31 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce/126/ [06:50:28] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #125: SUCCESS in 1 min 38 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/125/ [07:16:03] Project browsertests-Translate-sandbox.translatewiki.net-linux-firefox-sauce build #95: STILL FAILING in 25 min: https://integration.wikimedia.org/ci/job/browsertests-Translate-sandbox.translatewiki.net-linux-firefox-sauce/95/ [07:24:30] Project browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce build #112: STILL FAILING in 41 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce/112/ [07:25:42] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #68: SUCCESS in 1 min 10 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/68/ [07:35:46] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #128: SUCCESS in 19 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/128/ [07:36:14] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #596: SUCCESS in 28 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/596/ [07:36:51] Project UploadWizard-api-commons.wikimedia.org build #478: SUCCESS in 36 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/478/ [07:43:35] Project browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce build #142: STILL FAILING in 59 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce/142/ [09:01:00] Project browsertests-VisualEditor-production-linux-firefox-sauce build #14: STILL FAILING in 1 hr 35 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-production-linux-firefox-sauce/14/ [12:12:13] (03PS1) 10Hashar: Migrate mediawiki-core-qunit to Zuul cloner [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 [12:16:05] (03PS2) 10Hashar: Migrate mediawiki-core-qunit to Zuul cloner [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 [12:28:16] (03PS3) 10Hashar: Migrate mediawiki-core-qunit to Zuul cloner [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 [12:31:38] hashar: Can you be in #wikimedia-dev? Tried a couple times lately and thought you weren't online.. [12:33:15] Krinkle: na I left that channel a long time ago. There is too much spam there [12:34:12] (03CR) 10Krinkle: "Hm.. doesn't feel right to have that arbitrary stuff in -qunit. What about mw-install-sqlite and literally single other macro that operate" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 (owner: 10Hashar) [12:37:27] (03PS1) 10Addshore: Switch from experimental to test and gate for wikibase [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156270 [12:37:59] (03PS2) 10Addshore: Switch from experimental to test and gate for wikibase [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156270 [12:38:23] (03CR) 10Hashar: "Can probably make it a bit smarter. Meanwhile I need to adjust the qunit-querystring that injects settings in $WORKSPACE/LocalSettings.ph" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 (owner: 10Hashar) [12:41:46] (03Abandoned) 10Addshore: Add composer-install-extensions builder [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/125042 (owner: 10Addshore) [12:41:49] (03Abandoned) 10Addshore: Add extension composer-install bash script [integration/jenkins] - 10https://gerrit.wikimedia.org/r/125041 (owner: 10Addshore) [12:46:26] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #597: SUCCESS in 25 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/597/ [12:53:38] Project UploadWizard-api-commons.wikimedia.org build #479: SUCCESS in 27 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/479/ [12:54:10] (03PS4) 10Hashar: Migrate mediawiki-core-qunit to Zuul cloner [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 [13:00:53] Krinkle: mediawiki-core-qunit job using mediawiki/vendor as a dependency https://integration.wikimedia.org/ci/job/mediawiki-core-qunit2/1/console \O/ [13:08:46] (03PS5) 10Hashar: Migrate mediawiki-core-qunit to Zuul cloner [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 [13:29:50] (03CR) 10Hashar: [C: 032] "That fix the qunit job for a mediawiki/core change that depends on mediawiki/vendor : https://gerrit.wikimedia.org/r/#/c/119941/" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 (owner: 10Hashar) [13:31:51] (03Merged) 10jenkins-bot: Migrate mediawiki-core-qunit to Zuul cloner [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 (owner: 10Hashar) [13:36:16] hashar: Hm.. Direct clones from gerrit? Not local hardlink/replica? [13:36:28] That clone took 3 minutes [13:36:40] https://integration.wikimedia.org/ci/job/mediawiki-core-qunit2/1/consoleFull [13:37:03] yeah [13:37:06] then it will clean -xqdf [13:37:18] just like the Jenkins git plugin option "clean workspace" [13:37:36] that is what we are going to do with the disposable sandboxes anyway [13:37:41] or maybe use a shallow clone [13:37:57] Yes, but in that case you'll want --depth 10 or something like that [13:37:59] or have the sandbox instance to be pre populated with some archive of all the git repos [13:38:03] That's what Travis CI does too [13:38:08] but Iam not sure how much it will slowdown an instance creation [13:38:12] should be quick enough [13:38:30] you'd have to keep the archive up to date, and it takes up space, and lots of data duplication. [13:38:44] It doesn't use git clean right now [13:38:45] https://integration.wikimedia.org/ci/job/mediawiki-core-qunit2/2/console [13:38:51] we can update it once per week or so [13:39:00] It rm -rf,ed and new clone, *not* like git clena worksspace [13:39:12] when fetching from Zuul merger, git would grab the missing objects [13:40:24] I don't mean to intervene, but just saying, right now -qunit2 does not optimise with either local disk gerrit repl, nor does it do limited depth or re-use git repo / clean workspace. none of the three optimisations we use, that's too slow for the real job imho. [13:40:49] Krinkle: that second run clone again probably because I wiped that workspace [13:40:52] https://integration.wikimedia.org/ci/job/mediawiki-core-qunit/27308/consoleFull [13:40:54] is a rerun [13:40:57] and it does not reclone [13:41:27] k [13:43:06] hashar: btw, what stuff in vendor is used right now? I don't have either composer or mw/vendor checked out in my core. Stuff seems to work fine. No warnings, no test failures. [13:43:20] (03PS1) 10Hashar: mediawiki/vendor now triggers qunit job [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156277 [13:43:36] (03CR) 10Hashar: "mediawiki-core-qunit is triggered on mediawiki/vendor changes with https://gerrit.wikimedia.org/r/156277" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156268 (owner: 10Hashar) [13:43:59] (03CR) 10Hashar: [C: 032] mediawiki/vendor now triggers qunit job [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156277 (owner: 10Hashar) [13:44:12] (03Merged) 10jenkins-bot: mediawiki/vendor now triggers qunit job [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156277 (owner: 10Hashar) [13:46:32] Krinkle: yeah nothing depends on vendor repo yet [13:46:53] Krinkle: Bryan has been kind enough to wait for me to update our jenkins jobs to support core+vendor being run together [13:46:57] which was not that trivial [13:47:10] but it is done now. So I guess the change will land "soon" ™ [13:47:19] people will have to clone vendor or use composer [13:47:32] for tarball users, the vendor repo will be included [13:57:47] (03PS1) 10Hashar: Give a name to mediawiki/core gating queue [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156280 [13:58:24] hashar: I guess you'll want the mediawiki-core-* job in mediawiki/vendor to checkout the commit in vendor, not in core. [13:58:25] https://integration.wikimedia.org/ci/job/mediawiki-core-qunit/27310/consoleFull [13:58:31] It's cool that zuul-merger can do that though [13:58:32] I like it [13:58:41] 13:45:46 DEBUG:zuul.Cloner:Project mediawiki/core in Zuul does not have ref refs/zuul/master/Z51343a374d13404e9984c700a3fd190b [13:58:41] 13:45:46 DEBUG:zuul.Cloner:Falling back to branch master [13:59:00] Ah, it tries in both. [13:59:02] interesting. [13:59:16] (03PS2) 10Hashar: Give a name to mediawiki/core gating queue [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156280 [13:59:28] So it's aware of custom branches? (e.g. wmf or REL) [14:00:07] (03CR) 10Hashar: [C: 032] Give a name to mediawiki/core gating queue [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156280 (owner: 10Hashar) [14:00:16] (03Merged) 10jenkins-bot: Give a name to mediawiki/core gating queue [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156280 (owner: 10Hashar) [14:01:00] Krinkle: that took me a while to figure out how Zuul handled cross repository dependencies when entering changes in the dependent pipeline (i.e. the gate) [14:01:05] so I went to document it at http://ci.openstack.org/zuul/gating.html#cross-projects-dependencies [14:01:14] (03CR) 10Addshore: [C: 04-1] Add jobs for wikibase (031 comment) [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156114 (owner: 10Addshore) [14:01:14] and wrote a python client that implement the logic [14:01:32] Krinkle: if you have in the gate two changes A -> B [14:01:37] ideally it wouldn't have to try an expensive fetch in both and just tell it which one the real one is (if == ZUUL_PROJECT?) [14:01:43] for B , Zuul creates an additional reference for A [14:01:47] which you can thus fetch if needed [14:02:05] so if you have A made against 'vendor' followed up by B made against 'core' [14:02:11] Yeah, that's nice. [14:02:17] when running tests for B, you can fetch the future state of 'vendor' as if A has been merged [14:02:36] which is completely crazy && clever && smart [14:02:46] but when commiting plainly to mediawiki/vendor, that git hash isn't going to exist in meidawiki/core, it's a separate repo. [14:02:48] nit thing: upstream just loved the idea of having it done via a python script [14:02:53] they are currently using a bunch of shell script [14:02:55] On https://integration.wikimedia.org/ci/job/mediawiki-core-qunit/27310/consoleFull it tried to fetch the same ref from both. [14:03:09] and they are already updating the python script I wrote and will eventually switch to it [14:03:29] Yeah, that's quite nice. I guess that's another advantage of having a separate merger. [14:04:24] I think a patch has been proposed to have the merger optionally back in zuul main process [14:04:43] anyway if you have a gate queue A -> B -> C [14:04:46] and propose a change D [14:04:55] Zuul merger will create references for all those repositories [14:05:09] (assuming they are part of the same shared queue, i.e. all repositories have a common job) [14:05:24] which is the case for core and vendor repository. They share mediawiki-core-qunit and mediawiki-vendor-integration [14:05:35] (the later is a terrible name) [14:05:56] i would love to offer a graphical representation of the changes being used [14:06:10] yeah, but the merge commit created in git/mediawiki/vendor isn't going to exist in mediawiki/core [14:06:21] in the case of that pipeline, they'd each have their own merge commit [14:06:34] right? [14:06:52] yup [14:06:57] which might end up being the same result [14:07:03] but different commits / different zuul ref [14:07:11] the merger is not smart enough to reuse existing merges [14:07:18] it just create new ones [14:07:21] Maybe it's not ready yet, sorry if I'm poking too soon. I just notice that on https://integration.wikimedia.org/ci/job/mediawiki-core-qunit/27310/consoleFull it is doing a git fetch for the mediawiki-vendor zuul merge commt in mediawiki-core [14:07:30] that seems a bit primitive / inefficient. [14:08:25] that job has been triggered by a change made to vendor [14:08:36] yes [14:08:42] and the cloner has no idea whether the change depends on some other changes in a depednentpipeline (i.e. gate) [14:09:03] so it fetch to figure out whether a ref is available [14:09:06] and fallback to master if not [14:09:17] if we had a change previously, Zuul merger would have created the ref for it [14:09:30] ie core @ refs/zuul/master/Z51343a374d13404e9984c700a3fd190b [14:09:38] same id? [14:09:41] yeah [14:09:45] hm.. [14:09:49] the Zuul id Zxxxxx is the same for the change [14:09:58] but it might be reused on different repos / commits [14:10:10] so you can look up that references in other repositories [14:10:46] whenever we get a common job shared by the 200+ extensions we have [14:10:54] and folks CR+2 20 - 30 changes in a row [14:10:58] things will start being interesting [14:11:10] that would yield something like 4000 - 6000 merge commits [14:11:25] that is why we would need more mergers eventually [14:11:46] a nice thing with that system [14:11:55] is that we can test VisualEditor / Parsoid together [14:12:01] though I am not sure yet how to write the jobs for it [14:12:07] potentially we could have: [14:12:17] a) Visualeditor proposed patchset + Parsoid @ master [14:12:24] B) Visualeditor proposed patchset + Parsoid @ production [14:12:38] c) Parsoid proposed patchset + VisualEditor@ master [14:12:41] c) Parsoid proposed patchset + VisualEditor@ production [14:12:46] (that last is (d) ) [14:13:03] and thus ensure patches made to the master branch are back compatible with whatever we have in prod [14:13:16] and we could enroll ooui and oojs as well [14:17:12] (03CR) 10Addshore: "Our current tests only test against master of mediawiki so no need to worry!" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156114 (owner: 10Addshore) [14:43:28] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #193: ABORTED in 27 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/193/ [14:57:26] hashar: Sounds good, but complicated. [14:57:57] James_F: I wrote a python script that just does that :] [14:58:10] I have yet to figure out how to invoke it properly though hehe [15:04:18] hashar: :-) [15:04:34] hashar: I meant more that it sounds complex for (a) testing and (b) working out what is "production". [15:05:02] Note that Parsoid production is a manually-created cherry-pick of master pushed out manually on Mondays and Wednesdays when the Parsoid team are happy with it. [15:05:51] James_F: yeah I guess we will have to revisit the workflow with Parsoid team. Maybe a branch / tag would work [15:06:05] * James_F nods [15:06:23] I have completed mediawiki/core + mediawiki/vendor being tested together [15:06:31] will probably attempt to bring in some wmf deployed extensions now [15:06:48] Nice. [15:11:04] greg-g: mediawiki/vendor and mediawiki/core are now being tested together \O/ :D [15:11:23] though mw extensions stil solely rely on mediawiki/core :-/ [15:12:28] hashar: niice! [15:12:30] bd808: ^ [15:12:44] for extensions it is going to be a mess [15:12:55] Yippee, build fixed! [15:12:55] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #222: FIXED in 57 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/222/ [15:13:01] cause currently we test extension @ REL1_23 against mediawiki/core @ master [15:13:12] when we should test the extension with core using the same branch [15:13:18] * greg-g nods [15:13:18] greg-g: I saw that on my phone when I got up this morning! hashar is a rockstar [15:13:24] and from my test, a few extensions would no more pass tests when being tested against a REL branch [15:13:51] bd808: oh i would be a rock star the day 1 more people has deep knowledge about all that mess :-D [15:13:58] * bd808 looks for the next 4 month crazy project to send hashar [15:14:01] (to be fair Timo definitely has) [15:14:19] bd808: my little Zuul cloner has been accepted by upstream (OpenStack) [15:14:30] they already enhanced it and are planning to switch their infra to it [15:14:37] (superseding their old shell scripts) [15:15:02] sweet. You made the world better [15:15:04] hashar: to be explicit: testing master extension against MW REL1_23 (sometimes) doesn't pass? [15:15:23] greg-g: testing REL extension against REL core does not pass sometime [15:15:27] s/sometimes/often/ [15:15:28] due to some API changes in our PHP classes [15:15:34] well that seems wrong [15:15:41] so folks amend their extension REL branch to have tests pass with core@master :-D [15:15:50] yeah that is wrong [15:15:52] :) [15:16:00] though at the sametime I am not aware of any bug report because of this [15:16:07] greg-g: we don't subtract from api but we add a lot [15:16:29] what I am probably going to do is add a non voting job that test the extension with the proper mw/core branch [15:16:35] trigger dummy jobs for all of them [15:16:39] and fill bugs [15:16:42] yeah, but a REL and a REL, of the same point in time, *should* pass [15:17:14] course, we haven't had any auto testing of that before, so our RELs have no garauntee to pass with each other [15:18:07] extensions in REL1_23 do not pass together [15:18:13] but the one from master more or less pass together [15:18:23] * greg-g nods [15:18:29] the idea is to have all wmf deployed extensions to run a shared job [15:18:34] that will clone all of them [15:18:36] well, here's hoping for REL1_24 [15:18:42] checkout the proper branches from them and unleash the tests [15:19:03] maybe we can backport a bunch of changes for REL1_23 , but yeah seems better to target REL1_24 [15:19:14] look to the future and all [15:19:41] long term goal: get rid of mw/core wmf branches and their submodules [15:20:20] cause soon ™, whenever a patch is merged for an extension, we now the tests of all other extensions and core pass so we have a set() of commits that are known to work together [15:20:32] and hence should be deployable as is (assuming we actually have tests) [15:20:45] then we get autodeploy on +2 [15:22:16] * bd808 checks sky for flying swine [15:23:06] bd808: I've only got some with lipstick on, best I can do right now. [15:23:19] #mixingmetaphors [15:23:52] An external user was talking to me on irc yesterday and told me how excited they were that composer and hhvm were happening [15:24:12] They said something like "it's a 10 year jump in 6 months" [15:24:39] I didn't bother to tell them how long all of this had been in the works :) [15:25:14] :) [15:28:41] Can anyone help me understand what is causing this test failure? -- https://integration.wikimedia.org/ci/job/mediawiki-vendor-integration/295/console [15:28:53] Unit test file in '/srv/ssd/jenkins-slave/workspace/mediawiki-vendor-integration@3/src/tests/phpunit/structure/..' must end with Test. [15:31:46] bd808: phpunit naming convention I think. you have to name the files in a particular way [15:32:52] but there are no phpunit files in that commit and the tests on the parent commit pass. [15:33:02] Commit is https://gerrit.wikimedia.org/r/#/c/141599/ [15:33:44] * bd808 goes to read StructureTest [15:37:59] bd808: looks like a misplaced file to me? /srv/ssd/jenkins-slave/workspace/mediawiki-vendor-integration@3/src/tests/phpunit/structure/.. then 'includes/debug/logging/legacy...er.php' seems to be what makes the testrunner unhappy [15:38:19] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #194: STILL FAILING in 54 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/194/ [15:38:41] yeah. I'm going to run locally and see if I can figure out what the crazy find command is returning [15:38:49] That test is spooky stuff [15:39:33] I can reproduce at least locally. That's a good sign [15:39:48] and phpunit stripping the array elements is not very helpful [15:40:00] bd808: did someone accidentally commit a debug log there? just guessing.... [15:40:27] bd808: seems tests/phpunit/includes/debug/logging/legacy/Logger.php should be named LoggerTest.php [15:40:42] Doh [15:41:13] bd808: that is how phpunit find the test class [15:41:19] Why that doesn't fail on the commit that introduces it is interesting [15:41:38] failing to do so would cause phpunit to ignore the file, and hence tests are not run [15:41:48] Oh wait that commit does introduce it [15:41:54] we could probably run the structure tests earlier to fail faster [15:42:02] Thanks folks [15:42:10] * bd808 apparently isn't quite awake yet [15:42:34] * hashar rocket delivers donuts and free french coffee to bd808 [15:51:34] "00:05:50.212 Finished: SUCCESS" [15:51:41] w00t, but sloooooow [15:51:48] :> [15:52:49] Looks like it is all just testing slowness. Phpunit starts running at 00:00:08.237 so its not the cloner that is slowing things down [15:54:16] Have we ever tried using runTestsInParallel on our test suite? [15:54:57] bd808: as far as I know many things break [15:55:07] seems likely [15:55:10] :D [15:55:22] We had to do a bunch of work to enable it at $DAYJOB-1 [15:55:39] But it made our core tests soooo much faster [15:55:59] I can imagine :P [15:56:27] We ran `-j 16` and the speedup was about 10x [15:56:40] But I had a beefy test runner too [15:58:15] bd808: the browser tests would run in parallel but we'd bring the Jenkins host to its knees [15:58:30] chrismcmahon: need more jenkins slaves then ;p [15:58:42] yes we do. [15:59:16] We are going to have 2 for wikibase/data stuff once deployed :) https://integration.wikimedia.org/ci/label/Wikidata/ [15:59:33] greg-g: on other news, addshore worked on having the Wikidata Jenkins jobs triggered from Wikimedia Zuul :-D [15:59:50] chrismcmahon: hashar in the one minute before the meeting I'll just leave this question here: how much work is it to add more jenkins slaves in our context? [16:00:10] and it all looks good, just need to switch from our self hosted jenkins master to using zuul now [16:00:20] greg-g: chrismcmahon: roughly an hour to have puppet install all the stuff and 10 minutes to pool it in Jenkins [16:00:34] so I would say one hour and a half regardless of the number of slave to add [16:00:41] (for num being a reasonable number) [16:00:42] * greg-g nods [16:01:15] do we have a performance penalty for adding more slaves? [16:01:27] there is some overhead in jenkins [16:01:33] but nothing I am worrying about [16:01:48] at worth, we can set up a second jenkins master [16:01:54] s/worth/worse/ [16:02:24] we need to sync with labs ops though, since new labs instance means cpu/mem/harddisk being consumed on the labs infra [16:03:37] hashar: yes, that was my ultimate question about performance penalty, is if new lab instances will bog down what we have in place. [16:04:20] if it is to get more slaves for browsertests, we can create slaves that only have one cpu [16:04:23] and thus only one executor [16:04:34] that will mean less cpu / mem being allocated [16:05:27] hasharConfCall: can we have 10 such slaves? [16:06:05] potentially [16:06:24] or we can dynamically create them which is more or less my next evil project [16:06:41] :> [16:06:41] ah Chromium: Video Decode: Software only, hardware acceleration unavailable :-( [16:06:57] Jenkins has a Jclouds plugin that let one boot instances :-D [16:09:56] focusing on conf call now then commute / dinner [16:20:54] 3Wikimedia Labs / 3deployment-prep (beta): mwdeploy user has shell /bin/bash in labs LDAP and /bin/false in production/Puppet - 10https://bugzilla.wikimedia.org/65591#c11 (10Tim Landscheidt) (In reply to myself from comment #10) > [...] > So to migrate safely we would need to: > 1. Add the override to /usr/... [16:45:56] 3Wikimedia Labs / 3deployment-prep (beta): Increase number of Jenkins slaves to spread load and prevent browser test failures on beta - 10https://bugzilla.wikimedia.org/70049 (10Chris McMahon) 3NEW p:3Unprio s:3normal a:3None per Antoine: Have labs ops raise our quota of cpu/mem/disk then create a... [18:05:10] Project browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs build #100: STILL FAILING in 10 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs/100/ [18:14:14] Project browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce build #4: SUCCESS in 8 min 14 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce/4/ [18:15:03] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #68: SUCCESS in 49 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/68/ [18:15:18] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce build #97: STILL FAILING in 11 min: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce/97/ [18:16:54] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #124: SUCCESS in 1 min 50 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/124/ [18:17:04] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #17: STILL FAILING in 10 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/17/ [18:19:24] Project browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce build #125: STILL FAILING in 1 min 23 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce/125/ [18:34:30] Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #130: SUCCESS in 15 min: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/130/ [18:41:05] Project browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce build #110: STILL FAILING in 40 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce/110/ [18:42:45] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #101: SUCCESS in 1 min 38 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/101/ [18:46:40] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #181: STILL FAILING in 31 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/181/ [18:47:34] Project browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce build #41: SUCCESS in 1 min 33 sec: https://integration.wikimedia.org/ci/job/browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce/41/ [18:47:57] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce build #135: STILL FAILING in 13 min: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce/135/ [18:49:17] Project browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce build #97: SUCCESS in 1 min 19 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce/97/ [19:00:21] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #18: STILL FAILING in 11 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/18/ [19:01:38] chrismcmahon: backaround [19:01:52] chrismcmahon: any example of browser test job that should use a different branch than master? :D [19:02:12] cause I am sure we fixed that with zeljkof a while back [19:02:58] if I take https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/146/consoleFull [19:03:24] it queries test2.wikipedia.org mediawiki API to get the git branch [19:03:26] 00:00:05.036 ++ /srv/deployment/integration/slave-scripts/bin/mw-api-siteinfo.py http://test2.wikipedia.org/w/api.php git_branch [19:03:34] 00:00:05.315 + MEDIAWIKI_GIT_BRANCH=wmf/1.24wmf18 [19:03:34] 00:00:05.316 + git checkout -f origin/wmf/1.24wmf18 [19:04:07] though, the job originally clone the master branch as show in build git build data at https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/146/git/ [19:04:21] that is overridden after the clone has been done [19:04:46] that might be the source of the confusion [19:10:18] hashar: I think Zeljko and I are both confused then. He'll be back on Thursday, we can sort it out later this week. [19:10:55] chrismcmahon: yeah i think the error is due to the git build data information being shown [19:11:01] we always clone from master [19:11:07] but manually switch to a different branch [19:15:47] Project beta-scap-eqiad build #18899: FAILURE in 1 min 34 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18899/ [19:22:22] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce build #141: STILL FAILING in 39 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce/141/ [19:23:19] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #160: STILL FAILING in 22 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/160/ [19:24:37] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #57: SUCCESS in 1 min 16 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/57/ [19:25:44] Yippee, build fixed! [19:25:44] Project beta-scap-eqiad build #18900: FIXED in 1 min 42 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18900/ [19:30:15] Which is the repo that the browser tests are defined in again? I've forgotten. It's not JJBC and it's not Zuul-config… [19:31:15] James_F: browser tests for VE? [19:31:26] chrismcmahon: The browser test definitions. [19:31:43] chrismcmahon: We're close to launching for IE11 so I wanted to add it to the list of targets… [19:32:04] James_F: oh, you need a new build in Jenkins then [19:32:08] Yeah. [19:32:18] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #223: FAILURE in 9 min 54 sec: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/223/ [19:32:21] I was looking at this config yesterday. [19:32:30] And now I can't remember which repo I was looking at. :-) [19:36:54] James_F: now I'm confused. I thought it was https://github.com/wikimedia/integration-jenkins-job-builder-config but I'm not seeing my familiar jobs [19:37:24] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #142: STILL FAILING in 12 min: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/142/ [19:37:37] James_F: I'm about to go to lunch, I'll hack on that this afternoon. [19:37:57] chrismcmalunch: Maybe it got changed? [19:38:17] Ah, yes, 1eaa852640f8888d9c0791b9d173b0756f41203e [19:38:19] * James_F sighs. [19:39:52] Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #101: SUCCESS in 2 min 27 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/101/ [19:39:55] Project browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce build #86: STILL FAILING in 2.2 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce/86/ [19:40:05] That's not it, I think. [19:42:54] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #4: STILL FAILING in 2 min 58 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/4/ [19:43:50] Project browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce build #125: SUCCESS in 54 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce/125/ [19:46:00] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce build #100: SUCCESS in 2 min 9 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce/100/ [19:47:15] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #68: SUCCESS in 1 min 14 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/68/ [19:50:09] Project browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce build #146: STILL FAILING in 1 hr 3 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/146/ [19:50:39] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #598: SUCCESS in 27 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/598/ [19:51:20] bd808: the mediawiki/vendor patch will probably need to be hold a bit more [19:51:39] bd808: since the extensions tests do not clone mediawiki/vendor yet :-/ [19:52:02] but they will! :D [19:52:03] bah, humbug [19:52:24] it is probably fine really [19:52:32] You should reply to the email I sent then I guess before Ori starts merging :) [19:52:34] since the extensions are only running their tests and not the core ones [19:52:36] (iirc) [19:52:50] The core logging api will change under the covers [19:52:59] ah true [19:53:04] so suddenly everyone depends on vendor [19:53:05] bah :-( [19:53:11] sorry should have thought about it earlier [19:53:12] So anything in a test that logs will need to find PSR-3 [19:53:19] I should have too [19:53:23] No worries [19:53:26] workaround: disable logging haha [19:53:44] I "just" have to update all the 470+ jenkins jobs to switch to use zuul cloner [19:53:51] and delete the 940+ workspaces [19:53:56] will do tomorrow [19:54:09] at the sametime, that will break extensions REL branches [19:54:15] but I can keep the old jobs for them [19:54:22] (thinking out loud sorry) [19:56:06] hashar: Where did the browsertest config go? I'm going mad… [20:01:16] James_F: cloudbees branch [20:01:25] James_F: the one in the master branch were meant to be triggered on patch submission [20:01:25] hashar: … but we don't use CloudBees. [20:01:36] yeah legacy name [20:01:42] Ah. [20:01:43] think of it as "phase3" :D [20:01:43] * James_F sighs. [20:01:51] Yeah yeah. :-) [20:02:00] whenever Zeljkof is back from vacation, we will merge cloudbee in master [20:02:22] Cool. [20:02:53] I have created the branch to facilitate Zeljkof work in converting is template to jjb format [20:03:08] * James_F nods. [20:03:08] and let him happily screw "his" jobs without interfering with the rest of contint jobs [20:03:22] so yeah will be gone in a few :] [20:04:34] hashar: Thanks! [20:06:17] Hmm. Is there a way to target specific versions of IE? [20:06:33] (I guess I should wait for Zeljko, hmm? :-) [20:15:35] (03PS1) 10Jforrester: browsertests: Enable VE testing on IE11 and Safari; remove Chrome on Windows XP [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156448 [20:21:46] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #165: STILL FAILING in 49 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/165/ [20:28:02] James_F: I can find it [20:28:30] James_F: apparently we target IE 10 [20:28:47] there is some if BROWSER == Internet Explorer ; then VERSION=10 [20:30:03] James_F: see macro.yaml there is a case "$BROWSER" ) [20:30:05] hashar: Oh. [20:30:07] * James_F sighs. [20:30:21] we can revisit that part [20:30:22] Can we manually set VERSION in the browser-definitions? [20:30:26] * James_F nods. [20:30:30] and let one specify the browser version they want to use [20:30:36] seems to make sense for IE at least [20:30:44] so we would have jobs IE-10 IE-11 [20:30:50] and no [20:30:59] Yeah. [20:31:00] it is not settable in the browser definition :/ [20:31:13] definitely hardcoded based on $BROWSER [20:31:26] which is the jjb variable 'browser:' [20:32:48] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #170: STILL FAILING in 10 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/170/ [20:37:14] only 10 minutes whaou [20:37:41] {"tokens"=>{"*"=>"action=tokens has been deprecated. Please use action=query&meta=tokens instead."}} (MediawikiApi::TokenError) [20:37:41] bah [20:38:56] hashar: ^^^ There. [20:38:56] (03PS1) 10Jforrester: browsertests: Make it possible to specify a browser target version [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156452 [20:39:37] right right right, cloudbees branch [20:40:13] James_F: yeah that would do [20:40:31] James_F: now we have to figure out how to set the VERSION in that shell script based on a jjb variable 'version' [20:40:38] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #195: STILL FAILING in 53 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/195/ [20:40:43] Yeah, next step. :-) [20:40:46] variable that we probably want to set to 'default' [20:41:04] so the -z VERSION would become something like VERSION == 'default' ... case ... [20:41:12] Eh. [20:41:20] -z $VERSION is so much cleaner. ;-) [20:41:37] I agree [20:41:48] but JJB requires all its variables to be populated [20:41:59] Can I populate it to '0'? [20:42:01] some line above you can see export MEDIAWIKI_USER={mediawiki_user} [20:42:11] that {mediawiki_user} is a python string format [20:42:20] Yeah. [20:42:23] so you pass to the string an array of variables [20:42:42] syntax is something like: "{mediawiki_user}" % { 'mediawiki_user': 'selenium_user' } [20:42:51] and python bails out / error out whenever a key is missing [20:43:16] we may have the jjb defaults to set a variable version: 'default' [20:43:34] but I don't think we can support defining variables in JJB defaults section, or maybe I wrote a patch for it [20:43:43] zeljkof would probably have a better memory [20:43:49] * James_F nods. [20:44:43] ah yeah patch got merged [20:44:47] yesterday!!!!!!!! [20:44:48] https://review.openstack.org/#/c/100020/ [20:45:29] Nice. :-) [20:46:53] marxarelli: are you around? want to tackle a change to the mediawiki api gem? there is an Issue :-) [20:47:01] I made so many patch to JJB that I ended up being a core reviewer there (the equivalent of +2) [20:47:08] chrismcmahon: sure [20:47:23] chrismcmahon: what's the issue? [20:47:41] James_F: apparently Zeljkof and I talked about it back in June :( [20:47:47] hashar: Oh? [20:48:50] marxarelli: http://pastebin.com/9cCZJStV [20:49:01] James_F: this patch should let us pass a version on a per job basis [20:49:12] James_F: will have to revisit with zeljkof [20:49:39] marxarelli: our API call to get tokens is deprecated and thus all the browser tests that use the API are failing [20:49:43] chrismcmahon: oh boy [20:49:44] hashar: There's no hurry. Happy to wait for Zeljko's views. [20:49:51] +1 :-D [20:50:08] I completely trust Zeljkof on everything that is jjb related [20:50:09] marxarelli: it's a straightforward fix I think, I just suck at publishing gems [20:50:22] James_F: he nicely mastered the tool and trained a few folks already. :-D [20:50:58] chrismcmahon: no problem. it's an easy enough fix but we should also update the unit test [20:51:10] chrismcmahon: actually, update the unit test first :) TDD! [20:51:12] marxarelli: oh yeah, that too :-) [20:53:25] Project browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce build #130: STILL FAILING in 1 hr 2 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce/130/ [20:53:48] (03PS2) 10Jforrester: browsertests: Enable VE testing on IE11 and Safari; remove Chrome on Windows XP [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156448 [20:53:51] (03PS2) 10Jforrester: browsertests: Make it possible to specify a browser target version [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156452 [20:54:14] (03CR) 10jenkins-bot: [V: 04-1] browsertests: Enable VE testing on IE11 and Safari; remove Chrome on Windows XP [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156448 (owner: 10Jforrester) [20:54:17] (03CR) 10jenkins-bot: [V: 04-1] browsertests: Make it possible to specify a browser target version [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156452 (owner: 10Jforrester) [20:54:22] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #115: STILL FAILING in 21 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/115/ [20:55:41] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #125: SUCCESS in 2 min 15 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/125/ [20:55:53] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #126: FAILURE in 11 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/126/ [20:56:30] hashar: ^^ Hmm, see what you mean about it not liking undefined variables. [20:56:53] * James_F chooses to ignore it for a bit. :-) [20:58:01] (03PS1) 10Hashar: WIP kill jenkins slaves WIP [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156455 [20:58:21] (03CR) 10Hashar: [C: 04-2] "The next disrupting project of doom." [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156455 (owner: 10Hashar) [20:58:45] James_F: yeah that is a bit of a mess [20:59:10] James_F: with the JJB patch that got merged yesterday, one could set in the 'default' a version: default [20:59:17] then override it on a per job basis like: [20:59:30] - 'browsertests-{name}-{some}-{foo}': [20:59:41] browser: IE [20:59:41] version: 10 [20:59:58] and the default would have: version: default [21:00:07] so all jobs would have a 'version' variable set to 'default' [21:00:14] which we would override for IE jobs [21:00:50] (thinking out loud sorry) [21:01:42] hashar: But that would need that new version of JJB to be deployed, right? [21:01:47] Bah, meeting. [21:01:58] yeah updating it right now [21:05:18] Project browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce build #112: STILL FAILING in 24 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce/112/ [21:07:34] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #4: FAILURE in 13 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/4/ [21:08:06] Project UploadWizard-api-commons.wikimedia.org build #480: SUCCESS in 31 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/480/ [21:11:34] Project browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce build #127: SUCCESS in 3 min 27 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce/127/ [21:13:19] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #126: SUCCESS in 1 min 44 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/126/ [21:13:25] James_F|Away: I have updated our fork of JJB (in our Gerrit) and pushed a mail to engineering list asking folks to update their jjb copy [21:13:40] sleeeping time [21:18:30] anyway it is sleep time for me now [21:38:40] Project browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce build #113: STILL FAILING in 42 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce/113/ [21:42:13] Project browsertests-Translate-sandbox.translatewiki.net-linux-firefox-sauce build #96: STILL FAILING in 28 min: https://integration.wikimedia.org/ci/job/browsertests-Translate-sandbox.translatewiki.net-linux-firefox-sauce/96/ [21:45:39] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #69: SUCCESS in 3 min 24 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/69/ [22:10:08] Project browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce build #143: STILL FAILING in 1 hr 4 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce/143/ [22:12:15] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #129: FAILURE in 33 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/129/ [22:26:05] Project beta-scap-eqiad build #18918: FAILURE in 1 min 58 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18918/ [22:27:26] 3Wikimedia / 3Quality Assurance: update API gem for new token syntax - 10https://bugzilla.wikimedia.org/70066 (10Chris McMahon) 3NEW p:3Unprio s:3normal a:3None As of 26 August all tests using the API are failing: 13:42 chrismcmahon: hmm, breaking change to the API? {"tokens"=>{"*"=>"action=tokens... [22:43:41] Yippee, build fixed! [22:43:41] Project beta-scap-eqiad build #18919: FIXED in 1 min 45 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/18919/ [22:59:40] 3Wikimedia / 3Quality Assurance: Update API gem to handle action=tokens deprecation - 10https://bugzilla.wikimedia.org/70066#c1 (10Dan Duvall) 5NEW>3ASSI a:3Dan Duvall First things first, the API client should be refactored to not fail upon a deprecation warning. We can then look into how to best imple... [23:22:26] go marxarelli go! thanks for picking up the API change [23:32:06] Project browsertests-VisualEditor-production-linux-firefox-sauce build #15: STILL FAILING in 1 hr 46 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-production-linux-firefox-sauce/15/ [23:34:41] 3Wikimedia / 3Continuous integration: re-enable jenkins checking for Apache config - 10https://bugzilla.wikimedia.org/70068 (10Daniel Zahn) 3NEW p:3Unprio s:3normal a:3None In the past Apache configs were in the apache-config repo. When they were there and since Tim Starling wrote the generator for... [23:36:24] 3Wikimedia / 3Continuous integration: re-enable jenkins checking for Apache config - 10https://bugzilla.wikimedia.org/70068#c1 (10Daniel Zahn) also i'm going to note that now a change as the one above turns into "puppet merge" & "apache deployment" at the same time if merged both has to be done, and this cou... [23:53:12] (03PS1) 10Dduvall: Fixed token error handling [ruby/api] - 10https://gerrit.wikimedia.org/r/156480 (https://bugzilla.wikimedia.org/70066)