[00:00:08] bd808: I don't want to have to mess with puppet config hashes anymore [00:00:37] * bd808 shudders [00:01:17] loh come on [00:01:25] now I have to look up what "shudders" mean :D [00:01:27] Starting over to make things less unique will make a big differnece too. We cleaned up a lot in the pmtpa to eqiad transition but not enough [00:02:00] tremble convulsively, typically as a result of fear or revulsion. [00:02:12] * hashar conforts bd808 [00:02:16] or coMforts [00:02:21] I can never remember that one [00:02:29] comfort [00:02:53] damn french [00:03:30] bd808: and thank you to have talked about varnish earlier [00:03:38] that tricked me in trying varnishncsa to give you the command [00:03:46] that is how I found out the security audit spam going on [00:04:34] yeah for asking dumb questions [00:04:44] always ask!!!!!! :-D [00:04:57] you never know what kind of problem it is going to solve [00:05:27] I'm seldom afraid to ask. I know enough to know others know more. [00:05:58] yeah [00:06:23] I eventually figured out that I was not smart enough to understand everything [00:06:50] anyway [00:07:14] definitely need to sleep. Daughter waking up in 5 hours from now! [00:07:18] have a good dinner! [00:46:32] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #608: SUCCESS in 31 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/608/ [00:53:29] Yippee, build fixed! [00:53:30] Project UploadWizard-api-commons.wikimedia.org build #485: FIXED in 28 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/485/ [01:29:40] Yippee, build fixed! [01:29:40] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #226: FIXED in 54 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/226/ [03:05:12] Project browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs build #103: STILL FAILING in 11 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs/103/ [03:13:06] Yippee, build fixed! [03:13:07] Project browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce build #7: FIXED in 7 min 5 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce/7/ [03:13:50] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #71: SUCCESS in 43 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/71/ [03:14:36] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce build #100: STILL FAILING in 10 min: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce/100/ [03:20:30] Project beta-update-databases-eqiad build #3619: FAILURE in 29 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/3619/ [03:31:26] Yippee, build fixed! [03:31:27] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #127: FIXED in 17 min: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/127/ [03:32:45] Project browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce build #128: STILL FAILING in 1 min 18 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce/128/ [03:36:45] Project browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce build #113: STILL FAILING in 35 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce/113/ [03:40:36] Yippee, build fixed! [03:40:37] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce build #138: FIXED in 3 min 50 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce/138/ [03:41:38] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #104: SUCCESS in 1 min 1 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/104/ [03:43:14] Yippee, build fixed! [03:43:15] Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #133: FIXED in 10 min: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/133/ [03:46:53] Project browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce build #44: SUCCESS in 52 sec: https://integration.wikimedia.org/ci/job/browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce/44/ [03:53:06] Yippee, build fixed! [03:53:07] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #185: FIXED in 38 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/185/ [03:54:17] Project browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce build #100: SUCCESS in 1 min 10 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce/100/ [04:01:41] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #21: STILL FAILING in 7 min 24 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/21/ [04:30:18] Project browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce build #149: STILL FAILING in 47 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/149/ [04:36:13] Yippee, build fixed! [04:36:14] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #163: FIXED in 34 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/163/ [04:37:11] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #60: SUCCESS in 57 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/60/ [04:39:26] Yippee, build fixed! [04:39:26] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce build #144: FIXED in 57 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce/144/ [04:41:20] Yippee, build fixed! [04:41:20] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #145: FIXED in 4 min 8 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/145/ [04:43:48] Yippee, build fixed! [04:43:49] Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #104: FIXED in 2 min 28 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/104/ [04:43:50] Project browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce build #89: STILL FAILING in 1.3 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce/89/ [04:51:11] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #8: STILL FAILING in 7 min 19 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/8/ [04:51:51] Project browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce build #128: SUCCESS in 38 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce/128/ [04:53:09] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce build #103: SUCCESS in 1 min 17 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce/103/ [04:53:57] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #71: SUCCESS in 47 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/71/ [05:07:44] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #168: STILL FAILING in 28 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/168/ [05:23:36] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #198: STILL FAILING in 29 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/198/ [05:24:02] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #227: SUCCESS in 53 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/227/ [05:46:29] Project browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce build #133: STILL FAILING in 38 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce/133/ [06:01:20] Yippee, build fixed! [06:01:20] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #118: FIXED in 37 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/118/ [06:05:03] Yippee, build fixed! [06:05:04] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #128: FIXED in 3 min 43 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/128/ [06:11:03] Project browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce build #115: STILL FAILING in 24 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce/115/ [06:13:09] Yippee, build fixed! [06:13:10] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #7: FIXED in 8 min 6 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/7/ [06:14:16] Yippee, build fixed! [06:14:17] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #129: FIXED in 3 min 11 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/129/ [06:15:07] Yippee, build fixed! [06:15:07] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #173: FIXED in 51 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/173/ [06:15:45] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #3: STILL FAILING in 37 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/3/ [06:18:20] Yippee, build fixed! [06:18:21] Project browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce build #130: FIXED in 2 min 33 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce/130/ [06:21:41] Yippee, build fixed! [06:21:41] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #129: FIXED in 3 min 20 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/129/ [06:47:03] Project browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce build #116: STILL FAILING in 33 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce/116/ [06:47:29] Project browsertests-Translate-sandbox.translatewiki.net-linux-firefox-sauce build #99: STILL FAILING in 25 min: https://integration.wikimedia.org/ci/job/browsertests-Translate-sandbox.translatewiki.net-linux-firefox-sauce/99/ [06:48:34] Yippee, build fixed! [06:48:35] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #72: FIXED in 1 min 3 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/72/ [06:48:59] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #609: SUCCESS in 24 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/609/ [06:53:28] Project UploadWizard-api-commons.wikimedia.org build #486: SUCCESS in 28 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/486/ [07:04:27] Project browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce build #146: STILL FAILING in 50 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-firefox-sauce/146/ [07:05:52] Yippee, build fixed! [07:05:52] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #132: FIXED in 18 min: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/132/ [07:28:27] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #610: SUCCESS in 26 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/610/ [08:09:44] aharoni: around? [08:09:51] yo [08:09:58] great :) [08:10:13] apologies for the late notice, but I can not pair today at the usual time [08:10:39] I will be around later today, or we can pair tomorrow, or next week [08:12:40] aharoni: when would be a good time for you? [08:12:51] next week [08:14:10] aharoni: ok, see you next week then, the usual time [09:59:44] (03PS2) 10Hashar: Make mwext-Wikibase-* jobs concurrent [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156551 (owner: 10Addshore) [10:00:05] :> [10:07:29] (03CR) 10Hashar: [C: 032] "Made concurrent!" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156551 (owner: 10Addshore) [10:07:41] (03PS3) 10Hashar: Add Wikibase qunit job [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156554 (owner: 10Addshore) [10:08:16] addshore: that qunit job might just be working :] [10:09:22] (03CR) 10Hashar: [C: 032] "I am not sure how bad / good it will work. We have to try I guess." [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156554 (owner: 10Addshore) [10:10:13] (03CR) 10Hashar: [C: 032] "Layoutdiff job confirms it is not going to vote :-D https://integration.wikimedia.org/ci/job/integration-zuul-layoutdiff/1684/console" [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156560 (owner: 10Addshore) [10:10:35] :P [10:11:20] addshore: do you care of the job history when renaming wdjenkins -> wikidata ? [10:11:22] I can manually move them [10:11:33] or we can just leave them as is and remove the old one later on [10:11:55] (03PS4) 10Hashar: wdjenkins > wikidata [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156566 (owner: 10Addshore) [10:12:02] oh, will that messup the job history? :O [10:12:17] not sure [10:12:21] I would just leave the old job [10:12:25] and delete them later on [10:12:34] the history inJenkins is linear anyway [10:12:42] the jobs still look like they would be in the same place https://integration.wikimedia.org/ci/job/mwext-Wikibase-client-tests [10:12:46] I see no reference of wdjenkins :P [10:13:02] (03Merged) 10jenkins-bot: Make mwext-Wikibase-* jobs concurrent [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156551 (owner: 10Addshore) [10:14:04] (03Merged) 10jenkins-bot: Add Wikibase qunit job [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156554 (owner: 10Addshore) [10:14:39] currently trying to think of a nice way to inject an oauth token into the json of wikibase composer file before doing the composer install :P [10:15:00] (03Merged) 10jenkins-bot: Trigger wikibase-qunit job [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156560 (owner: 10Addshore) [10:16:11] gotta deploy that zuul config change [10:16:58] kk :) [10:17:14] and I need to make jjb faster :D [10:17:18] or have less jobs! [10:18:13] hah! [10:18:42] you should just have a job that updates the jenkins jobs like we did :P there is no trigger for it but it means you can just go to jenkins and click Run :P [10:23:15] yeah should do that [10:23:21] though with 4000k jobs ... that is not ideal :D [10:23:48] jjb has a cache though [10:24:42] zuul reloaded [10:24:48] addshore: qunit job should be triggering now [10:25:26] yup it is :) [10:25:49] https://integration.wikimedia.org/ci/job/mwext-Wikibase-qunit/1915/console [10:27:50] well, it ran but the job failed [10:28:05] Getting tarball of '{dependencies}' from git.wikimedia.org to '/mnt/jenkins-workspace/workspace/mwext-Wikibase-qunit/extensions/{dependencies}' [10:28:11] hmmm, that looks a bit wrong [10:31:48] ooooops [10:31:57] thats my fault :> [10:32:05] I haven't paid attention to that [10:32:20] I probably need an integration test that ensure all values have been expanded or something [10:32:36] :D [10:34:47] hmm, infact hashar, looking at jjbc, why has that not been expanded? [10:35:36] no idea :D [10:35:45] unless you cant do things like that in jobs? [10:35:49] https://gerrit.wikimedia.org/r/#/c/156566/ ( wdjenkins > wikidata ) is a noop [10:35:52] I guess that would make sense [10:35:53] I guess it can land it ? [10:35:59] yup! :) [10:36:20] then ill quickly bash a fix in for this [10:36:31] as for dependencies [10:36:36] mwext-Wikibase-qunit is defined as a job [10:37:10] and the project -> jobs: does not pass variable to 'job' definition [10:37:14] needs to be made a job-template [10:37:20] so: [10:37:22] - job-template: [10:37:28] name: 'mwext-Wikibase-qunit' [10:37:31] that should fix it [10:37:44] (03CR) 10Hashar: [C: 032] "noop :-)" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156566 (owner: 10Addshore) [10:39:46] (03Merged) 10jenkins-bot: wdjenkins > wikidata [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156566 (owner: 10Addshore) [10:40:17] (03PS1) 10Addshore: Make mwext-Wikibase-qunit a job template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156767 [10:40:33] (03PS4) 10Hashar: Add jobs for Wikidata build repo [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156567 (owner: 10Addshore) [10:52:38] (03PS5) 10Hashar: Add jobs for Wikidata build repo [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156567 (owner: 10Addshore) [10:54:06] (03CR) 10Hashar: [C: 032] "Deployed jobs:" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156567 (owner: 10Addshore) [10:54:15] (03CR) 10Hashar: "recheck" [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156572 (owner: 10Addshore) [10:54:34] (03PS1) 10Addshore: WIP DNM Add a READ oauth token for github [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156768 [10:55:45] (03CR) 10Hashar: "The Jenkins job mwext-Wikidata-qunit is not defined yet." [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156572 (owner: 10Addshore) [10:56:00] Fail! [10:56:22] :D [10:56:28] (03Merged) 10jenkins-bot: Add jobs for Wikidata build repo [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156567 (owner: 10Addshore) [10:56:32] give me 2 ticks :) [10:57:59] (03PS2) 10Hashar: Make mwext-Wikibase-qunit a job template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156767 (owner: 10Addshore) [10:58:41] (03PS1) 10Addshore: Add mwext-Wikidata-qunit job-template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 [11:00:34] the Populating default interwiki table is soooo long [11:00:44] *looks* [11:01:07] (03CR) 10Hashar: [C: 032] "That fix the variable expansion as seen in https://integration.wikimedia.org/ci/job/integration-jjb-config-diff/877/console" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156767 (owner: 10Addshore) [11:01:23] hah, a whole 15 seconds :P [11:01:27] addshore: seems qunit more or less run https://integration.wikimedia.org/ci/job/mwext-Wikibase-qunit/1920/console [11:01:32] yeah that is due to sqlite being slow [11:01:40] and that part of code does something very lame like: [11:01:50] for each interwiki, select, delete, update [11:02:02] >.> [11:02:03] each in their own transaction probably to add some more overhead [11:02:14] that is very obvious when you have debug log enabled and run the installer :D [11:03:01] Could not load some extensions because they are missing [11:03:01] 11:01:29 the expected entry point: [11:03:01] 11:01:29 /mnt/jenkins-workspace/workspace/mwext-Wikibase-qunit/extensions/{ext-name}/{ext-name}.php [11:03:07] I think for MySQL all the fields are inserted with just one query [11:03:07] guess thats in the qunit builder? [11:03:11] bah [11:03:26] (03Merged) 10jenkins-bot: Make mwext-Wikibase-qunit a job template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156767 (owner: 10Addshore) [11:03:56] I should really look at the generated XML file :D [11:04:15] :> [11:06:43] AHHH [11:06:56] ahh its from Snippet coming from integration/jenkins.git:/mediawiki/conf.d/ [11:07:04] addshore: the workspace probably has a directory /{ext-name}/ [11:07:16] and the automatic extension loaded look up directory un /extensions/ [11:07:21] ahhhh :P [11:07:32] then for each of them attempt to include "dir_name"/"dir_name".php [11:07:35] which is probably due to the fact it didnt expand it first time round [11:07:38] *goes to check [11:07:40] yeah :( [11:07:52] which also mean that whenever you remove a dependency [11:07:57] where are the workspaces again? /mnt somewhere? [11:08:01] the repository are still around and stalled at whatever commit was made [11:08:03] and still loaded [11:08:23] the fix will be to define the extension we actually want to load, regardless of what is in the workspace. Ihave got the code for it already [11:08:44] something like: if there is a file load_extension.txt , use its content instead of iterating dirs under /extensions/ [11:08:45] wikidata-jenkins1:/mnt/jenkins-workspace/workspace/mwext-Wikibase-qunit/extensions# ls [11:08:45] {dependencies} {ext-name} README Wikibase [11:08:54] yeah drop all the {* dirs :] [11:08:59] on both slaves [11:09:00] (in case) [11:09:12] that is messy sorry [11:09:46] {{done}} [11:10:09] rebuilding at https://integration.wikimedia.org/ci/job/mwext-Wikibase-qunit/1922/ [11:11:47] PhantomJS unable to load "http://localhost:9412/jenkins-mwext-Wikibase-qunit-1922/index.php?title=Special:JavaScriptTest/qunit" URI. [11:12:12] better :d [11:12:20] so what we have [11:12:20] but not quite good enough ;p [11:12:28] is on the slave there is a virtual host that listens on port 9412 [11:12:55] with docroot under /srv/localhost/qunit [11:13:01] and [11:13:08] we symlink the job workspace under that apache docroot: [11:13:09] ln -s /mnt/jenkins-workspace/workspace/mwext-Wikibase-qunit /srv/localhost/qunit/jenkins-mwext-Wikibase-qunit-1922 [11:13:09] 00:01:10.815 ln: failed to create symbolic link `/srv/localhost/qunit/jenkins-mwext-Wikibase-qunit-1922': No such file or directory [11:13:26] and honestly that ln failure should abort the script bah [11:13:45] but bash does not have -e [11:13:46] for some reason [11:14:17] drwxr-xr-x 3 jenkins-deploy root 4096 Aug 26 11:07 localhost [11:15:30] ah the macro has #!/bin/bash -x [11:15:31] :( [11:15:41] :> [11:16:56] https://integration.wikimedia.org/ci/job/test-hashar-shell/1/console :d [11:17:06] Jenkins look at the shell script [11:17:09] parse the shebang [11:17:12] and reuse the parameters set [11:17:21] the default is -xe (show commands and die on any error) [11:17:37] need to get rid of any #!/bin/bash -x since that disable erring out [11:17:40] erroring out [11:17:53] one more bug found :D [11:18:25] :D [11:36:14] addshore: maybe puppet does not create /srv/localhost/qunit ? [11:36:19] i mean, the 'qunit' subdir [11:36:32] nope it doesnt! [11:36:39] modules/contint/manifests/qunit_localhost.pp: file { '/srv/localhost/qunit': [11:36:43] just a mediawiki dir in there [11:37:04] that is in contint::qunit_localhost [11:37:10] though that create them as jenkins-slave user [11:37:15] that might be an issue [11:37:21] since the jobs on labs run using jenkins-deploy [11:37:32] the qunit jobs only run on production slaves [11:37:38] damn unconsistency [11:45:17] (03PS1) 10Hashar: Drop redundant bash -xe [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156775 [11:45:46] (03CR) 10Hashar: [C: 032] Drop redundant bash -xe [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156775 (owner: 10Hashar) [11:47:54] (03Merged) 10jenkins-bot: Drop redundant bash -xe [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156775 (owner: 10Hashar) [11:47:59] lunch time because I deserve it :D [11:48:02] :D [11:48:21] I need to figure out how to grep XML for anything that uses bash or bash -x [11:48:24] since that disables -e [11:49:29] not sure I want to parse the generated XML files though [11:51:11] post lunch we will see [11:52:33] addshore: and -qunit jobs might just not work on labs instance because of jenkins-slave / jenkins-deploy annoyance :-( [12:30:32] (03PS1) 10Hashar: Make sure bash snippets use -e [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156780 [12:31:07] (03PS2) 10Addshore: Add a READ oauth token for github [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156768 [12:46:30] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #611: SUCCESS in 28 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/611/ [12:47:44] (03CR) 10Addshore: [C: 04-1] "This issue seems to have gone away today, but this change should be left here incase it comes back..." [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156768 (owner: 10Addshore) [12:53:35] Project UploadWizard-api-commons.wikimedia.org build #487: SUCCESS in 35 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/487/ [12:56:52] hashar: when you get back could you limit the executors on each of the slaves to 6 please? :) [12:57:09] and potentially remind me about what you said the other day to make sqlite go faster? :P [12:57:14] addshore: instead of 8 ? [12:57:47] yup, they are only 4 cpu instances, and just did a test of them both full, test times go upa bit ;p [12:57:58] done [12:58:01] cheers :) [12:58:31] jenkins just crunched through tests for 19 changesets :P [12:58:52] 133 jobs :) [12:59:41] on a basically unloaded instance the api tests take aprox 9.5 mins, though if the instance is overloaded that can go up to 25 mins (which was the most I saw) [13:02:33] addshore: and they can be made faster by having sqlite on a tmpfs disk [13:02:53] since a hell lot of our tests end up hitting the database [13:03:03] the localization cache / recache might be a perf bottleneck as well [13:03:51] coffeee [13:04:50] if [ -d "$HOME/tmpfs" ]; then [13:07:01] couldnt we puppetise a /mnt/home/jenkins-deploy/tmpfs for all slaves? [13:08:36] addshore: yeah I tried [13:08:47] but the dir needs to be owned by jenkins-deploy on labs [13:08:52] and the user is not known by puppet [13:08:55] it is defined in LDAP [13:09:01] maybe we can create the dir without users [13:09:15] and notify an exec { 'chown jenkins-deploy:jenkins-deploy' } [13:09:34] (i.e. bypass puppet file ownship management) [13:20:01] (03PS2) 10Hashar: Make sure bash snippets use -e [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156780 [13:20:03] (03PS1) 10Hashar: Fix up qunit cleanup by using a publisher [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156782 [13:21:29] (03CR) 10Hashar: [C: 032] "Tested both passing and failing jobs." [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156782 (owner: 10Hashar) [13:22:01] (03CR) 10Hashar: [C: 032] "I have tested all jobs against both passing and failing builds." [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156780 (owner: 10Hashar) [13:25:20] (03Merged) 10jenkins-bot: Make sure bash snippets use -e [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156780 (owner: 10Hashar) [13:25:22] (03Merged) 10jenkins-bot: Fix up qunit cleanup by using a publisher [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156782 (owner: 10Hashar) [13:25:28] lovely bot [13:25:33] =] [13:26:17] in the news: France sells of new real estates drops by 15% [13:26:54] not surprising giving the overinflated price of apartment in new constructions [13:42:32] addshore: so bash -e overrides are gone [13:43:22] :D [13:44:52] (03PS5) 10Hashar: Remove wikidata-testextensions job [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156568 (owner: 10Addshore) [13:45:57] hashar_: are the experimental triggers for Wikidata repo on? [13:46:07] addshore: seems we need a mwext-Wikidata-qunit job [13:46:08] zuul-config change https://gerrit.wikimedia.org/r/#/c/156572/ complains [13:46:20] hashar_: there is a change up for it already :) [13:46:32] * hashar_ digs [13:46:43] ah https://gerrit.wikimedia.org/r/#/c/156769/ [13:46:49] (03PS2) 10Hashar: Add mwext-Wikidata-qunit job-template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 (owner: 10Addshore) [13:46:50] :D [13:48:12] (03CR) 10Hashar: [C: 04-1] Add mwext-Wikidata-qunit job-template (031 comment) [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 (owner: 10Addshore) [13:48:35] (03PS3) 10Hashar: Add mwext-Wikidata-qunit job-template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 (owner: 10Addshore) [13:48:40] tiny change [13:48:45] I have made in between [13:49:00] I need to find a way to ensure that some publisher is present based on builders being applied [13:51:31] (03CR) 10Hashar: [C: 04-1] "The job is not generated because the job-template is not associated with a project. So it is never realized by JJB." (031 comment) [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 (owner: 10Addshore) [13:51:44] addshore: nit: the job-template now has to be added to a project ^^^ [13:52:34] so just include it within the project in the yaml? [13:52:41] and I guess that should be done with the other templates also [13:55:29] addshore: probably :D [13:55:33] xD [13:56:02] oh wait, I know why now, silly me [13:57:12] (03PS4) 10Addshore: Add mwext-Wikidata-qunit job-template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 [14:03:47] lets deploy that new mwext-Wikidata-qunit job [14:03:55] damn [14:04:03] my coworking place as some US citizen visiting [14:04:17] :> [14:05:07] us girl meeting a tiny dog makes the weirdest accent : "oh my god, it is such a cuteeeeee doggie, awesome" [14:05:12] cliché [14:05:31] (03CR) 10Hashar: [C: 032] "excellent" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 (owner: 10Addshore) [14:07:39] (03Merged) 10jenkins-bot: Add mwext-Wikidata-qunit job-template [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156769 (owner: 10Addshore) [14:07:45] (03PS4) 10Hashar: Add experimental triggers for Wikidata build repo [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156572 (owner: 10Addshore) [14:08:26] (03CR) 10Hashar: "The Jenkins job mwext-Wikibase-qunit is created by https://gerrit.wikimedia.org/r/#/c/156767/ (deployed). Updated commit summary message t" [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156572 (owner: 10Addshore) [14:10:39] (03CR) 10Hashar: [C: 032] "Have a merry testing!" [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156572 (owner: 10Addshore) [14:10:47] (03Merged) 10jenkins-bot: Add experimental triggers for Wikidata build repo [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156572 (owner: 10Addshore) [14:11:35] addshore: wikidata experimental jobs should be runnable now [14:11:54] testing :) [14:12:37] and for https://gerrit.wikimedia.org/r/#/c/156768/2/wikidata.yaml [14:12:50] I am not sure why you need an oauth token :D [14:13:01] mwext-Wikidata-qunit (non-voting) not_registered on https://integration.wikimedia.org/zuul/ [14:13:30] hashar: as then we can more from gitcloning to the dists of the stuff we need, which then has proper caching, but if we do that too much we will hit the github api limit :) [14:13:43] ah damn me [14:13:53] yeah when jobs are created, they often are not registered with zuul :-:/ [14:14:46] will fix in a few [14:15:01] mhhm, there is also a bug for the tests I need to fix now :) [14:15:27] tests/extensions/Wikibase/build/jenkins/mw-apply-wb-settings.sh: No such file or directory :d [14:15:42] will get the -qunit job registered in a few [14:15:48] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #199: ABORTED in 9 min 57 sec: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/199/ [14:15:51] meanwhile, context switching to parsoid for a few [14:18:22] qunit job should be registered now [14:23:45] 3Wikimedia Labs / 3deployment-prep (beta): Commons beta cannot resolve URL with a colon in it - 10https://bugzilla.wikimedia.org/70124 (10dan) 3NEW p:3Unprio s:3normal a:3None Created attachment 16304 --> https://bugzilla.wikimedia.org/attachment.cgi?id=16304&action=edit sample XML file for use wit... [14:23:49] (03PS1) 10Addshore: Fix applying of config for Wikidata build jobs [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156788 [14:23:51] hashar: ^^ [14:24:51] addshore: wait for the diff and +1 if it is fine :] [14:24:53] will deploy [14:24:58] after [14:26:58] +1 [14:27:34] (03CR) 10Aude: [C: 031] "looks correct to me" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156788 (owner: 10Addshore) [14:29:34] (03CR) 10Addshore: [C: 031] Fix applying of config for Wikidata build jobs [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156788 (owner: 10Addshore) [14:31:00] (03CR) 10Hashar: [C: 032] "Deployed:" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156788 (owner: 10Addshore) [14:31:16] I should check whether you can push jobs to jenkins [14:31:56] addshore: aude: you are both in the 'nda' LDAP group \o/ [14:32:13] oh hashar, also, did you see my comment about running the Wikidata jobs on both the regular slaves OR our wikidata slaves? as they dont use composer :) I would guess in the node I could do Wikidata || LabsSlave or something similar? [14:32:20] I have seen examples of && but not || ;p [14:32:43] yeah that might work [14:32:48] but honestly I am not sure it will [14:33:07] (03Merged) 10jenkins-bot: Fix applying of config for Wikidata build jobs [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156788 (owner: 10Addshore) [14:33:28] :D [14:33:36] Maybe ill make a patch for it in some days and see :) [14:33:49] meh, /mnt/jenkins-workspace/workspace/mwext-Wikidata-client-nonexperimental-tests/extensions/Wikidata/vendor/extensions/Wikibase/build/jenkins/mw-apply-wb-settings.sh apparently doesnt exist still... that makes little sense [14:33:56] :-/ [14:35:10] hashar: can you also limit the executors on each slave to 4? :) think 6 is also too high, guess on labs it should just == the number of cores [14:35:25] yeah I did N core + 1 [14:35:39] cause lot of tests are mostly waiting for I/O [14:35:47] maybe 5 then ;p [14:35:50] haha [14:35:59] hehe [14:36:35] moving them down to 5 [14:36:39] I am having a break too tired. [14:36:48] and gotta look at paarsoid jobs next [14:36:59] (03PS1) 10Addshore: Fix path for wikidata build settings file [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156791 [14:37:12] hashar: this is the last one, I promise ;p [14:37:24] then tommorrow we can switch from experi to running :> [14:37:55] they are down to 5 executors [14:38:07] and deploying your last patch [14:38:49] [= [14:41:22] (03CR) 10Hashar: [C: 032] "bla deployed" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156791 (owner: 10Addshore) [14:41:36] addshore: deployed [14:41:39] and having a break [14:41:45] :D [14:44:10] (03Merged) 10jenkins-bot: Fix path for wikidata build settings file [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156791 (owner: 10Addshore) [14:53:11] (03PS1) 10Cscott: Refactor to remove about a hundred lines from mediawiki-extensions.yaml [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156792 [14:53:38] (03CR) 10jenkins-bot: [V: 04-1] Refactor to remove about a hundred lines from mediawiki-extensions.yaml [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156792 (owner: 10Cscott) [15:07:53] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #200: STILL FAILING in 44 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/200/ [15:10:00] (03PS2) 10Cscott: Refactor to remove about a hundred lines from mediawiki-extensions.yaml [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156792 [15:10:30] (03CR) 10jenkins-bot: [V: 04-1] Refactor to remove about a hundred lines from mediawiki-extensions.yaml [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156792 (owner: 10Cscott) [15:16:39] hashar: is there a bugzilla ticket for supporting IE11 browser test builds in Jenkins? [15:16:54] (03PS3) 10Cscott: Refactor to remove about a hundred lines from mediawiki-extensions.yaml [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156792 [15:17:10] chrismcmahon: none I am aware of [15:25:31] hashar: zeljkof and I would like to merge the cloudbees branch of jjb to master, would you be around in the next 30 minutes or so for questions about that? [15:31:31] chrismcmahon: lets wait for zeljkof to come back ? :D [15:31:35] I am going out in a few [15:31:40] hashar: I am back! :) [15:31:42] I have worked too late yesterday [15:31:43] hashar: I'm in a hangout with zeljkof [15:31:43] ah [15:31:55] so [15:31:57] checkout master [15:32:00] hashar: you have to go in a few minutes? [15:32:07] generate the XML job to a directory 'output-merge' [15:32:08] hashar: we are reviewing https://gerrit.wikimedia.org/r/#/c/152905/ [15:32:27] then checkout the cloudbees branch and generate the job to the same directory 'output-merge' [15:32:32] then merge cloudbeees in master branch [15:32:43] generate the XML jobs to a new directory 'output-postmerge' [15:32:54] how to do the merge? [15:32:59] git checkout cloudbees? [15:33:02] git merge master? [15:33:07] output-merge (which is jobs from master + cloudbees branches) should be strictly identical to the jobs generated by the merge commit (and in 'output-postmerge' ) [15:33:22] na merge cloudbees in master [15:33:25] git checkout master [15:33:28] git merge cloudbees [15:33:34] (making sure cloudbees is up to date [15:33:34] hashar: ok, I see [15:33:36] or : [15:33:40] git remote update [15:33:43] git checkout master [15:33:46] git pull [15:33:50] git merge origin/cloudbees [15:33:53] fix commits :D [15:34:02] conflicts? [15:34:12] and then? just git review? [15:35:29] hashar: trying it with chrismcmahon... [15:36:29] (03CR) 10Hashar: [C: 04-1] "Unfortunately you can not override the 'name' variable :( See the diff output." (031 comment) [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156792 (owner: 10Cscott) [15:38:07] (03PS3) 10Jforrester: browsertests: Enable VE on IE11 and Safari; remove Chrome on Windows XP [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156448 (https://bugzilla.wikimedia.org/70126) [15:38:35] (03CR) 10jenkins-bot: [V: 04-1] browsertests: Enable VE on IE11 and Safari; remove Chrome on Windows XP [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/156448 (https://bugzilla.wikimedia.org/70126) (owner: 10Jforrester) [15:38:44] 3Wikimedia / 3Quality Assurance: create browser test build for IE11/VisualEditor - 10https://bugzilla.wikimedia.org/70126 (10James Forrester) p:5Unprio>3Normal a:3James Forrester [15:38:46] zeljkof: on the news, some JJB patch I wrote in June has been merged [15:38:59] hashar: I saw it! :) [15:38:59] zeljkof: would let us define variables in default. I think that was needed for the browser versions [15:39:04] hashar: we found that, thanks [15:39:16] hashar: yes, that was the other thing chrismcmahon and I were talking today [15:39:23] patch being https://review.openstack.org/#/c/100020/ [15:39:33] integration/jenkins-job-builder has been updated [15:39:40] might want to pull and reinstall [15:40:16] hashar: that is a big reason we want to merge the cloudbees branch to master [15:40:29] finally [15:43:34] I am giving it a try myself :D [15:44:04] the .gitreview need a tiny change [15:44:09] and both branches have a macro.yaml [15:44:15] so needs to concatenate them [15:44:40] somehow after merge I am missing all the VisualEditor browser tests :D [15:44:53] Oops. [15:45:09] VE is disabled by default anyway isn't it ? [15:45:12] * hashar grins [15:46:15] zeljkof: chrismcmahon so each branches has a project: name: VisualEditor [15:46:22] the merge needs a bit more work as a result [15:46:41] one is defined in jobs.yaml [15:46:57] the other is in misc.yaml [15:47:26] I would just cut the jobs defined in misc.yaml and add them to the VisualEditor project in jobs.yaml [15:50:03] (03PS1) 10Hashar: Merge branch 'cloudbees' into 'master' [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156809 [15:50:07] ^^example :] [15:50:10] I am off [15:50:25] I can review whatever you come with tomorrow with zeljkof [15:50:29] * hashar waves [15:50:36] thanks hashar [15:50:40] hashar: thanks, see you tomorrow [15:54:14] (03CR) 10Zfilipin: [C: 031] Merge branch 'cloudbees' into 'master' [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156809 (owner: 10Hashar) [17:13:33] chrismcmahon: If you here about people having problems logging in to http://deployment.wikimedia.beta.wmflabs.org/, logging out from en.beta seems to help [17:14:03] The backing database for deployment was renamed and there seem to be some lingering centralauth issues because of it [17:14:43] 3Wikimedia Labs / 3deployment-prep (beta): hhvm creates core file in /tmp/ filling mediawiki02 labs instance root partition - 10https://bugzilla.wikimedia.org/69979#c10 (10Greg Grossmeier) Still at 12 since over night. I wonder if the core dumps were caused by the relatively mega high load due to the automat... [17:16:57] bd808: ok, thanks for the warning. I saw the rename happening [17:18:33] Other than this CA bit it seems to have gone ok [17:19:43] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #201: STILL FAILING in 49 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/201/ [17:25:58] 3Wikimedia Labs / 3deployment-prep (beta): hhvm creates core file in /tmp/ filling mediawiki02 labs instance root partition - 10https://bugzilla.wikimedia.org/69979#c11 (10Bryan Davis) (In reply to Greg Grossmeier from comment #10) > Still at 12 since over night. I wonder if the core dumps were caused by the... [17:35:14] bd808: "Or the fuzzing hit legit bugs in our php code that trigger hhvm segfaults." that'd be neat [17:52:18] greg-g: It would be... if we can understand the core files and stacktraces [17:52:38] that seems problematic ;) [17:53:21] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #9: STILL FAILING in 7 min 31 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/9/ [18:05:15] Project browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs build #104: STILL FAILING in 15 sec: https://integration.wikimedia.org/ci/job/browsertests-ZeroBanner-en.m.wikipedia.org-linux-phantomjs/104/ [18:13:35] Project browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce build #8: SUCCESS in 7 min 33 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-chrome-sauce/8/ [18:14:23] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #72: SUCCESS in 47 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/72/ [18:16:10] Project browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce build #101: STILL FAILING in 12 min: https://integration.wikimedia.org/ci/job/browsertests-TwnMainPage-sandbox.translatewiki.net-linux-firefox-sauce/101/ [18:20:07] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #128: SUCCESS in 5 min 43 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/128/ [18:21:28] Project browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce build #129: STILL FAILING in 1 min 20 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-language-browsertests.wmflabs.org-linux-firefox-sauce/129/ [18:34:27] Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #134: SUCCESS in 12 min: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/134/ [18:39:11] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce build #139: SUCCESS in 4 min 49 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce/139/ [18:40:35] Project browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #105: SUCCESS in 1 min 27 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/105/ [18:41:22] Project browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce build #114: STILL FAILING in 40 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-windows_8-internet_explorer-sauce/114/ [18:47:22] Project browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce build #45: SUCCESS in 1 min 21 sec: https://integration.wikimedia.org/ci/job/browsertests-PdfHandler-test2.wikipedia.org-linux-firefox-sauce/45/ [18:55:11] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #186: FAILURE in 38 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/186/ [18:56:28] Project browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce build #101: SUCCESS in 1 min 15 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-sandbox.translatewiki.net-linux-firefox-sauce/101/ [19:04:50] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #22: STILL FAILING in 8 min 21 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/22/ [19:16:03] Project browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce build #150: STILL FAILING in 34 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-test2.wikipedia.org-linux-chrome-sauce/150/ [19:16:23] marxarelli: do you have a wikitech username? [19:16:55] greg-g: sure do (Dduvall) [19:21:24] hrmm [19:23:00] greg-g: i think i'm already a member [19:23:28] 3Wikimedia Labs / 3deployment-prep (beta): shell wrapper to connect to databases - 10https://bugzilla.wikimedia.org/45706#c6 (10Bryan Davis) 5NEW>3RESO/FIX Fixed via a local commit in the puppet repo on deployment-salt: $ git show --pretty 52fc928 commit 52fc92891d53267ff2ed82b917017c288cdebaa2 Au... [19:37:38] marxarelli: are you around? got a question about a recent-ish MobileFrontend change [19:38:39] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #164: FAILURE in 33 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/164/ [19:38:43] chrismcmahon: sure, what's up? [19:39:36] Project browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #61: SUCCESS in 55 sec: https://integration.wikimedia.org/ci/job/browsertests-Math-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/61/ [19:40:35] marxarelli: features/no_javascript_site.feature has been failing for a while and I think I traced the start of the failure to this patch: https://gerrit.wikimedia.org/r/#/c/147115/ or something within a few hours of it [19:41:23] marxarelli: that test uses a funky step "Given(/^I am using user agent "(.+)"$/) do |user_agent|" in common_steps.rb [19:41:27] chrismcmahon: very possible. that's a huge patch [19:41:49] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce build #145: FAILURE in 1 hr 1 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-windows_xp-firefox-sauce/145/ [19:42:04] and I think something has gone wrong there. it is failing to pass reasonable values to page_object to instantiate the browser [19:43:15] marxarelli: there almost certainly has to be a better way of handling the browser's user agent string than what that test is doing :-) [19:43:33] chrismcmahon: i totally agree. i don't think that patch refactored the step though [19:43:44] it seems i only added parens [19:44:00] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #146: SUCCESS in 4 min 24 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/146/ [19:45:34] chrismcmahon: from what i've seen in mediawiki_selenium, that feature should probably use a @custom-browser tag to prevent early browser instantiation, and a Before hook to perform it manually (w/ the user agent) [19:45:51] chrismcmahon: though, maybe there's a better way of mocking the user agent, i'm not sure [19:46:42] Project browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #105: SUCCESS in 2 min 41 sec: https://integration.wikimedia.org/ci/job/browsertests-WikiLove-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/105/ [19:46:44] Project browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce build #90: STILL FAILING in 2 sec: https://integration.wikimedia.org/ci/job/browsertests-ContentTranslation-language-stage.wmflabs.org-linux-firefox-sauce/90/ [19:48:31] marxarelli: I am pretty certain that was the patch that broke the no_javascript test, I just haven't figured out how it broke. [19:52:45] Given I am using the mobile site # features/step_definitions/common_steps.rb:17 [19:52:45] Unable to pick a platform for the provided browser. [19:52:46] nil was passed to the PageObject constructor instead of a valid browser object. (RuntimeError) [19:52:53] marxarelli: but that one test has been this since ^^ [19:54:27] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #10: STILL FAILING in 7 min 41 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/10/ [19:55:17] chrismcmahon: ok. i'm heading to lunch but i'll take a look at the report when i get back [19:55:52] Project browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce build #129: SUCCESS in 1 min 24 sec: https://integration.wikimedia.org/ci/job/browsertests-Translate-meta.wikimedia.org-linux-firefox-sauce/129/ [19:56:19] marxarelli: thanks. I'll poke it a bit more, but I think the thing to do is to reconsider the whole process of hacking the user agent [19:57:39] Project browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce build #104: SUCCESS in 1 min 46 sec: https://integration.wikimedia.org/ci/job/browsertests-CirrusSearch-test2.wikipedia.org-linux-firefox-sauce/104/ [19:58:35] Project browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #72: SUCCESS in 56 sec: https://integration.wikimedia.org/ci/job/browsertests-PageTriage-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/72/ [20:11:56] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #228: SUCCESS in 55 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/228/ [20:12:24] Project UploadWizard-api-commons.wikimedia.beta.wmflabs.org build #612: SUCCESS in 28 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.beta.wmflabs.org/612/ [20:30:11] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #169: STILL FAILING in 48 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/169/ [20:48:54] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #202: STILL FAILING in 50 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/202/ [20:58:49] Project browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce build #134: STILL FAILING in 46 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-test2.m.wikipedia.org-linux-firefox-sauce/134/ [21:22:25] Project browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce build #116: STILL FAILING in 23 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-firefox-sauce/116/ [21:23:54] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #119: FAILURE in 34 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/119/ [21:26:13] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #129: SUCCESS in 3 min 46 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/129/ [21:26:59] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #174: SUCCESS in 56 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/174/ [21:29:32] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #130: SUCCESS in 3 min 18 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/130/ [21:32:50] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #8: FAILURE in 8 min 54 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/8/ [21:33:18] Project UploadWizard-api-commons.wikimedia.org build #488: SUCCESS in 27 sec: https://integration.wikimedia.org/ci/job/UploadWizard-api-commons.wikimedia.org/488/ [21:33:58] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #4: STILL FAILING in 39 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/4/ [21:37:06] Project browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce build #131: SUCCESS in 3 min 6 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-mediawiki.org-linux-firefox-sauce/131/ [21:40:18] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #130: SUCCESS in 3 min 12 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/130/ [21:49:56] bah! [22:00:55] Project browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce build #117: STILL FAILING in 33 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-test2.wikipedia.org-linux-chrome-sauce/117/ [22:01:51] (03PS1) 10Addshore: Apply wikidata settings specificy /bin/bash [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156977 [22:02:28] (03PS2) 10Addshore: Triggers for Wikidata jobs out of experimental [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/156715 [22:05:30] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141 (10Greg Grossmeier) 3NEW p:3Unprio s:3normal a:3None Let's get some icinga alerts so we know when things are going sideways in Beta Cluster. [22:06:58] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c1 (10Yuvi Panda) - No puppet run for more than 1h - Presence of any puppet failures What else? [22:09:43] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c2 (10Greg Grossmeier) p:5Unprio>3High My first pass list (puppet fails on important vms): * deployment-prep.deployment-bastion.puppetagent.failed_ev... [22:12:30] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c3 (10Greg Grossmeier) (In reply to Yuvi Panda from comment #1) > - No puppet run for more than 1h http://graphite.wmflabs.org/render/?width=586&height=... [22:30:28] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c4 (10Yuvi Panda) I just realized that you can't hit Labs URLs from prod, and so we can't actually do this right now because of that :( Two options: 1.... [22:34:28] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c5 (10Greg Grossmeier) * deployment-prep.deployment-mediawiki01.diskspace.root.byte_free.value < 2 gigs * deployment-prep.deployment-mediawiki02.diskspac... [22:36:28] 3Wikimedia Labs / 3deployment-prep (beta): Determine first pass list of icinga-alerting data from graphite.wmflabs - 10https://bugzilla.wikimedia.org/70141#c6 (10Greg Grossmeier) (In reply to Yuvi Panda from comment #4) > Two options: > 1. File an RT ticket to allow access to graphite.wmflabs.org from labmon... [22:42:36] marxarelli: back to the QA channel to continue the conversation from -mobile about the Echo test, this did not look like a bug to me because it is kind of a weird way to check for correctness: https://gerrit.wikimedia.org/r/#/c/156816 [22:43:40] it is likely a design smell of some sort [22:46:18] (03PS1) 10Addshore: Remove not needed $ext_candidates setting [integration/jenkins] - 10https://gerrit.wikimedia.org/r/156988 [23:01:03] chrismcmahon: yeah, that doesn't seem right [23:01:46] chrismcmahon: they should probably just define a new page element and assert that it's present or not present [23:02:08] (03PS1) 10Addshore: Change spaces to tab [integration/jenkins] - 10https://gerrit.wikimedia.org/r/156993 [23:02:51] chrismcmahon: though i could see how that might result in false positives when it hasn't finished loading yet [23:03:05] marxarelli: I think I argued with Jon about something very similar some time ago, I'mma let it go for now. [23:03:22] chrismcmahon: in that case, assert that the menu is present but not the new-notification link [23:08:27] (03CR) 10Addshore: [C: 031] "Per my test with https://integration.wikimedia.org/ci/job/mwext-Wikidata-client-tests/4/console this patch works and the settings are appl" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/156977 (owner: 10Addshore) [23:34:04] 3Wikimedia Labs / 3deployment-prep (beta): Unable to log in to beta labs on iOS devices - 10https://bugzilla.wikimedia.org/70145 (10Maryana Pinchuk) 3NEW p:3Unprio s:3normal a:3None I've observed this for a couple weeks now at various times on multiple iOS devices (iPhone 5 and iPad 2). It may be aff...