[03:50:20] 3Wikimedia / 3Continuous integration: jenkins - operations-puppet-puppetlint-strict - checks outdated files - 10https://bugzilla.wikimedia.org/67834 (10Daniel Zahn) 3NEW p:3Unprio s:3normal a:3None in operations/puppet i noticed on: https://gerrit.wikimedia.org/r/#/c/145472/ --> https://integratio... [06:17:48] 3Wikimedia / 3Continuous integration: jenkins - operations-puppet-puppetlint-strict - checks outdated files - 10https://bugzilla.wikimedia.org/67834#c1 (10Antoine "hashar" Musso) 5NEW>3RESO/WOR The first page of manifests/admins.pp is a comment with a bunch of blank line. Hit page down for the rest of t... [08:47:11] hashar_: could you take a look at this? https://gerrit.wikimedia.org/r/#/c/131048/ [08:47:58] I think I have managed to rebase this commit [08:48:07] and it seems to be working [08:48:26] but there were a lot of changes, so I would prefer if somebody else also took a look and merged it [08:58:16] zeljkof: gooood morning [08:58:29] hashar: morning :) [08:58:44] there is a thread on QA list "Failing MobileFrontend browser tests" that you might want to read :-D [08:58:59] Juliusz Gonera complains about the MobileFrontend browser tests failing constantly [08:58:59] hashar: reading it right now :) [08:59:02] great [08:59:02] yeah [08:59:10] I haven clue what are the issues :-( [08:59:19] we have been struggling with them for a while [08:59:42] one of the reasons we moved to wikimedia jenkins was because it was hard to debug at cloudbees [08:59:54] now we have root and everything now [09:00:00] \O/ [09:00:14] looking at the test trend on https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/ [09:00:26] thre is roughly 85 tests and always roughly 10 of them failling [09:00:36] I browsed the history and it seems that is different ones failing each time :-( [09:01:27] looking at a build test result such as https://integration.wikimedia.org/ci/view/BrowserTests/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/55/testReport/ [09:01:28] hashar: yeah [09:01:36] it shows the age of thetests [09:01:42] lot are usually 1 build old [09:01:50] I will try playing with setting up different types of builds [09:01:51] which mean they are new fail / transient error [09:02:02] I just need time :) [09:02:30] I guess we should remove mobile-l from notifications ? [09:02:47] hashar: I do not care :) [09:02:52] :D [09:02:55] if they ask for it, then yes [09:03:04] I think one person did [09:03:13] as far as I remember, they said it is just noise now, since tests are always failing [09:03:16] anyway looking at "Normalize ZeroBanner job" https://gerrit.wikimedia.org/r/#/c/131048/ :D [09:03:24] hashar: great, thanks [09:05:52] (03PS1) 10Hashar: Support setting VERSION for phantomjs browser [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/145527 [09:06:27] (03CR) 10Hashar: Normalize ZeroBanner job (031 comment) [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/131048 (owner: 10Hashar) [09:07:03] (03PS5) 10Hashar: Normalize ZeroBanner job [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/131048 [09:07:08] splitting splitting [09:08:44] (03CR) 10Hashar: [C: 031] Normalize ZeroBanner job [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/131048 (owner: 10Hashar) [09:12:31] hashar: should I merge zero jjb commit? [09:12:36] I see that you have +1d it [09:13:09] zeljkof: yes :-D [09:13:17] I can't login in Jenkins anymore :-( [09:13:28] hashar: I see, you have moved phantomjs version thing to a separate commit, good [09:13:32] will +2 everything [09:14:07] (03CR) 10Zfilipin: [C: 032] Support setting VERSION for phantomjs browser [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/145527 (owner: 10Hashar) [09:14:35] (03CR) 10Zfilipin: [C: 032] Normalize ZeroBanner job [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/131048 (owner: 10Hashar) [09:15:39] (03Merged) 10jenkins-bot: Support setting VERSION for phantomjs browser [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/145527 (owner: 10Hashar) [09:15:52] (03Merged) 10jenkins-bot: Normalize ZeroBanner job [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/131048 (owner: 10Hashar) [09:19:13] ah found it [09:19:18] LDAP must have been updated or something [09:24:59] ah that is Juliusz saying there is no point in receiving notifications to mobile-tech [09:25:05] guess we can be bold and remove it [09:25:17] till the jobs are stabilized / beta|saucelab issue solved [10:43:39] (03PS1) 10Hashar: Make Lingo jslint voting [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145534 (https://bugzilla.wikimedia.org/61609) [10:43:52] (03CR) 10Hashar: [C: 032] Make Lingo jslint voting [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145534 (https://bugzilla.wikimedia.org/61609) (owner: 10Hashar) [10:43:56] (03Merged) 10jenkins-bot: Make Lingo jslint voting [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145534 (https://bugzilla.wikimedia.org/61609) (owner: 10Hashar) [10:45:59] (03CR) 10Hashar: "If the job ever work, feel free to self merge this change =)" [integration/jenkins-job-builder-config] (cloudbees) - 10https://gerrit.wikimedia.org/r/144937 (https://bugzilla.wikimedia.org/62737) (owner: 10Zfilipin) [11:00:02] 3Wikimedia / 3Continuous integration: Add Jenkins jobs for Elastica extension repo - 10https://bugzilla.wikimedia.org/63231#c2 (10Antoine "hashar" Musso) Fixed in May by https://gerrit.wikimedia.org/r/#/c/135564/ though the triggers haven't been added to Zuul. [11:00:33] (03PS1) 10Hashar: Trigger Elastica jobs [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145535 (https://bugzilla.wikimedia.org/63231) [11:01:18] (03CR) 10Hashar: [C: 032] Trigger Elastica jobs [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145535 (https://bugzilla.wikimedia.org/63231) (owner: 10Hashar) [11:01:23] (03Merged) 10jenkins-bot: Trigger Elastica jobs [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145535 (https://bugzilla.wikimedia.org/63231) (owner: 10Hashar) [11:03:03] 3Wikimedia / 3Continuous integration: Add Jenkins jobs for Elastica extension repo - 10https://bugzilla.wikimedia.org/63231#c7 (10Antoine "hashar" Musso) 5PATC>3RESO/FIX a:3Antoine "hashar" Musso Tests pass on a dummy change https://gerrit.wikimedia.org/r/#/c/145536/ [11:06:31] 3Wikimedia / 3Continuous integration: [project] trigger browser tests from Gerrit (tracking) - 10https://bugzilla.wikimedia.org/53697#c6 (10Antoine "hashar" Musso) p:5High>3Normal This is no more a top priority. We have most browsertests run twice per day instead. We will eventually managed to get them... [11:56:39] (03PS5) 10Hashar: Drop history of mw/core jobs after 15 days [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/136993 (https://bugzilla.wikimedia.org/63936) [12:02:03] (03PS6) 10Hashar: Drop history of mw/core jobs after some time [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/136993 (https://bugzilla.wikimedia.org/63936) [12:02:57] (03CR) 10Hashar: [C: 032] "Deployed" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/136993 (https://bugzilla.wikimedia.org/63936) (owner: 10Hashar) [12:03:30] (03Merged) 10jenkins-bot: Drop history of mw/core jobs after some time [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/136993 (https://bugzilla.wikimedia.org/63936) (owner: 10Hashar) [17:44:01] 3Wikimedia / 3Continuous integration: jenkins - operations-puppet-puppetlint-strict - checks outdated files - 10https://bugzilla.wikimedia.org/67834#c2 (10Daniel Zahn) oh my.. sorry Antoine, of course you're right [17:44:17] 3Wikimedia / 3Continuous integration: jenkins - operations-puppet-puppetlint-strict - checks outdated files - 10https://bugzilla.wikimedia.org/67834 (10Daniel Zahn) 5RESO/?>3VERI [18:35:39] (03PS1) 10Pastakhov: add dependencies for the PhpTagsWiki extension [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/145604 [18:38:07] (03CR) 10Pastakhov: "How to enable tests for the PhpTagsWiki extension?" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/145604 (owner: 10Pastakhov) [18:41:46] 3Wikimedia / 3Continuous integration: Setup QUnit tests on Jenkins for Flow - 10https://bugzilla.wikimedia.org/67734#c15 (10Jon) The tests are still failing for me and it seems unrelated to MobileFrontend.. an issue in mediawiki.util https://integration.wikimedia.org/ci/job/mwext-Flow-qunit/82/console I thi... [19:37:25] (03PS1) 10Ori.livneh: Add jobrunner to mediawiki-services.yaml [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/145624 [20:54:35] (03CR) 10Krinkle: [C: 032] "Deployed jobrunner-phplint. https://integration.wikimedia.org/ci/job/jobrunner-phplint/" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/145624 (owner: 10Ori.livneh) [20:57:31] (03Merged) 10jenkins-bot: Add jobrunner to mediawiki-services.yaml [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/145624 (owner: 10Ori.livneh) [21:23:56] (03PS1) 10Ori.livneh: add config for mediawiki/services/jobrunner [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145692 [21:30:41] (03CR) 10Krinkle: [C: 032] add config for mediawiki/services/jobrunner [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145692 (owner: 10Ori.livneh) [21:30:47] (03Merged) 10jenkins-bot: add config for mediawiki/services/jobrunner [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/145692 (owner: 10Ori.livneh) [23:16:02] Krinkle: hate to bother you again, but same patch from before is still waiting in zuul. Currently zuul doesn't report anything as currently running(but i dont know if those queues are growing, just paging through integration.wikimedia.org/zuul/ now blue bars for currently running jobs) [23:16:19] i wouldn't bug you, but there a fatal happening on beta labs and i'm trying to debug it with that patch :) [23:16:30] ebernhardson: Sorry, queue was cleared. This is a side-effect of rebooting the system when it crashes every week. [23:16:38] Need to [x] CR+2 and re-CR+@ [23:16:42] ok [23:16:50] A few were preserved though [23:16:58] make sure it's not in the queue on /zuul/ [23:17:36] Krinkle: its listed in the queue under gate-and-submit, but nothing seems to be running [23:17:39] ebernhardson: It suck badly, but at the moment there's no human resources dedicated to a long term solution. Hashar and I are both working on other things. We do have plans for it, and are slowly working on a replacement for the backend that causes it to crash. [23:17:52] fun :) [23:17:59] ebernhardson: Hm.. got a link? [23:18:51] Krinkle: just https://integration.wikimedia.org/zuul/ . On the right side under gate-and-submit there is Queue:mediawiki/extensions/Flow and the two patches sitting there [23:19:28] Right, oh this makes sense [23:19:38] I think the old queue was preserved but not being used [23:19:44] new events are being processed from what I can see [23:19:55] can you verify by [x]CR2 and re-adding? [23:20:03] If that works, I'll go ahead and clear the old queue [23:21:04] Krinkle: i gave it a +0 and then +2 (path 145706) about 2 minutes ago. not seeing any gate-and-submit message on the patch from jenkins though so i might not have done that right: https://gerrit.wikimedia.org/r/#/c/145706/ [23:21:56] ebernhardson: one more time/ [23:22:44] OK, running now :) [23:22:48] ok new gate-and-submit message showed up [23:22:50] awsome, thanks! [23:23:11] restart != stop/start in zuul [23:23:15] apparantly [23:23:19] heh [23:23:24] restart preserves queue [23:23:29] which then makes it ignore anything else