[02:03:23] 3Wikimedia / 3Continuous integration: Jenkins: Job runner slaves in labs no longer updated by puppet - 10https://bugzilla.wikimedia.org/68254 (10Krinkle) 3NEW p:3Unprio s:3critic a:3None I don't know for how many weeks or months this has been broken but the logs are full of failures since at least Ju... [02:13:06] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package php5-parsekit missing in Trusty - 10https://bugzilla.wikimedia.org/68255 (10Krinkle) [02:13:07] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package php5-parsekit missing in Trusty - 10https://bugzilla.wikimedia.org/68255 (10Krinkle) 3NEW p:3Unprio s:3major a:3None Trying to provision a Trusty machine with puppet with the roles for integration slaves fails right due. Among the errors is... [02:14:06] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package php5-parsekit missing in Trusty - 10https://bugzilla.wikimedia.org/68255 (10Krinkle) [02:14:19] 3Wikimedia / 3Continuous integration: Jenkins: Upgrade nodejs from 0.8.x to 0.10.x on wmflabs integration slaves - 10https://bugzilla.wikimedia.org/66056 (10Krinkle) [02:15:22] 3Wikimedia / 3Continuous integration: Jenkins: Set up integration slaves with Ubuntu Trusty - 10https://bugzilla.wikimedia.org/68256 (10Krinkle) [02:15:24] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package ruby-jsduck missing in Trusty - 10https://bugzilla.wikimedia.org/68257 (10Krinkle) 3NEW p:3Unprio s:3major a:3None Trying to provision a Trusty machine with puppet with the roles for integration slaves fails right due. Among the errors is:... [02:24:21] 3Wikimedia / 3Continuous integration: Jenkins: Set up integration slaves with Ubuntu Trusty - 10https://bugzilla.wikimedia.org/68256 (10Krinkle) [02:24:23] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package for mobile jobs (androidsdk, libdclass) missing in Trusty - 10https://bugzilla.wikimedia.org/68259 (10Krinkle) 3NEW p:3Unprio s:3major a:3None Trying to provision a Trusty machine with puppet with the roles for integration slaves fails righ... [03:15:07] 3Wikimedia / 3Continuous integration: Jenkins: browserstests puppet manifest is broken - 10https://bugzilla.wikimedia.org/68260 (10Krinkle) 3NEW p:3Unprio s:3major a:3None (note, this is from setting up a new ubuntu-precise, not ubuntu-trusty image and provisioning it with role::ci::slave::labs from... [03:16:51] 3Wikimedia / 3Continuous integration: Jenkins: browserstests puppet manifest fails on "File[/var/lib/elasticsearc h]:ensure" - 10https://bugzilla.wikimedia.org/68260 (10Krinkle) [03:57:19] 3Wikimedia / 3Continuous integration: [Regression] Jenkins: Jobs for npm testing are broken due to npm certificate issues on the new slaves - 10https://bugzilla.wikimedia.org/61508#c17 (10Krinkle) 5ASSI>3RESO/FIX Existing instances have been patches so marking this as fixed. The fact that we need to pup... [04:59:22] 3Wikimedia / 3Continuous integration: Please have Jenkins do some basic checks of the phabtricator/ repos - 10https://bugzilla.wikimedia.org/68263 (10Greg Grossmeier) 3NEW p:3Unprio s:3normal a:3None We don't appear to have Jenkins doing anything on the phabricator/* repos; we should at least get som... [04:59:35] 3Wikimedia / 3Continuous integration: Please have Jenkins do some basic checks of the phabtricator/ repos - 10https://bugzilla.wikimedia.org/68263 (10Greg Grossmeier) p:5Unprio>3Normal [05:15:57] (03PS1) 10Legoktm: Whitelist jayvdb [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/147717 [05:20:21] 3Wikimedia / 3Continuous integration: Jenkins: browserstests puppet manifest fails on "File[/var/lib/elasticsearch]:ensure" - 10https://bugzilla.wikimedia.org/68260 (10Greg Grossmeier) p:5Unprio>3Normal [05:22:04] 3Wikimedia / 3Continuous integration: Jenkins: Set up integration slaves with Ubuntu Trusty - 10https://bugzilla.wikimedia.org/68256 (10Greg Grossmeier) p:5Unprio>3High [05:22:13] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package for mobile jobs (androidsdk, libdclass) missing in Trusty - 10https://bugzilla.wikimedia.org/68259 (10Greg Grossmeier) p:5Unprio>3Normal [05:22:21] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package php5-parsekit missing in Trusty - 10https://bugzilla.wikimedia.org/68255 (10Greg Grossmeier) p:5Unprio>3Normal [05:22:21] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package ruby-jsduck missing in Trusty - 10https://bugzilla.wikimedia.org/68257 (10Greg Grossmeier) p:5Unprio>3Normal [05:22:34] 3Wikimedia / 3Continuous integration: Jenkins: Job runner slaves in labs no longer updated by puppet - 10https://bugzilla.wikimedia.org/68254 (10Greg Grossmeier) p:5Unprio>3Highes [05:23:04] 3Wikimedia / 3Continuous integration: PageTriage tests must be voting - 10https://bugzilla.wikimedia.org/68205 (10Greg Grossmeier) p:5Unprio>3Normal [05:26:04] 3Wikimedia / 3Continuous integration: core mediawiki.util test failing in Flow qunit Jenkins jobs - 10https://bugzilla.wikimedia.org/68188#c2 (10Greg Grossmeier) p:5Unprio>3Normal This looks to be the consistent warning/failure in the console log: 00:44:56 >> Message: Died on test #2 at http://local... [05:27:05] 3Wikimedia / 3Continuous integration: All repositories should pass jshint test (tracking) - 10https://bugzilla.wikimedia.org/60619 (10Greg Grossmeier) p:5Unprio>3Normal [05:27:35] 3Wikimedia / 3Continuous integration: Set up automatic builds for extensions ported to HHVM - 10https://bugzilla.wikimedia.org/63120 (10Greg Grossmeier) p:5Unprio>3High [07:15:47] (03CR) 10Krinkle: [C: 031] Whitelist jayvdb [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/147717 (owner: 10Legoktm) [19:42:49] 3Wikimedia / 3Continuous integration: PageTriage tests must be voting - 10https://bugzilla.wikimedia.org/68205#c1 (10Antoine "hashar" Musso) The tests are still failing apparently. Whenever they are ready one would have to edit Zuul configuration file: Clone: ssh://gerrit.wikimedia.org:29418/integration/zu... [19:45:35] 3Wikimedia / 3Continuous integration: Jenkins: Job runner slaves in labs no longer updated by puppet - 10https://bugzilla.wikimedia.org/68254#c1 (10Antoine "hashar" Musso) /var is full. Someone thought it would be a good idea to only allocate 2GB to /var for labs instance. Once Ubuntu is installed there is... [19:49:49] 3Wikimedia / 3Continuous integration: Jenkins: Job runner slaves in labs no longer updated by puppet - 10https://bugzilla.wikimedia.org/68254#c2 (10Antoine "hashar" Musso) integration-slave1001.eqiad.wmflabs$ du -h /var/log/diamond 1.1G /var/log/diamond integration-slave1002$ du -h /var/log/diamond 1.2G... [19:53:34] 3Wikimedia / 3Continuous integration: Jenkins: Job runner slaves in labs no longer updated by puppet - 10https://bugzilla.wikimedia.org/68254#c3 (10Antoine "hashar" Musso) Cleared out /var/log/diamond/diamond.log on the three slaves + on puppetmaster. We would need a RT ticket to figure out why diamond logs... [19:59:19] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package ruby-jsduck missing in Trusty - 10https://bugzilla.wikimedia.org/68257#c1 (10Antoine "hashar" Musso) Timo, Faidon is on leave the whole summer. You would need a RT ticket to have the package build for Trusty and any of our European ops should be ab... [20:24:35] hashar: Hey [20:26:12] Krinkle: lo :-D [20:26:33] Krinkle: noticed you attempted setting up a slave with Trusty that is nice [20:27:07] hashar: Do you want to file the RT ticket for diamond? [20:27:31] hashar: Check https://wikitech.wikimedia.org/wiki/Nova_Resource:Integration/Setup [20:27:36] hashar: are you "back" ? [20:28:08] hashar: Did you document this elsewhere already? It was quite hard figuring out the puppet stuff. There was no puppetmaster last I checked, when was that added to integration labs? [20:30:53] Because ops is not ready with Trusty yet (loads of missing packages), and because I can't wait for that to have nodejs 0.10, I went ahead and made more non-puppet hacks using Chris Lea's PPA. I know this is weird, but I couldn't care. [20:31:17] I spend 1.5 day working through shitloads of crap, broken stuff, missing dependencies, puppet, trying to do it the right way. [20:31:43] hashar: yeah, greg told me about Faidon yesterday. I knew that, but forgot. I'll assk go.dog instead. [20:32:02] I'll file RT tickets for the packages now [20:32:29] Krinkle: na I am not back [20:32:34] finishing a cigar + a huge glass of rum [20:32:39] still on vacations technically [20:32:44] just went back home this afternoon [20:32:59] Krinkle: wanna do some hangout on monday to talk about it ? [20:33:34] Krinkle: I have a one hour call from 3pm to 4pm , can do 4:30pm / 5:30pm :) [20:34:25] Krinkle: and yeah CI slaves can't really be setup on Trusty yet :-/ [20:34:49] but some issues you will find will help with the production migration [20:34:58] so it is not a lost effort :D [20:35:38] Krinkle: for node.js, I am pretty sure we can get 0.10 backported to Precise and have production upgraded [20:35:59] though that has some impacts (Parsoid / PDF ) and whatever else is relying on nodejs [20:36:36] but in the long run Trusty is the goal. That is probably why Faidon rejected the idea of back porting nodejs 0.10 [20:37:20] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package for mobile jobs (androidsdk, libdclass) missing in Trusty - 10https://bugzilla.wikimedia.org/68259#c1 (10Krinkle) https://rt.wikimedia.org/Ticket/Display.html?id=7936 [20:37:33] Krinkle: invite me to some hangout next week. Will be happy to talk with you :-) Meanwhile, gotta relax and drink some water [20:37:40] see you next week! [20:37:49] 3Wikimedia / 3Continuous integration: [OPS] Jenkins: Package ruby-jsduck missing in Trusty - 10https://bugzilla.wikimedia.org/68257#c2 (10Krinkle) https://rt.wikimedia.org/Ticket/Display.html?id=7934 [20:38:29] hashar: cool, have fun! [20:38:34] :-) [20:38:36] hashar: It's the hottest day of the year so far. [20:38:41] 34 Celius today here [20:38:44] oh [20:38:50] nothing that bad here [20:39:01] had 32°C on thursday where I was [20:39:09] but that wasn't so unusual [20:39:17] good luck with that temp [20:39:22] :-]