[00:16:52] Yippee, build fixed! [00:16:52] Project selenium-Flow » chrome,beta,Linux,BrowserTests build #538: 09FIXED in 51 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/538/ [04:16:41] Yippee, build fixed! [04:16:42] Project selenium-MultimediaViewer » firefox,beta,Linux,BrowserTests build #541: 09FIXED in 20 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/541/ [06:57:19] PROBLEM - Puppet errors on deployment-kafka01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [06:58:48] (03CR) 10Hashar: [C: 032] Add Sam0410 to the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/383013 (owner: 10Gergő Tisza) [06:59:58] (03Merged) 10jenkins-bot: Add Sam0410 to the CI whitelist [integration/config] - 10https://gerrit.wikimedia.org/r/383013 (owner: 10Gergő Tisza) [08:38:22] 10Continuous-Integration-Infrastructure (shipyard), 10Release-Engineering-Team: Remove integration-slave-docker-1705.integration.eqiad.wmflabs - https://phabricator.wikimedia.org/T177743#3668546 (10hashar) [08:39:09] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Patch-For-Review: Upgrade docker on integration-slave-docker-* - https://phabricator.wikimedia.org/T176267#3619405 (10hashar) 05Open>03Resolved All done. One of the instance did not get upgraded because it is manually setup.... [08:52:25] 10Continuous-Integration-Infrastructure (shipyard), 10Cloud-VPS: integration-slave-docker-1001 deadlocked since Friday Oct 6th ~ 19:00 utc - https://phabricator.wikimedia.org/T177749#3668644 (10hashar) [08:53:23] !log hard restart integration-slave-docker-1001 via horizon. It is deadlocked somehow. - T177749 [08:53:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:53:28] T177749: integration-slave-docker-1001 deadlocked since Friday Oct 6th ~ 19:00 utc - https://phabricator.wikimedia.org/T177749 [08:58:01] RECOVERY - SSH on integration-slave-docker-1001 is OK: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) [08:59:25] PROBLEM - Puppet staleness on integration-slave-docker-1001 is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [43200.0] [09:00:32] hashar: I'm having a look at integration/config to add 2 new projects, but I'm a bit lost... [09:01:45] It looks like the templates are organized according to the gerrit structure. My projects are discovery/discovery-parent-pom and discovery/discovery-maven-tool-configs, so they should probably be defined in config/jjb/discovery.yaml, right? [09:02:04] PROBLEM - Puppet errors on deployment-trending01 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:02:39] hashar: slightly unrelated question: we seem to publish javadoc, any reason to not publish the full maven site? [09:04:25] RECOVERY - Puppet staleness on integration-slave-docker-1001 is OK: OK: Less than 1.00% above the threshold [3600.0] [09:26:38] gehel: bonjour. Désolé je suis dans un truc à la noix [09:27:02] hashar: no problem, no emergency here. Come back to me whenever you have time! [09:27:04] gehel: config/jjb/discovery.yaml probably sounds good. The yaml file names are abitrary [09:27:16] JJB just parse all the yaml files to a single document and then process the result [09:28:37] gehel: so most probably you want to create two new projects [09:28:39] with something like: [09:28:42] - project: [09:28:45] name: discovery/discovery-parent-pom [09:28:46] jobs: [09:29:17] - {name}-maven [09:29:36] hashar: it should be mainly the same config as the existing maven projects for discovery, just not entirely sure how to factorize that... [09:29:43] not sure which maven version ends up being used though [09:34:26] Ok, I'll have a try and send you a CR... [09:35:14] looks like the '{name}-maven' template use whatever first maven is defined in Jenkins [09:35:18] so probably 3.0.5 [09:44:43] Yippee, build fixed! [09:44:43] Project beta-code-update-eqiad build #176111: 09FIXED in 37 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/176111/ [09:45:27] 10Continuous-Integration-Infrastructure (shipyard), 10Cloud-VPS: integration-slave-docker-1001 deadlocked since Friday Oct 6th ~ 19:00 utc - https://phabricator.wikimedia.org/T177749#3668803 (10hashar) 05Open>03Resolved a:03hashar Hard rebooted, force ran puppet. The Jenkins channel to communicate with... [09:54:48] (03PS1) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [09:55:19] hashar: ^ (but I have mostly no idea what I'm doing) [09:56:09] (03CR) 10jerkins-bot: [V: 04-1] Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 (owner: 10Gehel) [09:57:00] (03PS2) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [10:10:22] ehel: looks like a god [10:10:29] gehel: looks like a good start :] [10:10:50] the "god" was probably an overstatement... [10:11:28] hashar: I don't like the redundancy with the job-template in jjb/search.yaml, but I'm not really sure how to factorize [10:14:48] there is a generic jbo template in jjb/job-templates.yaml named '{name}-maven' [10:17:23] gehel: I am commenting inline :) [10:17:40] Thanks! Will have a look [10:19:49] (03CR) 10Hashar: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs (034 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/383094 (owner: 10Gehel) [10:20:01] gehel: gave some info on https://gerrit.wikimedia.org/r/#/c/383094/2/jjb/discovery.yaml [10:20:13] but in short the job template already has a prefix 'discovery-' [10:20:14] hashar: thanks! Will look in a bit... [10:20:24] so in the list of projects you can drop the prefix and thus: [10:20:27] project: [10:20:30] - parent-pom [10:20:35] - maven-tool-configs [10:21:00] it is actually a great idea to have all them in the same jjb project :] [10:21:12] saves you from having to repeat the - project: name: foo for each of them [10:21:18] which is what we did in jjb/search.yaml [10:22:04] v [10:22:06] coffeeee [10:24:32] hashar: where does the prefix comes from? In this case, the full path to the project is discovers/discovery-parent-pom (there is already duplication in the project name, to follow Maven conventions that the project dir should contains the context of the project). [10:27:03] lunch, I'll correct that PR after... [10:28:00] gehel: bon appétit :) [10:28:10] and in short [10:28:26] the job template is 'discovery-{project}' it is given a value of project = discovery-parent-pom [10:28:38] so the job name end up being 'discovery-discovery-parent-pom' [10:29:07] Ok, and how do we find the full path to the gerrit repo? [10:29:28] gehel: it is injected by zuul when triggering the job [10:29:37] Oh, that's the magic I was missing! [10:29:41] :) [10:30:01] so when you send a patch for the gerrit project discovers/discovery-parent-pom [10:30:09] I though it was inferred from the general structure, or something similar, but could not understand how... [10:30:11] zuul inject in the job a variable ZUUL_PROJECT=discovers/discovery-parent-pom [10:30:15] and the job can have any name you want [10:30:28] Ok, it now make sense! [10:30:29] thanks! [10:30:35] And off to lunch for real! [10:30:38] then the job is made to git clone https://gerrit.wikimedia.org/r/p/$ZUUL_PROJECT [11:20:34] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Jenkins: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3669025 (10Paladox) >>! In T168644#3660984, @hashar wrote: > For #operations , we would need the Jenkins 2.73.1 Debi... [11:37:57] PROBLEM - App Server Main HTTP Response on deployment-mediawiki07 is CRITICAL: HTTP CRITICAL: HTTP/1.1 404 Not Found - string 'Wikipedia' not found on 'http://en.wikipedia.beta.wmflabs.org:80/wiki/Main_Page?debug=true' - 392 bytes in 0.013 second response time [11:45:43] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Jenkins: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3669089 (10hashar) Got a bunch of: ``` WARNING: [hudson.plugins.sshslaves.verifiers.TrileadVersionSupportManager ge... [11:49:26] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Upstream, 10WorkType-NewFunctionality: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#3669098 (10hashar) [11:49:29] 10Beta-Cluster-Infrastructure, 10Continuous-Integration-Infrastructure: Reenable ssh MAC/KEX hardening on beta cluster and integration labs project - https://phabricator.wikimedia.org/T100518#3669099 (10hashar) [11:49:31] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Operations, 10Jenkins: Upgrade jenkins to 2.73.1 (new lts release) - https://phabricator.wikimedia.org/T168644#3669096 (10hashar) 05Open>03Resolved a:03hashar [11:50:23] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Upstream, 10WorkType-NewFunctionality: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#1387714 (10hashar) Upgraded Jenkins to 2.73.1 however the SSH plugin reports upon connection: ``` WARNING: [hu... [12:09:54] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Infrastructure, 10User-zeljkofilipin: Upgrade to Chromium 59 or newer on Debian Jessie in CI - https://phabricator.wikimedia.org/T170032#3669130 (10MoritzMuehlenhoff) The Debian maintainer has asked for a volunteer to take care of chromium builds and t... [12:19:26] hashar hi, about https://phabricator.wikimedia.org/T168644#3669089 [12:19:41] i remeber someone implementing that error in the ssh slaves plugin [12:19:57] the jenkins version your now running supports the latest hmac. [12:22:15] https://github.com/jenkinsci/ssh-slaves-plugin/blob/67bbbffac69974b719c3177a1f0036126f227c52/src/main/java/hudson/plugins/sshslaves/verifiers/TrileadVersionSupportManager.java [12:22:55] Yippee, build fixed! [12:22:56] Project selenium-GettingStarted » firefox,beta,Linux,BrowserTests build #550: 09FIXED in 55 sec: https://integration.wikimedia.org/ci/job/selenium-GettingStarted/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/550/ [12:24:49] it's using the correct version https://github.com/jenkinsci/jenkins/blob/jenkins-2.73.1/core/pom.xml#L118 [12:28:09] hashar try testing with a edcsa key. [12:32:19] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Upstream, 10WorkType-NewFunctionality: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#3669177 (10Paladox) >>! In T103351#3669098, @hashar wrote: > Upgraded Jenkins to 2.73.1 however the SSH plugin... [12:32:48] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Upstream, 10WorkType-NewFunctionality: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#3669184 (10Paladox) Did you also upgrade the ssh plugins? [12:40:52] (03PS3) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [12:41:27] (03PS4) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [12:43:59] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Upstream, 10WorkType-NewFunctionality: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#3669221 (10Paladox) @hashar https://issues.jenkins-ci.org/browse/JENKINS-44893 we could be using an older cipher. [12:45:56] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Upstream, 10WorkType-NewFunctionality: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#3669225 (10Paladox) One user found removing java 7 fixed the issue "remove jdk dir with old java 7" [12:46:50] (03PS1) 10Gehel: Improvements to the generic Maven job [integration/config] - 10https://gerrit.wikimedia.org/r/383114 [12:48:15] (03CR) 10Gehel: "Comparing this job the the one defined in search.yaml, I see that search.yaml also defines a few wrappers (timestamps, ansicolor, timeout)" [integration/config] - 10https://gerrit.wikimedia.org/r/383114 (owner: 10Gehel) [12:49:11] hashar try uninstalling java 7 on all the slaves and contint :). [12:49:21] or try it on one of the slaves and on contint1001 [12:53:55] that's probaly why i doint experence the problem as java 7 is not in stretch. [12:55:14] i doint see any tests in integration that uses java 7 now :). [12:56:44] (03CR) 10jerkins-bot: [V: 04-1] Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 (owner: 10Gehel) [12:58:58] hashar it seems we doint have access to https://integration.wikimedia.org/ci/computer/ci-jessie-wikimedia-848573/builds now [12:59:13] "Forbidden [12:59:13] You don't have permission to access /ci/computer/ci-jessie-wikimedia-848573/builds on this server." [13:00:40] hashar: not sure I understand the failure above (^^^). Probably something obvious to you... [13:02:24] paladox: that is random non sense sorry [13:02:33] ok [13:07:33] (03CR) 10Hashar: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/383094 (owner: 10Gehel) [13:07:43] gehel: yeah that error is unclear. The project requires a 'name' variable [13:08:08] gehel: since you do not use the name variable in the job, it can be any string really [13:08:22] eg: name: 'discovery projects using maven' [13:08:23] :] [13:08:45] Ok, I was thinking along that line, but since I was not seeing any ref to ${name} ... [13:08:47] patch coming up [13:08:53] yeah that made sense [13:08:59] I would probably have done the exact same patch [13:09:00] :D [13:09:05] Project beta-scap-eqiad build #176721: 15ABORTED in 50 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/176721/ [13:10:13] Project beta-scap-eqiad build #176722: 04FAILURE in 0.39 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/176722/ [13:10:15] (03PS5) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [13:12:29] PROBLEM - Puppet errors on deployment-tin is CRITICAL: CRITICAL: 22.22% of data above the critical threshold [0.0] [13:13:44] Project beta-scap-eqiad build #176723: 04STILL FAILING in 0.33 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/176723/ [13:13:52] 10Continuous-Integration-Infrastructure, 10Jenkins, 10Patch-For-Review, 10Upstream, 10WorkType-NewFunctionality: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#3669325 (10hashar) I have applied https://gerrit.wikimedia.org/r/383120 on the CI puppet... [13:14:01] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Kanban), 10Jenkins, 10Patch-For-Review, and 2 others: Jenkins trilead-ssh2 doesn't support our MAC/KEX algorithms - https://phabricator.wikimedia.org/T103351#3669328 (10hashar) [13:19:54] paladox: turns out it is working just fine :] [13:20:11] paladox: I dont know why ssh plugin yields a "Could not create Trilead support class. Using legacy Trilead features" warning [13:20:26] paladox: so in short: congratulations :] [13:21:09] your welcome :) [13:21:10] https://issues.jenkins-ci.org/browse/JENKINS-44893 [13:21:35] Project beta-scap-eqiad build #176724: 04STILL FAILING in 0.43 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/176724/ [13:22:28] 13:21:35 LockFailedError: Failed to acquire lock "/var/lock/scap.operations_mediawiki-config.lock"; owner is "jenkins-deploy"; reason is "beta-scap-eqiad (build #176721)" [13:23:38] Project beta-scap-eqiad build #176725: 04STILL FAILING in 0.4 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/176725/ [13:24:52] ^ got it [13:25:00] aborted build left a lock file in place [13:25:34] thcipriani|afk: yeah sorry. I canceled a build earlier ] [13:26:01] !log Upgraded Jenkins to 2.73.1 earlier today [13:26:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:26:13] hashar: no problem, congrats on the upgrade :) [13:27:36] Yippee, build fixed! [13:27:37] Project beta-scap-eqiad build #176726: 09FIXED in 2 min 18 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/176726/ [13:31:56] (03CR) 10Zfilipin: "This was scheduled for EU SWAT today, but I do not feel comfortable deploying it until somebody that knows CI well (like hashar) gives it " [integration/config] - 10https://gerrit.wikimedia.org/r/375765 (https://phabricator.wikimedia.org/T176570) (owner: 10MarcoAurelio) [13:37:27] RECOVERY - Puppet errors on deployment-tin is OK: OK: Less than 1.00% above the threshold [0.0] [13:40:29] (03CR) 10Hashar: [C: 032] Whitelist Dvorapa on Zuul CI [integration/config] - 10https://gerrit.wikimedia.org/r/375765 (https://phabricator.wikimedia.org/T176570) (owner: 10MarcoAurelio) [13:41:05] gehel: going to check whether I can refactor out your patch to avoid some code duplication :] [13:41:22] gehel: as is it looks good. Just have to register the Gerrit projects in zuul/layout.yaml but I can just amend your patch [13:41:47] hashar: I was having a try in https://gerrit.wikimedia.org/r/#/c/383114/ [13:42:13] ohhhh yeah [13:42:56] (03Merged) 10jenkins-bot: Whitelist Dvorapa on Zuul CI [integration/config] - 10https://gerrit.wikimedia.org/r/375765 (https://phabricator.wikimedia.org/T176570) (owner: 10MarcoAurelio) [13:44:38] (03CR) 10Hashar: [C: 032] "That updates just analytics-refinery-maven :)" [integration/config] - 10https://gerrit.wikimedia.org/r/383114 (owner: 10Gehel) [13:44:55] hashar: ok, I'll rebase my patch on this one in a few... [13:46:19] gehel: and maybe we can refactor the maven jobs in jjb/search.yaml as well [13:46:27] if they all end up being the same we can end up with something like: [13:46:27] yep [13:46:31] - project: [13:46:35] name: 'our maven jobs' [13:46:39] project: [13:46:44] - analytics-refinery [13:46:48] - search-foobar [13:46:58] - discovery-parent-pom [13:46:59] jobs: [13:47:06] - '{project}-maven' [13:48:02] the analytics-refinery one is running at https://integration.wikimedia.org/ci/job/analytics-refinery-maven/770/console :) [13:48:32] (03Merged) 10jenkins-bot: Improvements to the generic Maven job [integration/config] - 10https://gerrit.wikimedia.org/r/383114 (owner: 10Gehel) [13:52:06] (03CR) 10Hashar: [C: 032] "The job worked fine after the change https://integration.wikimedia.org/ci/job/analytics-refinery-maven/770/console \o/" [integration/config] - 10https://gerrit.wikimedia.org/r/383114 (owner: 10Gehel) [13:52:53] 10Continuous-Integration-Config, 10Patch-For-Review: Whitelist Dvorapa on Zuul CI - https://phabricator.wikimedia.org/T176570#3669424 (10hashar) 05Open>03Resolved a:03hashar [13:57:09] (03PS6) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [13:58:40] hashar: does it make sense to port the wrappers defined in search.yaml to the generic maven job (timeout, timestamps, ansicolor) ? [14:02:57] gehel: maybe because we had to bump the default timeout [14:03:35] the defaults for jobs is in jjb/defaults.yaml [14:03:41] which has a -defaults: name: global [14:03:55] the timeout wrapper having 30 minutes [14:04:10] and the jobs in search.yaml seems to have 60 minutes. But I dont think there is any good reason for that [14:04:19] 30 minutes should be plenty for the search jobs [14:04:45] I agree :) [14:05:06] it probably just got copy pasted over and over [14:05:13] (03PS7) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [14:05:40] (03PS8) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [14:06:02] hashar: ok, this one should be good for the 2 new projects (if I understood how all that works) [14:06:44] (03CR) 10jerkins-bot: [V: 04-1] Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 (owner: 10Gehel) [14:06:58] ok, looks like I did not understand :( [14:09:22] ahhh yeah [14:10:51] (03PS1) 10Hashar: Lower search*-maven jobs timeout to 30 minutes [integration/config] - 10https://gerrit.wikimedia.org/r/383129 [14:11:12] gehel: I guess a project cant have two names :] [14:11:32] or it the name looks like a list internally bah [14:18:39] ok, let's try again... [14:18:58] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3669546 (10jkroll) Thanks @MaxSem. I've tried to reproduce it on deployment-med... [14:19:50] (03PS9) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [14:21:26] (03PS1) 10Gehel: search: use the generic maven job template [integration/config] - 10https://gerrit.wikimedia.org/r/383132 [14:22:21] (03CR) 10jerkins-bot: [V: 04-1] Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 (owner: 10Gehel) [14:22:24] hashar: my next step (whenever I find myself with nothing to do) will be to have a look at publishing the full maven site, instead of just the java doc [14:22:54] (03PS1) 10Hashar: {name}-maven now discard artifacts after 15 days [integration/config] - 10https://gerrit.wikimedia.org/r/383133 [14:22:55] that is surely doable :) [14:22:56] (03PS1) 10Hashar: Factor out common maven jobs [integration/config] - 10https://gerrit.wikimedia.org/r/383134 [14:23:21] gehel: those patches above ultimately make all the repos to use '{name}-maven' [14:23:35] with an alias job template '{name}-{project}-maven' that will fit your use case [14:23:40] this way you will get: [14:23:43] - project: [14:23:47] name: discovery [14:23:49] project: [14:23:53] - pom-parent [14:23:55] - foo [14:23:56] :) [14:23:59] jobs: [14:24:08] - {name}-{project}-maven [14:24:23] gehel: gotta grab kids at school. I guess I will follow up tonight [14:24:32] hashar: thanks for the help! [14:24:48] for the maven site, look at macros having "archive:" [14:24:57] there is probably one for javadoc or other build artifacts [14:25:11] if you know the path, it is rather trivial to save the files back in jenkins [14:25:34] publishing it is a bit more complicated but there are macros here and there. would have to look intoit. That is usually in -doc-publish jobs [14:26:00] (03PS10) 10Gehel: Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 [14:26:29] gehel: +1 :) [14:26:43] (03PS2) 10Gehel: search: use the generic maven job template [integration/config] - 10https://gerrit.wikimedia.org/r/383132 [14:26:48] je file! I deploy all of that in an hour and a half :) [14:30:48] (03CR) 10jerkins-bot: [V: 04-1] Factor out common maven jobs [integration/config] - 10https://gerrit.wikimedia.org/r/383134 (owner: 10Hashar) [14:35:17] (03CR) 10jerkins-bot: [V: 04-1] Add jenkins jobs for discovery-parent-pom and -maven-tool-configs [integration/config] - 10https://gerrit.wikimedia.org/r/383094 (owner: 10Gehel) [14:36:43] (03CR) 10jerkins-bot: [V: 04-1] search: use the generic maven job template [integration/config] - 10https://gerrit.wikimedia.org/r/383132 (owner: 10Gehel) [14:36:55] hasharAway: I'm giving up on understanding jjb atm... let's see if I can do something that works with your help later :( [14:43:43] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3669614 (10jkroll) Also, getting a core file when this happens would be helpful... [15:05:50] 10Release-Engineering-Team (Kanban), 10Analytics-Kanban, 10Patch-For-Review: Move Wikistats 2 from Differential to Gerrit - https://phabricator.wikimedia.org/T177288#3669669 (10Nuria) 05Open>03Resolved [15:10:11] PROBLEM - Puppet errors on deployment-cache-upload04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:16:15] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3632060 (10Addshore) I have also tried reproducing this and really cant make it... [15:21:52] PROBLEM - Puppet errors on deployment-cache-text04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [15:23:46] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3669690 (10MoritzMuehlenhoff) >>! In T176637#3669546, @jkroll wrote: > Thanks @... [15:25:56] (03CR) 10Hashar: [C: 032] "deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/383129 (owner: 10Hashar) [15:26:47] (03CR) 10Hashar: [C: 032] "Deployed the only job affected: analytics-refinery-maven" [integration/config] - 10https://gerrit.wikimedia.org/r/383133 (owner: 10Hashar) [15:27:10] (03Merged) 10jenkins-bot: Lower search*-maven jobs timeout to 30 minutes [integration/config] - 10https://gerrit.wikimedia.org/r/383129 (owner: 10Hashar) [15:27:59] (03Merged) 10jenkins-bot: {name}-maven now discard artifacts after 15 days [integration/config] - 10https://gerrit.wikimedia.org/r/383133 (owner: 10Hashar) [15:32:15] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3669695 (10Addshore) >>! In T176637#3669690, @MoritzMuehlenhoff wrote: > On the... [15:32:40] (03PS2) 10Hashar: Factor out common maven jobs [integration/config] - 10https://gerrit.wikimedia.org/r/383134 [15:34:04] PROBLEM - Free space - all mounts on deployment-kafka01 is CRITICAL: CRITICAL: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree (<100.00%) [15:34:49] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3669700 (10jkroll) >>! In T176637#3669690, @MoritzMuehlenhoff wrote: > On the 2... [15:35:21] (03PS3) 10Hashar: Template to factor out common maven jobs [integration/config] - 10https://gerrit.wikimedia.org/r/383134 [15:35:42] (03CR) 10Hashar: "Guillaume, that one will solve your trouble :]" [integration/config] - 10https://gerrit.wikimedia.org/r/383134 (owner: 10Hashar) [15:38:31] (03PS3) 10Hashar: search: use the generic maven job template [integration/config] - 10https://gerrit.wikimedia.org/r/383132 (owner: 10Gehel) [15:39:41] gehel: https://gerrit.wikimedia.org/r/#/c/383134/ and then your patch https://gerrit.wikimedia.org/r/#/c/383132/ [15:39:46] (03CR) 10Hashar: "Rebased on top of https://gerrit.wikimedia.org/r/#/c/383134/ which introduce the '{name}-{project}-maven' template (as an alias of the gen" [integration/config] - 10https://gerrit.wikimedia.org/r/383132 (owner: 10Gehel) [15:39:48] gehel: and I guess that will do what you are expecting :] [15:40:10] Ok, I'll start reading and see if I understand anything :) [15:40:40] gehel: there is a yaml trick to alias the content of one template to another one with a different name [15:47:12] 10Release-Engineering-Team (Kanban), 10Release, 10Train Deployments: 1.31.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T174359#3669771 (10Addshore) [15:47:15] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release, 10Train Deployments: 1.31.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T174358#3669772 (10Addshore) [16:04:55] (03CR) 10Gehel: [C: 031] "LGTM (and trusting hashar to know what he is doing)" [integration/config] - 10https://gerrit.wikimedia.org/r/383132 (owner: 10Gehel) [16:06:23] (03CR) 10Gehel: [C: 031] "LGTM (and now I mostly understand what I was doing wrong)" [integration/config] - 10https://gerrit.wikimedia.org/r/383134 (owner: 10Hashar) [16:06:25] (03PS1) 10Hashar: docker: trim /var/lib/apt/lists/ [integration/quibble] - 10https://gerrit.wikimedia.org/r/383152 [16:07:28] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3669831 (10Jdlrobson) @Addshore this doesn't appear to be happening any more, b... [16:08:25] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3669832 (10Jdlrobson) [16:09:31] (03PS2) 10Hashar: docker: trim /var/lib/apt/lists/ [integration/quibble] - 10https://gerrit.wikimedia.org/r/383152 [16:15:16] (03PS3) 10Hashar: docker: squash apt-get install in a single RUN [integration/quibble] - 10https://gerrit.wikimedia.org/r/383152 [16:18:50] (03PS4) 10Hashar: docker: squash apt-get install in a single RUN [integration/quibble] - 10https://gerrit.wikimedia.org/r/383152 [16:36:09] PROBLEM - Puppet errors on integration-slave-jessie-1004 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [16:42:06] (03PS1) 10Hashar: Running global-setup.sh is useless [integration/quibble] - 10https://gerrit.wikimedia.org/r/383159 [16:42:11] (03PS1) 10Hashar: docker: run as user nobody [integration/quibble] - 10https://gerrit.wikimedia.org/r/383160 [16:57:14] (03PS2) 10Hashar: docker: run as user nobody [integration/quibble] - 10https://gerrit.wikimedia.org/r/383160 [16:57:16] (03PS1) 10Hashar: Switch database backed to sqlite [integration/quibble] - 10https://gerrit.wikimedia.org/r/383161 [17:11:08] RECOVERY - Puppet errors on integration-slave-jessie-1004 is OK: OK: Less than 1.00% above the threshold [0.0] [17:19:35] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3670038 (10MoritzMuehlenhoff) >>! In T176637#3669700, @jkroll wrote: > Is it li... [17:20:25] 10Release-Engineering-Team (Watching / External), 10Contributors-Team, 10MobileFrontend, 10Operations, and 3 others: Diff page consistently produces 503 on beta cluster on first visit - https://phabricator.wikimedia.org/T176637#3670039 (10MoritzMuehlenhoff) >>! In T176637#3669695, @Addshore wrote: > Is it... [18:02:23] (03PS1) 10Umherirrender: Add sniff for @params instead of @param [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/383168 [18:06:31] (03CR) 10jerkins-bot: [V: 04-1] Add sniff for @params instead of @param [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/383168 (owner: 10Umherirrender) [18:57:22] 10Release-Engineering-Team, 10Collection, 10Readers-Web-Backlog, 10Readers-Web-Kanban-Board: Collection tests do not run properly - https://phabricator.wikimedia.org/T177672#3670334 (10Jdlrobson) cc @hashar [19:32:48] 10Release-Engineering-Team, 10Collection, 10Readers-Web-Backlog, 10Readers-Web-Kanban-Board: Collection tests do not run properly - https://phabricator.wikimedia.org/T177672#3670408 (10Jdlrobson) [19:55:52] (03PS1) 10Umherirrender: Unwrap types in function docs from {} [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/383184 [20:15:14] (03CR) 10Umherirrender: "recheck" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/383168 (owner: 10Umherirrender) [20:19:13] (03CR) 10jerkins-bot: [V: 04-1] Add sniff for @params instead of @param [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/383168 (owner: 10Umherirrender) [20:42:49] 10Continuous-Integration-Config, 10Patch-For-Review: operations-mw-config-composer-hhvm-jessie job lacks composer cache - https://phabricator.wikimedia.org/T156359#3670603 (10hashar) [20:42:51] 10Continuous-Integration-Config: composer cache-dir configuration vary between Trusty and Jessie - https://phabricator.wikimedia.org/T158117#3670600 (10hashar) 05Open>03Resolved a:03hashar Composer defaults to composer home dir /cache. But if it finds any env variable XDG_*, it will then uses $HOME/.cach... [21:29:56] PROBLEM - Puppet errors on integration-cumin is CRITICAL: CRITICAL: 30.00% of data above the critical threshold [0.0] [21:42:47] (03CR) 10Hashar: "A few nitpicks. The npm image could use a /cache directory owned by nobody." (034 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/382946 (owner: 10Legoktm) [21:53:15] (03CR) 10Hashar: Move doxygen-publish job to docker (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/382957 (owner: 10Legoktm) [21:57:43] (03CR) 10Hashar: [C: 04-1] Add sanity checking example-run.sh for composer image (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/382352 (owner: 10Legoktm) [22:09:57] RECOVERY - Puppet errors on integration-cumin is OK: OK: Less than 1.00% above the threshold [0.0] [22:20:28] (03PS3) 10Krinkle: mwconf: Use built-in TestSettings.php instead when available [integration/jenkins] - 10https://gerrit.wikimedia.org/r/383040 (https://phabricator.wikimedia.org/T177669)