[00:18:30] hi all! [00:18:51] Any chance we could get the mcrypt extension installed/enabled on the integration slaves? [00:19:16] fr-tech is hoping to ditch our fork of civicrm-buildkit, but the upstream version dies when that's not available [00:20:00] ejegg: Make a patch to puppet? :) [00:20:20] k, will do! [00:20:29] Should just be able to get ops to merge it [00:20:35] I think the hardest part is finding where it needs to be [00:20:58] repo is operations/puppet, right? [00:22:02] ejegg: https://github.com/wikimedia/puppet/blob/production/modules/contint/manifests/packages/php.pp#L4 [00:22:04] I think it's that file [00:22:19] ah, thanks! [00:22:37] not 100% sure, but looks sane :) [00:28:23] hmm, that seems to be for all the servers. phragile's manifest installs it explicitly [00:29:05] I hope contint::packages::php isn't on every server :) [00:29:33] ooh, sorry, contint [00:29:42] yep, that's the one then! [00:30:59] Can probably just get ops to merge and deploy it too [03:59:10] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,BrowserTests build #332: 04FAILURE in 3 min 9 sec: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=BrowserTests/332/ [06:03:14] PROBLEM - puppet last run on contint1001 is CRITICAL: CRITICAL: Catalog fetch fail. Either compilation failed or puppetmaster has issues [06:09:15] RECOVERY - puppet last run on contint1001 is OK: OK: Puppet is currently enabled, last run 7 seconds ago with 0 failures [06:27:44] Project selenium-Wikibase » chrome,test,Linux,BrowserTests build #302: 04FAILURE in 1 hr 47 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=BrowserTests/302/ [08:53:12] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Infrastructure, 07Jenkins, 07Upstream: Do not say "< wmf-insecte> Yippee, build fixed!" - https://phabricator.wikimedia.org/T95395#3109191 (10hashar) 05stalled>03declined Per Bryan. It is not going to happen unless someone solves it upstream via... [09:03:37] (03PS2) 10Hashar: oojs-ui-demos-publish to Jessie/modern NodeJs [integration/config] - 10https://gerrit.wikimedia.org/r/343077 (https://phabricator.wikimedia.org/T160583) [09:17:07] (03CR) 10Hashar: [C: 032] oojs-ui-demos-publish to Jessie/modern NodeJs [integration/config] - 10https://gerrit.wikimedia.org/r/343077 (https://phabricator.wikimedia.org/T160583) (owner: 10Hashar) [09:18:28] 10Continuous-Integration-Config, 10OOjs-UI, 13Patch-For-Review: oojs-ui-demos-publish job needs to run on anything other than Trusty please (modern Node version needed) - https://phabricator.wikimedia.org/T160583#3109214 (10hashar) 05Open>03Resolved a:03hashar The job has been migrated from Trusty to J... [09:18:33] (03Merged) 10jenkins-bot: oojs-ui-demos-publish to Jessie/modern NodeJs [integration/config] - 10https://gerrit.wikimedia.org/r/343077 (https://phabricator.wikimedia.org/T160583) (owner: 10Hashar) [09:20:52] (03PS4) 10Hashar: Search: switch to verify instead of package [integration/config] - 10https://gerrit.wikimedia.org/r/342878 (owner: 10DCausse) [09:24:23] gehel: dcausse: bonjour! En passant les jobs Jenkins de 'maven package' a 'maven verify' ca va lancer javadoc non ? [09:24:35] je me demande si du coup on peut retirer les jobs pour javadoc [09:24:50] hashar: aucune idée :/ [09:24:52] hashar: Ca dépend comment le plugin javadoc est configuré [09:25:19] et ça dépend de ce qu'on fait avec la javadoc après... [09:25:22] et le javadoc est en post-merge [09:25:53] ah oui on a deux javadoc [09:25:59] si javadoc est lancé aussi en build normaux on peut l'enlever et le laiser qu'en post merge à mon avis [09:26:01] un pour le test et +2 [09:26:14] et un autre plus specific qui ne lance que javadoc et publie le résultat vers doc.wm.o [09:26:34] ^ seul celui là est important je pense [09:26:52] yup [09:26:53] ce qui pourrait être intéressant serait de générer les maven sites et de laisser le contenu de celui-ci sous la responsabilité de Maven (ou d'un pom parent) [09:27:07] mais il faut tout le meme lancer javadoc sur chaque patch pour être sur qu'il marchera après le merge [09:27:42] hm oui tu as raisons si ca plante en post merge c'est pénible [09:27:47] hashar: yep, toujours générer la doc fait du sens [09:28:08] c'est ce qu'on fait avec le job -javadoc [09:28:23] tu as le lien vers cette config? [09:29:04] gehel: https://github.com/wikimedia/integration-config/blob/master/zuul/layout.yaml#L9099-L9137 [09:29:47] (03CR) 10Hashar: [C: 032] "All updated. We can then figure out whether javadoc is run by the 'verify' step and if so remove the -javadoc jobs :-}" [integration/config] - 10https://gerrit.wikimedia.org/r/342878 (owner: 10DCausse) [09:30:03] gehel: git clone ssh://gehel@gerrit.wikimedia.org:29418/integration/config :P [09:30:34] ;D [09:31:13] (03Merged) 10jenkins-bot: Search: switch to verify instead of package [integration/config] - 10https://gerrit.wikimedia.org/r/342878 (owner: 10DCausse) [09:31:41] merci pour le merge hashar! [09:33:51] la joie de JJB, j'avais presque oublié ... [09:34:04] :) [09:34:48] ce qui est bien avec ce 'mvn clean verify' c'est que ca vous laisse toute liberté pour ajouter d'autres outils [09:37:14] ouaip, c'est en général l'idée... maven propose suffisamment de structure pour gérer la logique de build et laisser à Jenkins juste la fonction de bête scheduler [09:39:04] on utilise jenkins pour publier la javadoc, pas maven... [09:41:21] Oh, et analytics fait des releases directement depuis Jenkins? Kool! [09:42:28] 10Continuous-Integration-Infrastructure (Little Steps Sprint), 06Discovery, 06Discovery-Search, 10Elasticsearch: Merge search/ javadoc jobs in the main maven job - https://phabricator.wikimedia.org/T160737#3109275 (10hashar) [09:42:55] dcausse: gehel: je nous ai fait une tâche pour intégrer javadoc dans "verify" ( https://phabricator.wikimedia.org/T160737 ) [09:43:05] merci! [09:43:15] hashar: merci! [09:43:21] si ca permet de remplacer deux jobs par un seul, c'est tout bénéf [09:43:35] pour les releases automatique oui Madhu a fait ça pour analytics/refinery [09:43:48] l'idée est de lancer un truc genre maven release [09:44:23] ce qui en théorie bump la version, tag le repo dans git. Puis pousser le tag dans Gerrit et je crois que Jenkins s'occupe de signer / lancer la publication sur mavencentral our archiva [09:44:47] j'ai pas trop suivi. Mais ça doit pouvoir être généralisé à tout les repos utilisant maven [09:45:58] on release sur maven central de notre côté pour cela il faudrait déployer une clef gpg and mettre un de mot de passe quelque part dans jenkins [09:47:01] javadoc est déjà binder à la phase "package", donc on devrait déjà l'avoir lors d'un verify [09:47:02] et pour ajouter un peu de confusion je suis en train de migrer nos builds vers gradle [09:47:10] (en tous cas pour search/extra [09:47:19] ok [09:51:54] J'ai reliance un job 'clean verify' pour search/extra [09:52:00] https://integration.wikimedia.org/ci/job/search-extra/422/console [09:52:15] Building jar: /home/jenkins/workspace/search-extra/target/extra-5.2.3-SNAPSHOT-javadoc.jar [09:52:42] * gehel is doing the same test locally... [09:53:37] https://integration.wikimedia.org/ci/job/search-extra/422/org.wikimedia.search$extra/ [09:53:46] ya tout [09:54:21] mais pour le job qui fait compile javadoc:javadoc ( https://integration.wikimedia.org/ci/job/search-extra-javadoc/421/console ) je vois plein de lignes qui génèrent le site / du html [09:59:09] hashar: tous les html sont dans te -javadoc.jar [09:59:10] intéressant... [09:59:53] ohhh [10:00:05] donc javadoc:jar génére tout et le pack dans un .jar [10:00:09] javadoc:javadoc doit être un peu plus verbeux et copie tous les fichiers dans target plutot que dans un jar peut-être [10:00:17] probablement [10:00:24] en attendant j'ai trouvé un plugin magic: mvn fr.jcgay.maven.plugins:buildplan-maven-plugin:list-phase [10:00:33] ca affiche tout le bousin [10:01:17] cool, toute la magie enfin révélée [10:01:17] kool! je connaissais pas celui-là! [10:02:07] http://stackoverflow.com/questions/1709625/maven-command-to-list-lifecycle-phases-along-with-bound-goals [10:02:17] (je ne sais pas comment on s'en sortirait sans stackoverflow ) [10:13:21] gehel: je pense que notre checkstyle n'est pas très exigeant: https://gerrit.wikimedia.org/r/#/c/343264/3/src/main/java/org/wikimedia/search/extra/ExtraPlugin.java a l'air de passer [10:21:57] On n'a pas grand chose comme règles... [10:57:30] 10Gerrit, 06Release-Engineering-Team, 10DBA, 06Operations, 13Patch-For-Review: Gerrit shows HTTP 500 error when pasting extended unicode characters - https://phabricator.wikimedia.org/T145885#3109383 (10Paladox) Upstream gerrit has added in built support for the MariaDB connector. So we won't need it pac... [12:31:21] 10Beta-Cluster-Infrastructure: Special:Version displays incorrect information for what commit is deployed there - https://phabricator.wikimedia.org/T159520#3109523 (10hashar) [12:31:23] 10Scap: [scap] Recompute and sync git version cache when sync-* are used - https://phabricator.wikimedia.org/T38271#3109521 (10hashar) [12:31:51] 10Beta-Cluster-Infrastructure: Special:Version displays incorrect information for what commit is deployed there - https://phabricator.wikimedia.org/T159520#3070282 (10hashar) I found out that scap does not regenerate the GitInfoCache when using sync commands. That is T38271 and Chad has a fix for it as D591. [12:32:29] 10Scap, 07Beta-Cluster-reproducible: [scap] Recompute and sync git version cache when sync-* are used - https://phabricator.wikimedia.org/T38271#415835 (10hashar) T159520 was about beta cluster Special:Version showing outdated git versions. [12:40:01] (03PS2) 10Zfilipin: WIP mediawiki-core-selenium-jessie is running by default but not voting [integration/config] - 10https://gerrit.wikimedia.org/r/324719 (https://phabricator.wikimedia.org/T139740) [12:52:51] (03PS3) 10Zfilipin: mediawiki-core-selenium-jessie Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/324719 (https://phabricator.wikimedia.org/T139740) [12:53:34] (03CR) 10Zfilipin: "Hashar, everything we talked about is implemented in PS #3." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/324719 (https://phabricator.wikimedia.org/T139740) (owner: 10Zfilipin) [12:54:56] (03PS4) 10Zfilipin: mediawiki-core-selenium-jessie Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/324719 (https://phabricator.wikimedia.org/T139740) [12:57:22] (03PS5) 10Zfilipin: mediawiki-core-selenium-jessie Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/324719 (https://phabricator.wikimedia.org/T139740) [12:59:43] hashar: regarding t159459 what if we force scheduler to only schedule jobs if the current load on labsvirt1001-2 is less than 50 [13:13:48] Zppix: potentially yeah. If that is at all possible [13:14:36] somone will need to investigate that possiblity ( i would if i had a clue how schuedluer code worked) [14:08:41] !log salt -v '*precise*' cmd.run 'puppet agent --disable "Pending shutdown on March 20th - T158652"' [14:08:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:08:46] T158652: Depool precise jenkins instances - https://phabricator.wikimedia.org/T158652 [14:12:57] PROBLEM - Puppet run on integration-slave-precise-1012 is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [0.0] [14:15:43] PROBLEM - Puppet run on integration-slave-precise-1011 is CRITICAL: CRITICAL: 66.67% of data above the critical threshold [0.0] [14:19:23] (03PS7) 10Zfilipin: WIP Problem: Can not use --retry option to retry failed tests as part of the same run [selenium] - 10https://gerrit.wikimedia.org/r/341523 (https://phabricator.wikimedia.org/T160086) [14:20:18] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 13Patch-For-Review: Depool precise jenkins instances - https://phabricator.wikimedia.org/T158652#3109761 (10hashar) A couple puppet clean up patches for contint and mediawiki modules. [14:54:37] PROBLEM - Free space - all mounts on deployment-ores-redis is CRITICAL: CRITICAL: deployment-prep.deployment-ores-redis.diskspace._srv.byte_percentfree (<44.44%) [15:54:43] (03PS1) 10Hashar: [operations/puppet] remove tox-jessie [integration/config] - 10https://gerrit.wikimedia.org/r/343317 [15:54:46] (03PS1) 10Hashar: (WIP) High priority test pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/343318 (https://phabricator.wikimedia.org/T160667) [15:56:50] 10Continuous-Integration-Infrastructure (Little Steps Sprint), 13Patch-For-Review: Create "High Priority" test pipeline - https://phabricator.wikimedia.org/T160667#3110055 (10hashar) I have played with it this afternoon. When duplicating pipelines part of its definition are copy.deepcopy() which fails whenever... [16:01:17] 10Continuous-Integration-Infrastructure (Little Steps Sprint): Remove zend tests from wmf branches - https://phabricator.wikimedia.org/T160669#3110067 (10hashar) I kept them around because `mwscript` is still bound to Zend PHP5 ( T146285 ) which was in reaction to {T132751}. So triggering the PHP5 jobs might co... [16:11:20] 10Beta-Cluster-Infrastructure, 10ORES, 06Revision-Scoring-As-A-Service, 15User-Ladsgroup: deployment-ores-redis /srv/ redis is too small (500MBytes) - https://phabricator.wikimedia.org/T160762#3110103 (10hashar) [16:16:23] thcipriani: so I Think I can get an high priority test pipeline [16:16:34] but I am also pretty sure something bad is going to explode [16:16:44] oh good [16:16:48] what makes you say that? [16:17:52] 10Continuous-Integration-Infrastructure (Little Steps Sprint), 13Patch-For-Review: Create "High Priority" test pipeline - https://phabricator.wikimedia.org/T160667#3110123 (10hashar) ``` lang=python >>> import copy, re >>> copy.deepcopy( re.compile('//') ) Traceback (most recent call last): File "", l... [16:17:56] copy.deepcopy( re.compile('//') ) [16:17:59] TypeError: cannot deepcopy this pattern object [16:18:11] I had the issue in what of the workflow rule that has a regex [16:18:23] and at some point the test suite explode when using deep copy [16:18:52] re.compile() is a singleton [16:19:03] returns always the same instance and deep copy eventually dies on it (as I understood it) [16:19:22] but I found a workaround which was to remove the regex that caused test to choke. I have no clue whether other regex would cause it to explode as well [16:19:34] gotta try it :-} [16:19:52] gate-and-submit I am not sure yet how to solve it :/ [16:32:46] 10Gerrit, 06Repository-Admins, 05MW-1.29-release (WMF-deploy-2016-11-01_(1.29.0-wmf.1)), 13Patch-For-Review: Rename the Semantic Forms extension to "Page Forms" - https://phabricator.wikimedia.org/T147582#3110169 (10demon) [16:34:39] RainbowSprinkles i got upstream to add inbuilt support for the mariadb connector :) [16:35:53] hashar: where are you trying this? Just in the zuul unit tests or do you have a test zuul setup? [16:36:02] It was because 1.5.9 of the connector did some changes that needed a change in gwtorm. jdbc:mariadb will not work from version 1.5.9 in gerrit 2.13. It will work in gerrit 2.14+. Workaround is to use jdbc:mysql. [16:36:17] thcipriani: paladox has a jenkins/zuul/gerrit setup on the "git" labs project [16:36:26] Yep :) [16:36:34] not sure whether that will cover that case [16:36:39] Running jenkins 2.x [16:36:43] I guess we will want a Gerrit on ci-staging as well [16:38:03] thcipriani: at least Zuul manages to load with my patch :} [16:40:38] hashar i even have a jenkins slave :) [17:01:24] 10Browser-Tests-Infrastructure, 05MW-1.29-release (WMF-deploy-2017-03-14_(1.29.0-wmf.16)), 05MW-1.29-release-notes, 13Patch-For-Review, and 2 others: Update Ruby tests to Selenium 3 - https://phabricator.wikimedia.org/T158074#3110276 (10Jdlrobson) [17:01:38] 10Browser-Tests-Infrastructure, 05MW-1.29-release (WMF-deploy-2017-03-14_(1.29.0-wmf.16)), 05MW-1.29-release-notes, 13Patch-For-Review, and 2 others: Update Ruby tests to Selenium 3 - https://phabricator.wikimedia.org/T158074#3025683 (10Jdlrobson) (reading is tracking work in the subtasks) [17:34:52] " [17:34:52] @GerritReview 2.13.6 is out https://goo.gl/Y5nt5Q for the first time with a native macOS installer - Kudos to Paladox from @Wikimedia [17:35:08] https://twitter.com/GerritReview/status/835246466318860288 [17:45:36] paladox: congratulations! [17:45:48] Your welcome :) [17:45:52] have a good week-end ** [17:45:59] you too [18:26:00] paladox: :) [18:26:09] :) [18:26:21] Good job ! Nice to get that shout out! [18:27:03] Yep, thanks :) [19:22:52] 10Continuous-Integration-Config, 10OOjs-UI: oojs-ui-demos-publish job needs to run on anything other than Trusty please (modern Node version needed) - https://phabricator.wikimedia.org/T160583#3104266 (10Volker_E) [19:26:38] 10Continuous-Integration-Config, 10OOjs-UI: Move OOUI out of the MediaWiki gate-and-submit queue - https://phabricator.wikimedia.org/T134946#2283244 (10Volker_E) [20:27:52] (03PS2) 10Reedy: Stop branching PageForms [tools/release] - 10https://gerrit.wikimedia.org/r/337746 [20:29:37] (03PS3) 10Reedy: Stop branching PageForms [tools/release] - 10https://gerrit.wikimedia.org/r/337746 (https://phabricator.wikimedia.org/T149749) [20:29:50] (03CR) 10Reedy: [C: 032] Stop branching PageForms [tools/release] - 10https://gerrit.wikimedia.org/r/337746 (https://phabricator.wikimedia.org/T149749) (owner: 10Reedy) [20:30:49] (03Merged) 10jenkins-bot: Stop branching PageForms [tools/release] - 10https://gerrit.wikimedia.org/r/337746 (https://phabricator.wikimedia.org/T149749) (owner: 10Reedy) [20:41:45] Yippee, build fixed! [20:41:46] Project selenium-Echo » chrome,beta,Linux,BrowserTests build #336: 09FIXED in 44 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/336/ [20:41:49] Yippee, build fixed! [20:41:50] Project selenium-Echo » firefox,beta,Linux,BrowserTests build #336: 09FIXED in 49 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/336/ [21:45:36] 10Continuous-Integration-Config, 10OOjs-UI: oojs-ui-demos-publish job needs to run on anything other than Trusty please (modern Node version needed) - https://phabricator.wikimedia.org/T160583#3111152 (10Jdforrester-WMF) Thank you so much! [21:55:45] (03Draft1) 10Paladox: Whitelist tosfos [integration/config] - 10https://gerrit.wikimedia.org/r/343403 [21:55:47] (03PS2) 10Paladox: Whitelist tosfos [integration/config] - 10https://gerrit.wikimedia.org/r/343403 [23:11:35] 10Continuous-Integration-Infrastructure (Little Steps Sprint): Remove zend tests from wmf branches - https://phabricator.wikimedia.org/T160669#3111374 (10demon) >>! In T160669#3110067, @hashar wrote: > So triggering the PHP5 jobs might cover the corner case of code being run as maintenance script and we have a l... [23:18:48] 10Deployment-Systems, 06Release-Engineering-Team, 10Wikimedia-General-or-Unknown: Document and automate updating of static/project-logos in mediawiki-config - https://phabricator.wikimedia.org/T98640#3111388 (10hashar) a:05ori>03None [23:29:05] 06Release-Engineering-Team, 10TimedMediaHandler, 10TimedMediaHandler-Transcode, 07Wikimedia-maintenance-script-run: Please mass-reset the video transcodes of tens of thousand videos stuck in "Unknown" state - https://phabricator.wikimedia.org/T151199#3111405 (10Jdforrester-WMF) [23:29:47] 10Continuous-Integration-Infrastructure: Get rid of zend tests for wmf branches - https://phabricator.wikimedia.org/T94149#3111409 (10hashar) [23:29:49] 10Continuous-Integration-Infrastructure (Little Steps Sprint): Remove zend tests from wmf branches - https://phabricator.wikimedia.org/T160669#3111411 (10hashar) [23:31:36] 10Continuous-Integration-Infrastructure (Little Steps Sprint): Get rid of zend tests for wmf branches - https://phabricator.wikimedia.org/T94149#1156282 (10hashar) 05stalled>03Open >>! In T160669#3111374, @demon wrote: >>>! In T160669#3110067, @hashar wrote: >> So triggering the PHP5 jobs might cover the cor... [23:32:03] 06Release-Engineering-Team, 10TimedMediaHandler, 10TimedMediaHandler-Transcode, 07Wikimedia-maintenance-script-run: Please mass-reset the video transcodes of tens of thousand videos stuck in "Unknown" state - https://phabricator.wikimedia.org/T151199#2810203 (10Jdforrester-WMF) Looks like `maintenance/rese...