[04:16:50] Yippee, build fixed! [04:16:51] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #255: FIXED in 43 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/255/ [05:10:38] Yippee, build fixed! [05:10:39] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #210: FIXED in 6 min 59 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/210/ [05:24:01] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #227: FAILURE in 39 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/227/ [05:54:08] bd808|BUFFER: greg-g: thanks for killing mediawiki04. i did use it recently but yes can make it again if needed and I'd err on the side of keeping icinga clean [06:02:02] PROBLEM - BetaLabs: Puppet failure events on labmon1001 is CRITICAL: CRITICAL: deployment-prep.deployment-mediawiki04.puppetagent.failed_events.value (100.00%) [07:07:19] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce build #182: FAILURE in 40 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-windows_8-internet_explorer-sauce/182/ [07:26:11] grrr, labsconsole why u hate sessions? [07:33:01] YuviPanda|afk: so, verified it really was deleted in mediawiki logs/deleted revs. but graphite/icinga is still complaining about puppet run. which obviously won't be fixed for a deleted host. ideas? [[Nova Resource:I-000005ba.eqiad.wmflabs]] [08:11:30] 3Wikimedia / 3Continuous integration: Jenkins: Install PerformancePlugin - 10https://bugzilla.wikimedia.org/71347#c2 (10Antoine "hashar" Musso) I have installed the plugin and it is supported by JJB http://ci.openstack.org/jenkins-job-builder/publishers.html#publishers.performance We can probably use it on... [08:22:48] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #189: ABORTED in 8 min 26 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/189/ [08:26:00] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #46: ABORTED in 50 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/46/ [08:51:33] (03CR) 10XZise: "But wouldn't it also work with Python 3.3 as long as there is a 'python3' executable on the system? But yeah the nosetest name is kind of " [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162636 (owner: 10XZise) [08:57:08] !log rebased puppetmaster [08:57:11] Logged the message, Master [09:35:04] (03PS3) 10Tobias Gritschacher: Move wikidata-performance browsertests job to WMF Jenkins [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163129 [09:41:36] zeljkof: hi [09:42:00] do you have that single-language screenshot creation job ready, by any chance? [09:43:18] aharoni: hi [09:43:27] started it, let me check the statu [09:43:30] status [09:45:42] aharoni: https://gerrit.wikimedia.org/r/#/c/163175/ [09:45:42] here it is [09:45:48] I need to finish it up [09:45:53] ok [09:45:55] I am in the middle of something now [09:46:03] not urgent, I was just going over my Gerrit board. [09:46:10] as soon as I am done with that I will continue [09:48:47] cool, thank you [10:51:45] * zeljkof is out of lunch [11:27:19] * zeljkof is back [11:46:11] jeremyb: ah, good point [11:46:26] jeremyb: file a bug? I think I'll need to write a cleanup script for graphite that archives them in some form [12:36:15] 3Wikimedia / 3Continuous integration: Jenkins: Install PerformancePlugin - 10https://bugzilla.wikimedia.org/71347#c3 (10Antoine "hashar" Musso) 5NEW>3RESO/FIX I have installed the plugin on the Wikimedia Jenkins and Tobias advertised its usage on the QA mailing list: https://lists.wikimedia.org/pipermail... [12:44:02] 3Wikimedia Labs / 3deployment-prep (beta): deployment-mediawiki02 and mediawiki03 have puppet disabled - 10https://bugzilla.wikimedia.org/71410 (10Antoine "hashar" Musso) 3NEW p:3Unprio s:3normal a:3None The instances deployment-mediawiki02 and deployment-mediawiki03 have puppet disabled. That preve... [12:56:48] 3Wikimedia / 3Continuous integration: wikidata-jenkins* instances needs puppet update - 10https://bugzilla.wikimedia.org/71411 (10Antoine "hashar" Musso) 3NEW p:3Unprio s:3normal a:3None Labs op Andrew Bogott merged a few changes in operations/puppet.git to point instances to a new LDAP server. See a... [13:32:19] 3Wikimedia Labs / 3deployment-prep (beta): hhvm creates core file in /tmp/ filling mediawiki02 labs instance root partition - 10https://bugzilla.wikimedia.org/69979#c19 (10Marc A. Pelletier) While I can think of a number of good reasons why you'd want to keep cores in a development environment, would you eve... [13:34:45] (03Restored) 10Hashar: Jenkins job validation (DO NOT SUBMIT)... [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/60646 (owner: 10Hashar) [13:34:47] (03PS5) 10Hashar: Jenkins job validation (DO NOT SUBMIT)... [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/60646 [13:35:06] (03CR) 10jenkins-bot: [V: 04-1] Jenkins job validation (DO NOT SUBMIT)... [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/60646 (owner: 10Hashar) [13:35:08] (03PS2) 10Hashar: Zuul public.conf is gone [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162585 [13:38:09] (03CR) 10Hashar: "recheck" [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/60646 (owner: 10Hashar) [13:38:34] (03Abandoned) 10Hashar: Jenkins job validation (DO NOT SUBMIT)... [integration/zuul-config] - 10https://gerrit.wikimedia.org/r/60646 (owner: 10Hashar) [13:38:59] 3Wikimedia Labs / 3deployment-prep (beta): hhvm creates core file in /tmp/ filling mediawiki02 labs instance root partition - 10https://bugzilla.wikimedia.org/69979#c20 (10Ori Livneh) (In reply to Marc A. Pelletier from comment #19) > While I can think of a number of good reasons why you'd want to keep cores... [13:39:11] (03CR) 10Hashar: [C: 032] "Deployed and tested with PS4 and PS5 of the dummy change: https://gerrit.wikimedia.org/r/#/c/60646/" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162585 (owner: 10Hashar) [13:40:01] one less problem [13:42:41] (03Merged) 10jenkins-bot: Zuul public.conf is gone [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162585 (owner: 10Hashar) [14:01:21] 3Wikimedia / 3Continuous integration: wikidata-jenkins* instances needs puppet update - 10https://bugzilla.wikimedia.org/71411 (10Addshore) a:3Addshore [14:01:45] 3Wikimedia / 3Continuous integration: wikidata-jenkins* instances needs puppet update - 10https://bugzilla.wikimedia.org/71411#c1 (10Addshore) If I don't appear to do this within the week please give this ticket a poke! :) [14:07:39] !log updated puppetmaster labs/private on both integration and beta cluster projects ( a41fcdd..84f0906 ) [14:07:44] Logged the message, Master [14:21:42] (03PS2) 10Zfilipin: WIP pick a language [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163175 [14:22:05] !log apt-get upgrade and reboot of all integration-slaveXX instances [14:22:06] (03PS3) 10Zfilipin: WIP pick a language [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163175 [14:22:07] Logged the message, Master [14:24:46] hashar: ummm, is there a reason our jenkins instance is in french? :) [14:24:56] zeljkof: yeah just noticed that [14:24:57] "Retour au tableau de bord" [14:25:15] I definitely have set it to always use english [14:25:24] jenkins usually detects preferred browser language, as far as I remember [14:25:25] I have saved the conf again and it is back in english for me [14:25:39] hashar: back to english for me too [14:25:46] no clue what happened [14:26:02] Vive La France! :) [14:27:18] hashar: if you have minute... [14:27:22] take a look at https://gerrit.wikimedia.org/r/#/c/163175/ [14:27:28] not sure what I did wrong there [14:27:59] I was expecting to be able to pick the language too (not just mediawiki api url) [14:28:00] https://integration.wikimedia.org/ci/view/BrowserTests/view/-All/job/browsertests-VisualEditor-language-screenshot-linux-firefox/build?delay=0sec [14:28:42] hold on :D [14:28:50] finishing some package upgrade on the jenkins slaves [14:30:17] hashar: thanks, there is no rush, debugging it now [14:30:17] https://integration.wikimedia.org/ci/job/integration-jjb-config-diff/1196/console [14:30:31] the diff says something did change [14:30:39] did I change the correct template...? [14:32:23] (03PS4) 10Zfilipin: WIP pick a language [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163175 [14:33:41] ok, looks like I have changed -sauce template, but not the one that uses local firefox [14:33:59] * zeljkof is fixing... [14:35:21] excellent, it works! :) https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox-sauce/build?delay=0sec [14:35:42] only now to fix the commit to change the correct template... [14:35:51] aharoni: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox-sauce/build?delay=0sec [14:35:55] done! [14:36:06] well, not done, working on it, but looks like I am pretty close [14:39:17] 3Wikimedia / 3Continuous integration: hhvm 3.3.0-20140925+wmf2 has some annoying build dependency - 10https://bugzilla.wikimedia.org/71413 (10Antoine "hashar" Musso) 3NEW p:3Unprio s:3normal a:3None Since https://gerrit.wikimedia.org/r/150813 , we install hhvm build dependencies using `apt-get build-... [14:39:41] (03PS5) 10Zfilipin: Core browser tests no longer have site specific Cucumber tags [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162910 (https://bugzilla.wikimedia.org/67616) [14:39:56] (03PS2) 10Zfilipin: Running language screenshot job using local Firefox [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162869 (https://bugzilla.wikimedia.org/69535) [14:40:00] 3Wikimedia / 3Continuous integration: Set up automatic builds for extensions ported to HHVM - 10https://bugzilla.wikimedia.org/63120#c23 (10Antoine "hashar" Musso) The hhvm build deps have some conflict/cycle with libjpeg62 and libjpeg8 which do not play well together. Filled as https://bugzilla.wikimedia.or... [14:41:49] zeljkof: ok available now [14:42:09] hashar: please merge this one :) https://gerrit.wikimedia.org/r/#/c/162869/ [14:42:13] and I am all set [14:42:19] (I _hate_ to self merge) [14:42:46] (03CR) 10Zfilipin: "Amir, Antoine, please merge this commit into master, so I can implement selecting a subset of languages for visual editor screenshot job." [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162869 (https://bugzilla.wikimedia.org/69535) (owner: 10Zfilipin) [14:42:52] seems you self solved your issue above ? :-] [14:42:57] aharoni: ^ [14:43:10] hashar: yes, the problem was between keyboard and monitor, as usual :) [14:44:16] (03CR) 10Hashar: [C: 032] Running language screenshot job using local Firefox [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162869 (https://bugzilla.wikimedia.org/69535) (owner: 10Zfilipin) [14:44:18] +2 ed :-) [14:44:33] hashar: thanks! [14:44:52] zeljkof: I am giving your name to folks interested in JJB :D [14:45:15] zeljkof: so can I put one language in lang_list and click "Build"? [14:45:20] aharoni: wait! [14:45:34] soon(tm) [14:45:35] in minutes [14:45:46] yeah that is doable [14:45:52] hashar: go ahead, will do my best [14:45:59] I dislike having to pass all the languages in a single string though [14:46:01] still struggling with jjb, but learning slowly [14:46:13] at least you at ease with most of jjb [14:46:14] hashar: we can make it beautiful later(tm) [14:46:23] ahha [14:46:32] better rephrased as: "lets build tech debt right now ©" [14:47:24] (03Merged) 10jenkins-bot: Running language screenshot job using local Firefox [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162869 (https://bugzilla.wikimedia.org/69535) (owner: 10Zfilipin) [14:49:01] (03PS5) 10Zfilipin: WIP pick a language [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163175 [14:50:14] aharoni: done! https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/build?delay=0sec [14:50:26] building for hr to test out [14:50:36] feel free to build with other languages when hr finishes [14:50:42] OK [14:50:51] mmm... how will I know? [14:51:28] aharoni: this will stop updating https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=hr,label=contintLabsSlave%20&&%20UbuntuPrecise/7/console [14:51:48] and also, feel free to start new jobs right now, they will wait for this one to finish anyway [14:52:36] hashar: how would you make the "a huge string" nicer? [14:52:45] checkboxes? [14:53:17] (https://gerrit.wikimedia.org/r/#/c/163175/) [14:53:56] aharoni: uh oh [14:53:58] Exception Caught: Unable to connect to redis server. (internal_api_error_JobQueueConnectionError) (MediawikiApi::ApiError) [14:54:08] meh [14:54:12] happened to me earlier [14:54:13] aharoni, hashar: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=hr,label=contintLabsSlave%20&&%20UbuntuPrecise/7/console [14:54:22] I already emailed about it on the QA mailing list [14:54:40] aharoni: you should also probably report a bug, so it does not get lost [14:54:54] didn't Ori mention something about redis these days? [14:57:04] (03PS6) 10Zfilipin: Make it possible to run VisualEditor screenshot job for arbitrary number of languages [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163175 [14:57:36] (03PS7) 10Zfilipin: Make it possible to run VisualEditor screenshot job for arbitrary number of languages [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163175 [14:57:37] he did [14:57:49] It was in reply to precisely the same in email in which he mentioned it [14:58:20] aharoni: I have to go now, this should work when the redis problem is solved [14:58:32] zeljkof: OK [15:21:01] "Unable to connect to redis server" on beta labs. known problem? [15:21:19] aharoni: bug fill it please [15:21:42] seems some $wg variable is unproperly set [15:22:30] 3Wikimedia / 3Continuous integration: wikidata-jenkins* instances needs puppet update - 10https://bugzilla.wikimedia.org/71411#c2 (10Jan Zerebecki) What blocks these from being on the normal puppet master? [15:22:57] hashar: aharoni I'll file it, I need to work on Flow and this breaks Flow [15:25:22] chrismcmahon, hashar - https://bugzilla.wikimedia.org/show_bug.cgi?id=71415 [15:25:31] please change the component if needed [15:26:44] 3Wikimedia / 3Continuous integration: wikidata-jenkins* instances needs puppet update - 10https://bugzilla.wikimedia.org/71411#c3 (10Addshore) The builder instances use: https://github.com/wmde/puppet-builder The jenkins instances use: https://github.com/wmde/puppet-composer (also has class ci::slave::labs a... [15:29:45] 3Wikimedia Labs / 3deployment-prep (beta): Unable to connect to redis server - 10https://bugzilla.wikimedia.org/71415 (10Chris McMahon) [15:32:50] thanks aharoni [16:00:15] 3Wikimedia / 3Continuous integration: Jobs are sometime no more being triggered by Zuul / Jenkins - 10https://bugzilla.wikimedia.org/63760#c12 (10Antoine "hashar" Musso) Documented a workaround on https://www.mediawiki.org/wiki/Continuous_integration/Zuul#Known_issues The gearman server sometime deadlock w... [16:31:30] 3Wikimedia Labs / 3deployment-prep (beta): Unable to connect to redis server - 10https://bugzilla.wikimedia.org/71415 (10Ori Livneh) 5PATC>3RESO/FIX [16:34:01] chrismcmahon: I don't remember ever saying this to you directly, but working with Zeljko on my latest GSoC project was fantastic. [16:34:56] Now we Selenium creating screenshots automatically for us in all languages [16:34:59] Japanese - https://www.mediawiki.org/wiki/Help:VisualEditor/User_guide/ja [16:35:04] aharoni: glad to hear it! Zeljko said good things about the project [16:35:18] Russian - https://www.mediawiki.org/wiki/Help:VisualEditor/User_guide/ru [16:35:20] And so on. [16:35:31] I hope to add Arabic and Persian very soon. [16:37:55] Project browsertests-VisualEditor-language-screenshot-linux-firefox » fa,contintLabsSlave && UbuntuPrecise build #8: FAILURE in 5 min 26 sec: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=fa,label=contintLabsSlave%20&&%20UbuntuPrecise/8/ [16:39:23] Hmm, Persian failed :( [16:39:27] I wonder why. [16:43:27] Project browsertests-VisualEditor-language-screenshot-linux-firefox » ar,contintLabsSlave && UbuntuPrecise build #8: FAILURE in 10 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-language-screenshot-linux-firefox/LANGUAGE_SCREENSHOT_CODE=ar,label=contintLabsSlave%20&&%20UbuntuPrecise/8/ [16:46:03] aharoni: And Arabic. :-( [16:46:31] Well, it's probably an issue with the job configuration or with the labs servers. [16:46:55] It was an experiment by Zeljko to run them this way - only some particular language instead of all of them. [16:47:14] Ah. [16:47:29] We probably only need to run them once a week at most. [16:50:18] 3Wikimedia / 3Continuous integration: make wikidata-build instances work without puppet master self - 10https://bugzilla.wikimedia.org/71419 (10Jan Zerebecki) 3NEW p:3Unprio s:3enhanc a:3None Make https://wikitech.wikimedia.org/wiki/Nova_Resource:Wikidata-build instances work with the normal labs pup... [16:50:30] 3Wikimedia / 3Continuous integration: wikidata-jenkins* instances needs puppet update - 10https://bugzilla.wikimedia.org/71411 (10Jan Zerebecki) [16:50:32] 3Wikimedia / 3Continuous integration: make wikidata-build instances work without puppet master self - 10https://bugzilla.wikimedia.org/71419 (10Jan Zerebecki) [17:42:31] 3Wikimedia Labs / 3deployment-prep (beta): Unable to connect to redis server - 10https://bugzilla.wikimedia.org/71415#c5 (10Chris McMahon) 5RESO/FIX>3REOP I'm still seeing errors about redis when trying to save an edit [18:22:25] Project beta-update-databases-eqiad build #4392: FAILURE in 2 min 23 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/4392/ [18:39:30] 3Wikimedia / 3Continuous integration: make wikidata-build instances work without puppet master self - 10https://bugzilla.wikimedia.org/71419#c1 (10Addshore) It will not be allowed in operations/puppet due to both composer and pulling from github. This is what was tried before doing it the way it is currently... [18:54:11] Project browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #200: FAILURE in 8 min 59 sec: https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/200/ [18:55:04] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #256: FAILURE in 18 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/256/ [18:55:16] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce build #203: FAILURE in 1 min 4 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-chrome-sauce/203/ [19:01:15] 3Wikimedia / 3Quality Assurance: Fonts for Japanese and Chinese must be installed for VisualEditor localized screenshots - 10https://bugzilla.wikimedia.org/69535#c22 (10Antoine "hashar" Musso) 5PATC>3NEW Amir can we close this bug or maybe we can keep it open to track the installation of fonts for all th... [19:14:58] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce build #23: FAILURE in 18 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-chrome-monobook-sauce/23/ [19:21:39] Yippee, build fixed! [19:21:40] Project beta-update-databases-eqiad build #4393: FIXED in 1 min 38 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/4393/ [19:21:46] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #90: FAILURE in 6 min 46 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/90/ [19:23:17] Project browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce build #35: FAILURE in 18 min: https://integration.wikimedia.org/ci/job/browsertests-Flow-en.wikipedia.beta.wmflabs.org-linux-firefox-monobook-sauce/35/ [19:34:04] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #304: FAILURE in 10 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/304/ [19:36:19] Project browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #211: FAILURE in 1 min 8 sec: https://integration.wikimedia.org/ci/job/browsertests-UploadWizard-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/211/ [19:46:48] Project browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #76: FAILURE in 5 min 32 sec: https://integration.wikimedia.org/ci/job/browsertests-Echo-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/76/ [19:47:34] (03PS1) 10Hashar: perllint: rename misnamed variable [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163654 [19:59:44] 3Wikimedia Labs / 3deployment-prep (beta): Unable to connect to redis server - 10https://bugzilla.wikimedia.org/71415#c6 (10Chris McMahon) for example, clicking Preferences: [fe58754d] /wiki/Special:Preferences Exception from line 827 of /srv/mediawiki/php-master/includes/jobqueue/JobQueueRedis.php: Unable... [20:00:43] (03CR) 10Cmcmahon: [C: 032] Core browser tests no longer have site specific Cucumber tags [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162910 (https://bugzilla.wikimedia.org/67616) (owner: 10Zfilipin) [20:01:48] (03CR) 10Hashar: [C: 032] "Updates a single job: mwext-timeline-perllint" [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163654 (owner: 10Hashar) [20:05:32] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #235: FAILURE in 29 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/235/ [20:07:42] (03Merged) 10jenkins-bot: perllint: rename misnamed variable [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/163654 (owner: 10Hashar) [20:08:13] (03PS6) 10Hashar: Core browser tests no longer have site specific Cucumber tags [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162910 (https://bugzilla.wikimedia.org/67616) (owner: 10Zfilipin) [20:08:31] (03CR) 10Hashar: [C: 032] Core browser tests no longer have site specific Cucumber tags [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162910 (https://bugzilla.wikimedia.org/67616) (owner: 10Zfilipin) [20:11:53] (03Merged) 10jenkins-bot: Core browser tests no longer have site specific Cucumber tags [integration/jenkins-job-builder-config] - 10https://gerrit.wikimedia.org/r/162910 (https://bugzilla.wikimedia.org/67616) (owner: 10Zfilipin) [20:17:56] bd808: sorry about the zuul cloner / vendor repository cloning delay [20:18:05] bd808: had some issue with VisualEditor last week :/ [20:18:26] hashar: No worries. As long as I kow it is getting closer I'm happy. :) [20:19:01] mwext-VisualEditor-qunit/config.xml: [20:19:01] :( [20:20:04] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #239: FAILURE in 8 min 24 sec: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/239/ [20:26:58] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #272: FAILURE in 36 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/272/ [20:38:30] 3Wikimedia / 3Continuous integration: make wikidata-build instances work without puppet master self - 10https://bugzilla.wikimedia.org/71419#c2 (10Jan Zerebecki) I understand that much was tried in that direction. And it probably didn't help that composer on its own was not accepted at that time. composer:... [20:43:45] 3Wikimedia / 3Continuous integration: make wikidata-build instances work without puppet master self - 10https://bugzilla.wikimedia.org/71419#c3 (10Aude) I updated the local git puppet repo (and labs/private) and now puppet agent -tv fails due to some syntax error: sudo puppet agent -tv info: Retrieving plug... [20:54:11] hey beta people! can you help me understand how http://en.wikipedia.beta.wmflabs.org/ gets its mediawiki config? [20:54:44] Project browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce build #72: FAILURE in 12 min: https://integration.wikimedia.org/ci/job/browsertests-Echo-test2.wikipedia.org-linux-firefox-sauce/72/ [20:55:17] http://noc.wikimedia.org/conf/ see -labs.php files which amend the usual configs [20:55:23] i thought it would be wmf-config/CommonSettings-labs.php, but my patch there doesn't seem to have taken effect. [20:56:30] oh actually -- i bet I have to manually deploy the config change? [20:58:18] https://integration.wikimedia.org/ci/job/beta-mediawiki-config-update-eqiad/1122/console should have done it [21:03:00] 3Wikimedia / 3Continuous integration: make wikidata-build instances work without puppet master self - 10https://bugzilla.wikimedia.org/71419#c4 (10Aude) and just a side note, the wikidata-builder3 hasn't been making any builds the past week due to https://github.com/wmde/WikidataBuilder/issues/29 as a worka... [21:19:29] 3Wikimedia / 3Quality Assurance: Fonts for Japanese and Chinese must be installed for VisualEditor localized screenshots - 10https://bugzilla.wikimedia.org/69535#c23 (10Amir E. Aharoni) 5NEW>3RESO/FIX I'm closing this. Installing fonts in the future should be simple enough... I think :) Thanks a lot for... [21:22:47] chrismcmahonafk: just a heads up, no new code will be being deployed to beta [21:26:22] puppet fail: deployment-prep.deployment-mediawiki04 [21:26:33] 3Wikimedia Labs / 3deployment-prep (beta): deployment-rsync01 20GB hard drive is too small - 10https://bugzilla.wikimedia.org/71431 (10Sam Reed (reedy)) 3NEW p:3Unprio s:3normal a:3None Exactly what it says on the tin. It's causing auto code updates to break [21:26:49] integration.integration-dev-trusty [21:32:07] Project browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #194: FAILURE in 45 sec: https://integration.wikimedia.org/ci/job/browsertests-MultimediaViewer-en.wikipedia.beta.wmflabs.org-linux-chrome-sauce/194/ [21:40:12] Project browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce build #47: STILL FAILING in 13 min: https://integration.wikimedia.org/ci/job/browsertests-VisualEditor-en.wikipedia.beta.wmflabs.org-os_x_10.9-safari-sauce/47/ [21:46:25] Project browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce build #190: FAILURE in 6 min 12 sec: https://integration.wikimedia.org/ci/job/browsertests-UniversalLanguageSelector-commons.wikimedia.beta.wmflabs.org-linux-firefox-sauce/190/ [22:16:29] 3Wikimedia / 3Continuous integration: wikidata-jenkins* instances needs puppet update - 10https://bugzilla.wikimedia.org/71411#c4 (10Jan Zerebecki) Those puppet failures after trying with an updated operations/puppet.git ( see https://bugzilla.wikimedia.org/show_bug.cgi?id=71419#c3 for the error ) on wikidat... [22:17:59] 3Wikimedia / 3Continuous integration: make wikidata-build instances work without puppet master self - 10https://bugzilla.wikimedia.org/71419#c5 (10Jan Zerebecki) Replied to comment #3 in https://bugzilla.wikimedia.org/show_bug.cgi?id=71411#c4 . [22:55:41] Yippee, build fixed! [22:55:41] Project beta-scap-eqiad build #23441: FIXED in 1 min 39 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/23441/ [23:19:29] mediawiki-vendor-integration just failed for me because it ran out of disk space… https://integration.wikimedia.org/ci/job/mediawiki-vendor-integration/2352/console [23:19:48] on on https://gerrit.wikimedia.org/r/#/c/162609/ [23:26:42] MatmaRex: /dev/sdb1 160G 75G 85G 47% /srv/ssd [23:26:59] that's on lanthanum [23:34:03] 3Wikimedia / 3Continuous integration: Jenkins: lanthanum tmpfs is filling up with stale tmp files - 10https://bugzilla.wikimedia.org/71128#c2 (10Krinkle) And again... ssh lanthanum.eqiad.wmnet cd /var/lib/jenkins/tmpfs sudo -su jenkins-slave ll rm -rf *@* mwext-* ll [23:36:19] MatmaRex: I think Krinkle may have fixed the probelm at least temporarily. See https://bugzilla.wikimedia.org/show_bug.cgi?id=71128 [23:36:32] icinga-wm: RECOVERY - Disk space on lanthanum is OK: DISK OK [23:39:30] 3Wikimedia / 3Continuous integration: Jenkins: lanthanum tmpfs is filling up with stale tmp files - 10https://bugzilla.wikimedia.org/71128#c3 (10Krinkle) (In reply to Antoine "hashar" Musso from comment #1) > The find -mtime 60 is pretty lame. Since then I found a way to have a task > to run on build comple...