[00:05:01] Project beta-update-databases-eqiad build #9131: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9131/ [01:05:00] Project beta-update-databases-eqiad build #9132: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9132/ [02:05:00] Project beta-update-databases-eqiad build #9133: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9133/ [02:17:34] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2375204 (10Danny_B) [03:01:40] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2375218 (10Danny_B) Gitblit `/raw/...` paths are not functional in repos containing slash (ie. https://git.wikimedia.... [03:05:00] Project beta-update-databases-eqiad build #9134: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9134/ [03:12:14] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2375236 (10Danny_B) How to deal with `/zip/` action? AFAICS Diffusion links all zip and gz files from Github, bzip2... [04:05:00] Project beta-update-databases-eqiad build #9135: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9135/ [04:18:12] Yippee, build fixed! [04:18:13] Project selenium-MultimediaViewer » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #42: 09FIXED in 22 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/42/ [04:20:05] Project beta-update-databases-eqiad build #9136: 04STILL FAILING in 4.8 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9136/ [06:05:06] Project beta-update-databases-eqiad build #9137: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9137/ [06:30:42] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2375299 (10Paladox) @Danny_B we added support for downloading zip and gz files in diffusion. It downloads from GitHu... [07:05:02] deployment prep seems down [07:05:05] Project beta-update-databases-eqiad build #9138: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9138/ [07:05:09] (Cannot access the database: Can't connect to MySQL server on '10.68.17.94' (4) (10.68.17.94)) [07:05:25] up again [07:45:14] 07Browser-Tests, 10Wikidata, 03Wikidata-Sprint-2016-05-24: Sitelink browser test sometimes fails with firefox because of rate limit? - https://phabricator.wikimedia.org/T126585#2375348 (10Tobi_WMDE_SW) Looking at the actual screenshots on Saucelabs, e.g. https://assets.saucelabs.com/jobs/e6cd0f782ac54c04bfaa... [08:05:00] Project beta-update-databases-eqiad build #9139: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9139/ [08:25:58] Project beta-update-databases-eqiad build #9140: 04STILL FAILING in 5 min 57 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9140/ [08:26:17] Nikerabbit: beta cluster db is / was overloaded apparently [08:26:26] Nikerabbit: there is some nasty script going on [08:28:25] hashar: bad nasty scripts :D [08:29:06] Nikerabbit: some Echo clean up task that is stall update.php https://phabricator.wikimedia.org/T137615 :D [08:30:57] !log Beta: `mwscript extensions/Echo/maintenance/removeInvalidTargetPage.php --wiki=enwiki` for T137615 [08:30:58] T137615: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615 [08:31:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [08:32:49] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2375405 (10hashar) ``` Deleted 497 records from 500 records Deleted 500 records from 500 records Deleted 500 record... [09:23:32] zeljkof: MultimediaViewer bump of selenium webdriver failing https://gerrit.wikimedia.org/r/#/c/293703/ [09:26:34] zeljkof: and the Selenium change https://github.com/SeleniumHQ/selenium/commit/3c0e38c54d9c3275c3fda0c6d0a4e961aa806c23 [09:29:18] fx 47 release notes https://www.mozilla.org/en-US/firefox/47.0/releasenotes/ [09:35:15] https://github.com/seleniumhq/selenium/issues/2110 [09:37:49] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Config: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561#2375518 (10zeljkofilipin) [09:38:13] be back soonish [09:55:12] 10Continuous-Integration-Infrastructure, 10Zuul: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2375575 (10Paladox) @hashar could it be gerrit 2.8 not being supported since upstream use a newer gerrit version so there not really testing again... [10:05:00] Project beta-update-databases-eqiad build #9141: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9141/ [10:09:02] back [10:13:05] 10Browser-Tests-Infrastructure: Update mediawiki_selenium to use Marionette - https://phabricator.wikimedia.org/T137540#2375654 (10hashar) [10:13:30] zeljkof: I have mentioned selenium-webdriver (2.53.1) on the mw selenium update task ^ [10:13:41] hashar: thanks! [10:19:04] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Config: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561#2375658 (10hashar) [10:19:13] zeljkof: and I summarized our discussion / the situation on https://phabricator.wikimedia.org/T137561 [10:19:31] hashar: great [10:19:41] the "Update mediawiki_selenium to use Marionette" task would probably need a sub tasks to have geckodriver to be added on the slaves [10:20:01] I am still triaging stuff I need to do this week :| [10:20:10] will jump on ff soon [10:23:57] !log Hard reboot integration-slave-trusty-1015 [10:24:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:34:53] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Config: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561#2375733 (10hashar) I am replaying the apt pinning to Firefox 46.0 which Jan did on Friday. Ie cherry picking https://gerrit.wikimedia.org/r/#/c/293739/3 and manuall... [10:35:36] !log T137561 salt -v '*trusty*' cmd.run "cd /root/ && dpkg -i firefox_46.0.1+build1-0ubuntu0.14.04.3_amd64.deb" [10:35:37] T137561: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561 [10:35:40] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:37:16] !log Restarted puppetmaster on integration-puppetmaster (memory leak / can not fork: no memory) [10:37:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:38:21] well we are back on firefox 46 [10:44:47] zeljkof: firefox 46 definitely works :) [10:45:15] hashar: great [10:45:25] it should work, since it "works on my machine" ™️ [10:45:32] ;) [10:45:47] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Config: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561#2375746 (10hashar) Slaves are back on Firefox 46.0 . Gave a recheck on MultimediaViewer change https://gerrit.wikimedia.org/r/#/c/293703/ and it pass again. [10:46:33] 10Browser-Tests-Infrastructure: Update mediawiki_selenium to use Marionette - https://phabricator.wikimedia.org/T137540#2375749 (10hashar) [10:46:35] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Config: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561#2375748 (10hashar) [10:47:29] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Config: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561#2371835 (10hashar) 05Open>03stalled Stalled pending update of mediawiki_selenium to Marionette T137540 Would probably need the geckodriver to be packaged / shi... [10:47:36] zeljkof: so it is stalled as far as I am concerned [10:47:52] until we support Firefox 47 / Marionette / geckodriver [10:55:15] hashar: I will work on it [10:55:21] but not eta yet [10:55:28] probably this week [10:55:46] if wikimania preparations do not interfere [11:05:00] Project beta-update-databases-eqiad build #9142: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9142/ [12:05:00] Project beta-update-databases-eqiad build #9143: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9143/ [12:15:40] (03CR) 10Lokal Profil: Add npm template to labs/tools/heritage (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/293640 (https://phabricator.wikimedia.org/T137544) (owner: 10Jean-Frédéric) [12:35:11] (03PS5) 10Jean-Frédéric: Add npm template to labs/tools/heritage [integration/config] - 10https://gerrit.wikimedia.org/r/293640 (https://phabricator.wikimedia.org/T137544) [12:38:03] (03CR) 10Lokal Profil: [C: 031] Add npm template to labs/tools/heritage [integration/config] - 10https://gerrit.wikimedia.org/r/293640 (https://phabricator.wikimedia.org/T137544) (owner: 10Jean-Frédéric) [12:42:38] 10Continuous-Integration-Config, 10Wiki-Loves-Monuments, 13Patch-For-Review: Add npm/Grunt entry-points for testing - https://phabricator.wikimedia.org/T137544#2376002 (10Lokal_Profil) [12:54:30] 10Beta-Cluster-Infrastructure: Rebuild beta cluster saltmaster on Jessie - https://phabricator.wikimedia.org/T136411#2376013 (10Krenair) [12:54:33] 10Beta-Cluster-Infrastructure, 07Puppet, 07Tracking: Deployment-prep hosts with puppet errors (tracking) - https://phabricator.wikimedia.org/T132259#2376014 (10Krenair) [12:54:35] 10Beta-Cluster-Infrastructure: deployment-cache-upload04/text04 Could not find data item cache::cluster in hiera no default supplied at /etc/puppet/modules/role/manifests/cache/base.pp:17 - https://phabricator.wikimedia.org/T136077#2376010 (10Krenair) 05Open>03Resolved a:03Krenair These hosts' puppet were... [13:04:19] (03PS6) 10Hashar: Add npm template to labs/tools/heritage [integration/config] - 10https://gerrit.wikimedia.org/r/293640 (https://phabricator.wikimedia.org/T137544) (owner: 10Jean-Frédéric) [13:04:39] (03CR) 10Hashar: [C: 032] "I have dropped the depends on or the CI Config patch would not merge :D" [integration/config] - 10https://gerrit.wikimedia.org/r/293640 (https://phabricator.wikimedia.org/T137544) (owner: 10Jean-Frédéric) [13:05:00] Project beta-update-databases-eqiad build #9144: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9144/ [13:05:28] (03Merged) 10jenkins-bot: Add npm template to labs/tools/heritage [integration/config] - 10https://gerrit.wikimedia.org/r/293640 (https://phabricator.wikimedia.org/T137544) (owner: 10Jean-Frédéric) [13:06:15] 10Beta-Cluster-Infrastructure, 07Puppet: Puppet error on deploment-aqs01 because E: Version '2.2.6' for 'cassandra' was not found - https://phabricator.wikimedia.org/T137706#2376063 (10Krenair) [13:06:21] 10Beta-Cluster-Infrastructure, 07Puppet: Puppet errors on deploment-aqs01 because E: Version '2.2.6' for 'cassandra' was not found - https://phabricator.wikimedia.org/T137706#2376077 (10Krenair) [13:08:05] 10Beta-Cluster-Infrastructure, 07Puppet: Puppet errors on deploment-aqs01 because E: Version '2.2.6' for 'cassandra' was not found - https://phabricator.wikimedia.org/T137706#2376063 (10Krenair) [13:08:09] 10Beta-Cluster-Infrastructure, 10scap, 10Analytics, 06Services, and 3 others: Set up AQS in Beta - https://phabricator.wikimedia.org/T116206#2376084 (10Krenair) [13:17:48] 10Continuous-Integration-Config, 10Wiki-Loves-Monuments, 13Patch-For-Review: Add npm/Grunt entry-points for testing - https://phabricator.wikimedia.org/T137544#2376094 (10JeanFred) 05Open>03Resolved p:05Triage>03Normal [13:19:17] (03PS1) 10Hashar: gzip integration-zuul-layoutdiff logs [integration/config] - 10https://gerrit.wikimedia.org/r/294059 [13:23:51] (03PS2) 10Hashar: gzip integration-zuul-layoutdiff logs [integration/config] - 10https://gerrit.wikimedia.org/r/294059 [13:24:42] (03CR) 10jenkins-bot: [V: 04-1] gzip integration-zuul-layoutdiff logs [integration/config] - 10https://gerrit.wikimedia.org/r/294059 (owner: 10Hashar) [13:26:02] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedia.org" - https://phabricator.wikimedia.org/T137460#2376121 (10hashar) [13:26:47] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedia.org" - https://phabricator.wikimedia.org/T137460#2368900 (10hashar) Occurred again https://integration.wikimedia.org/c... [13:26:51] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedia.org" - https://phabricator.wikimedia.org/T137460#2368900 (10MoritzMuehlenhoff) Is there a way to re-trigger the CI job... [13:27:42] (03PS3) 10Hashar: gzip integration-zuul-layoutdiff logs [integration/config] - 10https://gerrit.wikimedia.org/r/294059 [13:29:51] (03CR) 10Hashar: [C: 032] gzip integration-zuul-layoutdiff logs [integration/config] - 10https://gerrit.wikimedia.org/r/294059 (owner: 10Hashar) [13:31:12] (03Merged) 10jenkins-bot: gzip integration-zuul-layoutdiff logs [integration/config] - 10https://gerrit.wikimedia.org/r/294059 (owner: 10Hashar) [13:31:26] (03CR) 10Hashar: "I have run gzip manually on gallium which is saved ~ 2.1 Gbytes of disk." [integration/config] - 10https://gerrit.wikimedia.org/r/294059 (owner: 10Hashar) [13:32:51] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure, 10MediaWiki-Unit-tests: CI jobs failing with DNS resolution errors such as "Could not resolve host: gerrit.wikimedia.org" - https://phabricator.wikimedia.org/T137460#2376129 (10hashar) >>! In T137460#2376125, @MoritzMuehlenhoff wrote:... [13:47:38] Yippee, build fixed! [13:47:39] Project selenium-VisualEditor » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #49: 09FIXED in 3 min 38 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/49/ [14:01:14] 10Beta-Cluster-Infrastructure, 10cassandra, 07Puppet: Puppet errors on deploment-aqs01 because E: Version '2.2.6' for 'cassandra' was not found - https://phabricator.wikimedia.org/T137706#2376158 (10mobrovac) [14:05:00] Project beta-update-databases-eqiad build #9145: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9145/ [14:17:49] 07Browser-Tests: Math tests fail with Watir::Wait::TimeoutError - https://phabricator.wikimedia.org/T137711#2376208 (10zeljkofilipin) [14:21:00] 07Browser-Tests: Math tests fail with Watir::Wait::TimeoutError - https://phabricator.wikimedia.org/T137711#2376225 (10Physikerwelt) the meta tag was changed to an img tag [14:22:00] (03PS1) 10Hashar: 15 days of logs for apps-android-wikipedia-test [integration/config] - 10https://gerrit.wikimedia.org/r/294062 [14:23:20] (03CR) 10Hashar: [C: 032] 15 days of logs for apps-android-wikipedia-test [integration/config] - 10https://gerrit.wikimedia.org/r/294062 (owner: 10Hashar) [14:24:40] (03Merged) 10jenkins-bot: 15 days of logs for apps-android-wikipedia-test [integration/config] - 10https://gerrit.wikimedia.org/r/294062 (owner: 10Hashar) [14:43:44] Project beta-update-databases-eqiad build #9146: 15ABORTED in 23 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9146/ [14:47:07] 07Browser-Tests, 10Math, 13Patch-For-Review: Math tests fail with Watir::Wait::TimeoutError - https://phabricator.wikimedia.org/T137711#2376245 (10zeljkofilipin) p:05Triage>03Normal [14:47:16] 07Browser-Tests, 10Math, 13Patch-For-Review, 15User-zeljkofilipin: Math tests fail with Watir::Wait::TimeoutError - https://phabricator.wikimedia.org/T137711#2376208 (10zeljkofilipin) [14:59:22] *yawn* [15:02:13] 05Gitblit-Deprecate: Update all references to git.wikimedia.org and replace them with the Phabricator equivalent - https://phabricator.wikimedia.org/T137353#2365874 (10Danny_B) For the record: We'll be able to redirect most of the links to the relevant place. The remaining stuff will be linked to either Diffusio... [15:09:46] 05Gitblit-Deprecate: Update all references to git.wikimedia.org and replace them with the Phabricator equivalent - https://phabricator.wikimedia.org/T137353#2376320 (10Paladox) p:05Low>03Lowest Changing to lowest per ^^. We could update the links that break but ^^ has managed to support most of the links. [15:17:12] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2376360 (10Danny_B) `/feed/` links don't seem to have any equivalent in Diffusion (pity!) so for the time being they... [15:23:25] 10Browser-Tests-Infrastructure, 03releng-201516-q4, 10Malu (Malu-Prototype): Prototype new JS framework (malu) - https://phabricator.wikimedia.org/T131121#2376368 (10zeljkofilipin) All tasks in [[ https://phabricator.wikimedia.org/project/view/1906/ | Malu-Prototype ]] project should be resolved. [15:24:43] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2376373 (10Danny_B) `/docs/` links don't seem to have any equivalent in Diffusion so for the time being they may be r... [15:26:56] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2376399 (10Danny_B) [15:31:37] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2376421 (10zeljkofilipin) [15:37:56] (03PS1) 10Zfilipin: Delete selenium-PdfHandler Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/294078 (https://phabricator.wikimedia.org/T134492) [15:38:41] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2376480 (10zeljkofilipin) [15:39:00] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2376481 (10Danny_B) `/patch/` links have pretty similar equivalent in Diffusion https://git.wikimedia.org/patch/media... [15:39:33] Project selenium-MobileFrontend » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #45: 04FAILURE in 17 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/45/ [15:40:04] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2376483 (10Danny_B) Links like https://phabricator.wikimedia.org/rMW471ab05ea26bd1c844237bc752043536d9d2c284 are not... [15:46:21] Yippee, build fixed! [15:46:21] Project selenium-MobileFrontend » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #45: 09FIXED in 24 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/45/ [15:48:58] 06Release-Engineering-Team (Deployment-Blockers), 05Release: MW-1.28.0-wmf.3 deployment blockers - https://phabricator.wikimedia.org/T135559#2376513 (10Anomie) [15:50:25] Yippee, build fixed! [15:50:26] Project selenium-Math » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #50: 09FIXED in 33 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/50/ [15:50:27] Yippee, build fixed! [15:50:28] Project selenium-Math » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #50: 09FIXED in 35 sec: https://integration.wikimedia.org/ci/job/selenium-Math/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/50/ [15:50:42] (03CR) 10Gergő Tisza: [C: 031] "The job just checks whether the pdf generation link in the sidebar exists. I don't think it provides enough value to be worth keeping." [integration/config] - 10https://gerrit.wikimedia.org/r/294078 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [15:51:44] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2376523 (10zeljkofilipin) [15:55:27] (03PS2) 10Zfilipin: Update selenium* Jenkins jobs so every job has an owner [integration/config] - 10https://gerrit.wikimedia.org/r/294078 (https://phabricator.wikimedia.org/T134492) [15:56:40] 06Release-Engineering-Team, 15User-greg: Figure out timing of offsite - https://phabricator.wikimedia.org/T137720#2376537 (10greg) [15:56:58] (03CR) 10Zfilipin: "Patch set 1 was just deleting one job, but there were several changes that needed to be made, so I have done all related changes in patch " [integration/config] - 10https://gerrit.wikimedia.org/r/294078 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [15:57:33] 06Release-Engineering-Team, 15User-greg, 15User-zeljkofilipin: Determine location of 2016 RelEng team offsite - https://phabricator.wikimedia.org/T137721#2376553 (10greg) [15:58:00] 06Release-Engineering-Team, 15User-greg, 15User-zeljkofilipin: Plan 2016 RelEng team offsite - https://phabricator.wikimedia.org/T134830#2278940 (10greg) [15:58:25] 06Release-Engineering-Team, 15User-greg: Determine timing of 2016 RelEng team offsite - https://phabricator.wikimedia.org/T137720#2376569 (10greg) [16:00:10] (03PS3) 10Zfilipin: Update selenium* Jenkins jobs so every job has an owner [integration/config] - 10https://gerrit.wikimedia.org/r/294078 (https://phabricator.wikimedia.org/T134492) [16:00:32] (03CR) 10Zfilipin: "Patch set 3 has better commit message." [integration/config] - 10https://gerrit.wikimedia.org/r/294078 (https://phabricator.wikimedia.org/T134492) (owner: 10Zfilipin) [16:01:09] 06Release-Engineering-Team, 05MW-1.23-release: Update branches in mediawiki/extensions/* for REL1_23 - https://phabricator.wikimedia.org/T66157#2376577 (10Jdforrester-WMF) Moving this into RelEng's orbit more clearly; however, I imagine this isn't going to get done given it's been two years, and can just be cl... [16:02:53] 07Browser-Tests, 10Math, 13Patch-For-Review, 15User-zeljkofilipin, 05WMF-deploy-2016-06-14_(1.28.0-wmf.6): Math tests fail with Watir::Wait::TimeoutError - https://phabricator.wikimedia.org/T137711#2376579 (10zeljkofilipin) 05Open>03Resolved [16:05:00] Project beta-update-databases-eqiad build #9147: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9147/ [16:10:01] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2376617 (10Danny_B) [16:19:53] 10Beta-Cluster-Infrastructure: Rebuild beta cluster saltmaster on Jessie - https://phabricator.wikimedia.org/T136411#2376648 (10Krenair) I compared the list of instances connected to the new server against `nova list` on silver, everything looks correct so I've deleted deployment-salt. [16:29:12] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2376658 (10mmodell) Really nice progress! Thank you everyone for pitching in to help. [16:37:05] twentyafterfour: landed, thanks [16:37:09] :) [16:49:28] 10Browser-Tests-Infrastructure, 03releng-201516-q4, 10Malu (Malu-Prototype): Meta: Prototype new JS framework (malu) - https://phabricator.wikimedia.org/T131121#2156623 (10greg) [16:52:41] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Ownership of Selenium tests - https://phabricator.wikimedia.org/T134492#2376689 (10greg) \o/ [16:53:54] 06Release-Engineering-Team, 10Security-Data-Mapping, 07Documentation, 15User-greg: Release Engineering Data Map - https://phabricator.wikimedia.org/T133239#2376695 (10greg) 05Open>03stalled [17:05:00] Project beta-update-databases-eqiad build #9148: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9148/ [17:07:10] 10Browser-Tests-Infrastructure, 03releng-201516-q4, 10Malu (Malu-Prototype): Meta: Prototype new JS framework (malu) - https://phabricator.wikimedia.org/T131121#2376705 (10greg) Duh :) [17:09:15] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2376711 (10greg) This is still happening as of 17:05 UTC. @Mattflaschen-WMF you added that collab team project, ar... [17:19:44] 10Beta-Cluster-Infrastructure, 06Services: deployment-changeprop instance keeps going OOM and becoming inaccessible - https://phabricator.wikimedia.org/T137725#2376761 (10Krenair) [17:24:14] 06Release-Engineering-Team: Write blog post highlighting Phabricator improvements - https://phabricator.wikimedia.org/T137727#2376793 (10greg) [17:24:20] 06Release-Engineering-Team: Write blog post highlighting recent Phabricator improvements - https://phabricator.wikimedia.org/T137727#2376813 (10greg) [17:24:36] 10Deployment-Systems, 10scap, 03Scap3 (Scap3-MediaWiki-MVP), 15User-mobrovac, 07WorkType-NewFunctionality: Create a script to run test requests for the MediaWiki service - https://phabricator.wikimedia.org/T136839#2376814 (10mobrovac) [17:26:33] Amir1: kk, meetings complete if you want to chat about ORES prod things; although, I must caution that I'm far from an expert WRT mediawiki guts. [17:29:56] 06Release-Engineering-Team, 06Developer-Relations (Jul-Sep-2016): Write blog post highlighting recent Phabricator improvements - https://phabricator.wikimedia.org/T137727#2376835 (10Qgil) [17:33:04] 06Release-Engineering-Team, 15User-greg: Create FY1516Q4 RelEng Quarterly Review slide deck - https://phabricator.wikimedia.org/T137728#2376837 (10greg) [17:34:55] thcipriani: sorry, I was afk coming from WMDE office to the hotel [17:35:01] (it's about 8 PM here) [17:35:19] np :) [17:35:46] okay, I checked everything looks as I might expect except one thing: [17:35:50] db is not updated [17:36:10] like, we add hooks that should change beta features [17:36:22] but they haven't worked (yet) [17:38:06] thcipriani: can you check the beta features table in fawiki_p directly [17:38:06] hmm, when you say "db is not updated" what are you seeing? [17:38:42] 06Release-Engineering-Team: Scope out "deployment-dashboard" project - https://phabricator.wikimedia.org/T137729#2376875 (10greg) [17:39:05] thcipriani: in the replica in labs I can't see 1- the ores tables [17:39:16] 2- ores is not in beta features table [17:40:29] and obviously I can't see ORES in https://fa.wikipedia.org/wiki/%D9%88%DB%8C%DA%98%D9%87:%D8%AA%D8%B1%D8%AC%DB%8C%D8%AD%D8%A7%D8%AA#mw-prefsection-betafeatures [17:40:46] everything in beta worked as I expected [17:40:53] not sure why it's not working in here [17:42:26] Amir1: hmm, so I am sure the ores tables are created for fawiki https://phabricator.wikimedia.org/P3238 [17:42:45] unsure about beta_features [17:42:53] okay [17:43:04] let me give you the proper sql query [17:43:09] kk [17:43:09] to check beta features [17:45:30] thcipriani: "select * from betafeatures_user_counts where feature = 'ores-enabled';" [17:45:36] to see if it's there [17:48:05] Amir1: empty set [17:49:11] thcipriani: hmm, means hooks are not properly set. Do you need to run anything special with maintenance scripts if you are registering new hooks? [17:50:34] ehh, not that I'm aware of? Honestly don't know. [17:52:40] 10Beta-Cluster-Infrastructure, 10EventBus, 06Services, 15User-mobrovac: deployment-changeprop instance keeps going OOM and becoming inaccessible - https://phabricator.wikimedia.org/T137725#2376941 (10mobrovac) p:05Triage>03High a:03mobrovac I have temporarily `systemctl mask`-ed the service, so the h... [17:52:59] thcipriani: okay, before I go and dig super deep, can you check if ores_classification table is empty or not? [17:53:16] sure. [17:53:35] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2373400 (10Catrope) How is it possible that this is still happening? @hashar says he ran the script to completion,... [17:54:25] Amir1: seems to have things: https://phabricator.wikimedia.org/P3238 [17:55:12] nice, I would love to know why these tables are not in labs [17:59:41] 10Deployment-Systems, 03Scap3, 06Operations: Warning: rename(): Permission denied in /srv/mediawiki/wmf-config/CommonSettings.php on line 189 - https://phabricator.wikimedia.org/T136258#2376983 (10RobH) [18:05:00] Project beta-update-databases-eqiad build #9149: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9149/ [18:05:10] thcipriani: everything is alright, hooks are okay but one of them, just one of them, is not working properly [18:05:17] I'm looking into it [18:05:35] :(( kk [18:08:51] thcipriani: oh, it's a simple issue, I just fix it and we can have it in the evening SWAT (or even now, if that's possible which is very unlikely) [18:09:34] Amir1: evening SWAT would be the right place for it. Glad to hear it's a simple fix :) [18:10:13] yeah, I might be asleep by then. [18:15:41] thcipriani: one thing to be sure I'm not breaking anything. Can you do "select feature from betafeatures_user_counts;" in fawiki or any wiki? [18:15:56] so I know I'm changing the right list [18:16:16] I can do it in labs, the tables are not there [18:16:43] *can't [18:18:10] Amir1: https://phabricator.wikimedia.org/P3238 [18:18:49] \o/ [18:18:51] that's it [18:21:42] thcipriani: https://gerrit.wikimedia.org/r/#/c/294103/ [18:21:45] that would fix it [18:22:05] but first I need permission from greg-g and/or James_F [18:22:35] hey, it would be great to approve it if you have some time. It's already tested and working, ORES is in prod now [18:29:52] Amir1: Did you go through the new Beta Feature process? [18:30:48] James_F: I haven't heard of it [18:31:07] Amir1: Then probably "no", which means a C -2 from me. :-( [18:31:17] It's linked from https://www.mediawiki.org/wiki/Beta_Features [18:31:57] (On very limited bandwidth here sorry.) [18:31:58] James_F: wait a sec [18:32:18] by the new process you mean exactly what [18:32:25] it passed the security review [18:32:33] it has community consequences [18:32:38] DBA approval [18:32:53] it has been in the beta cluster for several months [18:33:32] and everything in the check list is met [18:35:06] If it's met then I'm OK with it going out. [18:35:48] thanks :) [18:36:15] James_F: if possible, please add +1 there, anytime you can until the evening SWAT [18:36:20] Found it. Amir1: The checklist is https://www.mediawiki.org/wiki/Beta_Features/Package#Release_Requirements [18:36:34] Can you put on the config patch the links to each of the items being done? [18:36:56] (In a gerrit comment is fine, not in the change itself.) [18:37:53] James_F: sure, [18:38:04] there are some very very minor things [18:38:14] like the talk page is not flowified yet [18:38:32] Kk. [18:39:50] I can help with that if needed. [18:40:09] James_F: it would be great [18:48:32] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377149 (10greg) This being the aborted job, didn't look at logs [18:49:49] James_F: https://gerrit.wikimedia.org/r/#/c/294103/ [18:50:11] pleas ask if you want anything or an explanation [18:59:38] I need to go to a grocery store, be back in a few minutes [19:00:21] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377189 (10hashar) The Echo removeInvalidTargetPage.php was me blindly attempting to cleanup the beta cluster enwi... [19:02:54] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377204 (10Catrope) removeInvalidTargetPage.php is ancient, it was added in 2014. It's also not supposed to be run... [19:05:00] Project beta-update-databases-eqiad build #9150: 15ABORTED in 45 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9150/ [19:08:38] Back [19:10:38] James_F: so everything else is met? [19:10:53] I'm making the page right now [19:13:32] i am having trouble with this CI error: https://integration.wikimedia.org/ci/job/mediawiki-phpunit-parsertests-php53/554/console - I can't see anything that requires net_smtp. mail "suggests" it though. could something CI specific be installed suggested packages? [19:13:53] if it's nothing obvious i'll make a ticket... [19:20:54] cwd: that job runs on Zend 5.3 and one of the dependency requires php at least 5.5.9 [19:21:28] cwd: that is because 1.26 is supposed to still support Zend 5.3 :D [19:21:39] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377253 (10hashar) I guess update.php block on the same SQL as extensions/Echo/maintenance/removeOrphanedEvents.php... [19:22:00] !log T137615 deployment-db2, enwiki > CREATE INDEX echo_notification_event ON echo_notification (notification_event); [19:22:01] T137615: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615 [19:22:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [19:22:43] hashar: yep...i'm trying to get the fundraising branch on 1.26 because 1.25 is EOL this month [19:22:45] cwd: so it depends which PHP fundraising is using nowadays ;) [19:22:55] we are still 5.3 :( [19:23:08] so that patch would break your prod setup for sure :/ [19:23:31] the good news is that REL1_26 should support 5.3 just fine! [19:24:10] cwd: then I am trying to understand from where the dependencies comes and why they fail [19:24:14] hashar: i can't figure out what it is that depends on net_smtp (which requires 5.5.9) [19:24:18] yeah me too :) [19:24:24] the thing is [19:24:37] we have mediawiki depedencnies shipped via mediawiki/vendor [19:25:40] cwd: and I think the job cant find a fundraising/REL1_26 branch and ends up fall backing to master [19:25:55] 00:00:11.762 DEBUG:zuul.Repo:Checking out remotes/origin/master [19:25:55] 00:00:11.909 INFO:zuul.Cloner:Prepared mediawiki/vendor repo with branch master at commit d1f60f632530be0a40d090457dc6b1d733bae7d7 [19:26:17] easiest fix is to cut a fundraising/REL1_26 branch in mediawiki/vendor [19:26:27] hashar: oooh that makes sense [19:26:32] longest fix is to craft a different job or find a way to suggest a different branch [19:26:34] to flalback to [19:27:00] cutting that branch is no problem, thanks! [19:27:29] 'mwext-donationinterfacecore125-testextension-zend53' does that [19:28:05] cwd: for Donation interface, the zuul-cloner utility is instructed to fall back to fundraising/REL1_25 via --branch fundraising/REL1_25 [19:28:16] maybe we should always pass that instead of master [19:28:57] cwd: one sure thing, it is quite a good thing to see you catching up! [19:29:46] hashar: i appreciate your help! [19:32:42] Project beta-update-databases-eqiad build #9151: 15ABORTED in 12 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9151/ [19:34:57] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377293 (10Catrope) >>! In T137615#2377253, @hashar wrote: > Looks like the `echo_notification` table in beta lacks... [19:37:51] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377295 (10hashar) On beta after INDEX echo_notification_event ON echo_notification (notification_event); | id... [19:39:02] Project beta-update-databases-eqiad build #9152: 04STILL FAILING in 4.4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9152/ [19:44:01] Project beta-update-databases-eqiad build #9153: 04STILL FAILING in 2 min 48 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9153/ [19:48:27] Yippee, build fixed! [19:48:28] Project beta-update-databases-eqiad build #9154: 09FIXED in 38 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9154/ [19:49:28] James_F: https://www.mediawiki.org/wiki/ORES_extension [19:49:35] What do you think of this for now? [19:53:16] cwd: please please enquriy for help / question etc :) [19:53:25] cwd: and if in doubt fill bugs! [19:54:16] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377359 (10Catrope) >>! In T137615#2377293, @Catrope wrote: > I'll fix that by splitting off this index creation.... [19:54:20] hashar: will do! i just created that vendor branch on gerrit and it fixed CI. thanks again :) [19:55:05] !log T137615 deployment-db2, **eswiki** > CREATE INDEX echo_notification_event ON echo_notification (notification_event); [19:55:06] T137615: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615 [19:55:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [19:58:08] James_F: if you agree on the page name, tell me to make the patches and merge them, and so on. [19:59:42] Amir1: It's not about the extension, it's about the feature. "ORES review tool" maybe? [20:00:18] James_F: yeah, I had doubt too on the other hand I don't want to confuse people with the service [20:00:36] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2377370 (10hashar) So the issue was the introduction in Echo of a script/db update: RemoveOrphanedEvents . It depe... [20:00:50] Service -> extension -> tool. [20:00:51] but "ORES review tool" is not correct either since the plan is to expand functionalists beyond patrolling [20:01:06] Project beta-update-databases-eqiad build #9155: 04FAILURE in 8.7 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9155/ [20:01:08] what about "ORES tool"? [20:01:14] Sure. But each new functionality would be its own feature, right? [20:01:40] It would not be OK to just throw in new, different features into the same "Beta Feature" bucket. [20:01:44] we didn't make it that way but probably possible to do so [20:01:48] They should each have their own opt-in/default states. [20:02:01] you know better [20:02:05] sure [20:02:11] Yippee, build fixed! [20:02:11] Project beta-update-databases-eqiad build #9156: 09FIXED in 37 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9156/ [20:02:22] so I move it to the "ORES review tool" [20:03:49] Sure. [20:04:40] Amir1: If you make the patch I'll +2. [20:06:05] nice [20:06:49] (Add me as a review on gerrit so I notice. ;-)) [20:07:01] !log beta: update.php / database update finally pass! [20:07:05] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [20:10:18] hashar: i added tests for the new 1.26 branch here: https://gerrit.wikimedia.org/r/#/c/293344/4/jjb/wm-fundraising.yaml - will run in concert (non-voting) with 1.25 until we actually deploy the new branch, if that sounds like a good approach [20:11:00] James_F: https://gerrit.wikimedia.org/r/294114 [20:11:24] cwd: reviewing :) [20:11:59] (03PS5) 10Hashar: Make DonationInterface test run against 1_26 branch. [integration/config] - 10https://gerrit.wikimedia.org/r/293344 (https://phabricator.wikimedia.org/T137213) (owner: 10Cdentinger) [20:12:19] cwd: how it is from last week! so you already figured out the fix !!! [20:13:08] heh yeah, i got distracted [20:13:57] Amir1: Thank you! [20:14:07] Thank you! [20:14:25] let me add it to SWAT [20:15:25] and I'm really sorry about adding tables, I should be made manually. There was the hook and it got registered [20:15:33] so I thought that should be enough [20:17:40] cwd: I think we can get rid of code duplication by using the mediawiki minor version as a variable [20:17:46] cwd: will give it a try :) [20:20:13] Project beta-update-databases-eqiad build #9158: 04FAILURE in 12 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9158/ [20:26:59] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2377421 (10mmodell) @Danny_B: I don't think we should worry about redirecting links to zip files. I think the current... [20:32:38] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2377424 (10Paladox) >>! In T137224#2377421, @mmodell wrote: > @Danny_B: > I don't think we should worry about redirec... [20:39:43] (03PS6) 10Hashar: Make DonationInterface test run against 1_26 branch. [integration/config] - 10https://gerrit.wikimedia.org/r/293344 (https://phabricator.wikimedia.org/T137213) (owner: 10Cdentinger) [20:40:11] cwd: I could not resist at reducing the code duplication. Moved to a job template that takes a 'branch' variable such as REL1_25 or REL1_26 [20:40:17] cwd: but the job is renamed in the process :( [20:42:45] hashar: thank you! the duplication grossed me out too but i didn't know how to do variables :P [20:42:53] Project selenium-Echo » chrome,beta,Linux,contintLabsSlave && UbuntuTrusty build #54: 04FAILURE in 1 min 52 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/54/ [20:42:54] Project selenium-Echo » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #54: 04FAILURE in 1 min 53 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/54/ [20:50:30] cwd: you can have an idea looking at the patch [20:50:47] cwd: I have introduced a new project that realize a single job template [20:51:07] cwd: and the project has branch: [REL1_25, REL1_26] [20:51:26] jjb basically does a cartesian product of all parameters for a project against all jobs listed [20:52:27] (03CR) 10Hashar: [C: 032] Make DonationInterface test run against 1_26 branch. [integration/config] - 10https://gerrit.wikimedia.org/r/293344 (https://phabricator.wikimedia.org/T137213) (owner: 10Cdentinger) [20:52:33] hashar: makes sense! though it would have taken me all day to figure out. [20:53:03] (03CR) 10Hashar: "Forgot to say: excellent patch! The JJB template / variables are a bit annoying to handle though but I took care of it :)" [integration/config] - 10https://gerrit.wikimedia.org/r/293344 (https://phabricator.wikimedia.org/T137213) (owner: 10Cdentinger) [20:53:03] there is a lot of jjb specific terminology [20:53:09] cwd: yeah [20:53:15] cwd: though not so much in the end [20:53:47] (03Merged) 10jenkins-bot: Make DonationInterface test run against 1_26 branch. [integration/config] - 10https://gerrit.wikimedia.org/r/293344 (https://phabricator.wikimedia.org/T137213) (owner: 10Cdentinger) [20:53:51] but for sure our conf is scary since it is so large [20:54:27] cwd: deployed, mind doing recheck for patches on each of 1.26 1.25 ? [20:54:40] will do, thank you! [20:54:49] it is a bit mixed up [20:55:11] since a patch you propose against REL1_26 would still trigger the 1.25 job mwext-donationinterfacecore-REL1_25-testextension-zend53 [20:55:58] hashar: ah yes, well that's ok until we need to deploy that branch [20:56:11] then we can kill the .25 jobs and make .26 voting [20:56:13] cwd: we can refactor later :D [20:56:18] yeah :) [20:56:19] and have a single job [20:56:29] that vary the --branch based on whatever branch a patch is made against [20:56:44] so if you send a patch against fundraising/REL1_42 , we would pass --branch=REL1_42 [20:57:51] oh yeah good call [21:00:10] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2377509 (10mmodell) >>! In T137224#2376483, @Danny_B wrote: > Links like https://phabricator.wikimedia.org/rMW471ab05... [21:01:53] cwd: basically the possibilities are infinite [21:02:39] 10Beta-Cluster-Infrastructure, 07Puppet, 07Tracking: Deployment-prep hosts with puppet errors (tracking) - https://phabricator.wikimedia.org/T132259#2377518 (10Krenair) [21:02:43] 10Beta-Cluster-Infrastructure, 10scap, 10Analytics, 06Services, and 3 others: Set up AQS in Beta - https://phabricator.wikimedia.org/T116206#2377519 (10Krenair) [21:02:46] 10Beta-Cluster-Infrastructure, 10cassandra, 13Patch-For-Review, 07Puppet: Puppet errors on deploment-aqs01 because E: Version '2.2.6' for 'cassandra' was not found - https://phabricator.wikimedia.org/T137706#2377515 (10Krenair) 05Open>03Resolved a:03Eevans That seems to have fixed puppet, thanks. [21:03:01] 10Beta-Cluster-Infrastructure, 10cassandra, 07Puppet: Puppet errors on deploment-aqs01 because E: Version '2.2.6' for 'cassandra' was not found - https://phabricator.wikimedia.org/T137706#2377521 (10Krenair) [21:05:48] hashar: i can see how it's really useful to be able to pass messages to jjb from gerrit [21:06:52] cwd: http://docs.openstack.org/infra/jenkins-job-builder/definition.html [21:07:09] cwd: and the best way is to create your own little yaml file [21:07:17] that is easier to run and debug this way [21:08:58] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2377529 (10mmodell) [21:11:43] !log https://integration.wikimedia.org/ci/computer/integration-slave-trusty-1015/ put offline. Jenkins cant ssh / pool it for some reason [21:11:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [21:12:13] cwd: I did a recheck on one of your patch 1.26 fails and 1.25 pass https://gerrit.wikimedia.org/r/#/c/293895/ [21:12:19] cwd: congratulations! [21:12:41] PHP Parse error: syntax error, unexpected '[' in /mnt/jenkins-workspace/workspace/mwext-donationinterfacecore-REL1_26-testextension-zend53/src/extensions/cldr/LanguageNames.body.php on line 13 :D [21:12:43] typical [21:14:31] hehehe i saw that [21:14:33] wat [21:14:55] we must be on a different branch or something [21:15:01] ...one with a syntax error [21:15:56] oh that must be a short array thing [21:16:10] we must be pinned to an older version [21:20:40] Yippee, build fixed! [21:20:40] Project beta-update-databases-eqiad build #9159: 09FIXED in 39 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9159/ [21:34:40] (03PS1) 10Cdentinger: Test most fundraising extensions against vanilla 1.26 [integration/config] - 10https://gerrit.wikimedia.org/r/294173 [21:35:21] hashar: ^ does this make sense to you? i'm thinking we don't need to cut fundraising branches for everything (now that i think about it i'm not sure if even vendor needs that...) [21:37:08] cwd: yup that one makes sense :) [21:38:08] it is probably better for everyone the less we have to fork stuff for fundraising [21:38:44] cwd: then the fundraising branch has probably different dependencies [21:38:55] so might make sense to keep a fundraising branch on vendor.git [21:39:37] (03CR) 10Hashar: [C: 031] "Make sense to me. Too late for me to deploy it though" [integration/config] - 10https://gerrit.wikimedia.org/r/294173 (owner: 10Cdentinger) [21:39:42] cwd: looks good [21:39:46] cwd: but I really gotta sleep :( [21:40:03] of course! thanks again for your help [22:13:45] I keep getting these emails from shinken [22:13:56] Notification Type: RECOVERY [22:13:56] Host: deployment-salt [22:13:56] State: UP [22:13:56] Address: 10.68.16.99 [22:14:02] I deleted this instance hours ago. [22:14:12] Info: PING OK - Packet loss = 0%, RTA = 0.84 ms [22:14:48] But of course, that IP has already been reallocated to something in contintcloud [22:37:38] 07Browser-Tests, 10MobileFrontend: wikidata description browser tests do not run anywhere - https://phabricator.wikimedia.org/T137756#2377842 (10Jdlrobson) [23:01:24] bd808, could you +2 https://gerrit.wikimedia.org/r/#/c/293500/ [23:01:37] if it looks good of course :) [23:20:05] Project beta-update-databases-eqiad build #9161: 04FAILURE in 4.4 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/9161/