[01:53:28] (03CR) 10Thcipriani: [C: 032] "Innocuous change, adds to what already exists" [tools/scap] - 10https://gerrit.wikimedia.org/r/224374 (owner: 10Thcipriani) [01:53:46] (03Merged) 10jenkins-bot: Add service deploy via scap [tools/scap] - 10https://gerrit.wikimedia.org/r/224374 (owner: 10Thcipriani) [01:55:28] (03CR) 10Thcipriani: [C: 032] Add pattern-matching arg to limit deploy hosts [tools/scap] - 10https://gerrit.wikimedia.org/r/238208 (owner: 10Thcipriani) [01:55:42] (03Merged) 10jenkins-bot: Add pattern-matching arg to limit deploy hosts [tools/scap] - 10https://gerrit.wikimedia.org/r/238208 (owner: 10Thcipriani) [02:49:55] 10Browser-Tests, 10Continuous-Integration-Infrastructure, 10VisualEditor, 5Patch-For-Review: browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox jenkins job failing - https://phabricator.wikimedia.org/T111510#1640289 (10Jdforrester-WMF) [02:50:00] 10Browser-Tests, 10VisualEditor: No such file or directory - i18n/af.json (Errno::ENOENT) - https://phabricator.wikimedia.org/T111525#1640290 (10Jdforrester-WMF) [03:17:07] Yippee, build fixed! [03:17:07] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #818: FIXED in 35 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-firefox-sauce/818/ [07:55:33] 10Continuous-Integration-Infrastructure, 10Ops-Access-Requests, 6operations, 5Patch-For-Review: Let contint-admins force run puppet with /usr/local/sbin/puppet-run - https://phabricator.wikimedia.org/T110943#1640690 (10hashar) Can you add this task to the next week meeting agenda please? No worries there... [07:58:27] 10Beta-Cluster, 6operations, 7HHVM: Convert work machines (tin, terbium) to Trusty and hhvm usage - https://phabricator.wikimedia.org/T87036#1640693 (10hashar) Following on @Dzahn comment, should probably use Jessie instead of Trusty. If so: * rephrase the task summary * remove blocker {T65899} * maybe cre... [08:05:18] 10Beta-Cluster, 10Continuous-Integration-Infrastructure, 5Patch-For-Review: deployment-logstash2 puppet certificate - https://phabricator.wikimedia.org/T112537#1640708 (10hashar) >>! In T112537#1638684, @gerritbot wrote: > Change 238221 had a related patch set uploaded (by Hashar): > Turn puppet autosign bac... [08:06:49] (03PS1) 1020after4: Beginnings of some scap3 documentation [tools/scap] - 10https://gerrit.wikimedia.org/r/238391 (https://phabricator.wikimedia.org/T109515) [08:07:10] (03CR) 10jenkins-bot: [V: 04-1] Beginnings of some scap3 documentation [tools/scap] - 10https://gerrit.wikimedia.org/r/238391 (https://phabricator.wikimedia.org/T109515) (owner: 1020after4) [08:17:02] (03PS2) 1020after4: Beginnings of some scap3 documentation [tools/scap] - 10https://gerrit.wikimedia.org/r/238391 (https://phabricator.wikimedia.org/T109515) [08:18:55] (03PS3) 1020after4: Beginnings of some scap3 documentation [tools/scap] - 10https://gerrit.wikimedia.org/r/238391 (https://phabricator.wikimedia.org/T112554) [08:58:21] 10Continuous-Integration-Config, 5Patch-For-Review, 7Puppet: Setup rubocop for operations/puppet ruby code lints - https://phabricator.wikimedia.org/T102020#1640793 (10akosiaris) Done. I noticed that git submodules are being excluded right now in https://gerrit.wikimedia.org/r/#/c/235695/6/.rubocop.yml,cm.... [10:17:35] 10Continuous-Integration-Infrastructure, 5MW-1.26-release: Fetch dependencies using composer instead of cloning mediawiki/vendor for non-wmf branches - https://phabricator.wikimedia.org/T90303#1640948 (10JanZerebecki) Flow seems to have problems: https://integration.wikimedia.org/ci/job/mwext-qunit-composer/3... [10:33:40] 10Continuous-Integration-Config, 5Patch-For-Review, 7Puppet: Setup rubocop for operations/puppet ruby code lints - https://phabricator.wikimedia.org/T102020#1640982 (10JanZerebecki) Sure you can add them. I would advise to enable the same Jenkins jobs on the submodule repo itself first (I didn't check if tha... [12:55:00] Project browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce build #596: FAILURE in 59 sec: https://integration.wikimedia.org/ci/job/browsertests-GettingStarted-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/596/ [12:55:23] Project beta-scap-eqiad build #70117: FAILURE in 1 min 14 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/70117/ [12:56:39] (03PS1) 10Hashar: Generate HTML coverage report [tools/scap] - 10https://gerrit.wikimedia.org/r/238428 [12:56:42] (03PS1) 10Hashar: Add some coverage to scap.cdlib [tools/scap] - 10https://gerrit.wikimedia.org/r/238429 [12:57:13] (03CR) 10Hashar: "That helps tracks coverage. We can even get it published under https://integration.wikimedia.org/cover/ when patches are merged." [tools/scap] - 10https://gerrit.wikimedia.org/r/238428 (owner: 10Hashar) [12:57:39] (03CR) 10Hashar: "Not that useful but at least give some usage example and slightly increase test coverage." [tools/scap] - 10https://gerrit.wikimedia.org/r/238429 (owner: 10Hashar) [12:59:20] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #785: FAILURE in 27 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/785/ [13:01:26] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team, 5Patch-For-Review: Repositories with Ruby code should be documented and appropriate Jenkins jobs should be running - https://phabricator.wikimedia.org/T1361#1641217 (10zeljkofilipin) [13:01:28] 10Continuous-Integration-Infrastructure, 10Gather, 5Patch-For-Review, 5WMF-deploy-2015-09-15_(1.26wmf23): Ruby syntax check and RuboCop for Gather - https://phabricator.wikimedia.org/T112097#1641216 (10zeljkofilipin) 5Open>3Resolved [13:05:15] 10Continuous-Integration-Infrastructure, 10QuickSurveys, 5Patch-For-Review: Run RuboCop for QuickSurveys - https://phabricator.wikimedia.org/T112091#1641257 (10zeljkofilipin) 5Open>3Resolved [13:05:16] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team, 5Patch-For-Review: Repositories with Ruby code should be documented and appropriate Jenkins jobs should be running - https://phabricator.wikimedia.org/T1361#1641258 (10zeljkofilipin) [13:05:44] Yippee, build fixed! [13:05:45] Project beta-scap-eqiad build #70118: FIXED in 1 min 26 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/70118/ [13:06:43] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: Repositories with Ruby code should be documented and appropriate Jenkins jobs should be running - https://phabricator.wikimedia.org/T1361#23935 (10zeljkofilipin) [13:10:10] 10Continuous-Integration-Config, 7Puppet: Setup rubocop for operations/puppet ruby code lints - https://phabricator.wikimedia.org/T102020#1641274 (10zeljkofilipin) [13:11:51] (03CR) 10Hashar: "The Prolog reference was merely a Tongue-in-cheek. I am wondering now how we can run this on all repositories. There is no easy way in" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/237719 (https://phabricator.wikimedia.org/T109119) (owner: 10BryanDavis) [13:38:44] 10Continuous-Integration-Config, 7Puppet: Move RuboCop job from experimental pipeline to the usual pipelines for operations/puppet - https://phabricator.wikimedia.org/T110019#1641354 (10zeljkofilipin) a:3zeljkofilipin [13:43:59] 10Continuous-Integration-Config, 7Puppet: Move RuboCop job from experimental pipeline to the usual pipelines for operations/puppet - https://phabricator.wikimedia.org/T110019#1641377 (10zeljkofilipin) > 15:41 you can start by adding a bit of doc at https://www.mediawiki.org/wiki/Continuous_integration... [13:50:30] 10Continuous-Integration-Config, 7Puppet: Setup rubocop for operations/puppet ruby code lints - https://phabricator.wikimedia.org/T102020#1641403 (10zeljkofilipin) @akosiaris: A quick look at the submodules (searching for `.rb` files) says there are none. Am I missing them? [13:52:37] 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team: Repositories with Ruby code should be documented and appropriate Jenkins jobs should be running - https://phabricator.wikimedia.org/T1361#1641415 (10zeljkofilipin) [13:52:40] 10Continuous-Integration-Config, 7Puppet: Setup rubocop for operations/puppet ruby code lints - https://phabricator.wikimedia.org/T102020#1641411 (10zeljkofilipin) 5Open>3Resolved I think this task is resolved. The only subtask that is created is T110019. I plan to work on it this week. If you think there... [13:57:16] 10Continuous-Integration-Infrastructure: Move https://github.com/legoktm/tools-ci to gerrit - https://phabricator.wikimedia.org/T111758#1641430 (10hashar) I have pushed the current code to integration/config.git under branch `attic/legoktm/tools-ci`. [13:57:47] !log Force pushed https://github.com/legoktm/tools-ci to gerrit integration/config.git under branch attic/legoktm/tools-ci https://phabricator.wikimedia.org/T111758 [13:57:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [13:58:09] (03PS1) 10Hashar: Import of legoktm/tools-ci [integration/config] - 10https://gerrit.wikimedia.org/r/238445 (https://phabricator.wikimedia.org/T111758) [13:58:35] 10Continuous-Integration-Infrastructure, 5Patch-For-Review: Move https://github.com/legoktm/tools-ci to gerrit - https://phabricator.wikimedia.org/T111758#1641434 (10hashar) https://gerrit.wikimedia.org/r/238445 proposes it under the subdirectory `/dashboard/`. [13:58:57] (03CR) 10jenkins-bot: [V: 04-1] Import of legoktm/tools-ci [integration/config] - 10https://gerrit.wikimedia.org/r/238445 (https://phabricator.wikimedia.org/T111758) (owner: 10Hashar) [14:00:07] (03CR) 10Hashar: [C: 04-2] "Did it in a rush, it has a bunch of unrelated impact on files in the root directory." [integration/config] - 10https://gerrit.wikimedia.org/r/238445 (https://phabricator.wikimedia.org/T111758) (owner: 10Hashar) [14:04:22] 10Continuous-Integration-Infrastructure, 5MW-1.26-release: Fetch dependencies using composer instead of cloning mediawiki/vendor for non-wmf branches - https://phabricator.wikimedia.org/T90303#1641447 (10hashar) ``` WARN [Chromium 44.0.2403 (Ubuntu 0.0.0)]: Disconnected (1 times), because no message in 60000 m... [14:19:59] (03CR) 10Filippo Giunchedi: [C: 031] Allow full path to hosts file [tools/scap] - 10https://gerrit.wikimedia.org/r/238213 (owner: 10Thcipriani) [14:20:04] 10Continuous-Integration-Infrastructure, 5MW-1.26-release: Fetch dependencies using composer instead of cloning mediawiki/vendor for non-wmf branches - https://phabricator.wikimedia.org/T90303#1641474 (10JanZerebecki) We need to create a composer version of the jobs in the template extension-gate. [15:11:28] 10Browser-Tests, 10Wikidata: adapt wikidata_api gem to be compatible with mediawiki_api gem version 0.4 - https://phabricator.wikimedia.org/T106811#1641628 (10dduvall) a:5dduvall>3None [15:14:02] 10Continuous-Integration-Config, 7Puppet: Setup rubocop for operations/puppet ruby code lints - https://phabricator.wikimedia.org/T102020#1641643 (10akosiaris) >>! In T102020#1641403, @zeljkofilipin wrote: > @akosiaris: A quick look at the submodules (searching for `.rb` files) says there are none. Am I missin... [15:17:30] 10Browser-Tests, 5MW-1.26-release, 5Patch-For-Review: It takes about 20 seconds just to start a Sauce Labs browser - https://phabricator.wikimedia.org/T92613#1641657 (10hashar) On https://integration.wikimedia.org/ci/job/browsertests-Core-en.wikipedia.beta.wmflabs.org-linux-firefox-sauce/743/consoleFull 00:... [15:19:10] 10Browser-Tests, 10Continuous-Integration-Infrastructure, 6Release-Engineering-Team, 10Wikidata, 5Patch-For-Review: browsertest jobs should not be allowed to run for 10 hours - https://phabricator.wikimedia.org/T92275#1641664 (10hashar) [15:19:12] 10Browser-Tests, 5MW-1.26-release, 5Patch-For-Review: It takes about 20 seconds just to start a Sauce Labs browser - https://phabricator.wikimedia.org/T92613#1641662 (10hashar) 5Open>3Resolved Seems we did all we could do and the MediaWiki core browser test job is faster now. Wikidata should be as well... [15:36:31] 10Browser-Tests, 10Continuous-Integration-Infrastructure, 10VisualEditor, 5Patch-For-Review: browsertests-VisualEditor-language-screenshot-os_x_10.10-firefox jenkins job failing - https://phabricator.wikimedia.org/T111510#1641745 (10dduvall) The short term fix here is to simply revert the changes made in h... [15:41:19] 10Browser-Tests, 10VisualEditor: Delete or fix failed VisualEditor browsertests Jenkins job - https://phabricator.wikimedia.org/T94162#1641759 (10zeljkofilipin) @ryasmeen: Are you working on this? [16:09:56] I'm about to cut the new branch, any patches that need to merge ahead of that? [16:12:55] (03CR) 1020after4: [C: 032] Add --environment flag to cli.Application [tools/scap] - 10https://gerrit.wikimedia.org/r/238211 (owner: 10Thcipriani) [16:14:41] (03Merged) 10jenkins-bot: Add --environment flag to cli.Application [tools/scap] - 10https://gerrit.wikimedia.org/r/238211 (owner: 10Thcipriani) [16:14:44] (03Merged) 10jenkins-bot: Allow full path to hosts file [tools/scap] - 10https://gerrit.wikimedia.org/r/238213 (owner: 10Thcipriani) [16:17:25] (03CR) 10Chad: [C: 032] Generate HTML coverage report [tools/scap] - 10https://gerrit.wikimedia.org/r/238428 (owner: 10Hashar) [16:17:58] (03Merged) 10jenkins-bot: Generate HTML coverage report [tools/scap] - 10https://gerrit.wikimedia.org/r/238428 (owner: 10Hashar) [16:18:03] 10Continuous-Integration-Infrastructure: Find out which jobs are using ElasticSearch as a backend - https://phabricator.wikimedia.org/T112667#1641905 (10hashar) 3NEW a:3hashar [16:19:17] (03CR) 10Chad: [C: 032] Beginnings of some scap3 documentation [tools/scap] - 10https://gerrit.wikimedia.org/r/238391 (https://phabricator.wikimedia.org/T112554) (owner: 1020after4) [16:19:32] (03Merged) 10jenkins-bot: Beginnings of some scap3 documentation [tools/scap] - 10https://gerrit.wikimedia.org/r/238391 (https://phabricator.wikimedia.org/T112554) (owner: 1020after4) [16:27:25] 10Continuous-Integration-Config, 5Patch-For-Review, 7Puppet: Setup rubocop for operations/puppet ruby code lints - https://phabricator.wikimedia.org/T102020#1641963 (10JanZerebecki) I missed that submodules are not checked out in that job. [16:30:34] 10Continuous-Integration-Config, 7Puppet: also clone submodules in operations/puppet jobs - https://phabricator.wikimedia.org/T112670#1641972 (10JanZerebecki) 3NEW [16:31:41] andrewbogott: so in short, nodepool boot an instance out of an image. snapshot it and then boot instances out of that snapshot [16:32:04] andrewbogott: which I guess means the snapshot image will be copied on compute nodes as instances are booted on them [16:32:41] yeah, makes sense. [16:32:53] I don’t supposed you have record of the ids of either the new images or the new snapshots? [16:33:34] of the old ones ? [16:33:39] might in the nodepool logs [16:34:15] if you have the id of an image that was created and no longer used… I can verify that it’s not present anymore [16:39:42] andrewbogott: 8dc5a15a-4f3a-452d-8442-857d6d7fae0a might be a snapshot id [16:39:54] build on Sep 11th 21:00utc [16:40:12] I haven't any id for the images I pushed and then deleted. But I guess they are properly gone [16:40:24] hashar: ok, will look in a moment... [16:49:45] andrewbogott: and I sent the nodepool patch to bump the # of instances consumed by nodepool. No urgency https://gerrit.wikimedia.org/r/238491 Feel free to lower the numbers as may fit [16:50:35] hashar: do you have the image id of the image that nodepool is using right now? [16:50:41] I don’t see anything in glance that I didn’t put there [16:50:53] sure [16:51:09] ci-jessie-wikimedia 46150ea9-3a0f-4157-9179-239f54df8117 checksum: 5920468dbf4196380bd64ab04db736ed [16:51:30] and the snapshots are: [16:51:44] ci-jessie-wikimedia-1442005022 366cb618-eda6-4994-8b72-4e2e50bead60 [16:51:54] ci-jessie-wikimedia-1442326440 7ff37c7f-57b1-4817-9a3a-0f5504bfd1bb [16:51:59] and these are in project ‘integration’ right? [16:52:13] nop [16:52:17] contintcloud [16:52:24] integration is for the current slaves [16:52:36] contintcloud is managed entirely by nodepool via the nodepoolmanager user [16:52:52] ah! There they are :) [16:55:16] hashar: ok, I need to go but will look at this later on today [16:55:23] So far nothing very alarming is happening :) [16:55:30] andrewbogott: I am trusting openstack is deleting them [16:55:33] just wanted to get you informed [16:55:45] in case the disks fill up [16:58:51] 6RelEng-Admin, 6Team-Practices: Do 90 day review of post-offsite actions in early August '15 - https://phabricator.wikimedia.org/T103917#1642050 (10demon) 5Open>3Resolved In May 2015, the Release Engineering team had our offsite in Annecy, France, just prior to the Lyon hackathon. The four days were spent... [16:59:03] yo everyone ^ [16:59:29] marxarelli: s/resources/people/, per your comment on being unclear. [16:59:37] Otherwise word-for-word what I sent internally [17:00:48] ostriches: w00t [17:01:50] Sign-Off [17:01:52] 6RelEng-Admin, 6Team-Practices: Do 90 day review of post-offsite actions in early August '15 - https://phabricator.wikimedia.org/T103917#1642058 (10hashar) @demon summary above has been discussed the #together private mailing list. [17:02:00] ostriches: excellent writing, kudos :) [17:08:49] 6RelEng-Admin, 6Team-Practices: Do 90 day review of post-offsite actions in early August '15 - https://phabricator.wikimedia.org/T103917#1642075 (10demon) >>! In T103917#1642050, @demon wrote: > Re-check with the outside stakeholders of Release Engineering in one year. The problems identified from the outside... [17:44:16] 10Continuous-Integration-Config, 10Fundraising Tech Backlog, 10Fundraising-Backlog: Enable PHPUnit testing on the wikimedia/fundraising/SmashPig repo - https://phabricator.wikimedia.org/T104264#1642312 (10awight) [17:57:43] (03PS1) 10Jforrester: Add Eran Roz to V+2'ers [integration/config] - 10https://gerrit.wikimedia.org/r/238506 [17:59:29] (03PS2) 10Legoktm: Add Eran Roz to V+2'ers [integration/config] - 10https://gerrit.wikimedia.org/r/238506 (owner: 10Jforrester) [17:59:40] (03CR) 10Legoktm: [C: 032] Add Eran Roz to V+2'ers [integration/config] - 10https://gerrit.wikimedia.org/r/238506 (owner: 10Jforrester) [17:59:52] legoktm: Ta. [18:00:28] (03Merged) 10jenkins-bot: Add Eran Roz to V+2'ers [integration/config] - 10https://gerrit.wikimedia.org/r/238506 (owner: 10Jforrester) [18:09:51] !log deploying https://gerrit.wikimedia.org/r/238506 [18:09:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [18:10:55] (03PS2) 10Dduvall: Rename and simplify some git deploy functions [tools/scap] - 10https://gerrit.wikimedia.org/r/236241 (https://phabricator.wikimedia.org/T109514) [18:13:52] 10Deployment-Systems, 10MediaWiki-Unit-tests, 6Release-Engineering-Team, 5MW-1.25-release, 5Patch-For-Review: Tests directory subtly missing from core/extension releases - https://phabricator.wikimedia.org/T91426#1642463 (10DanielRenfro) :) [18:40:37] thcipriani: fyi, made a fix to scap-vagrant's dns resolution of container names [18:40:44] other than that, it seems to be working pretty well [18:41:22] marxarelli: I actually just started futzing with it a few minutes ago, I'm getting: lots of default: getaddrinfo: Name or service not known [18:42:13] yeah, i forgot that the host was using dhcp and would blow away my changes to resolv.conf [18:42:35] so i reimplemented the change as a dhclient entry hook [18:43:00] you be able to simply `git pull` `vagrant provision` to fix it [18:43:17] kk, lemme give that a shot [18:43:22] or `vagrant destroy -f` and `vagrant up` if all else fails [18:43:42] re-upping is pretty fast since the vagrant base box and lxc rootfs are cached [18:44:21] "Configuring host DNS to resolve local container names" hooray [18:48:34] marxarelli: nice! Totally worked after a little ssh-keyscan -f /etc/dsh/group/mockbase >> ~/.ssh/known_hosts [18:48:58] thcipriani: oh, that should be done automatically [18:49:19] hmm, gave me the known-hosts error :\ [18:49:32] er, host-key verification failed [18:49:40] ah, maybe you had provisioned a while back before i implemented it [18:49:47] ? [18:50:20] I provisioned, wiped, provisioned, pulled, provisioned. So....maybe :) [18:51:12] either way, this is pretty awesome. [18:51:35] \o/ [18:52:04] it wasn't a total waste of time! (i had that fear numerous times while setting it up) [18:53:09] heh, no way, this will make developing way easier (no need to break staging and flounder fixing it) [18:53:40] i still get some thrashing at times (probably due to the /var/local/lxc.img -> loop0 -> btrfs -> lxc backstore madness) [18:54:05] but it works a lot better now that the vm memory has been increased [18:55:24] my favorite part of the setup is actually the bind mounts, i.e. that host:./scap is vagrant:/scape is scap-target-n:/srv/deployment/scap/scap [18:55:52] makes the dev workflow super simple [18:56:19] * marxarelli wonders if mw-vagrant w/ lxc could use a bind mount in labs [18:56:45] 10Beta-Cluster, 10Traffic, 6operations, 5Patch-For-Review: Upgrade beta-cluster caches to jessie - https://phabricator.wikimedia.org/T98758#1642618 (10demon) Working on this. Failing on the usual TLS madness. [18:57:06] this is a vast improvement. my workflow has been: get something I like, make a patch, scp patch to staging-tin, apply patch, deploy via trebuchet, run deploy, fix breakage, repeat. [18:57:20] haha [18:57:49] yeah, i probably would have gone that route if we weren't all using the same staging instances [18:58:01] imagine that workflow under concurrency :) [18:59:16] marxarelli: yup, unworkable, vagrant/lxc ftw. Nicely done, sir. [18:59:38] thanks! [18:59:48] (03CR) 10Chad: [C: 031] Rename and simplify some git deploy functions [tools/scap] - 10https://gerrit.wikimedia.org/r/236241 (https://phabricator.wikimedia.org/T109514) (owner: 10Dduvall) [18:59:49] My workflow is: keep my laptop reasonably close to the same environment as our production servers ;) (I'm on ubuntu, not osx) [18:59:52] now on to rollback ... [19:00:13] but this vagrant setup is sweet. [19:00:21] twentyafterfour: when are you going to upgrade to jessie? ;) [19:00:36] (03CR) 10Chad: [C: 032] Add some coverage to scap.cdlib [tools/scap] - 10https://gerrit.wikimedia.org/r/238429 (owner: 10Hashar) [19:00:41] * marxarelli needs to switch back to linux one of these days [19:00:51] marxarelli: I was considering that actually probably soon [19:02:26] I think I'm gonna set up a 3 screen workstation with two debian machines and a mac mini all linked to the same keyboard/mouse (with synergy, unless something better has been created since the last time I tested the alternatives) [19:02:59] synergy dual workstations was always more productive than what I've got now [19:03:23] http://synergy-project.org/ [19:04:55] (03Merged) 10jenkins-bot: Add some coverage to scap.cdlib [tools/scap] - 10https://gerrit.wikimedia.org/r/238429 (owner: 10Hashar) [19:05:00] i never really took to synergy but a friend of mine has used it for years and swears by it [19:05:20] Aww, box no support my provider :( [19:05:33] ostriches: parallels? [19:05:38] Yep [19:05:50] it takes a tiny bit of getting used to but I actually think synergy is better usability than a linux machine with two monitors [19:06:17] 10Continuous-Integration-Infrastructure, 10Wikidata: [Bug] Intermittent qunit failures (MessageBlobStore::insertMessageBlob failed, database locked during setup) - https://phabricator.wikimedia.org/T111530#1642651 (10JanZerebecki) We could try switching to MariaDB from sqlite for qunit tests. [19:06:18] there's no jessie base box for parallels? weird [19:06:52] https://phabricator.wikimedia.org/P2045 [19:07:05] since each screen is a separate computer and only clipboards are sync'd it means that each screen has it's own focused window and switching back and forth doesn't require clicking to get focus back where it belongs each time [19:07:13] ostriches: https://atlas.hashicorp.com/boxes/search?provider=parallels&q=jessie&sort=&utf8=%E2%9C%93 [19:07:32] maybe try that first one [19:08:59] This box can work with multiple providers! The providers that it can work with are listed below. Please review the list and choose the provider you will be working with. [19:09:09] 1) virtualbox [19:09:10] 2) vmware [19:09:11] lmao [19:09:44] blerg. :/ [19:09:53] Ah, old version. [19:09:55] Not current one [19:10:09] I wonder if I can make a parallels one :) [19:10:47] ostriches: there's a `vagrant package` command now that's supposed to simplify that process [19:11:38] Hmmm [19:11:55] oh, wait. that might only be for virtualbox [19:12:05] Command only says vbox. [19:12:15] --base NAME Name of a VM in virtualbox to package as a base box [19:12:21] parallels has its own packager [19:12:23] http://parallels.github.io/vagrant-parallels/docs/boxes/packer.html [19:13:10] oh wait! [19:13:12] ostriches: https://atlas.hashicorp.com/parallels/boxes/debian-8.1 [19:14:10] Silly vagrant didn't find that the first time... [19:14:31] the Vagrantfile needs some tweaks for it. one sec [19:17:04] Yeah, just have to switch the config.vm.box when the provider is parallels. [19:22:23] ostriches: okey doke. should work now [19:22:39] maybe [19:22:41] :) [19:26:14] Ok, we're gettin there! [19:27:03] Yippee, build fixed! [19:27:04] Project browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #786: FIXED in 28 min: https://integration.wikimedia.org/ci/job/browsertests-MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/786/ [19:54:14] ostriches: if you get a bunch of getaddrinfo errors just run `vagrant provision` again. my previous dns fix was not so fixy [19:54:22] Yeah, I did that [19:54:25] Now it works lmao [19:54:31] :) good! [19:54:45] Now just getting permission denied on the git clone to target hosts. [19:54:48] But fixable [19:55:05] oh really? [19:55:11] for which clone? [19:55:18] /srv/deployment/mockbase/deploy [19:55:51] The dir exists and is root:root [19:56:00] ah, ok [19:57:24] that's probably the biggest downside to using a shell provisioner: you forgot to account for incremental changes in the original script [19:58:05] huh. i just provisioned from scratch and didn't have a permissions problem [20:01:14] Lemme try fresh. [20:24:52] twentyafterfour, ostriches: Do you aim to switch to SemVer "1.27.0-wmf.1" numbering from 1.27wmf1 onwards? Should I start labelling the projects as such? Just about to create 1.27/1 now… [20:26:06] I would like to switch to semver, I don't know if releasetaggerbot is the only blocker but I'll fix any release tooling that breaks due to the change [20:26:38] James_F: go ahead and start labeling the projects... a full version increment is a good time to switch I suppose [20:26:42] OK. [20:27:19] Tah-dah: https://phabricator.wikimedia.org/project/profile/1513/ [20:27:57] twentyafterfour: Fixing the Python shouldn't be too hard; I had a WIP that I stopped working on because, well, Python… [20:28:22] lol [20:28:38] I'll push it if you care. [20:28:49] James_F: sure I'll take a look [20:29:02] I've been learning python lately, getting pretty decent with it [20:30:27] Hmm. [20:30:31] Where did I put that patch? [20:30:43] I might have over-written it. :-( [20:40:53] twentyafterfour: https://gerrit.wikimedia.org/r/238542 for your delectation. :-) [21:57:27] 5Continuous-Integration-Scaling: Disposable VMs need a cache for package managers - https://phabricator.wikimedia.org/T112560#1643228 (10hashar) Discussing with OpenStack people, they have some jobs downloading Linux distributions and are looking for a cache/mirroring solution. Their RFC (== spec) is at https://... [21:58:02] 5Continuous-Integration-Scaling: Evaluate angry-caching-proxy as a package managers cache - https://phabricator.wikimedia.org/T112561#1643230 (10hashar) 5Open>3Resolved a:3hashar Evaluation done for now. See my comments in the task. [21:58:04] 5Continuous-Integration-Scaling: Disposable VMs need a cache for package managers - https://phabricator.wikimedia.org/T112560#1643233 (10hashar) [22:23:15] 5Continuous-Integration-Scaling: Disposable VMs need a cache for package managers - https://phabricator.wikimedia.org/T112560#1643322 (10dduvall) >>! In T112560#1643228, @hashar wrote: > Discussing with OpenStack people, they have some jobs downloading Linux distributions and are looking for a cache/mirroring so... [22:49:25] 3Scap3: Scap3 service sync should break up remote deploy tasks - https://phabricator.wikimedia.org/T109861#1643409 (10dduvall) Per our sprint meeting discussion last Friday, the main reasoning behind breaking up deployment into distinct stages is to be able to independently control the batch sizes, ultimately le... [22:49:38] 3Scap3: Scap3 service sync should break up remote deploy tasks - https://phabricator.wikimedia.org/T109861#1643410 (10dduvall) a:3dduvall [22:49:52] 3Scap3: Scap3 should break up remote deploy tasks - https://phabricator.wikimedia.org/T109861#1643411 (10dduvall) [22:50:34] 10Deployment-Systems, 3Scap3, 5Patch-For-Review: Scap3 should support rollback - https://phabricator.wikimedia.org/T109514#1643413 (10dduvall) [22:50:36] 3Scap3: Scap3 should break up remote deploy tasks - https://phabricator.wikimedia.org/T109861#1561092 (10dduvall) [22:58:00] (03PS1) 10Dduvall: Execute distinct stages of deployment separately [tools/scap] - 10https://gerrit.wikimedia.org/r/238631 (https://phabricator.wikimedia.org/T109861) [22:58:23] (03CR) 10jenkins-bot: [V: 04-1] Execute distinct stages of deployment separately [tools/scap] - 10https://gerrit.wikimedia.org/r/238631 (https://phabricator.wikimedia.org/T109861) (owner: 10Dduvall) [22:59:02] (03PS2) 10Dduvall: Execute distinct stages of deployment separately [tools/scap] - 10https://gerrit.wikimedia.org/r/238631 (https://phabricator.wikimedia.org/T109861) [22:59:25] (03CR) 10jenkins-bot: [V: 04-1] Execute distinct stages of deployment separately [tools/scap] - 10https://gerrit.wikimedia.org/r/238631 (https://phabricator.wikimedia.org/T109861) (owner: 10Dduvall) [23:00:43] (03PS3) 10Dduvall: Execute distinct stages of deployment separately [tools/scap] - 10https://gerrit.wikimedia.org/r/238631 (https://phabricator.wikimedia.org/T109861) [23:04:04] (03CR) 10Mobrovac: [C: 031] Execute distinct stages of deployment separately (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/238631 (https://phabricator.wikimedia.org/T109861) (owner: 10Dduvall) [23:05:32] (03CR) 10Dduvall: Execute distinct stages of deployment separately (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/238631 (https://phabricator.wikimedia.org/T109861) (owner: 10Dduvall) [23:08:48] (03CR) 10Mobrovac: [C: 031] Rename and simplify some git deploy functions [tools/scap] - 10https://gerrit.wikimedia.org/r/236241 (https://phabricator.wikimedia.org/T109514) (owner: 10Dduvall) [23:09:03] Yippee, build fixed! [23:09:04] Project browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce build #264: FIXED in 12 min: https://integration.wikimedia.org/ci/job/browsertests-Gather-en.m.wikipedia.beta.wmflabs.org-linux-chrome-sauce/264/ [23:15:52] 3Scap3, 5Patch-For-Review: Scap3 should break up remote deploy tasks - https://phabricator.wikimedia.org/T109861#1643511 (10dduvall) Another benefit to this design is that it simplifies any general before/after hook implementation that we may want to support in the future.