[01:07:07] 10Deployment-Systems, 06Release-Engineering-Team (Long-Lived-Branches): Convert old wmf/* deployment branches to tags (recurring chore) - https://phabricator.wikimedia.org/T1288#2464852 (10demon) Done for all extensions, skins and vendor. No more extraneous tags. No more branches other than the currently activ... [02:32:18] 10Continuous-Integration-Config, 10MediaWiki-Debian: Set up CI auto-building for mediawiki/debian repository - https://phabricator.wikimedia.org/T122978#2465072 (10Legoktm) I just switched the package to use git-buildpackage so I think this can be revisited. [02:50:28] 10Continuous-Integration-Config, 10MediaWiki-Debian: Set up CI auto-building for mediawiki/debian repository - https://phabricator.wikimedia.org/T122978#2465081 (10Legoktm) Closer I suppose. Will need some work on setting up chroots for unstable/sid I think. [05:31:39] (03PS4) 10Lethexie: Single Line comments no multiple '*'. [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/295895 [05:45:05] Project mediawiki-core-code-coverage build #2136: 04STILL FAILING in 2 hr 45 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/2136/ [08:34:52] !log Unpooling integration-slave-precise-1002 will use it as a zuul-server test instance temporarily [08:34:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [08:35:54] hashar :) [08:36:08] hashar i installed grafana [08:36:17] and graphite [08:37:08] and hi [08:41:09] PROBLEM - Host zuul-precise is DOWN: CRITICAL - Host Unreachable (10.68.19.173) [09:27:18] zuul-precise ^^ that is me. A one off instance to debug Zuul. Turns out Precise labs image can't boot anymore [09:27:45] paladox: there is a project to switch from Graphite to Prometheus as well [09:27:49] though it is still under evaluation [09:28:04] Oh [09:28:21] hashar im trying to test weather the jessie version has the same problem [09:28:25] as precise for graphs [09:28:34] but im not sure how to set it up to track zuul [09:28:42] It's all up and running including statsd [09:28:50] gerrit-graph.wmflabs.org [09:28:58] gerrit-grap.wmflabs.org [09:29:00] hashar ^^ [09:29:29] hashar andrebogott needs to update precise to use the new ldaps [09:29:51] but he asked me if it was a prority when i tryed installing precise i said no. [09:32:31] yeah it is not a big deal [09:32:33] Spelt the name wrong it's andrewbogott [09:32:35] Ok [09:33:55] hashar i tryed building the dpkg that required the newer pycrypto [09:33:58] but got an error [09:34:42] I got src/MD2.c:31:20: fatal error: Python.h: No such file or directory [09:34:53] error: command 'gcc' failed with exit status 1 [09:34:53] warning: GMP or MPIR library not found; Not building Crypto.PublicKey._fastmath. [09:34:53] building 'Crypto.Hash._MD2' extension [09:34:53] ---------------------------------------- [09:34:53] Can't roll back pycrypto; was not uninstalled [09:34:54] Cleaning up... [09:35:02] hashar ^^ [09:39:09] hashar why not try setting up a trusty instance then install precise [09:40:58] hashar i guess you could try a trusty instance? [09:41:12] creating one and try it there instead of precise. [09:45:27] hashar it seems the 2015 image of precise is available in labs but the 2016 one is disabled [09:50:52] brb [10:03:07] 10scap, 10Parsoid, 06Services, 03Scap3 (Scap3-Adoption-Phase1), 15User-mobrovac: Deploy Parsoid with scap3 - https://phabricator.wikimedia.org/T120103#2465413 (10mobrovac) [10:18:51] hashar why not make a trusty or Jessie docker image and use it on the precise server that Zuul is on [10:19:14] And maybe host doc.wm.org in it for now [10:19:34] until we migrate to the new server [10:21:44] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465456 (10hashar) I have finally managed to reproduce the deadlock on the labs instance `integration-slave-precise-1002` wi... [10:23:31] Oh you reproduced it [10:23:35] :) [10:24:04] Maybe try different paramiko versions. [11:50:42] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465658 (10hashar) Turns out the issue is that python-daemon closes all file descriptor when daemonizing the application.... [11:51:14] paladox: we will migrate the Zuul server to a Jessie server [11:51:29] but that is ongoing and has dependency on hardware / network wiring in the datacenter [11:51:35] (+ fullreinstall) [11:51:44] Docker is a NO/NO for production [11:51:50] at least as of today [11:52:04] I have found the cause [11:52:09] gotta figure out a fix for it [12:00:29] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465665 (10Paladox) @hashar does that mean we have to update nodepool but also shoulden we use version paramiko 1.11.6 on pr... [12:02:45] paladox: so yeah that definitely paramiko :) [12:03:32] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465669 (10hashar) And see also http://stackoverflow.com/questions/20636678/paramiko-inside-python-daemon-causes-ioerror wi... [12:04:25] paladox: funnily in the IRC log I was looking recently, jeblair from OpenStack mentioned the same issue and pointed to https://github.com/paramiko/paramiko/commit/6f211115f49edcea7d23b764d7cf3a84ff12f5f0 [12:06:52] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465671 (10Paladox) @hashar we could do it so it imports it after it daemonizing. And then potentially upload the workaroun... [12:08:46] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465675 (10Paladox) Or try this pull https://github.com/paramiko/paramiko/pull/691/files please. [12:15:09] FIXED !!!!!!!!!!!!!!!!!!! [12:16:55] * andre__ steals one exclamation mark :) [12:18:04] (03Abandoned) 10Paladox: 2.1.0-151-g30a433b-wmf3precise1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/298957 (https://phabricator.wikimedia.org/T137525) (owner: 10Paladox) [12:18:54] it is running!! [12:18:59] I am so happy [12:20:06] *hug* :) [12:28:27] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465737 (10hashar) p:05Normal>03High a:03hashar The root cause is the Zuul refactoring of Gerrit connections. The roo... [12:36:17] (03PS1) 10Hashar: Do not import paramiko before daemonization [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/299136 (https://phabricator.wikimedia.org/T137525) [12:38:30] (03CR) 10Paladox: [C: 031] Do not import paramiko before daemonization [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/299136 (https://phabricator.wikimedia.org/T137525) (owner: 10Hashar) [12:38:43] (03CR) 10Paladox: "Thank you for tracing this." [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/299136 (https://phabricator.wikimedia.org/T137525) (owner: 10Hashar) [13:07:13] hashar thanks for finding the problem and doing a workaround, I'm using a 4g mobile connection since I'm out about (72mbps) :) but paladox irc name is logged in on my computer st home [13:07:19] St = at [13:10:11] (03PS1) 10Hashar: 2.1.0-151-g30a433b-wmf3precise1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/299139 (https://phabricator.wikimedia.org/T137525) [13:10:57] (03CR) 10Paladox: [C: 031] 2.1.0-151-g30a433b-wmf3precise1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/299139 (https://phabricator.wikimedia.org/T137525) (owner: 10Hashar) [13:13:46] paladox: at least the fix is trivial and straightforward :) [13:14:09] Yep :) [13:14:57] We can try multiple gerrit connections now :) [13:15:29] Once the precise dpkg has been built and updated on integration [13:15:39] hashar: ^^ [13:55:04] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2465902 (10hashar) I have rebuild the Debian package and published it on https://people.wikimedia.org/~hashar/debs/zuul_2.1.... [14:03:32] hashar hi, im back [14:03:33] :) [14:06:24] paladox: I am out :) [14:06:38] paladox: going to enjoy some fresh air and sun bath [14:06:40] ok :) [14:06:45] barely went out of home for the last 3 days [14:06:55] oh, yes [14:07:01] it is warm here too [14:07:10] 27degrees next week [14:19:53] ostriches, hi it seems searching in gerrit-new brings up non related search results for example typing in metrolook should show commits for metrolook, not other repo's but in gerrit.wikimedia.org it works [14:20:00] https://gerrit-new.wikimedia.org/r/#/q/metrolook [14:20:06] https://gerrit.wikimedia.org/r/#/q/metrolook,n,z [14:30:47] 10Deployment-Systems, 06Release-Engineering-Team (Long-Lived-Branches): Convert old wmf/* deployment branches to tags (recurring chore) - https://phabricator.wikimedia.org/T1288#2466010 (10Krinkle) [14:31:04] 10Deployment-Systems, 06Release-Engineering-Team (Long-Lived-Branches): Convert old wmf/* deployment branches to tags (recurring chore) - https://phabricator.wikimedia.org/T1288#22541 (10Krinkle) [15:01:56] 10Continuous-Integration-Infrastructure, 10Zuul, 07Upstream: Circular dependencies break Zuul - https://phabricator.wikimedia.org/T129938#2466104 (10Paladox) 05stalled>03Open @hashar fixed the problem with zuul and can now continue the rollout of zuul updates :). I belive he is aiming to update zuul nex... [15:09:39] 10Deployment-Systems, 10scap, 10Analytics, 10Analytics-Cluster, and 3 others: Deploy analytics-refinery with scap3 - https://phabricator.wikimedia.org/T129151#2466150 (10elukey) Just generated and added the pub/priv key to the private repo. [15:25:31] ostriches :) [15:36:00] 10Continuous-Integration-Infrastructure, 10Zuul, 07Upstream: [upstream] Zuul cloner fails on extension jobs against a wmf branch - https://phabricator.wikimedia.org/T73133#2466243 (10Paladox) 05stalled>03Resolved This is now resolved since https://review.openstack.org/#/c/123437/ was merged upstream and... [15:37:02] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: Migration of browsertests* Jenkins jobs to selenium* jobs - https://phabricator.wikimedia.org/T128190#2466248 (10greg) [15:37:46] 10Continuous-Integration-Config, 10Zuul, 13Patch-For-Review: Restore integration/config Zuul version requirement - https://phabricator.wikimedia.org/T136610#2466252 (10Paladox) 05stalled>03Open We can now move forward with this task since @hashar found where the problem was. [16:00:00] (03PS1) 10Ejegg: Replace DonationInterface 1_26 tests with 1_27 tests [integration/config] - 10https://gerrit.wikimedia.org/r/299170 [16:00:31] (03PS4) 10Paladox: Revert "Pin Zuul version used for testing" [integration/config] - 10https://gerrit.wikimedia.org/r/292346 (https://phabricator.wikimedia.org/T136610) (owner: 10Hashar) [16:01:13] (03CR) 10jenkins-bot: [V: 04-1] Revert "Pin Zuul version used for testing" [integration/config] - 10https://gerrit.wikimedia.org/r/292346 (https://phabricator.wikimedia.org/T136610) (owner: 10Hashar) [16:03:08] (03PS5) 10Paladox: Revert "Pin Zuul version used for testing" [integration/config] - 10https://gerrit.wikimedia.org/r/292346 (https://phabricator.wikimedia.org/T136610) (owner: 10Hashar) [16:03:50] (03CR) 10jenkins-bot: [V: 04-1] Revert "Pin Zuul version used for testing" [integration/config] - 10https://gerrit.wikimedia.org/r/292346 (https://phabricator.wikimedia.org/T136610) (owner: 10Hashar) [16:04:27] (03PS6) 10Paladox: Revert "Pin Zuul version used for testing" [integration/config] - 10https://gerrit.wikimedia.org/r/292346 (https://phabricator.wikimedia.org/T136610) (owner: 10Hashar) [16:05:16] 10Beta-Cluster-Infrastructure, 10EventBus, 06Services, 15User-mobrovac: deployment-changeprop instance keeps going OOM and becoming inaccessible - https://phabricator.wikimedia.org/T137725#2466283 (10mobrovac) 05Open>03Resolved Cleaning the ZK offsets and deploying the newest version fixed this. [16:05:50] (03CR) 10jenkins-bot: [V: 04-1] Revert "Pin Zuul version used for testing" [integration/config] - 10https://gerrit.wikimedia.org/r/292346 (https://phabricator.wikimedia.org/T136610) (owner: 10Hashar) [16:09:10] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review, 07Upstream: zuul-cloner does not support Ref events - https://phabricator.wikimedia.org/T76003#788073 (10Paladox) Is this still a problem since zuul was updated to 2.1. [16:11:25] 10Continuous-Integration-Infrastructure, 10Zuul, 07Upstream: Zuul: Implement support for customizing status_url to include the change.id - https://phabricator.wikimedia.org/T65744#686327 (10Paladox) @hashar could you rebase https://review.openstack.org/#/c/86900/ please. [16:21:38] 06Release-Engineering-Team, 10LDAP-Access-Requests, 06Operations, 10Ops-Access-Requests, 06WMF-NDA-Requests: Determine a core set or a checklist of permissions for deployment purpose - https://phabricator.wikimedia.org/T140270#2466325 (10greg) The only part that I'm not 100% sure about and would like fee... [16:23:24] 10Continuous-Integration-Config, 07Jenkins, 07Puppet: jenkins homedir on nodepool slaves is in /home/jenkins but this doesn't seem to be anywhere in puppet - https://phabricator.wikimedia.org/T140417#2466330 (10greg) p:05Triage>03Normal [16:31:59] 10Continuous-Integration-Infrastructure, 10Zuul, 07Upstream: Zuul-cloner failing to acquire .git lock sometimes - https://phabricator.wikimedia.org/T86730#975087 (10Paladox) I belive this is fixed in https://phabricator.wikimedia.org/rCIZU0a6a0c422cdffe668bec2a9420d9bdd32182a0d8 Since it now also checks for... [16:32:30] 10Continuous-Integration-Infrastructure, 10Zuul, 07Upstream: Zuul-cloner failing to acquire .git lock sometimes - https://phabricator.wikimedia.org/T86730#2466359 (10Paladox) [16:32:34] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review: Investigate Zuul 2.1.0-151-g30a433b that stops processing Gerrit events - https://phabricator.wikimedia.org/T137525#2466358 (10Paladox) [16:36:06] (03PS2) 10Ejegg: Replace DonationInterface 1_26 tests with 1_27 tests [integration/config] - 10https://gerrit.wikimedia.org/r/299170 [16:42:16] (03CR) 10Paladox: Replace DonationInterface 1_26 tests with 1_27 tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/299170 (owner: 10Ejegg) [16:46:24] Can anyone help ejegg and me deploy an experimental job to zuul? [16:47:32] (03PS3) 10Ejegg: Replace DonationInterface 1_26 tests with 1_27 tests [integration/config] - 10https://gerrit.wikimedia.org/r/299170 [16:47:53] (03CR) 10Ejegg: "thanks Paladox" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/299170 (owner: 10Ejegg) [16:47:59] :/ kind of a bad day from releng's side, antoine and zeljko are already out (Friday at 6:45pm already), tyler and mukunda have the day off (vacation), and I'm just a chicken [16:48:24] hehe [16:48:58] And I'm half day [16:49:00] * awight leaves the chicken some mealworms to distract it and applies a bunch of duck tape to zuul :p [16:49:10] (like another hour, I started early) [16:49:42] no worries, i'll find something else to play with for now! [16:51:14] (03CR) 10Paladox: [C: 031] "You welcome" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/299170 (owner: 10Ejegg) [16:51:26] (03CR) 10Paladox: "Looks all good to me." [integration/config] - 10https://gerrit.wikimedia.org/r/299170 (owner: 10Ejegg) [16:51:40] Hmm. I'm getting "16:40:41 stderr: 'fatal: HEAD not found below refs/heads!'" on a few MW/core merge attempts. [16:51:48] awight: I'm, funnily enough, eating an egg right now (and hashbrowns) [16:51:53] James_F: That sounds...bad.... [16:52:02] From the UI? [16:52:04] ostriches: A bunch of the branches you just killed are referenced. [16:52:06] James_F that may be a bug in zuul [16:52:08] https://integration.wikimedia.org/ci/job/mediawiki-extensions-hhvm/69077/console [16:52:08] awight: though, to be fair, it's a duck egg [16:52:31] James_F: Wtf...referenced by....? [16:52:44] ostriches: zuul-cloner's memory, maybe? [16:52:52] That's annoying. [16:53:14] (03PS4) 10Ejegg: Replace DonationInterface 1_26 tests with 1_27 tests [integration/config] - 10https://gerrit.wikimedia.org/r/299170 [16:53:15] hmmm, force re-clones in zuul-merger? that sounds painful [16:53:23] Re-cloning might be needed. [16:53:23] Eh. [16:53:34] Or just running a `git remote prune origin` on the repos. [16:53:38] Should clear the old refs. [16:53:47] (03CR) 10Ejegg: Replace DonationInterface 1_26 tests with 1_27 tests (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/299170 (owner: 10Ejegg) [16:53:58] (but really, git shouldn't barf just because an upstream branch disappeared....) [16:54:10] zuul man, zuul is picky [16:54:55] I blame its parents. [16:54:56] greg-g: There's some hilarious duck drama at my house these days... a mama managed to hatch half a dozen eggs and we're quickly reaching critical duck mass. You should visit and take a few with you! [16:55:28] Hmm, where do these repos live? [16:55:32] These days [16:55:32] ..................................... man I want to [16:55:35] (take those ducks) [16:55:55] DEBUG:zuul.Repo:Pruning stale refs [16:55:56] Hmmm [16:56:22] It's trying to prune, but it hits James_F's error [16:56:25] Weird. [16:56:36] greg-g: photo under [Cute] in the staff mailing list... [16:57:08] ostriches: It's also not occurring on some of the CI slaves. [16:57:11] http://stackoverflow.com/questions/8551574/head-not-found-below-refs-heads-after-i-push-commit-with-cr-crlf-changes [16:57:14] ostriches ^^ [16:57:23] seems it may be poiting to an invalid branch [16:57:30] ostriches: E.g. https://integration.wikimedia.org/ci/job/mediawiki-core-qunit-jessie/1698/consoleFull ran fine. [16:57:56] Locally it points to refs/heads/master [16:58:00] James_F each repo is cloned differently and stored in zuul [16:58:11] So some may have problems and others wont [16:58:13] Gerrit agrees. [16:58:20] HEAD -> refs/heads/master [16:58:46] http://stackoverflow.com/questions/4848607/git-fatal-no-such-ref-head [17:00:48] demon@ytterbium /var/lib/gerrit2/review_site/git/mediawiki/extensions/MobileApp.git (BARE:master)$ cat HEAD [17:00:48] ref: refs/heads/master [17:01:00] It's fine on gerrit. My guess is that HEAD on the zuul clone is fubar'd [17:01:06] (again, where are these repos?) [17:01:19] ostriches /srv/zuul [17:01:21] i think [17:01:22] Well, it says it cloned.... [17:01:23] 16:40:40 INFO:zuul.Cloner:Creating repo mediawiki/extensions/MobileApp from upstream https://gerrit.wikimedia.org/r/p/mediawiki/extensions/MobileApp [17:01:55] Fresh clone agrees locally: [17:01:59] chad@notsexy /a/MobileApp (master)$ git symbolic-ref HEAD [17:01:59] refs/heads/master [17:13:05] ostriches i think we should delete the repo that it cloned in zuul and let it re clone [17:16:11] (03CR) 10Paladox: [C: 031] "Looks good to me." [integration/config] - 10https://gerrit.wikimedia.org/r/299170 (owner: 10Ejegg) [17:16:42] ostriches it works http://puppet-compiler.wmflabs.org/3339/ [17:16:43] :) [17:18:25] * paladox using my mobile network much better then my wireless extender keeps cuttung me out. On 4g. :) [17:23:25] 10Continuous-Integration-Infrastructure, 10OOjs, 10VisualEditor: npm jobs failing with ">> Error: Cannot find module 'cst'" in VE-MW, OOjs, and OOUI - https://phabricator.wikimedia.org/T140367#2462408 (10Jdforrester-WMF) 05Open>03Resolved a:03Jdforrester-WMF [17:32:16] ostriches the web editor after publishing it goes into refs/changes but for the diffusion links to show it needs linksdrafts enabled (Might be a bug in gerrit) [17:32:20] https://phab-01.wmflabs.org/R2:7dd738b9cdb0eae1a45c7d16c243c316804ddec5 [17:32:28] https://gerrit-new.wikimedia.org/r/#/c/298014/ [17:33:07] I won't be messing with gerrit today, I'm only working a half day and leaving in about 30 minutes. [17:33:17] Ok [17:34:29] Yay windows users can now edit in linux path's on gerrit https://gerrit-new.wikimedia.org/r/#/c/298015/ [17:34:31] ostriches ^^ [17:34:47] Makes it more easy for windows users due to the path structure. [17:35:34] But even then it wont work when loading in windows, it will just merge the two files. [17:52:04] 06Release-Engineering-Team, 10LDAP-Access-Requests, 06Operations, 10Ops-Access-Requests, and 2 others: Determine a core set or a checklist of permissions for deployment purpose - https://phabricator.wikimedia.org/T140270#2466552 (10greg) Also adding #security-team for their feedback on this proposal and my... [17:58:15] ostriches would you be able to quickly review https://gerrit.wikimedia.org/r/#/c/299182/ before you go please. [17:58:32] You doint have to merge but could you +1 or -1 if you agree or disagree. [17:58:34] please [17:59:28] There's no point in doing it today, it's not going to get deployed if I'm not around to babysit it [17:59:37] Plus I'm unsure on the usecase [17:59:40] Anyway, I'm gone [18:00:40] paladox: why the urgency? [18:00:55] andre__ no ugrency [18:01:02] paladox, then why do you ping people? [18:01:10] It's disruptive. [18:01:17] andre__ i was only asking [18:01:48] paladox: But why? People get Gerrit notifications anyway (and can read them when they actually have time). [18:02:10] IRC pings mean I have to stop what I'm working on. And this request is not urgent. [18:02:30] andre__: hello [18:02:36] andre__: urgency I am out of beer :) [18:02:48] hashar: hej hej! Haha :D [18:02:55] really [18:03:01] I only have red wine left at home :( [18:03:02] hashar: I'd love to pass one to you :) [18:03:37] andre__: while you are floating around, do you know what it takes to have a post on blog.wikimedia.org under the Technology cat ? [18:03:38] Oh, there's no reason. I only did it to ask, i wasent saying he had to, i was asking if he could review, there was no urgancy and he can ignore my pings or even ask me to stop pinging him. [18:04:14] Trust me, if I'm on gerrit or Phab cc I *will* read it. [18:04:16] andre__: Paladox last week has sprinted reinstalling the whole CI infrastructure on labs instance and found a bunch of neat trick :D [18:04:16] When I've got the time. [18:04:31] Ok sorry [18:04:31] paladox: It's totally right and fine to ping people on IRC when there's a good/urgent reason. But for non-urgent Gerrit patches and when people are CC'ed on Gerrit anyway, it's just a second notification for the very same thing. And hence not helpful but disruptive. [18:04:42] Ok, sorry [18:04:51] I ain't tripping, but yeah it's an attention shift. [18:04:53] We already all have too much communication channels. No need to duplicate topics/content. Thanks :) [18:04:53] Anyway, I'm out. [18:04:55] Bye folks. [18:04:59] See you! [18:05:00] Good weekend :D [18:05:06] brb [18:05:20] hashar: Oh yeah, I saw that about the CI stuff. Congrats and thanks for that help, paladox! :) [18:05:31] Oh, your welcome :) [18:05:45] hashar: see https://meta.wikimedia.org/wiki/Wikimedia_Blog [18:06:37] 10Continuous-Integration-Infrastructure, 07Tracking: doc.wikimedia.org: Generate documentation for release tags (tracking) - https://phabricator.wikimedia.org/T73062#2466615 (10hashar) [18:06:40] 10Continuous-Integration-Infrastructure, 10Zuul, 13Patch-For-Review, 07Upstream: zuul-cloner does not support Ref events - https://phabricator.wikimedia.org/T76003#2466613 (10hashar) 05Open>03declined I think that got more or less fixed upstream. The idea was to trigger job on a reference update for e... [18:07:02] andre__: neat thanks! :) [18:07:12] yw :) [18:17:02] Project mediawiki-core-code-coverage build #2137: 04STILL FAILING in 3 hr 17 min: https://integration.wikimedia.org/ci/job/mediawiki-core-code-coverage/2137/ [18:20:23] PROBLEM - Host deployment-upload is DOWN: CRITICAL - Host Unreachable (10.68.16.189) [18:20:52] deployment-upload is done since beta got entirely moved to Swift :] [18:22:19] yeah, just need to delete it [18:25:38] (03PS1) 10Awight: Run DonationInterface LintYaml job via composer-test [integration/config] - 10https://gerrit.wikimedia.org/r/299185 [18:29:53] Im back [18:29:54] :) [18:31:51] 06Release-Engineering-Team, 15User-zeljkofilipin: Identify inaugural SWAT members for the European SWAT window - https://phabricator.wikimedia.org/T139544#2466688 (10greg) My instinct is not to start this next week for these reasons: * it's Friday and I still haven't announced it (though I have poked the ops@l... [18:31:58] (03CR) 10Hashar: [C: 032 V: 032] Do not import paramiko before daemonization [integration/zuul] (patch-queue/debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/299136 (https://phabricator.wikimedia.org/T137525) (owner: 10Hashar) [18:32:13] (03CR) 10Hashar: [C: 032 V: 032] 2.1.0-151-g30a433b-wmf3precise1 [integration/zuul] (debian/precise-wikimedia) - 10https://gerrit.wikimedia.org/r/299139 (https://phabricator.wikimedia.org/T137525) (owner: 10Hashar) [18:32:24] hashar ^^ :) :) [18:33:47] * paladox Wow bash will be included in the windows 10 update being released on 2 august 2016 due to popularity https://blogs.msdn.microsoft.com/wsl/2016/07/08/bash-on-ubuntu-on-windows-10-anniversary-update/ [18:37:11] 06Release-Engineering-Team, 15User-zeljkofilipin: Add a European mid-day SWAT window - https://phabricator.wikimedia.org/T137970#2466703 (10greg) For those not subscribed to the sub-task: >>! In T139544#2466688, @greg wrote: > My instinct is not to start this next week for these reasons: > * it's Friday and I... [18:37:50] hashar i actually did install all the ci, did gerrit manually and zuul and jenkins except from using some puppet rules for the proxy and used the ci puppet role for the jenkins-slave-01 [18:39:06] hashar i had alot of help from you without you i would have been stuck with nothing working. [18:39:15] But now i mostly remeber how i do it [18:40:14] * paladox only one fix today in windows 10 build 14390 [18:41:11] We can now do mutiple connections in zuul to gerrit [18:41:13] :) [18:44:40] (03CR) 10Paladox: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/292346 (https://phabricator.wikimedia.org/T136610) (owner: 10Hashar) [18:52:18] 10Continuous-Integration-Config, 10FileAnnotations: Set up JenkinsBot for FileAnnotations repo - https://phabricator.wikimedia.org/T140499#2466850 (10Jdforrester-WMF) [18:52:35] 10Continuous-Integration-Config, 10FileAnnotations: Set up JenkinsBot for FileAnnotations repo - https://phabricator.wikimedia.org/T140499#2466863 (10Jdforrester-WMF) @Paladox Would you have time to do this? Thanks! [18:53:04] 10Continuous-Integration-Config, 10FileAnnotations: Set up JenkinsBot for FileAnnotations repo - https://phabricator.wikimedia.org/T140499#2466865 (10Paladox) Yes, I can do that now :). [18:57:09] awight: good to see your Donation interfaces changes gate properly on both REL1_25 and REL1_26 :) (was https://gerrit.wikimedia.org/r/#/c/293465/ ) [18:57:15] awight: kudos really [18:57:47] hashar :) we can now continue our zuul updates until we hit another bug. [18:57:54] :) [18:58:01] 06Release-Engineering-Team, 15User-zeljkofilipin: Identify inaugural SWAT members for the European SWAT window - https://phabricator.wikimedia.org/T139544#2466920 (10Ladsgroup) For me the training will be swift and fast, I know scap very well (beside contributing in it, I migrated ORES to use scap), I have req... [18:59:42] 06Release-Engineering-Team, 15User-zeljkofilipin: Identify inaugural SWAT members for the European SWAT window - https://phabricator.wikimedia.org/T139544#2466921 (10greg) @Ladsgroup I think your assessment is correct enough :) Down to 1.5 ;) [19:00:36] hashar: Since you mention it... :) We're trying to get two jobs into the DonationInterface.experimental trigger, * a REL1_27 patch and * the generic extension tests [19:00:51] I guess putting the generic stuff into experimental would be much harder though, cos it's an entire job template [19:01:40] awight: namely run the same stuff that mediawiki/core or other extensions use? [19:01:53] can go with a REL1_27 one at least [19:02:36] hashar i think i can fix the pinning of zuul [19:02:51] paladox: what do you mean by "pinning" ? [19:03:06] Well we are pinning zuul in integration/config [19:03:08] to a commit [19:03:15] due to test breaking from the precise brance [19:03:17] branch [19:03:36] https://phabricator.wikimedia.org/T136610 [19:03:53] yeah there is a task about it [19:04:00] hashar: The 1.27 thing should be easy enough, we were just having trouble deploying ejegg's patch to zuul: https://gerrit.wikimedia.org/r/#/c/299170/ [19:04:05] Yep [19:04:06] paladox: I will restore it [19:04:14] hashar but i think i may have discovered how to fix it [19:04:54] (03PS1) 10Paladox: Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 [19:04:55] hashar ^^ [19:05:11] Fails in https://gerrit.wikimedia.org/r/#/c/292346/ [19:06:17] (03CR) 10jenkins-bot: [V: 04-1] Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 (owner: 10Paladox) [19:06:47] Yay one step forward [19:06:51] now i get error AttributeError: 'Scheduler' object has no attribute 'registerTrigger' [19:07:48] awight|lunch: ejegg|away that https://gerrit.wikimedia.org/r/#/c/299170/ is good to go (thank you Paladox) [19:07:56] Your welcome :) [19:08:40] paladox: yeah looks like the test suite needs an update :D [19:08:49] hashar yep :) [19:08:55] I fixed the first part :) [19:09:03] Now im not sure about the second [19:09:30] the FakeTrigger class is to mock Gerrit [19:09:44] Oh [19:10:05] https://github.com/openstack-infra/zuul/blob/master/tests/test_scheduler.py [19:10:20] and they are now connections [19:10:29] Oh [19:10:39] so we need to update them to be connections [19:11:05] in zuul/scheduler.py you can look at _getDriver() [19:11:13] Ok, thanks [19:11:24] that is the registry of available drivers for connections / reporters [19:11:48] and the list is hardcoded :/ [19:11:56] Oh [19:13:09] maybe we can inject it directly [19:13:12] Yep [19:13:30] with something like zuul.sched.triggers['gerrit'] = FakeGerrit() [19:13:39] Oh [19:13:47] Replace [19:13:48] cls.sched.registerTrigger(FakeTrigger(), 'gerrit') [19:13:48] cls.sched.registerTrigger(FakeTrigger(), 'timer') [19:13:48] cls.sched.registerTrigger(FakeTrigger(), 'zuul') [19:13:51] with what you said [19:13:54] :) [19:14:31] (03CR) 10Hashar: [C: 031] "Looks all good to me." [integration/config] - 10https://gerrit.wikimedia.org/r/299170 (owner: 10Ejegg) [19:14:47] paladox: yeah potentially [19:14:52] But i think we may have to name it cls.sched.triggers['gerrit'] = FakeGerrit() [19:14:55] hashar ^^ [19:14:56] and the FakeTrigger will probably need to be adjusted [19:15:01] Oh ok [19:15:02] we dont use the timer / zuul triggers afaik [19:15:06] Oh [19:16:14] (03PS2) 10Paladox: Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 [19:16:20] hashar ^^ let's hope it passes [19:16:21] :) [19:16:53] (03CR) 10jenkins-bot: [V: 04-1] Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 (owner: 10Paladox) [19:17:14] (03PS3) 10Paladox: Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 [19:17:49] hashar [19:17:49] 19:17:39 ./tests/test_zuul_scheduler.py:51:40: F821 undefined name 'FakeGerrit' [19:17:50] 19:17:39 ./tests/test_zuul_scheduler.py:52:39: F821 undefined name 'FakeGerrit' [19:17:50] 19:17:39 ./tests/test_zuul_scheduler.py:53:38: F821 undefined name 'FakeGerrit' [19:17:53] (03CR) 10jenkins-bot: [V: 04-1] Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 (owner: 10Paladox) [19:18:44] paladox: and the @branch I had was not even correct [19:18:56] the branch debian/precise-wikimedia does not have the patches applied [19:19:13] Oh [19:19:20] I thought you merged it in there [19:19:21] they are in branch patch-queue/debian/precise-wikimedia [19:19:33] Oh yes [19:19:35] tis a bit of a mess :( [19:19:38] Oh [19:19:50] debian/precise-wikimedia is based on the upstream branch [19:19:55] 06Release-Engineering-Team, 15User-greg: skill matrix updates - https://phabricator.wikimedia.org/T140507#2466983 (10greg) [19:20:01] the only differences are changes made in the /debian/ directory [19:20:12] changes to the software in patch-queue/debian/precise-wikimedia [19:20:16] hashar NameError: global name 'FakeGerrit' is not defined [19:20:17] oh [19:20:34] and are exported in the debian/precise-wikimedia branches as a serie of pathces in debian/patches/ [19:20:39] eek [19:20:56] Oh and yep [19:21:42] (03CR) 10Hashar: Fix zuul being pinned to a specific commit (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/299194 (owner: 10Paladox) [19:22:37] paladox: do you have python2.7 available in your Windows Ubuntu ? ;D [19:22:44] you could run the tests locally [19:22:53] hashar oh, i think so [19:23:01] i managed to get ubuntu 16.04 installed [19:23:06] over ubuntu 14.04. [19:24:14] Let's start my ubuntu desktop straight from windows [19:24:23] without vm and dual botting [19:24:31] im running both linux and windows together [19:24:40] I can view all my file path view unity [19:24:43] oh really? [19:24:46] Yes [19:24:52] It is on the news [19:25:01] that microsoft included a unchanged ubuntu image [19:25:03] 06Release-Engineering-Team, 15User-greg: share casual feedback with vendors - https://phabricator.wikimedia.org/T140508#2467002 (10greg) [19:25:05] so many hacks now [19:25:16] 06Release-Engineering-Team, 15User-greg: Write casual feedback for RelEng vendors - https://phabricator.wikimedia.org/T139208#2467015 (10greg) 05Open>03Resolved [19:25:47] hashar due to popularity microsoft will be releasing bash in the upcomming windows 10 update being released on august 2 2016. [19:26:01] 400+ million more users will be using ubuntu. [19:26:09] let me rephrase that [19:26:26] 400 million users will have a bunch of crap they dont care about installed on their machines :D [19:26:40] good to know they are including it [19:26:45] that is going to solve a lot of troubles [19:26:48] Well i am not sure if they will have to download the image when clicking an image [19:27:00] Microsoft may buy ubuntu company [19:27:16] Canonical [19:27:18] yes [19:27:27] Microsoft only did this in 3 months [19:27:46] microsoft oproched them in decemeber and by april had a working ubuntu on windows. [19:28:00] * paladox starting desktop [19:28:07] * paladox using compiz [19:28:12] I cant remember the story behind Ubuntu. But iirc its creator wanted to push Linux to the main stream [19:28:26] Yep, now there about to get so many people [19:28:54] they may have to rate limit as popularity increased due to microsoft almost actually broke the internet last year with windows 10 release [19:30:17] Some things doint work correctly and your very limited, but for it to work like this it is OMG [19:31:05] Now what will be funny if microsoft added support for installing an actual deb package in windows. [19:31:22] root@PATRICKM:~# python --version [19:31:22] Python 2.7.12 [19:31:50] Hey look microsoft changed it from localhost to my name of my user account. [19:32:54] (03PS4) 10Paladox: Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 [19:33:33] (03CR) 10jenkins-bot: [V: 04-1] Fix zuul being pinned to a specific commit [integration/config] - 10https://gerrit.wikimedia.org/r/299194 (owner: 10Paladox) [19:33:51] hashar what is so funny is that you carn't destroy your machine, you can have as many due overs as you like since you just lxrun /uninstall [19:33:58] then lxrun /install [19:36:23] when Ubuntu was brandnew, it was super "free" to get it [19:36:31] you could fill out a form on their site [19:36:45]