[00:03:18] 05Gitblit-Deprecate, 10releng-201516-q2: [keyresult] Deprecate gitblit in favor of Diffusion - https://phabricator.wikimedia.org/T111465#2387717 (10Danny_B) [00:03:22] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2387714 (10Danny_B) 05Open>03Resolved Rules are written. Deploying them is another task. [00:05:05] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2387718 (10Paladox) The above works. git.wmflabs.org [00:09:45] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2387721 (10Paladox) [00:13:09] 05Gitblit-Deprecate, 10releng-201516-q2: [keyresult] Deprecate gitblit in favor of Diffusion - https://phabricator.wikimedia.org/T111465#2387723 (10Paladox) @dzahn were now ready to deploy ^^ [00:16:30] 10Beta-Cluster-Infrastructure, 10DBA, 10Flow, 03Collab-Team-2016-Apr-Jun-Q4: Run Flow External Store migration in dry-run mode on Beta - https://phabricator.wikimedia.org/T119567#1829837 (10Etonkovidova) Looks fine in vagrant both for dry-run and real run. ``` vagrant@mediawiki-vagrant:~$ foreachwiki exte... [00:26:53] 10Beta-Cluster-Infrastructure, 10DBA, 10Flow, 03Collab-Team-2016-Apr-Jun-Q4: Run Flow External Store migration in dry-run mode on Beta - https://phabricator.wikimedia.org/T119567#2387761 (10Mattflaschen-WMF) It's not doing anything in Vagrant because there is only one External Store configured, and the nam... [00:42:43] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2387774 (10Etonkovidova) Two last builds (#9235 and #9236) are successful. [06:09:15] 06Release-Engineering-Team: Proposal: Add a European mid-day SWAT window - https://phabricator.wikimedia.org/T137970#2385565 (10KartikMistry) I support this proposal. [07:59:14] 10Beta-Cluster-Infrastructure, 10Notifications, 03Collab-Team-2016-Apr-Jun-Q4: beta-update-databases-eqiad being aborted at 45 minutes since June 9th - https://phabricator.wikimedia.org/T137615#2388027 (10hashar) 05Open>03Resolved >>! In T137615#2383275, @Catrope wrote: > That's very strange. update.php... [08:05:53] 06Release-Engineering-Team (Deployment-Blockers), 13Patch-For-Review, 05Release: MW-1.28.0-wmf.6 deployment blockers - https://phabricator.wikimedia.org/T136971#2388033 (10hashar) 05Open>03Resolved It is all good. The only minor issue was VisualEditor causing notice/warnings without any user impact as fa... [08:09:09] 10Continuous-Integration-Infrastructure, 13Patch-For-Review: Figure out paths that needs to be backed up on gallium - https://phabricator.wikimedia.org/T65938#2388040 (10hashar) 05Open>03Resolved a:03hashar Done with Moritz in 5679234aa2407a405dcb15f50773ac6bffba5ab9 bacula::director::fileset { 'con... [08:11:16] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2368961 (10Paladox) But I think this task is also about uploaded the rewrites and then remove the server behind git.w... [08:13:11] https://integration.wikimedia.org/ci/job/parsoidsvc-npm-run-lint-node-4.3/167/ has been running for four hours [08:20:00] Nikerabbit: you can abort it from the web interface. Login with your labs account [08:20:11] Nikerabbit: I havent investigated yet what is causing the blocking [08:20:51] hashar: just noting, I have no interested in the commit itself [08:24:52] 05Gitblit-Deprecate, 10releng-201516-q2: [keyresult] Deprecate gitblit in favor of Diffusion - https://phabricator.wikimedia.org/T111465#2388074 (10greg) [08:24:56] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2388071 (10greg) 05Resolved>03Open >>! In T137224#2387714, @Danny_B wrote: > Rules are written. Deploying them is... [08:25:52] Nikerabbit: I am going to restart Jenkins entirely [08:33:20] did I break en.wikipedia.beta.wmflabs.org [08:33:38] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2388125 (10greg) These, I believe, should be merged for this to be done: * https://gerrit.wikimedia.org/r/#/c/293789/... [08:33:39] it get super slow when I purged one page [08:36:03] wmflabs seems down to me [08:42:27] gerrit loading slowly for me now [08:45:24] back now [08:52:55] telia issue (see -operations) [08:53:04] * greg-g should sleep [10:02:03] !log Refreshed Nodepool Jessie image [10:02:08] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:06:22] !log Refreshed Nodepool Trusty image [10:06:25] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:24:05] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2388330 (10mmodell) Greg: I guess https://gerrit.wikimedia.org/r/#/c/294867/ supersedes the others. We also need to... [10:34:22] 10Continuous-Integration-Infrastructure: mysql down on integration-slave-trusty-1015 - https://phabricator.wikimedia.org/T138074#2388356 (10JanZerebecki) [10:35:08] !log offlined integration-slave-trusty-1015 T138074 [10:35:09] T138074: mysql down on integration-slave-trusty-1015 - https://phabricator.wikimedia.org/T138074 [10:35:11] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL, Master [10:38:15] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2388379 (10Paladox) @mmodell I guess we can ask ops to do the dns bit please. [10:50:59] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2388406 (10JanZerebecki) >>! In T137224#2388330, @mmodell wrote: > Greg: I guess https://gerrit.wikimedia.org/r/#/c/2... [10:58:01] 10Continuous-Integration-Infrastructure, 05Gerrit-Migration, 10releng-201516-q2, 10releng-201516-q3, and 2 others: [keyresult] Connect Differential code review with continuous integration - https://phabricator.wikimedia.org/T31#2388432 (10Paladox) @mmodell have you managed to get phabricator working with Z... [11:00:45] hashar: hey, I wrote a help on using wheels. I hope you find it useful: https://wikitech.wikimedia.org/wiki/User:Ladsgroup/Shipping_dependencies_using_wheels [11:14:04] 10Continuous-Integration-Infrastructure, 05Gerrit-Migration, 10releng-201516-q2, 10releng-201516-q3, and 2 others: [keyresult] Connect Differential code review with continuous integration - https://phabricator.wikimedia.org/T31#2388450 (10hashar) We are not using Zuul for now. Phabricator triggers jobs di... [11:17:54] 10Continuous-Integration-Infrastructure, 05Gerrit-Migration, 10releng-201516-q2, 10releng-201516-q3, and 2 others: [keyresult] Connect Differential code review with continuous integration - https://phabricator.wikimedia.org/T31#2388451 (10Paladox) @hashar but how do we view jobs like we could in Zuul pleas... [11:19:14] 10Continuous-Integration-Infrastructure, 05Gerrit-Migration, 10releng-201516-q2, 10releng-201516-q3, and 2 others: [keyresult] Connect Differential code review with continuous integration - https://phabricator.wikimedia.org/T31#2388453 (10Paladox) Also how can we add jobs to phabricator for each repo. Like... [11:50:11] 10Continuous-Integration-Config, 10MediaWiki-extensions-ConfirmEdit-(CAPTCHA-extension), 06translatewiki.net, 05WMF-deploy-2016-06-21_(1.28.0-wmf.7): ConfirmEdit lint tests broken - https://phabricator.wikimedia.org/T137974#2388474 (10matmarex) [13:24:50] 10Deployment-Systems, 03Scap3: scap3 upstream/debian versioning - https://phabricator.wikimedia.org/T127828#2388609 (10fgiunchedi) thanks @hashar for the overview! I think I prefer the latter, namely keep debian packaging and upstream separate. So upon a new version is released e.g. 3.2.1: * change version in... [14:16:02] thcipriani|afk: Can you review, https://gerrit.wikimedia.org/r/#/c/294874/ - using dblist thing first time. [14:40:19] * thcipriani looks [14:51:11] kart_: looks right to me. [15:01:58] 03releng-201516-q4, 10Malu (Malu-Prototype), 07Surveys, 15User-zeljkofilipin: Browser testing user satisfaction survey - https://phabricator.wikimedia.org/T131123#2388707 (10zeljkofilipin) [15:07:14] 03releng-201516-q4, 10Malu (Malu-Prototype), 07Surveys, 15User-zeljkofilipin: Browser testing user satisfaction survey - https://phabricator.wikimedia.org/T131123#2388745 (10zeljkofilipin) [15:07:52] 03releng-201516-q4, 10Malu (Malu-Prototype), 07Surveys, 15User-zeljkofilipin: Browser testing user satisfaction survey - https://phabricator.wikimedia.org/T131123#2156648 (10zeljkofilipin) [15:08:06] 03releng-201516-q4, 10Malu (Malu-Prototype), 07Surveys, 15User-zeljkofilipin: Browser testing user satisfaction survey - https://phabricator.wikimedia.org/T131123#2156648 (10zeljkofilipin) [15:08:20] 03releng-201516-q4, 10Malu (Malu-Prototype), 07Surveys, 15User-zeljkofilipin: Browser testing user satisfaction survey - https://phabricator.wikimedia.org/T131123#2156648 (10zeljkofilipin) [15:15:04] 03releng-201516-q4, 10Malu (Malu-Prototype), 07Surveys, 15User-zeljkofilipin: Browser testing user satisfaction survey - https://phabricator.wikimedia.org/T131123#2388757 (10zeljkofilipin) Ok, I think I have done everything suggested. I have used sideways emoji (`:)`) instead of upright ({icon smile-o}) be... [15:19:19] twentyafterfour: hey, if you have some time to set up some mirror repos in diffusion, it would be great: https://phabricator.wikimedia.org/T137819 Tell me if you want to do it. If there are some sort configs in puppet etc. tell me and I'll do it. [15:35:36] thcipriani: thanks! [15:37:39] Amir1 Hi, there's one that has been imported https://phabricator.wikimedia.org/diffusion/1880/ [15:38:06] and just needs a callsign plus to have diffusion mirroring to github turned on. I coulden find any repo for the other ones though. [15:38:34] 10Browser-Tests-Infrastructure, 05MW-1.27-release-notes, 13Patch-For-Review, 15User-zeljkofilipin: Remove LoginPage from mediawiki_selenium Ruby gem - https://phabricator.wikimedia.org/T127042#2388785 (10zeljkofilipin) [15:38:39] paladox: actually that one is not mirrored from github [15:38:53] Amir1 i mean to github. [15:39:02] it used github got into gerrit but now it's diverged [15:39:25] Amir1 oh so you want the repos in gerrit and then mirrored to diffusion. [15:39:55] paladox: we want repos in diffusion mirrored from github [15:40:04] that would be the best option [15:40:13] Amir1 oh ok. yes that can happen. [15:40:35] Amir1 will you be using differential for reviewing code or just github. [15:40:44] just github [15:41:14] Amir1 ok, yes that will work. [15:41:20] Are we also doing it for https://phabricator.wikimedia.org/diffusion/1880/manage/uris/ too [15:41:21] neat [15:41:37] thanks. Do you need list of repos? [15:41:47] (03Abandoned) 10Zfilipin: Logging in via LoginPage#login_with is a security risk [selenium] - 10https://gerrit.wikimedia.org/r/270905 (https://phabricator.wikimedia.org/T127042) (owner: 10Zfilipin) [15:41:49] Amir1 i will have to ask one of the phab admins. But will work the same way we do it for gerrit [15:41:54] and Amir1 yes please [15:42:02] Github links too please. [15:42:36] 1- https://github.com/wiki-ai/ores [15:42:51] 10Browser-Tests-Infrastructure, 13Patch-For-Review, 15User-zeljkofilipin: mediawiki_selenium raises MediawikiSelenium::ConfigurationError if a configuration in environments.yml is empty string - https://phabricator.wikimedia.org/T128860#2388792 (10zeljkofilipin) [15:42:53] 2- https://github.com/wiki-ai/editquality [15:42:56] (03Abandoned) 10Zfilipin: WIP MediawikiSelenium::ConfigurationError is raised if a configuration is empty string [selenium] - 10https://gerrit.wikimedia.org/r/274938 (https://phabricator.wikimedia.org/T128860) (owner: 10Zfilipin) [15:43:10] 3- https://github.com/wiki-ai/wikiclass [15:43:23] Amir1 thanks [15:43:34] thank you! [15:43:50] Amir1 should we name the repo as it is done in https://phabricator.wikimedia.org/T137819 [15:44:06] So [15:44:07] mediawiki/services/ores/deploy [15:44:07] •mediawiki/services/ores [15:44:07] •mediawiki/services/ores/editquality [15:44:07] •mediawiki/services/ores/wikiclass [15:44:27] paladox: names doesn't matter much but it would be nice to have it under research/ores [15:44:48] research/ores/ores [15:44:52] Amir1 ok. thanks [15:45:07] What would be under research/ores/ores? [15:45:23] wiki-ai/ores [15:45:57] what about research/revision-scoring/ores? [15:45:58] halfak: because research/ores is taken (not sure, we should check but probably it is since we have research/ores/wheels) [15:46:13] Oh I see [15:46:14] Hmm [15:46:30] In this case, ores/wheels is really ores/deploy/wheels [15:46:32] since we have research/ores/wheels let's keep it this way :) [15:46:37] Sure [15:46:46] Which one should https://github.com/wiki-ai/editquality be named [15:46:51] It's nice to have names make sense. [15:46:53] and https://github.com/wiki-ai/wikiclass please [15:47:00] * halfak starts an etherpad [15:47:16] https://etherpad.wikimedia.org/p/ores_prod_repos [15:48:08] Thanks halfak ^ [15:52:37] OK. I think we have the etherpad in a good state. I hope it makes sense. [15:53:55] halfak Yep thankyou very much. [15:53:56] :) [16:21:01] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2388901 (10Paladox) I guess we remove https://github.com/wikimedia/operations-puppet/blob/52737634512bf43f8f98b757be4... [16:21:23] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2388902 (10Paladox) But we will need to update git.wikimedia.org ip to use iridium. [16:44:17] Amir1 hi Luke081515 has imported the repos. [16:44:25] Amir1 could you have a look at https://etherpad.wikimedia.org/p/ores_prod_repos please [16:44:46] also he is unsure what he should do for number 4. since that repo is already present in diffusion. [16:45:19] Amir1 [16:45:20] https://phabricator.wikimedia.org/diffusion/1912/ [16:45:27] https://phabricator.wikimedia.org/diffusion/1914/ [16:45:33] https://phabricator.wikimedia.org/diffusion/1913/ [16:45:42] https://phabricator.wikimedia.org/diffusion/1915/ [16:45:49] https://phabricator.wikimedia.org/diffusion/1880/ [16:46:59] Amir1 he left a question for number 4. [16:47:09] halfak|Lunch ^^ [16:50:57] paladox: hey, [16:51:01] I was afk [16:51:13] Is it possible to just move it? [17:03:20] 07Browser-Tests, 10MobileFrontend: Cucumber tests won't run locally on firefox 47 - https://phabricator.wikimedia.org/T138095#2389003 (10bmansurov) [17:09:30] Amir1: looking at those repos now [17:09:42] thanks [17:12:46] twentyafterfour: Luke made those [17:12:54] https://etherpad.wikimedia.org/p/ores_prod_repos [17:13:03] Thanks to him [17:13:33] cool, is there anything more I can help with? [17:14:37] I don't think so :) [17:14:41] I will let you know [17:15:00] 07Blocked-on-RelEng, 05Gitblit-Deprecate, 06Operations, 13Patch-For-Review: Phase out antimony.wikimedia.org (git.wikimedia.org / gitblit) - https://phabricator.wikimedia.org/T123718#2389056 (10JanZerebecki) [17:17:13] 10Deployment-Systems, 03Scap3: scap3 upstream/debian versioning - https://phabricator.wikimedia.org/T127828#2389058 (10mmodell) >>! In T127828#2388609, @fgiunchedi wrote: > thanks @hashar for the overview! I think I prefer the latter, namely keep debian packaging and upstream separate. +1 [17:17:43] 05Gitblit-Deprecate, 10releng-201516-q2: [keyresult] Deprecate gitblit in favor of Diffusion - https://phabricator.wikimedia.org/T111465#2389060 (10JanZerebecki) [17:18:30] twentyafterfour: https://etherpad.wikimedia.org/p/ores_prod_repos can you the gerrit repo? it's the deploy repo and we can't use diffusion for that [17:18:42] *can you move [17:22:02] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2389079 (10mmodell) So we need these two to merge in the listed order: 1. https://gerrit.wikimedia.org/r/#/c/293789/... [17:24:23] Amir1: why can't we use diffusion for the deployment repo? because of scap or something else? [17:24:40] twentyafterfour: yeah, scap::source [17:25:01] maybe I should fix that ;) [17:25:21] it would be awesome [17:26:10] Amir1: so github.com/wiki-ai/ores-wikimedia-config needs to get imported into gerrit? (until scap::source supports diffusion?) [17:26:35] no it is already there [17:26:48] and they got diverged and probably will be kept diverged [17:27:09] mediawiki/services/ores/deploy.git [17:27:24] it would be great to rename this ^ [17:27:38] rename to what? [17:29:42] research/ores/deploy [17:30:06] oh ok [17:30:32] let me see if I can figure out how to do that [17:32:23] 10Browser-Tests-Infrastructure, 10Continuous-Integration-Config, 15User-zeljkofilipin: Firefox v47 breaks mediawiki_selenium - https://phabricator.wikimedia.org/T137561#2389125 (10JanZerebecki) We do not support Firefox 45 in the "Modern" grade, but according to https://www.mediawiki.org/wiki/Compatibility#B... [17:37:14] Amir1 i think it is this [17:37:14] https://phabricator.wikimedia.org/diffusion/1880/manage/history/ [17:37:18] we renamed it for you [17:37:22] twentyafterfour ^^ [17:37:30] Luke081515 renamed it per request. [17:37:52] yeah but that one is the github repo [17:38:44] paladox: nope, is it a gerrit repo or it's a mirror from github? [17:38:44] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2389143 (10Paladox) @mmodell do we send an email out on wikitech-I saying git.wikimedia.org will be redirected soon. [17:38:52] Amir1 oh. [17:38:58] You want it from gerrit [17:39:04] because I was able to make patch in the gerrit [17:39:21] Amir1 we can change the link to gerrit. [17:39:28] Do you have the gerrit project link please [17:39:33] Amir1 ^^ [17:39:50] paladox: yeah [17:39:54] wait a sec [17:39:59] Amir1 ok thanks [17:40:18] https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/services/ores/deploy [17:40:20] I created a gerrit project for ores/deploy [17:40:20] paladox: ^ [17:40:25] Thanks [17:40:31] https://gerrit.wikimedia.org/r/#/admin/projects/research/ores/deploy [17:40:45] but I haven't copied over the old repo yet [17:41:00] I'm about to a make patch there [17:41:05] ok [17:41:25] I can copy the repository if you'd like to avoid recreating it via a patch [17:41:57] I'm trying to update it [17:42:11] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2389149 (10Aklapper) If that was a question the sentence has to end with a question mark. Always. [17:42:58] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2389150 (10Paladox) @Aklapper ok sorry, done. [17:43:21] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2389151 (10mmodell) lol [17:45:15] twentyafterfour: is it okay to merge this? https://gerrit.wikimedia.org/r/#/c/294935/ [17:45:33] twentyafterfour also can you click the update button for https://phabricator.wikimedia.org/diffusion/1880/manage/status/ please. [17:45:35] or I need to make a patch in the other repo? [17:46:37] Amir1 are you refereing to creating another patch in diffusion for https://phabricator.wikimedia.org/diffusion/1880/ ? [17:46:46] You doint have to since it will import from gerrit now [17:46:57] just need to click the update button and watch as the repo is updated. [17:46:58] :) [17:47:37] Amir1: sure merge away [17:47:59] paladox: I can't update, there is no button for me [17:48:13] Amir1 an admin has to do it. [17:48:55] Since it requires edit rights. I presume later when we are going to start migrating to use differential we will allow users to edit there own repos like they can on gerrit [17:49:13] awesome :) but my request to rename it from a gerrit repo to another gerrit repo [17:49:52] for now, until we can get scap::source issue fixed [17:50:12] Amir1: yes, I created the other repo, I'll mirror the old name to the new name then remove the old name I guess [17:50:17] I don't see a way to rename in gerrit [17:50:49] twentyafterfour: understood [17:51:18] in that case since our puppet uses the old name, might run into some troubles [17:51:37] twentyafterfour theres a raw error [17:51:37] https://phabricator.wikimedia.org/diffusion/1880/manage/status/ [17:51:40] in the status [17:55:44] twentyafterfour it says [17:55:45] Initialization Error Pull of 'R1880' failed: Command failed with error #128! COMMAND git remote add origin 'xxxxx' STDOUT (empty) STDERR fatal: remote origin already exists. [18:00:08] 10Continuous-Integration-Config, 10Wikidata, 13Patch-For-Review: [Task] Setup a Jenkins job to run Wikidata browsertests on test.wikidata.org - https://phabricator.wikimedia.org/T101499#2389161 (10JanZerebecki) a:05JanZerebecki>03None [18:07:40] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2389616 (10greg) Yeah, we should announce before it happens. [18:53:21] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2390465 (10Paladox) We also need to remove https://github.com/wikimedia/operations-puppet/blob/bdd27ef834044a25c5a4e6... [19:47:17] 10Continuous-Integration-Infrastructure, 06Labs, 10Labs-Infrastructure: Nodepool has trouble taking snapshots on OpenStack labs - https://phabricator.wikimedia.org/T138106#2390592 (10hashar) [19:58:08] greg-g, can I deploy a small change? https://gerrit.wikimedia.org/r/294950 - a volunteer suspects it breaks their code and I don't want to piss them off [19:59:28] 10Continuous-Integration-Config, 10Zuul, 13Patch-For-Review, 07Upstream: free some repositories from their unintended chain to mediawiki/core - https://phabricator.wikimedia.org/T107529#2390610 (10hashar) >>! In T107529#2138456, @hashar wrote: > I have proposed upstream a patch to have the project template... [20:07:03] MaxSem: maybe it can be reproduced / confirmed on beta cluster? [20:07:11] 03releng-201516-q4, 10Malu (Malu-Prototype), 07Surveys, 15User-zeljkofilipin: Browser testing user satisfaction survey - https://phabricator.wikimedia.org/T131123#2390644 (10greg) >>! In T131123#2388757, @zeljkofilipin wrote: > As far as I am concerned, we can launch the survey. We might wait a week since... [20:08:01] MaxSem: I would greenlight it if I knew what that schema.Foo meant :/ [20:08:18] lol [20:08:41] it's a module name. must match extension.json [20:08:47] which this patch does [20:09:10] comes from https://gerrit.wikimedia.org/r/#/c/280368/4/modules/ext.wikimediaEvents.geoFeatures.js,cm snt it ? [20:09:23] which is from April 6th.. :( [20:09:28] yup [20:09:55] which would mean it has been broken for a while.. [20:10:19] we will discuss the removal of schema soon as we clearly don't care as evident from us not noticing [20:10:23] hashar hi [20:10:30] Im trying to install gerrit on labs. [20:10:39] Do you know how i can do it please. [20:10:49] I just want to show a volunteer that we care about their tools being broken [20:10:53] Is there a specific port i must use. Since im using 80 [20:11:09] MaxSem: [GREEN] Map team go go go [GREEN] [20:11:15] http://gerrit-test.wmflabs.org/ [20:11:18] thanks hashar :D [20:11:33] MaxSem: let me +1 the cherry pick when you have done :D [20:12:03] then you will get events loaded, and might take care of them [20:12:16] https://gerrit.wikimedia.org/r/#/c/294958/ [20:12:55] MaxSem: it is in the gate [20:13:22] dont we have client side javascript reported back to us nowadays? [20:13:28] I thought Timo worked on something like that [20:13:46] hashar im not sure which port to use. [20:13:50] https://gerrit-test.wmflabs.org/logs/error_log [20:14:35] MaxSem: I have the error in the console with Firefox 47 / Linux :( [20:15:08] hashar, I thought you used Macs before [20:17:56] MaxSem: a year or so ago I bought an Intel NUC (a small machine) with Linux on it solely to build debian packages [20:18:11] hashar is there any puppet roles. [20:18:11] MaxSem: and as well benefit from a rotting 22inch screen I had at home [20:18:15] I need to use for gerrit. [20:18:18] paladox: what are you trying to do ? [20:18:30] hashar im trying to install gerrit. then zuul [20:18:39] paladox: we have a very basic puppet role for Gerrit but it is horribly broken [20:18:52] Oh [20:19:02] paladox: and a Debian package but it has not been updated in a long time. So one has to build Gerrit from source :( [20:19:10] Is there a way i can install it on labs. [20:19:20] I have the war package. I also installed java. [20:19:26] no straightforward way I know of [20:19:31] Just wont start the http demon. [20:19:47] java.io.FileNotFoundException: /var/www/html/review_site/etc/keystore (No such file or directory) [20:19:50] hashar do you know what the puppet role is called please. [20:19:51] Oh [20:19:55] maybe it is nt installed ? [20:19:57] Let me go and create that. [20:20:06] Oh how do i install that? [20:20:07] and dont use the puppet class / role. it is crap really [20:20:10] Ok [20:20:15] I cant remember [20:20:25] but you have to do something like java -jar gerrit.jar dbinstall [20:20:32] ok thanks [20:20:51] which would take care of creating all the files under review_site [20:21:10] and that tree must not be in /var/www/html or exposed by apache [20:21:12] Ok [20:21:25] Gerrit would listen on a port [20:21:37] can i use the default 80 port [20:21:49] yeah probably [20:22:13] MaxSem: do you need a second pair of eyes to baby sit the deploy ? [20:22:20] I get [20:22:21] root@gerrit-test:/var/www/html# java -jar gerrit.war dbinstall [20:22:21] fatal: unknown command dbinstall [20:22:21] (no com.google.gerrit.pgm.dbinstall) [20:22:26] MaxSem: if anything needed, please poke me :) [20:22:38] paladox: I gave you a random command :) [20:22:45] Oh [20:23:01] paladox: definitely read https://gerrit.wikimedia.org/r/Documentation/install.html [20:23:08] Yep, im reading that [20:23:09] sudo adduser gerrit2 [20:23:09] sudo su gerrit2 [20:23:09] java -jar gerrit.war init -d /path/to/your/gerrit_application_directory [20:23:18] Oh you have to add users [20:23:22] which should create everything [20:23:46] http://www.vogella.com/tutorials/Gerrit/article.html [20:24:41] and you can try your luck on #gerrit [20:24:50] Oh ok [20:24:57] our config is provided by puppet https://phabricator.wikimedia.org/diffusion/OPUP/browse/production/modules/gerrit/templates/gerrit.config.erb?color=1 [20:25:05] Thanks [20:25:06] it is a bit scary [20:25:15] and depends on various plugins iirc [20:25:25] Oh [20:25:34] also password / credentials are in a different file secure.config https://phabricator.wikimedia.org/diffusion/OPUP/browse/production/modules/gerrit/templates/secure.config.erb [20:25:44] but the install step should take care of that [20:25:50] Oh [20:26:00] iirc I just invoke gerrit.war init [20:26:03] reply to all questions [20:26:10] then if needed tweak the config file manually [20:26:15] Ok, yep i did that. [20:27:18] paladox: you can browse at https://phabricator.wikimedia.org/diffusion/OPUP/browse/production/modules/gerrit/ that would give you an ide [20:27:19] a [20:27:23] Ok [20:27:24] thanks [20:27:28] I dont think it can be applied on labs, but I might be wrong [20:27:31] Do you know of the puppet role. [20:27:35] Luke081515 is asking [20:27:37] please [20:28:27] paladox: iirc Chad has removed the Gerrit labs role [20:28:34] hashar oh [20:28:57] I think there is a package [20:28:59] you can try with gerrit::instance [20:29:12] Ok [20:29:15] and the .deb package ships a gerrit.war which is totally outdated [20:29:28] Oh [20:29:35] I found an update to date one [20:29:43] But is hosted not on debian or ubuntu [20:29:46] though on Jessie we have Gerrit 2.12.2 :) [20:30:04] Oh :) [20:30:12] When will we be using gerrit 2.12. [20:30:12] production is still on Precise [20:30:26] with the debian package shipping 2.7-rc2-507-g1e7090b-1 [20:30:36] Yep, git.wikimedia.org can now go. Danny_B created some really good rewrites. [20:30:41] and the .war is manually replaced with the 2.8.2... we are running now [20:30:41] hashar oh [20:30:57] if you get to install Gerrit with apt get on labs, you would get the 2.12.2 war [20:30:58] hashar i wonder when we can use gerrit 2.12 with it's inbuilt edit files. [20:31:05] hashar yep [20:31:08] no idea [20:31:17] we would need a test setup to make sure Zuul works fine with it [20:31:19] Yay [20:31:21] it worked [20:31:22] openstack uses 2.11 [20:31:26] apt-get install gerrit [20:31:35] automatically downloads from the wikimedia apt repo [20:31:43] so you should have a gerrit.war somewhere under /var/lib/gerrit/ [20:31:46] and a gerrit2 unix user [20:32:13] Oh [20:32:14] :) [20:32:14] sudo su gerrit2 [20:32:31] Yep that worked [20:32:32] hashar [20:32:39] java -jar gerrit.war init -d /var/lib/gerrit2/review_site [20:32:43] Now just have to figure out how to fix it starting. [20:32:44] and that should work [20:32:59] Do i have to update apache [20:33:29] I am not sure what the Debian package ships, but it most probably have an init script sudo /etc/init.d/gerrit [20:33:47] sudo service gerrit start [20:33:53] the apache update is most probably some security fix [20:34:02] apt-cache policy [20:34:05] But fails with [20:34:06] -- Logs begin at Fri 2016-06-17 19:06:59 UTC, end at Fri 2016-06-17 20:31:45 UTC [20:34:06] Jun 17 20:31:14 gerrit-test systemd[1]: Reloading. [20:34:06] Jun 17 20:31:14 gerrit-test systemd[1]: Reloading. [20:34:06] Jun 17 20:31:45 gerrit-test sudo[26888]: root : TTY=pts/0 ; PWD=/var/www/html/re [20:34:06] Jun 17 20:31:45 gerrit-test sudo[26888]: pam_unix(sudo:session): session opened [20:34:07] would gives you the version difference [20:34:08] Jun 17 20:31:45 gerrit-test systemd[1]: Starting LSB: Start/stop Gerrit Code Rev [20:34:10] -- Subject: Unit gerrit.service has begun with start-up [20:34:12] -- Defined-By: systemd [20:34:16] -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel [20:34:18] -- [20:34:20] -- Unit gerrit.service has begun starting up. [20:34:22] Jun 17 20:31:45 gerrit-test gerrit[26907]: ** ERROR: GERRIT_SITE not set [20:34:24] Jun 17 20:31:45 gerrit-test systemd[1]: gerrit.service: control process exited, [20:34:26] hehe [20:34:26] Jun 17 20:31:45 gerrit-test systemd[1]: Failed to start LSB: Start/stop Gerrit C [20:34:28] -- Subject: Unit gerrit.service has failed [20:34:30] -- Defined-By: systemd [20:34:32] -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel [20:34:34] -- [20:34:36] -- Unit gerrit.service has failed. [20:34:38] -- [20:34:40] -- The result is failed. [20:35:26] echo "GERRIT_SITE="/var/lib/gerrit2/review_site" > /etc/default/gerrit [20:35:47] err [20:35:49] that is wrong [20:35:59] create /etc/default/gerrit [20:36:00] with [20:36:02] GERRIT_SITE="/var/lib/gerrit2/review_site" [20:36:02] GERRIT_WAR="/var/lib/gerrit2/review_site/bin/gerrit.war" [20:36:15] or [20:36:21] Ok thankls [20:36:25] cp /etc/default/gerritcodereview /etc/default/gerrit [20:36:52] It says [20:36:52] cp: cannot stat ‘/etc/default/gerritcodereview’: No such file or directory [20:37:05] then just create it with the above GERRIT_ variables [20:37:10] Ok [20:37:16] that /etc/default/gerrit is loaded by /etc/init.d/gerrit [20:37:20] that set env variables [20:37:28] which are then used to spawn gerrit [20:37:36] (or that gerrit itself expect) [20:38:01] Still says ** ERROR: GERRIT_SITE not set [20:38:14] Probaly since is /var/lib/gerrit2/review_site not created [20:38:27] ah we have https://phabricator.wikimedia.org/T103735 Get rid of the gerrit Debian package and migrate to puppet [20:38:39] Oh :) [20:39:09] time to read the doc :D [20:39:10] https://gerrit-review.googlesource.com/Documentation/install-quick.html [20:39:14] https://gerrit-review.googlesource.com/Documentation/install.html [20:39:21] Yep, im reading them. [20:39:22] the quick guide is probably enough [20:39:47] have you run the init command? [20:40:02] eg java -jar gerrit.war init --batch -d /var/lib/gerrit2/review_site ? [20:40:15] or maybe you got it created elsewhere [20:40:21] but must NOT be in /var/www [20:40:29] Oh [20:40:32] else [20:40:35] i have it in /var/www [20:40:46] that means anyone having access to apache would be able to access any files of Gerrit [20:40:49] such as ... passwords! [20:40:51] Oh [20:41:03] Oh [20:41:08] Woops [20:41:23] one would do something like wget http://yourinstance.example.org/review_site/etc/secure.config [20:41:24] :D [20:41:32] or whatever else [20:41:35] Oh [20:41:35] so yeah [20:41:37] just init [20:42:05] java -jar gerrit.war init --batch -d /var/lib/gerrit2/review_site [20:42:08] Ok [20:42:14] gerrit will run as the 'gerrit2' unix user [20:42:24] Yep it's created there now. [20:42:27] Do i update apache [20:42:30] to use the new path [20:42:35] and being a system user (ie it is not an human using that account) its home dir is under /var/lib/ [20:42:41] ok [20:42:43] so the gerrit2 home dir is /var/lib/gerrit2 [20:42:54] and you put a Gerrit setup there under review_site [20:42:58] mostly Skipping because of failed dependencies [20:42:58] Error: Could not find group gerrit2 [20:42:58] Error: /Stage[main]/Gerrit::Jetty/File[/var/lib/gerrit2/review_site]/group: change from root to gerrit2 failed: Could not find group gerrit2 [20:42:58] Error: Could not set 'file' on ensure: Could not find group gerrit2 at 72:/etc/puppet/modules/gerrit/manifests/jetty.pp [20:42:59] Error: Could not set 'file' on ensure: Could not find group gerrit2 at 72:/etc/puppet/modules/gerrit/manifests/jetty.pp [20:43:02] Wrapped exception: [20:43:04] Could not find group gerrit2 [20:43:06] Error: /Stage[main]/Gerrit::Jetty/File[/var/lib/gerrit2/.ssh/id_rsa]/ensure: change from absent to file failed: Could not set 'file' on ensure: Could not find group gerrit2 at 72:/etc/puppet/modules/gerrit/manifests/jetty.pp [20:43:11] yeah [20:43:28] the user / group are probably provided by the Debian package [20:43:33] or maybe they have to be created manually [20:43:35] Oh [20:43:40] so in short [20:43:46] dont use the puppet manifest :D [20:43:52] Ok [20:44:19] apt-get install gerrit . If needed adduser gerrit2 [20:44:36] tweak /etc/default/gerrit [20:44:39] sudo gerrit2 [20:44:42] java -jar gerrit.war init --batch -d /var/lib/gerrit2/review_site [20:45:08] ./review_site/bin/gerrit.sh start [20:45:11] {done} [20:45:28] well not so done, you have to do the rest of the install [20:45:50] anyway for whaqt it is worth, we had the idea of having a Vagrant image for CI [20:46:01] Oh [20:46:04] with at least Gerrit/Zuul/Jenkins/JJB [20:46:08] that would make everything easy [20:46:13] and maybe later add in Phabricator and Harbormaster :D [20:46:19] would be a nice playground area I guess [20:46:39] https://github.com/roidelapluie/vagrant-gerrit [20:47:15] https://github.com/lawrancej/gerrit-dev-vm [20:50:10] "roidelapluie" is french and literally mean "king of the rain" [20:50:19] Oh [20:51:10] apache wont start [20:51:11] now [20:51:40] he is part of https://inuits.eu/ a small company for OpenSource software in Belgium [20:51:44] hashar we have french lessions here. [20:51:54] well [20:52:07] some of them are well known [20:52:08] hashar i forgot the french since i haven't spoke it in a long time. [20:52:12] and it is still a small world :) [20:52:19] anyway [20:52:24] will have to get to bed soonish [20:52:26] I kmow bonjour [20:52:27] Ok [20:52:30] for apache, look at the apache error log I guess [20:52:38] I have i think it is sigterm [20:52:40] or if Jessie journalctl maybe [20:53:23] hashar it says [20:53:23] [Fri Jun 17 20:44:47.370345 2016] [mpm_prefork:notice] [pid 26065] AH00169: caught SIGTERM, shutting down [20:53:43] But nothing new now [20:54:37] paladox: try again with mod_php disabled? [20:54:50] Dereckson oh, is php causing that. [20:54:54] Do i uninstall it? [20:56:42] mod_php *could* crash the Apache process without any log in Apache [20:56:51] it is evil :D [20:57:13] But there is no proof it's here the case. Comment the mod_php lines in your Apache HTTPD config. [20:57:14] paladox: Gerrit most probably has a standalone web server of its own [20:57:21] paladox: so you could just point to it [20:57:31] Seems to have two files [20:57:32] -rw-r--r-- 1 root root 1408 Jun 17 20:56 000-default.conf [20:57:32] -r--r--r-- 1 root root 194 Jun 17 20:41 00-dummy.conf [20:57:32] -r--r--r-- 1 root root 3923 Jun 17 20:41 50-gerrit-wikimedia-org.conf [20:58:57] eeek that last one might comes from the deb package [20:59:09] Fixed it [20:59:12] 10Beta-Cluster-Infrastructure, 10DBA, 10Flow, 03Collab-Team-2016-Apr-Jun-Q4: Run Flow External Store migration in dry-run mode on Beta - https://phabricator.wikimedia.org/T119567#2390709 (10Etonkovidova) Thx! I've set up External Store on vagrant. [20:59:13] I uninstalled apache [21:00:59] hashar i get You don't have permission to access / on this server. [21:01:02] http://gerrit-test.wmflabs.org/ [21:01:23] well [21:01:26] that is apache [21:01:55] your Gerrit is on a different port, probably 8080 [21:02:02] try opening it in the webproxy maybe [21:02:36] Ok [21:03:13] and from the internet, you would have to push over http which requires an api token [21:03:25] which will be transmitted in clear text :( [21:03:48] hashar what's gerrit2 password [21:04:23] read the doc! [21:04:24] The first user to sign-in and register an account will be automatically placed into the fully privileged Administrators group, permitting server management over the web and over SSH. Subsequent users will be automatically registered as unprivileged users. [21:04:28] better hurry :) [21:04:36] Og [21:04:37] Oh [21:05:23] for ssh access to port 29418 it is a bit more complicated [21:05:33] you would have to proxy the ssh requests via the bastion.wmflabs.org [21:05:42] but really it is now to late to start on that topic :( [21:05:51] you can probably test locally at least [21:05:57] ok [21:06:56] heading to bed! Good luck with Gerrit [21:07:03] ok bye [21:09:45] hashar i have another build to install on windows [21:09:48] :) [21:09:58] I love it when they release two builds in one week [21:10:17] :D [21:23:16] Project selenium-Wikidata » firefox,beta,Linux,contintLabsSlave && UbuntuTrusty build #27: 04FAILURE in 2 hr 33 min: https://integration.wikimedia.org/ci/job/selenium-Wikidata/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/27/ [21:30:23] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2390792 (10Paladox) @greg do you know who would send the email out? [21:36:21] ostriches im guesing updating modules/phabricator/templates/system.gitconfig.erb with the github link for mw core to push only refs/heads/ and refs/tags/ will work [22:11:58] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2390889 (10greg) One of me, Mukunda, or Chad, probably. [22:18:07] 05Gitblit-Deprecate, 06Release-Engineering-Team, 06Operations, 13Patch-For-Review: write Apache rewrite rules for gitblit -> diffusion migration - https://phabricator.wikimedia.org/T137224#2390924 (10Paladox) Ok Thanks for replying. [23:30:21] 10Beta-Cluster-Infrastructure, 10Flow, 03Collab-Team-2016-Apr-Jun-Q4, 13Patch-For-Review: Set up Flow-specific External Store cluster on Beta (secondary to the main one) - https://phabricator.wikimedia.org/T128417#2073927 (10Etonkovidova) - Re-run the above query for most recent entries ``` MariaDB [enwiki...