[00:04:06] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10Patch-For-Review, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3801635 (10Jdforrester-WMF) [00:12:22] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10Patch-For-Review, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3579974 (10bd808) [00:22:01] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<20.00%) [04:07:58] Yippee, build fixed! [04:07:59] Project selenium-MultimediaViewer » safari,beta,OS X 10.9,BrowserTests build #594: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=safari,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=OS%20X%2010.9,label=BrowserTests/594/ [04:51:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 40.00% of data above the critical threshold [10.0] [05:21:50] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 20.00% of data above the critical threshold [10.0] [06:27:22] 10Gerrit-Migration, 10Documentation: Update Code Review related documentation on wiki pages from Gerrit to Differential - https://phabricator.wikimedia.org/T207#3801927 (10Ptrpov) [06:27:26] 10Gerrit-Migration, 10Documentation: Update Code Review related documentation on wiki pages from Gerrit to Differential - https://phabricator.wikimedia.org/T207#3801931 (10Ptrpov) [06:28:29] 10Continuous-Integration-Scaling, 10Release-Engineering-Team (Someday): Isolate contintcloud nova project from the rest of the wmflabs cloud - https://phabricator.wikimedia.org/T86168#3801967 (10Ptrpov) [06:28:31] 10Continuous-Integration-Scaling, 10Release-Engineering-Team (Someday): Isolate contintcloud nova project from the rest of the wmflabs cloud - https://phabricator.wikimedia.org/T86168#962720 (10Ptrpov) [06:37:08] 10Continuous-Integration-Infrastructure, 10Continuous-Integration-Scaling, 10releng-201415-Q3, 10releng-201415-Q4, and 2 others: [EPIC] Run CI jobs in disposable VMs - https://phabricator.wikimedia.org/T47499#3801978 (10Legoktm) [06:37:11] 10Continuous-Integration-Scaling, 10Release-Engineering-Team (Someday): Isolate contintcloud nova project from the rest of the wmflabs cloud - https://phabricator.wikimedia.org/T86168#3801977 (10Legoktm) 05duplicate>03Open [06:38:26] 10Gerrit-Migration, 10Wikimedia Phabricator RfC: Identify features Gerrit users would miss in Phabricator - https://phabricator.wikimedia.org/T23#3802008 (10Legoktm) [06:38:38] 10Gerrit-Migration, 10Documentation: Update Code Review related documentation on wiki pages from Gerrit to Differential - https://phabricator.wikimedia.org/T207#3802011 (10Legoktm) 05duplicate>03Open [06:55:17] PROBLEM - Puppet errors on deployment-kafka01 is CRITICAL: CRITICAL: 44.44% of data above the critical threshold [0.0] [07:10:30] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802102 (10Osnard) I've noticed that changes in a lot of our BlueSpice* repos (e.g. [1], [2], [3] and [4]) are not automatically committed anymore, after "CR +2"... [07:12:00] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:30:17] RECOVERY - Puppet errors on deployment-kafka01 is OK: OK: Less than 1.00% above the threshold [0.0] [07:34:24] legoktm: for the record, when -qa archive in favor of -releng neither had codesniffer nor commit-msg-val :) [07:35:22] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802117 (10Paladox) I think you may be hitting T155558 . You can try to re c+2 and see if that works now. [07:42:05] greg-g: https://gerrit.wikimedia.org/r/#/c/154262/ [07:58:39] legoktm: I was looking at https://gerrit.wikimedia.org/r/#/c/184195/2/channels.yaml [08:24:34] greg-g: I don't think the MediaWiki-CodeSniffer project even existed at that point :) [08:25:38] right, that change is Jan 10, and I created it on Feb 26 2015 [08:34:13] 10Continuous-Integration-Infrastructure (shipyard), 10monitoring, 10Graphite: Purge labs graphite metrics of Docker ephemeral partitions - https://phabricator.wikimedia.org/T181476#3802168 (10hashar) [08:34:18] 10Continuous-Integration-Infrastructure (shipyard), 10Cloud-Services, 10Operations, 10monitoring, and 3 others: Grafana reports ALL docker mounts in a spammy way - https://phabricator.wikimedia.org/T177052#3802166 (10hashar) 05Open>03Resolved a:03hashar [08:38:23] !log integration: removed a hack to puppetmaster environments/future/environment.conf containing: parser = future \n manifest = $confdir/manifests\n [08:38:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:40:27] !log deployment-prep: removed a hack to puppetmaster environments/future/environment.conf containing: parser = future \n manifest = $confdir/manifests\n [08:40:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:40:47] !log rebased operations/puppet on deployment-prep and integration puppetmasters [08:40:52] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:44:38] 10Continuous-Integration-Infrastructure (shipyard), 10monitoring, 10Graphite: Purge labs graphite metrics of Docker ephemeral partitions - https://phabricator.wikimedia.org/T181476#3802182 (10hashar) p:05Triage>03Normal //diamond: skip DiskSpace for Docker containers// https://gerrit.wikimedia.org/r/#/c/... [08:54:12] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:29:12] legoktm: no worries. I'm sorry that I did that. I got in a "remove everything that isn't core to our work right now" mode and then just dug in a bit. My apologies. [10:03:59] 10Continuous-Integration-Infrastructure (shipyard), 10monitoring, 10Graphite: Purge labs graphite metrics of Docker ephemeral partitions - https://phabricator.wikimedia.org/T181476#3802209 (10hashar) [10:08:41] !log docker push wmfreleng/npm-browser-test-stretch:v2017.11.30.21.30 && docker push wmfreleng/npm-browser-test-stretch:latest | https://gerrit.wikimedia.org/r/#/c/394340/ | T179360 [10:08:46] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:08:46] T179360: Create "npm-browser" docker image with npm, xvfb, chromium, and firefox installed - https://phabricator.wikimedia.org/T179360 [10:20:14] PROBLEM - Free space - all mounts on integration-slave-docker-1001 is CRITICAL: CRITICAL: integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_e6e01440f04a145c09affed5a3ca6f3b53daaab53d038a0d9a25a2321ad2e83e.byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_ae0c0365a418e6d09fafa87f9895fd4e627f98827599ba01651a8d2bb [10:20:14] e (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_542702f60914ef9f11b4fff9801fb50b98babed3d88dab01384772c8a8f1f043.byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_382de2b48f7a102ecf17cbd12d459f88057d36dba96cedb922040e35e9b82d2e.byte_percentfree (No valid datapoints found) integra [10:20:14] docker-1001.diskspace._var_lib_docker_devicemapper_mnt_244a2d354369e401b6c66d4bd544048c3840d932cf778fdf984537361725f816.byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_d8fc462aeb76074a5f89517c31b54a82a6b9bee7edadd84f909f7bf192acd160.byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker [10:20:14] a7f3437c5df7fe9022aa85e5b8d3f8456090e82a1199b2b29dec9635842.byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_1c0fb41f7a2181b123e5946fba45e85cdfef2556fc8597cb15f65675a1b19486.byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_eed8308ecda3c515fc3eb746da906634666ed3ec1b [10:20:15] byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_31efaafd7825c53306a17741dcce1df6a28a339aadc13d4aa228986a0325c8a7.byte_percentfree (No valid datapoints found) integration.integration-slave-docker-1001.diskspace._var_lib_docker_devicemapper_mnt_734cb090a18ec3f54bb70110faa369e4073fe6ad423521c364e403698f3ec8b1.byte_percentfree (No valid datapoints [10:36:11] 10Continuous-Integration-Config, 10Proton, 10Patch-For-Review, 10Readers-Web-Backlog (Tracking): Set up Jenkins for chromium-render and chromium-render-deploy repositories - https://phabricator.wikimedia.org/T179552#3802277 (10phuedx) >>! In T179552#3798316, @hashar wrote: > I don't mind downloading Chrome... [11:09:54] 10Continuous-Integration-Infrastructure (shipyard), 10monitoring, 10Graphite: Purge labs graphite metrics of Docker ephemeral partitions - https://phabricator.wikimedia.org/T181476#3802436 (10fgiunchedi) I've deleted the metrics but some instances are recreating those ``` /var/log/carbon/carbon-cache@h/crea... [11:25:54] zeljkof: jan_drewniak told me he helped migrate some browser tests to nodejs/wdio [11:26:07] and he told me he was interested in adding some for portals indeed :] [11:26:15] hashar: cool :) [11:26:17] twist [11:26:36] I was just looking at https://gerrit.wikimedia.org/r/#/c/394539/ [11:26:39] I am bout to deploy a new docker container that is build on stretch and comes with PhantomJS / latest Chromium and Firefox v52 (the ESR version) [11:27:03] latest chromium would be great [11:27:19] we could run selenium tests headless, no need for xvfb [11:33:10] the containers come with all three browsers [11:33:16] and phantomjs at least requires xvfb [11:33:24] firefox I dont know, probably it does? [11:34:11] firefox either already has a headless feature, or will pretty soon [11:39:31] zeljkof: Firefox introduced headless in v55 for Linux and v56 for windows/mac [11:39:38] so we dont have it on the ESR version (v52) [11:45:34] ahhh [11:46:32] (03PS3) 10Hashar: npm-browser with stretch [integration/config] - 10https://gerrit.wikimedia.org/r/394340 (https://phabricator.wikimedia.org/T179360) [11:46:47] (03PS1) 10Filippo Giunchedi: operations-puppet: install mtail [integration/config] - 10https://gerrit.wikimedia.org/r/394551 (https://phabricator.wikimedia.org/T181794) [11:52:30] (03PS4) 10Hashar: Migrate npm-browser-test to Debian Stretch [integration/config] - 10https://gerrit.wikimedia.org/r/394340 (https://phabricator.wikimedia.org/T179360) [11:54:34] (03PS5) 10Hashar: Migrate npm-browser-test to Debian Stretch [integration/config] - 10https://gerrit.wikimedia.org/r/394340 (https://phabricator.wikimedia.org/T179360) [11:55:33] !log updating *npm-browser-node-6-docker jobs to use a new container based on Stretch with Chromium/Firefox | https://gerrit.wikimedia.org/r/#/c/394340/ | T179360 [11:55:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:55:39] T179360: Create "npm-browser" docker image with npm, xvfb, chromium, and firefox installed - https://phabricator.wikimedia.org/T179360 [11:56:03] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802581 (10Osnard) Seems not to work. In my case jenkins-bot does not even v+1 [12:04:16] (03CR) 10Hashar: [C: 032] "Works on all three repos:" [integration/config] - 10https://gerrit.wikimedia.org/r/394340 (https://phabricator.wikimedia.org/T179360) (owner: 10Hashar) [12:05:27] (03Merged) 10jenkins-bot: Migrate npm-browser-test to Debian Stretch [integration/config] - 10https://gerrit.wikimedia.org/r/394340 (https://phabricator.wikimedia.org/T179360) (owner: 10Hashar) [12:06:53] 10Continuous-Integration-Infrastructure (shipyard), 10User-zeljkofilipin: Upgrade to Chromium 59 or newer on Debian Jessie in CI - https://phabricator.wikimedia.org/T170032#3802669 (10hashar) [12:06:55] 10Continuous-Integration-Infrastructure (shipyard), 10Patch-For-Review: Create "npm-browser" docker image with npm, xvfb, chromium, and firefox installed - https://phabricator.wikimedia.org/T179360#3802664 (10hashar) 05Open>03Resolved a:03hashar Done! The `*npm-browser-node-6-docker` jobs are now based o... [12:09:02] zeljkof: still around? [12:09:15] zeljkof: I would like to decline https://phabricator.wikimedia.org/T170032 "upgrade Chromium on Jessie" [12:09:29] hashar: I'm here [12:09:32] let me see... [12:09:36] in favor of a new task to migrate the job to a docker container based on Stretch and having Chromium 62 [12:09:40] I am ready to decline it :] [12:10:00] go ahead [12:10:14] all I care about if headless chrome(ium) [12:10:18] 10Continuous-Integration-Infrastructure (shipyard), 10User-zeljkofilipin: Upgrade to Chromium 59 or newer on Debian Jessie in CI - https://phabricator.wikimedia.org/T170032#3802675 (10hashar) 05Open>03declined I have switched the `*npm-browser-node-6-docker` to Stretch with PhantomJS 2.1.1, Firefox 52 and... [12:10:18] not how we get there :) [12:10:21] 10Release-Engineering-Team (Watching / External), 10MediaWiki-Core-Tests, 10Patch-For-Review, 10User-zeljkofilipin: WebdriverIO should run Chrome headlessly - https://phabricator.wikimedia.org/T167507#3802677 (10hashar) [12:10:26] so then there is https://phabricator.wikimedia.org/T167507 [12:10:32] WebdriverIO should run Chrome headlessly [12:11:38] the selenium/wdio jobs need a mediawiki install + mysql or sqlite or something [12:12:45] yes [12:13:50] 10Continuous-Integration-Infrastructure (shipyard), 10PAWS, 10monitoring, 10Graphite: Purge labs graphite metrics of Docker ephemeral partitions - https://phabricator.wikimedia.org/T181476#3802679 (10hashar) Ah sorry, I forgot toolforge has some Docker hosts as well :( So I guess the tools puppet master h... [12:14:29] zeljkof: which brings me to jan_drewniak patch to add wdio tests to portals ( https://gerrit.wikimedia.org/r/#/c/394539/ ) [12:14:31] it is a static site [12:14:41] so that is probably easy to setup [12:14:59] hashar: yes, that would be probably the simplest to set up [12:15:19] what I am wondering is whether webdriver.io has a system to test files on the file system [12:15:27] eg without requiring apache to be setup [12:15:44] hashar: it should [12:15:52] I'm sure you can point webdriver.io to file paths, but in my case, I need http for some ajax requests [12:15:54] the ruby stack could do it [12:15:59] eg give it a file directory like ./src/ and maybe wdio has a feature to expose it over http [12:16:13] any browser can access file:// urls [12:16:13] * hashar reads http://webdriver.io/guide/services/static-server.html [12:16:40] pff [12:16:50] so hmm [12:16:58] seems like there is no need for apache :] [12:18:16] ^waaa... didn't know about that! (should use that instead of the node-server on local) [12:18:44] * hashar tries [12:19:08] first running the container against https://gerrit.wikimedia.org/r/#/c/394539/1 :] [12:19:45] haha it's just an express server https://github.com/LeadPages/wdio-static-server-service/blob/master/package.json#L23 [12:21:05] bah need chromedriver as well [12:23:00] hashar: yes, you need either chromedriver or selenium server [12:23:37] AHHH chromium-driver installs the driver under /usr/bin : /usr/bin/chromedriver [12:24:40] there is also a firefoxdriver [12:26:35] firefoxdriver is the old one [12:26:40] new one is geckodriver [12:27:25] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review, 10User-Joe: Upgrade latest docker-registry.wikimedia.org/nodejs-devel to stretch - https://phabricator.wikimedia.org/T180524#3802701 (10Joe) A new version of the nodejs-devel image based on nodesource's own package... [12:27:33] 10Release-Engineering-Team (Kanban), 10Patch-For-Review, 10Release Pipeline (Blubber): Establish blubber config in mathoid - https://phabricator.wikimedia.org/T173127#3802703 (10Joe) [12:27:35] 10Release-Engineering-Team (Kanban), 10Operations, 10Release Pipeline, 10Patch-For-Review, 10User-Joe: Upgrade latest docker-registry.wikimedia.org/nodejs-devel to stretch - https://phabricator.wikimedia.org/T180524#3802702 (10Joe) 05Open>03Resolved [12:42:07] ahahah [12:42:23] jan_drewniak: zeljkof: I got the portals/deploy selenium tests running in a container [12:42:28] I have no idea how it works really [12:42:33] :D [12:42:45] seems chromedriver is killed though bah [12:42:52] that's how I feel about computers in general [12:43:33] ah killall chromedriver bah [12:46:42] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802724 (10Paladox) Do those repos have tests? If they doint then +2 alone will require you to v+2 and press submit. [12:47:34] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802725 (10Paladox) See https://github.com/wikimedia/integration-config/search?utf8=✓&q=BlueSpiceContextMenu&type= [12:58:21] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802740 (10Osnard) Hmmmm...., seems they do not. I thought all new repos would be configured to at least have PHPCS, banana-checker, etc. Thanks for the hin. I w... [13:10:41] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802760 (10Paladox) Your welcome and nope all new repos are not added automatically, requires us to add the tests that the repo needs. [13:14:13] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802767 (10Osnard) But just for my understanding: It is sufficient to add entires like [1] for all the BlueSpice* extensions? Or can this be archived any simpler... [13:20:15] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802779 (10Paladox) You carnt use a while card for the project name (at least I doint see any from a quick look) you can choose the tests you want more from the... [13:25:18] (03PS1) 10Hashar: docker: add Chromedriver to npm-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/394565 (https://phabricator.wikimedia.org/T167507) [13:33:42] (03CR) 10Hashar: "I gave it a try with https://gerrit.wikimedia.org/r/#/c/394539/ and it seems to be working :)" [integration/config] - 10https://gerrit.wikimedia.org/r/394565 (https://phabricator.wikimedia.org/T167507) (owner: 10Hashar) [13:46:26] !log deployment-prep bounce elasticsearch on logstash2 to test jmx_exporter [13:46:32] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:48:10] (03PS2) 10Hashar: docker: add Chromedriver to npm-browser-test [integration/config] - 10https://gerrit.wikimedia.org/r/394565 (https://phabricator.wikimedia.org/T167507) [13:49:10] (03CR) 10Hashar: "I am rebuilding the container and it is being pushed." [integration/config] - 10https://gerrit.wikimedia.org/r/394565 (https://phabricator.wikimedia.org/T167507) (owner: 10Hashar) [13:54:24] (03PS1) 10Umherirrender: [BrickipediaExtra] Make unit tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/394569 [13:58:34] (03CR) 10Hashar: [C: 032] [BrickipediaExtra] Make unit tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/394569 (owner: 10Umherirrender) [13:59:54] (03Merged) 10jenkins-bot: [BrickipediaExtra] Make unit tests voting [integration/config] - 10https://gerrit.wikimedia.org/r/394569 (owner: 10Umherirrender) [14:22:34] (03CR) 10Hashar: "Deployed!" [integration/config] - 10https://gerrit.wikimedia.org/r/394569 (owner: 10Umherirrender) [14:24:53] (03PS27) 10Umherirrender: Update tests for BlueSpice [integration/config] - 10https://gerrit.wikimedia.org/r/380790 [14:25:03] (03CR) 10Umherirrender: "added BlueSpiceWhoIsOnline and BlueSpiceWatchList" [integration/config] - 10https://gerrit.wikimedia.org/r/380790 (owner: 10Umherirrender) [14:28:01] (03CR) 10Hashar: "Passed on https://integration.wikimedia.org/ci/job/wikimedia-portals-deploy-npm-browser-node-6-docker/1/console :)" [integration/config] - 10https://gerrit.wikimedia.org/r/394565 (https://phabricator.wikimedia.org/T167507) (owner: 10Hashar) [14:40:20] (03PS1) 10Robert Vogel: Changed settings for BlueSpice-repos [integration/config] - 10https://gerrit.wikimedia.org/r/394578 [14:41:13] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811#3802978 (10Osnard) Okay, I've started with editing `integration-config`: https://gerrit.wikimedia.org/r/394578 [14:41:25] (03CR) 10jerkins-bot: [V: 04-1] Changed settings for BlueSpice-repos [integration/config] - 10https://gerrit.wikimedia.org/r/394578 (owner: 10Robert Vogel) [14:49:42] 10Release-Engineering-Team (Watching / External), 10Operations, 10Patch-For-Review, 10Scoring-platform-team (Current), 10Wikimedia-Incident: Cache ORES virtualenv within versioned source - https://phabricator.wikimedia.org/T181071#3802985 (10awight) [15:01:26] (03Abandoned) 10Umherirrender: Update tests for BlueSpice [integration/config] - 10https://gerrit.wikimedia.org/r/380790 (owner: 10Umherirrender) [15:08:30] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803018 (10Halfak) Well.. I've had my github account locked, so I'm working on experimenting with gitlab. I've c... [15:11:13] (03CR) 10Umherirrender: Changed settings for BlueSpice-repos (034 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/394578 (owner: 10Robert Vogel) [15:27:48] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [15:43:28] (03PS2) 10Robert Vogel: Changed settings for BlueSpice-repos [integration/config] - 10https://gerrit.wikimedia.org/r/394578 [15:45:22] (03CR) 10Robert Vogel: Changed settings for BlueSpice-repos (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/394578 (owner: 10Robert Vogel) [15:51:31] (03CR) 10Umherirrender: [C: 031] Changed settings for BlueSpice-repos [integration/config] - 10https://gerrit.wikimedia.org/r/394578 (owner: 10Robert Vogel) [15:53:42] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team (Current), 10Wikimedia-Incident: Write reports about why Ext:ORES is helping cause server 500s and alternatives to fix - https://phabricator.wikimedia.org/T181010#3803155 (10awight) [15:54:32] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team (Current), 10Wikimedia-Incident: [Spike] Write reports about why Ext:ORES is helping cause server 500s and write tasks to fix - https://phabricator.wikimedia.org/T181010#3776331 (10awight) [16:11:54] 10Release-Engineering-Team, 10ORES, 10Operations, 10Scoring-platform-team (Current): Connection timeout from tin to new ores servers - https://phabricator.wikimedia.org/T181661#3803203 (10akosiaris) A quick look at graphs for various ores hosts[1] and tin [2] does not show anything network related. A look... [16:25:37] (03CR) 10Paladox: Changed settings for BlueSpice-repos (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/394578 (owner: 10Robert Vogel) [16:35:57] greg-g: no worries :) hope you feel better too! [16:53:43] hmm when I updated the DPL submodule it linked to an intersection repo [16:53:53] I'm not sure why.. [16:56:20] there is aslo ^ disregard that please [16:56:33] regardless there is https://phabricator.wikimedia.org/T181818 [16:57:08] Hey folks. Should we expect scap to work nicely with LFS? [16:59:01] twentyafterfour hi, about phabricator. Is lfs supported and if lfs is enabled on the github repo will it pull it in as a lfs object if phab is being used as a mirror? [16:59:48] FWIW, we're in the process of switching from github to gitlab because of LFS limitations. Not sure if that is relevant. [17:01:39] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803356 (10Halfak) I'm working on updating https://phabricator.wikimedia.org/source/editquality to pull from gitlab... [17:24:19] greg-g: I hate to do this to you, but the Multimedia team would like to request special dispensation to do a Friday deploy during the English fundraiser [17:24:27] https://phabricator.wikimedia.org/T181737 [17:24:37] https://gerrit.wikimedia.org/r/394593 is the fix, merged already [17:24:43] I can backport and deploy on your "go" [17:53:18] marktraceur: greg-g is out today. no_justification usually makes these calls in his absence. (/me passes the buck :)) [17:54:13] marktraceur: Go forth, and make patches to all apaches [17:54:52] A patch apache patches patchily. [17:55:24] Switching to -operations, thanks! [17:58:48] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803540 (10demon) >>! In T181678#3798554, @Halfak wrote: > Trying start a gerrit review for wheels. Got this: > >... [17:59:46] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803543 (10demon) >>! In T181678#3803356, @Halfak wrote: > I'm working on updating https://phabricator.wikimedia.or... [18:02:21] twentyafterfour: (and others): have to restart apache on prod phab really quick [18:02:51] php-curl needs updating and phab needs it [18:23:41] done [18:26:59] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team (Current), 10Wikimedia-Incident: [Spike] Write reports about why Ext:ORES is helping cause server 500s and write tasks to fix - https://phabricator.wikimedia.org/T181010#3803643 (10awight) [18:27:23] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team (Current), 10Wikimedia-Incident: [Spike] Write reports about why Ext:ORES is helping cause server 500s and write tasks to fix - https://phabricator.wikimedia.org/T181010#3776331 (10awight) Deployment documentation is updated, struck-th... [18:30:59] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team (Current), 10Wikimedia-Incident: How can we test all the wiki/page combinations that can be affected by ORES? - https://phabricator.wikimedia.org/T181830#3803654 (10awight) [18:34:39] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team, 10Documentation, 10Wikimedia-Incident: Document ORES architecture from a robustness perspective - https://phabricator.wikimedia.org/T181831#3803671 (10awight) [18:35:00] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team (Current), 10Wikimedia-Incident: [Spike] Write reports about why Ext:ORES is helping cause server 500s and write tasks to fix - https://phabricator.wikimedia.org/T181010#3776331 (10awight) [18:35:25] 10Release-Engineering-Team (Watching / External), 10Scoring-platform-team (Current), 10Wikimedia-Incident: [Spike] Write reports about why Ext:ORES is helping cause server 500s and write tasks to fix - https://phabricator.wikimedia.org/T181010#3776331 (10awight) 05Open>03Resolved p:05Triage>03High Cl... [18:45:50] 10Release-Engineering-Team, 10Deployments, 10HHVM, 10Wikimedia-Incident: Figure out why HHVM kept running stale code for hours - https://phabricator.wikimedia.org/T181833#3803747 (10Krinkle) [18:45:55] 10Release-Engineering-Team, 10Deployments, 10HHVM, 10Wikimedia-Incident: Figure out why HHVM kept running stale code for hours - https://phabricator.wikimedia.org/T181833#3803772 (10Krinkle) [18:52:49] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803805 (10Halfak) @demon, right, I'm still not able to push the wheels LFS migration. Can you help us get gitlabs... [18:54:47] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803812 (10bd808) Related: {T143969} [18:55:26] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10Diffusion, and 4 others: Add gitlab to proxies/whitelist for mirroring to phabricator - https://phabricator.wikimedia.org/T181835#3803814 (10Halfak) [18:58:06] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10Diffusion, and 4 others: Add gitlab to proxies/whitelist for mirroring to phabricator - https://phabricator.wikimedia.org/T181835#3803838 (10Halfak) See also {T143969} [19:00:59] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803864 (10demon) >>! In T181678#3803805, @Halfak wrote: > @demon, right, I'm still not able to push the wheels LFS... [19:05:10] 10Gerrit, 10Release-Engineering-Team (Kanban), 10Scap (Tech Debt Sprint FY201718-Q2), 10ORES, and 3 others: Plan migration of ORES repos to git-lfs - https://phabricator.wikimedia.org/T181678#3803891 (10Halfak) @demon, it seems this is a different conversation. We do want to use lfs internally on gerrit f... [19:05:53] 10Release-Engineering-Team, 10Wikidata, 10User-Addshore: Mark extension-Wikidata on Gerrit as ARCHIVED - https://phabricator.wikimedia.org/T181838#3803897 (10Addshore) [19:05:59] o/ no_justification [19:06:13] Do you want to talk about external mirroring here instead. [19:06:29] To be honest, I'm not excited about having this conversation again for the Nth time :| [19:06:39] I feel like we've missed something here. [19:07:23] 10Release-Engineering-Team, 10Wikidata, 10User-Addshore: Mark extension-Wikidata & wikidata-build-resources on Gerrit as ARCHIVED - https://phabricator.wikimedia.org/T181838#3803914 (10Addshore) [19:07:23] Whitelisting gitlab is easy, I'm not going to block that [19:07:29] Great :) [19:07:33] I'm just confused as to what repos are going where and where everything is mirroring [19:07:39] 10Release-Engineering-Team, 10Wikidata, 10User-Addshore: Mark extension-Wikidata & wikidata-build-resources on Gerrit as ARCHIVED - https://phabricator.wikimedia.org/T181838#3803897 (10Addshore) a:05Addshore>03None [19:07:50] And why Github would block you for resource usage if you're putting the lfs data with us :) [19:08:08] 10Release-Engineering-Team, 10Wikidata, 10User-Addshore: Mark extension-Wikidata & wikidata-build-resources on Gerrit as ARCHIVED - https://phabricator.wikimedia.org/T181838#3803897 (10MarcoAurelio) (please do not forget to inactivate the Diffusion mirrors and to delete their GitHub ones as well) [19:08:10] no_justification, we were missing github's LFS to local LFS [19:08:29] This is helpful because our contributors submit PRs via github (soon to be gitlab) [19:08:30] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10Patch-For-Review, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3803922 (10Addshore) [19:08:45] Missing? Could you rephrase? [19:08:47] And we don't think it's good to force people to learn and use gerrit. :) [19:08:53] *mirroring [19:09:16] Project selenium-MinervaNeue » chrome,beta,Linux,BrowserTests build #221: 04FAILURE in 20 min: https://integration.wikimedia.org/ci/job/selenium-MinervaNeue/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/221/ [19:09:47] Mirroring to phab provides a nice opportunity to resolve critical security concerns *and* remain open to our contributors. [19:09:56] Yeah, ok I got that [19:10:01] So then what do we need gerrit lfs for? [19:10:07] It doesn't do observation mode a la phab [19:10:42] some of our repos need to be in gerrit. [19:10:45] E.g. wheels [19:11:01] Which is fine because none of our contributors are interested in our deployment wheels. [19:11:24] And that's why I'm asking you to help me push the LFS conversion of our wheels repository to gerrit. [19:11:35] Gotcha. Ok now I understand everything [19:11:44] Ty ty for explaining. Async via task I was missing some details [19:11:44] :) [19:12:19] :) thanks for helping out [19:12:50] Ok, so two things you need from meeeee: [19:12:50] 1) Whitelist gitlab (easy, I'll write a patch now) [19:12:50] 2) Help you force-push to gerrit since you're rewriting history [19:13:32] Right. Also, should we expect phab/diffusion is going to figure out what to do with LFS? [19:14:13] I *think* Mukunda said that was ready to go, but we should double check [19:15:44] halfak: Sortaaaa relatedly, looking at puppet we have two repos that are being directly deployed from github/wiki-ai :( [19:15:50] that's a no-no, we need to fix that soon [19:16:06] 10Release-Engineering-Team (Watching / External), 10Wikidata, 10Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3803952 (10Addshore) 05Open>03declined [19:16:45] 10Gerrit, 10Wikidata: [Task] move git repositories that are dependencies of wikidata to gerrit - https://phabricator.wikimedia.org/T74907#3803956 (10Addshore) 05Open>03declined declining per the fact we dont really need this any more [19:16:55] no_justification, that can't be true [19:16:57] Link me plz. [19:17:15] ...Unless you're looking at one of our wmflabs clusters [19:17:42] https://phabricator.wikimedia.org/source/operations-puppet/browse/production/?grep=wiki-ai [19:18:01] One is labs. Other might be, but isn't clearly labeled as such [19:19:33] Project selenium-MinervaNeue » firefox,beta,Linux,BrowserTests build #221: 04FAILURE in 30 min: https://integration.wikimedia.org/ci/job/selenium-MinervaNeue/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/221/ [19:21:11] 10Release-Engineering-Team (Watching / External), 10Wikidata: Document wikidata deployment properly - https://phabricator.wikimedia.org/T168491#3803996 (10Addshore) [19:21:14] 10Release-Engineering-Team (Watching / External), 10Wikidata, 10Story: [Story] Use composer-merge-plugin to include Wikidata components in mediawiki-vendor - https://phabricator.wikimedia.org/T95663#3803997 (10Addshore) [19:21:47] 10Release-Engineering-Team (Watching / External), 10Wikidata: Document wikidata deployment properly - https://phabricator.wikimedia.org/T168491#3366283 (10Addshore) 05Open>03Invalid The page linked in the desc is now essentially archived. The deployment process is now the same as all other extensions. [19:22:09] halfak: https://gerrit.wikimedia.org/r/#/c/394640/ submitted for gitlab whitelisting [19:22:42] Oh yeah, that's 100% for our labs deploy [19:23:01] staging only runs in labs [19:23:11] wikilabels only runs in labs [19:23:23] Thanks for the gitlabs whitelisting [19:23:37] 10Continuous-Integration-Config, 10Wikidata, 10Patch-For-Review, 10User-Addshore: Only run npm job on Jenkins for builds of data-values/value-view - https://phabricator.wikimedia.org/T178083#3804037 (10Addshore) [19:23:42] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10Patch-For-Review, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3804038 (10Addshore) [19:23:53] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10Patch-For-Review, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3615917 (10Addshore) [19:24:05] 10Release-Engineering-Team, 10Wikidata, 10Epic, 10Patch-For-Review, 10User-Addshore: [Epic] Kill the Wikidata build step - https://phabricator.wikimedia.org/T173818#3615922 (10Addshore) [19:49:11] 10Continuous-Integration-Config, 10MathSearch: mwext-testextension-zend should load extension mathsearch after math - https://phabricator.wikimedia.org/T117659#1780887 (10Umherirrender) Both are migrated to extension.json already. Does it help to set required: Math in MathSearch's extension.json? That should f... [19:53:49] PROBLEM - Mediawiki Error Rate on graphite-labs is CRITICAL: CRITICAL: 80.00% of data above the critical threshold [10.0] [20:20:53] PROBLEM - Puppet errors on deployment-ms-be04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:21:45] PROBLEM - Puppet errors on integration-slave-jessie-1003 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:22:27] PROBLEM - Puppet errors on integration-slave-jessie-1001 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:32:09] PROBLEM - Puppet errors on integration-slave-jessie-1004 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:32:58] 10Release-Engineering-Team, 10ORES, 10Operations, 10Scoring-platform-team (Current): Connection timeout from tin to new ores servers - https://phabricator.wikimedia.org/T181661#3804344 (10awight) I just ran scap with `-l "ores1001.*" and deployment went smoothly. However, with scap running in parallel and... [20:39:57] 10Gerrit-Migration, 10Documentation: Update Code Review related documentation on wiki pages from Gerrit to Differential - https://phabricator.wikimedia.org/T207#3804365 (10cscott) [20:41:45] Yippee, build fixed! [20:41:45] Project selenium-Echo » chrome,beta,Linux,BrowserTests build #596: 09FIXED in 44 sec: https://integration.wikimedia.org/ci/job/selenium-Echo/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/596/ [20:42:19] Yippee, build fixed! [20:42:20] Project selenium-Wikibase-chrome » chrome,beta,Linux,DebianJessie && contintLabsSlave build #29: 09FIXED in 55 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase-chrome/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=DebianJessie%20&&%20contintLabsSlave/29/ [20:43:17] 10Gerrit-Migration, 10Documentation: Update Code Review related documentation on wiki pages from Gerrit to Differential - https://phabricator.wikimedia.org/T207#3804398 (10Jdforrester-WMF) [20:46:30] PROBLEM - Puppet errors on deployment-ms-be03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [20:53:49] RECOVERY - Mediawiki Error Rate on graphite-labs is OK: OK: Less than 1.00% above the threshold [1.0] [21:04:03] 10Release-Engineering-Team (Watching / External), 10Scap, 10ORES, 10Operations, 10Scoring-platform-team: Disconnect scoring repos to stop mirroring from GitHub - https://phabricator.wikimedia.org/T181851#3804438 (10awight) [21:04:17] 10Release-Engineering-Team (Watching / External), 10Scap, 10ORES, 10Operations, 10Scoring-platform-team (Current): Disconnect scoring repos to stop mirroring from GitHub - https://phabricator.wikimedia.org/T181851#3804454 (10awight) [21:05:46] 10Continuous-Integration-Config, 10Tool-Global-user-contributions: Require PHP 5.6 for GUC - https://phabricator.wikimedia.org/T181852#3804461 (10Krinkle) [21:06:38] (03PS1) 10Krinkle: Switch tools/guc jobs from php55 to php56 [integration/config] - 10https://gerrit.wikimedia.org/r/394655 (https://phabricator.wikimedia.org/T181852) [21:08:27] Hey folks. [21:08:42] I think we'll need git lfs in order to work with our repos on deployment-tin [21:08:55] But it doesn't looks like it is installed. [21:09:13] I'm not sure how to do this in puppet because git-lfs isn't in the standard jessie repos [21:09:18] any ideas? [21:10:32] 10Release-Engineering-Team (Watching / External), 10Scap, 10ORES, 10Operations, 10Scoring-platform-team (Current): Disconnect scoring repos to stop mirroring from GitHub - https://phabricator.wikimedia.org/T181851#3804492 (10Halfak) Done! https://phabricator.wikimedia.org/source/editquality/manage/uris/... [21:10:40] You'd need to get ops to package it, put it in the WMF repos.... [21:13:42] (03CR) 10Krinkle: [C: 032] Switch tools/guc jobs from php55 to php56 [integration/config] - 10https://gerrit.wikimedia.org/r/394655 (https://phabricator.wikimedia.org/T181852) (owner: 10Krinkle) [21:13:54] (03CR) 10Krinkle: [C: 032] "Compiled and deployed new composer-php56-jessie and composer-package-php56-jessie job." [integration/config] - 10https://gerrit.wikimedia.org/r/394655 (https://phabricator.wikimedia.org/T181852) (owner: 10Krinkle) [21:14:58] (03Merged) 10jenkins-bot: Switch tools/guc jobs from php55 to php56 [integration/config] - 10https://gerrit.wikimedia.org/r/394655 (https://phabricator.wikimedia.org/T181852) (owner: 10Krinkle) [21:15:28] there are packages in testing, so it would need stretch and then a jessie backport [21:15:29] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/394655 [21:15:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [21:16:01] Thanks Reedy. I'll file a task. [21:16:41] Nevermind. there is one! https://phabricator.wikimedia.org/T180628 [21:21:27] PROBLEM - Free space - all mounts on integration-slave-docker-1002 is CRITICAL: CRITICAL: integration.integration-slave-docker-1002.diskspace.root.byte_percentfree (<11.11%) [21:27:27] 10Continuous-Integration-Config, 10Tool-Global-user-contributions, 10Patch-For-Review: Require PHP 5.6 for GUC - https://phabricator.wikimedia.org/T181852#3804551 (10Krinkle) 05Open>03Resolved p:05Triage>03Normal [21:27:30] 10Continuous-Integration-Config, 10Tool-Global-user-contributions: Require PHP 5.6 for GUC - https://phabricator.wikimedia.org/T181852#3804461 (10Krinkle) [21:29:32] (03PS1) 10Thcipriani: Service Pipeline: Move blubber config location [integration/config] - 10https://gerrit.wikimedia.org/r/394663 [21:30:51] PROBLEM - Free space - all mounts on deployment-sca03 is CRITICAL: CRITICAL: deployment-prep.deployment-sca03.diskspace._srv.byte_percentfree (<100.00%) [21:32:04] (03CR) 10Thcipriani: [C: 032] "Already deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/394663 (owner: 10Thcipriani) [21:33:22] (03Merged) 10jenkins-bot: Service Pipeline: Move blubber config location [integration/config] - 10https://gerrit.wikimedia.org/r/394663 (owner: 10Thcipriani) [21:40:20] tabbycat: Didn't we have a task filed for "automate the repo archiving process" [21:40:28] I could've *sworn* we filed it in its own task [21:40:31] But I can't find it [21:41:22] no_justification, yes, we had one [21:41:24] iirc [21:42:54] Well I for the life of me cannot find it [21:42:58] (I have a WIP :)) [22:10:59] tabbycat: https://phabricator.wikimedia.org/P6418 :D [22:12:57] no_justification is that using digest or basic auth? :) [22:13:13] no_justification, and that single script will take care of EVERYTHING? [22:13:26] paladox: Ask David P, it's his library :p [22:13:31] lol [22:13:36] tabbycat: Well, the git parts at least [22:13:40] We can add moar :p [22:13:42] Again this is a WIP [22:13:50] David Pursehouse? [22:14:17] awesome no_justification [22:14:17] Yeah [22:14:26] looking for the task [22:14:32] paladox: But just read the source instead :p [22:14:38] ok [22:15:00] no_justification, T175499 [22:15:00] T175499: Tool to archive extensions (and do related stuff)? - https://phabricator.wikimedia.org/T175499 [22:15:03] :) [22:15:22] It uses .netrc, which is a subset of HTTPDigestAuth :) [22:15:58] tabbycat: If we get really fancy, we could use pywikibot to do the on-wiki work :D [22:16:35] well, I guess that'd be good too [22:16:45] but some pages are marked for translation and whatnot [22:17:33] also, for git, since I don't have +2 on mediawiki, I guess I can't use it directly; so it should, maybe, allow to submit a patch to the refs/meta/config branch? [22:18:25] 10Continuous-Integration-Config, 10Gerrit, 10Cleanup, 10Diffusion, 10GitHub-Mirrors: Tool to archive extensions (and do related stuff)? - https://phabricator.wikimedia.org/T175499#3804663 (10demon) {P6418} [22:18:56] tabbycat: Well I like using {{tnt|ArchivedExtension|}} [22:19:04] Since people don't pay attention to colored status boxes [22:19:20] Yep, that's what I do [22:19:35] easier than to browse and add status = unmaintained [22:19:45] that when I don't write "unmantained" [22:20:03] English... meh :P [22:20:16] Or I just bite the bullet and we make a role account for this [22:20:29] But it needs write access to basically every repo :( [22:20:32] * no_justification cries a little [22:20:38] danger danger danger [22:22:57] Hmmm. I wonder if I could write a plugin for gerrit, then it would only do what we want it do [22:23:05] (and we could attribute it to the system "Gerrit Code Review" user) [22:23:18] +1 to plugin [22:23:49] Says the guy who hasn't worked with JGit before haha [22:24:59] Gerrit could call Phab and Github APIs easy enough.... [22:25:02] A plugin would be better cause then it wouldnt have to be supplied auth creds or anything, right? [22:25:19] lol @ jgit. [22:25:58] For the Gerrit bit it would already be internally authed yes. Lucky for usssss.... We already have Phab and Github creds we could use [22:26:05] Andddd we already use the Phab ones [22:26:22] Would this be for the ui? [22:26:27] Yeah. Plugin on Gerrit seems nice [22:26:37] Nah just do ssh plugin it's easiest [22:27:06] Ooh I just found my weekend project! [22:27:12] lol [22:27:24] would you do this in buck or bazel? [22:27:36] Oh yeah. Ugh. [22:27:41] Maven! Lol [22:27:44] lol [22:28:00] bazel is really easy :) [22:28:04] it's basically python [22:28:16] Yeah but it wouldn't let us do this plugin until 2.14 [22:28:21] ah [22:28:25] yeh. [22:28:27] I really need to upgrade [22:28:46] 230pm on a Friday seems like a bad time tho [22:28:46] i guess create the plugin, then branch it and then update it for 2.14+ :) [22:29:03] it's only 22:28pm here :) [22:29:13] Long as the API's I use are stable I could write against 2.14 and deploy to 2.13 [22:29:17] Right? [22:29:25] Yep [22:29:38] I can help with polygerrit support later :). [22:29:45] as the api is the same in poly too. [22:33:01] please make it usable for us mortals? [22:35:07] tabbycat: I'll give it a new permission we can grant to people w/o admin rights [22:35:22] (still needs some permission grant though, don't want somebody archiving all repos!) [22:35:26] :P [22:35:32] true that [22:35:36] heh [22:40:04] 10Release-Engineering-Team (Kanban), 10ORES, 10Operations, 10Scoring-platform-team (Current), and 2 others: Git refusing to clone some ORES submodules - https://phabricator.wikimedia.org/T181552#3804694 (10mmodell) a:03mmodell [22:40:49] twentyafterfour: Relatedly, if you get a change I wrote a gerrit change to phab's gitconfig [22:40:52] To whitelist gitlab [22:41:04] o/ mmodell [22:41:13] Just saw you claimed T181552 [22:41:13] T181552: Git refusing to clone some ORES submodules - https://phabricator.wikimedia.org/T181552 [22:41:13] no_justification: cool [22:41:25] https://gerrit.wikimedia.org/r/#/c/394640/ [22:41:27] You should know we're in a weird state with those phab repos and it might affect your troubleshooting. [22:41:45] I can explain when you are ready [22:41:47] twentyafterfour, ^ [22:41:56] * halfak assumes phab usernames cross over :S [22:42:05] halfak: ok [22:42:41] I think that they should work just like normal but we have shut off "observing" temporarily. [22:42:50] Because we jumped the gun on moving over to git-lfs. [22:43:06] And we're not reverting that while we wait for full git-lfs support. [22:43:07] no_justification: so your saying i cant archive everything :( not fair jk but who exactly would get said userright? [22:43:15] twentyafterfour, ^ [22:43:27] halfak: so they are on phab only or gerrit only for now? [22:43:41] phab only. But phab *was* observing. [22:43:56] I assume when I turn that off it will continue to work like a regular repo but just not get updates. [22:44:03] Read-only that is [22:44:04] are you using git-lfs on phabricator? [22:44:15] I want to do so eventually :) [22:44:40] Zppix: Whoever gives me the most beer. It'll be a contest :D [22:44:45] Especially with that wikiclass repo noted in the task. [22:44:55] no_justification: lol [22:45:08] halfak: phabricator supposedly has support for git-lfs but it's untested currently [22:45:32] * no_justification mutters something about gerrit having lfs support now ;-) [22:46:09] twentyafterfour, once we have git-lfs in our deploy environment, we'll be working on converting and I'd be happy to test out phab support for it. [22:46:24] cool [22:46:31] no_justification, we need git-lfs to actually be running on scap machines and in labs in order to take advantage of that though :| [22:48:48] Yeahhhh, so about thattttttt [22:49:55] Ah, it's in third-party repos until we hit buster [22:50:03] Could be backported, but the build-depends list is uglyyyyyyy [22:50:11] I remember talking about this with Tyler [22:51:12] Build-Depends: debhelper (>= 9), dh-golang, git (>= 1.8.0), golang-go (>= 1.3.0), ruby-ronn, golang-github-kr-pty-dev, golang-github-pkg-errors-dev, golang-github-spf13-cobra-dev, golang-github-rubyist-tracerx-dev (>= 0.0~git20170927.0.7879593), golang-github-bgentry-go-netrc-dev, golang-github-olekukonko-ts-dev, golang-github-thomsonreuterseikon-go-ntlm-dev, golang-github-xeipuuv-gojsonschema-dev (>= [22:51:12] 0.0~git20170210.0.6b67b3f) [22:51:14] Yeahhhhh [22:51:16] About that [22:54:04] no_justification: that doesn't look too bad [22:54:26] you think all the golang stuff would be a problem [22:54:27] ? [22:55:08] Maybe it's not as bad as it looks on copy+paste [22:55:30] golang-github-* is kinda funny, but I guess LFS was their baby originally [22:56:11] Idk how many of those are in stretch or below though [22:57:58] Right. I figured this would be a pain. [22:57:59] :/ [22:58:26] Large binary blobs are a pain to begin with :) [22:58:28] heheheeh [22:58:37] Ok, errand time, gotta go pick up doggie meds at the vet [23:00:21] medddsss [23:00:31] * tabbycat has well, yes, a cat [23:00:47] dogspeed [23:00:49] ;) [23:01:01] neutered him two months ago now is getting fat [23:05:34] FWIW we managed to package blubber putting all dependencies in vendor [23:05:52] git-lfs IIRC uses glide so it can be built using vendoring [23:06:26] i.e. we may not need to backport all the build-depends but we may end up with a large binary: I don't know [23:07:28] a large binary isn't too big of a deal... you want large bins you gotta use a large bin to get them :P [23:09:03] git-lfs's new slogan [23:10:00] the one that go get built is 12MB if that's meaningful at all [23:10:54] that doesn't seem too problematic to me but ... [23:11:06] I guess we'd need input from ops [23:12:19] yeah, probably just need to get the ball rolling, ensure that something can be built that works for jessie and stretch and then poke a task [23:18:11] 10MediaWiki-Codesniffer: Detect use of create_function with codesniffer - https://phabricator.wikimedia.org/T181865#3804825 (10Umherirrender) [23:21:52] 10Release-Engineering-Team, 10Cleanup, 10Wikidata, 10MW-1.31-release-notes (WMF-deploy-2017-12-05 (1.31.0-wmf.11)), and 2 others: Mark extension-Wikidata & wikidata-build-resources on Gerrit as ARCHIVED - https://phabricator.wikimedia.org/T181838#3804838 (10Umherirrender)