[00:08:25] (03PS3) 10Legoktm: Exclude common folders: [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362266 (https://phabricator.wikimedia.org/T122738) (owner: 10Umherirrender) [00:08:38] (03PS4) 10Legoktm: Exclude common folders [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362266 (https://phabricator.wikimedia.org/T122738) (owner: 10Umherirrender) [00:08:41] (03PS5) 10Legoktm: Exclude common folders [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362266 (https://phabricator.wikimedia.org/T122738) (owner: 10Umherirrender) [00:08:46] (03CR) 10Legoktm: [C: 032] Exclude common folders [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362266 (https://phabricator.wikimedia.org/T122738) (owner: 10Umherirrender) [00:11:23] (03Merged) 10jenkins-bot: Exclude common folders [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362266 (https://phabricator.wikimedia.org/T122738) (owner: 10Umherirrender) [00:14:53] (03PS1) 10Legoktm: Set --parallel=2 by default [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) [00:15:54] 10MediaWiki-Codesniffer, 10Patch-For-Review: Take advantage of PHPCS's parallel feature - https://phabricator.wikimedia.org/T169189#3393529 (10Legoktm) a:03Legoktm OK sounds good, I put up a patch that adds it to rulseset.xml. [00:18:07] Project selenium-Flow » firefox,beta,Linux,BrowserTests build #437: 04FAILURE in 2 min 7 sec: https://integration.wikimedia.org/ci/job/selenium-Flow/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/437/ [02:13:44] Project beta-code-update-eqiad build #161921: 04FAILURE in 43 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/161921/ [02:23:44] Yippee, build fixed! [02:23:44] Project beta-code-update-eqiad build #161922: 09FIXED in 44 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/161922/ [04:17:33] Yippee, build fixed! [04:17:34] Project selenium-MultimediaViewer » firefox,beta,Linux,BrowserTests build #438: 09FIXED in 21 min: https://integration.wikimedia.org/ci/job/selenium-MultimediaViewer/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/438/ [04:40:35] 10MediaWiki-Codesniffer, 10Patch-For-Review: MediaWiki-Codesniffer sniffs the .git folder - https://phabricator.wikimedia.org/T122738#3393792 (10Umherirrender) 05Open>03Resolved p:05Triage>03Normal a:03Umherirrender [05:05:25] Project beta-scap-eqiad build #161870: 04FAILURE in 1 min 46 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/161870/ [05:15:47] Yippee, build fixed! [05:15:47] Project beta-scap-eqiad build #161871: 09FIXED in 2 min 9 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/161871/ [05:47:39] PROBLEM - Free space - all mounts on deployment-fluorine02 is CRITICAL: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<30.00%) [06:30:19] Yippee, build fixed! [06:30:19] Project selenium-Wikibase » chrome,test,Linux,BrowserTests build #407: 09FIXED in 1 hr 50 min: https://integration.wikimedia.org/ci/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=test,PLATFORM=Linux,label=BrowserTests/407/ [07:07:40] RECOVERY - Free space - all mounts on deployment-fluorine02 is OK: OK: All targets OK [07:33:38] Hello everybody, newbie question about scap - is there any config variable to limit the number of *-rev dirs on the target hosts? [07:34:05] analytics is using git-fat and sometimes we end up with disks filled up [07:34:48] from https://doc.wikimedia.org/mw-tools-scap/scap3/repo_config.html the only one that is maybe related is tags_to_keep, but not sure [07:35:03] the alternative for me is to write a cron job that purges old revs [07:51:46] elukey: hello. If scap3 doesn't handle that, mosdt probably it should :] [07:52:01] I dont know the code base though [07:54:07] hashar: thanks! Will ask to thcipriani|afk then :) [08:08:15] (03CR) 10Hashar: [C: 04-1] Add mw-config to gate-and-submit-swat pipeline (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/362316 (https://phabricator.wikimedia.org/T169279) (owner: 10Paladox) [08:12:04] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Analytics: Archive analytics/kraken git repository - https://phabricator.wikimedia.org/T169303#3393987 (10hashar) [08:12:53] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Analytics: Archive analytics/kraken git repository - https://phabricator.wikimedia.org/T169303#3394001 (10hashar) [08:14:42] (03CR) 10Hashar: "> analytics-kraken-maven" [integration/config] - 10https://gerrit.wikimedia.org/r/361482 (owner: 10Paladox) [08:15:51] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Analytics: Archive analytics/kraken git repository - https://phabricator.wikimedia.org/T169303#3394004 (10hashar) [08:16:14] !log Gerrit: changing repos to read-only: analytics/kraken analytics/kraken/deploy analytics/vagrant/kraken - T169303 [08:16:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:16:20] T169303: Archive analytics/kraken git repository - https://phabricator.wikimedia.org/T169303 [08:19:45] (03PS1) 10Hashar: Unconfigure analytics/kraken [integration/config] - 10https://gerrit.wikimedia.org/r/362344 (https://phabricator.wikimedia.org/T169303) [08:21:49] (03CR) 10Hashar: [C: 032] Unconfigure analytics/kraken [integration/config] - 10https://gerrit.wikimedia.org/r/362344 (https://phabricator.wikimedia.org/T169303) (owner: 10Hashar) [08:23:24] (03Merged) 10jenkins-bot: Unconfigure analytics/kraken [integration/config] - 10https://gerrit.wikimedia.org/r/362344 (https://phabricator.wikimedia.org/T169303) (owner: 10Hashar) [08:23:43] 10Continuous-Integration-Config, 10Release-Engineering-Team (Kanban), 10Analytics, 10Patch-For-Review: Archive analytics/kraken git repository - https://phabricator.wikimedia.org/T169303#3394011 (10hashar) 05Open>03Resolved [08:29:50] (03CR) 10Addshore: [C: 031] Set --parallel=2 by default [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) (owner: 10Legoktm) [09:22:35] PROBLEM - Long lived cherry-picks on puppetmaster on deployment-puppetmaster02 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [09:32:15] (03CR) 10Hashar: [C: 031] "For the few files in this repository, I don't think it matters much though it does not hurt anyway :]" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) (owner: 10Legoktm) [09:33:05] (03CR) 10Legoktm: "@Hashar: It doesn't matter much for this repo, but every other repository will inherit this as the default, which will probably make a dif" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) (owner: 10Legoktm) [09:40:41] legoktm: still around ? :) [09:40:54] legoktm: are you sure the phpcs.xml setting from tools/codesniffer get inherited? :] [09:41:03] I think so [09:41:09] I didn't test it [09:41:41] I'm also not fully awake :P [09:41:58] I can imagine :] [09:41:59] I will try [09:42:03] (03PS1) 10Hashar: parallel 2 -> 64 [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362359 [09:42:08] if it works I will just +2 your patch !!! [09:42:33] and sleep you should get! [09:45:25] PHP Fatal error: Uncaught Error: Class 'Composer\Autoload\ClassLoader' not found mediawiki/core/vendor/composer/autoload_real.php:23 [09:45:27] bah [09:46:30] hashar: that's https://phabricator.wikimedia.org/T167168 :( [09:46:59] AHHH awesome [09:47:01] thank you legoktm!! [09:47:23] and it does not seem to parallelize :( [09:48:49] :/ [09:48:51] (03CR) 10Hashar: [C: 031] "It seems like phpcs.xml is solely for that repo and is not used as a default config for consumers." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) (owner: 10Legoktm) [09:49:45] oh [09:49:47] I'm stupid [09:49:55] my patch was supposed to edit MediaWiki/ruleset.xml [09:50:01] 10MediaWiki-Codesniffer, 10Upstream: PHP_CodeSniffer 3.x breaks when prepend-autoloader: false is set (like it is in MediaWiki core) - https://phabricator.wikimedia.org/T167168#3319724 (10hashar) Got it as well with composer 1.4.1 while trying to run phpcs from mediawiki/core PHP Fatal error: Uncaught Error:... [09:50:41] ;D [09:51:06] legoktm: most probably you should have a glass of water and head to bed. You will be able to amend with a fresh mind tomorrow_ [09:51:11] ;] [09:52:22] good night :) [09:52:53] (03Restored) 10Hashar: Update slave-scripts/bin/php wrapper script to support php 7.0 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/361700 (owner: 10Paladox) [09:53:29] legoktm: good night! [10:03:56] 10MediaWiki-Releasing, 10MediaWiki-Containers, 10Services, 10User-mobrovac, 10Wikimedia-Hackathon-2015: Ready-to-use Docker package for MediaWiki - https://phabricator.wikimedia.org/T92826#3394256 (10Addshore) @mobrovac to me it generally seems like the effort there has skipped a few stages. In my mind t... [10:10:07] 10Release-Engineering-Team, 10Page-Previews, 10Reading-Web-Backlog, 10Epic: [EPIC] Generate compiled assets from continuous integration - https://phabricator.wikimedia.org/T158980#3394262 (10Jhernandez) Seems like a topic for a different card. [10:25:42] Project beta-scap-eqiad build #161908: 04FAILURE in 1 min 59 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/161908/ [10:35:49] Yippee, build fixed! [10:35:50] Project beta-scap-eqiad build #161909: 09FIXED in 2 min 12 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/161909/ [10:51:04] (03PS1) 10Hashar: browsertests: clear /log at start [integration/config] - 10https://gerrit.wikimedia.org/r/362375 [10:56:15] (03CR) 10Hashar: [C: 032] "Jobs updated" [integration/config] - 10https://gerrit.wikimedia.org/r/362375 (owner: 10Hashar) [10:58:53] (03Merged) 10jenkins-bot: browsertests: clear /log at start [integration/config] - 10https://gerrit.wikimedia.org/r/362375 (owner: 10Hashar) [11:37:55] (03PS1) 10WMDE-Fisch: Enable QUnit tests for AdvancedSearch extension [integration/config] - 10https://gerrit.wikimedia.org/r/362384 [11:47:29] (03CR) 10Hashar: [C: 032] Enable QUnit tests for AdvancedSearch extension [integration/config] - 10https://gerrit.wikimedia.org/r/362384 (owner: 10WMDE-Fisch) [11:49:15] (03Merged) 10jenkins-bot: Enable QUnit tests for AdvancedSearch extension [integration/config] - 10https://gerrit.wikimedia.org/r/362384 (owner: 10WMDE-Fisch) [12:12:45] (03PS1) 10Addshore: Add Newsletter to make-wmf-branch [tools/release] - 10https://gerrit.wikimedia.org/r/362388 (https://phabricator.wikimedia.org/T110170) [12:27:55] (03CR) 10Paladox: "recheck" [integration/jenkins] - 10https://gerrit.wikimedia.org/r/361700 (owner: 10Paladox) [12:30:43] (03PS3) 10Paladox: Update slave-scripts/bin/php wrapper script to support php 7.0 [integration/jenkins] - 10https://gerrit.wikimedia.org/r/361700 [12:33:57] (03Abandoned) 10Paladox: Add mw-config to gate-and-submit-swat pipeline [integration/config] - 10https://gerrit.wikimedia.org/r/362316 (https://phabricator.wikimedia.org/T169279) (owner: 10Paladox) [12:35:38] (03CR) 10Paladox: Migrate analytics tests from java 7 to java 8 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/361482 (owner: 10Paladox) [12:55:29] (03CR) 10Hashar: Migrate analytics tests from java 7 to java 8 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/361482 (owner: 10Paladox) [12:56:24] (03CR) 10Paladox: Migrate analytics tests from java 7 to java 8 (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/361482 (owner: 10Paladox) [13:01:01] (03PS1) 10Hashar: Cleanup localhost-cleanup JJB macro [integration/config] - 10https://gerrit.wikimedia.org/r/362405 [13:06:06] (03CR) 10Hashar: [C: 032] Whitelisting MarcoAurelio's new email address [integration/config] - 10https://gerrit.wikimedia.org/r/362261 (owner: 10MarcoAurelio) [13:07:04] (03Merged) 10jenkins-bot: Whitelisting MarcoAurelio's new email address [integration/config] - 10https://gerrit.wikimedia.org/r/362261 (owner: 10MarcoAurelio) [13:08:46] thanks hashar for merging the analytics patch :). Only realised now you merged it :) [13:14:26] (03PS1) 10Hashar: DonationInterface jobs to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/362409 [13:24:19] (03CR) 10Hashar: [C: 032] DonationInterface jobs to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/362409 (owner: 10Hashar) [13:27:38] (03Merged) 10jenkins-bot: DonationInterface jobs to Nodepool [integration/config] - 10https://gerrit.wikimedia.org/r/362409 (owner: 10Hashar) [13:35:06] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<11.11%) [13:50:13] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #444: 04FAILURE in 6 min 13 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/444/ [14:09:10] (03CR) 10Umherirrender: "To inherit it must be part of MediaWiki/ruleset.xml, not part of the phpcs.xml" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) (owner: 10Legoktm) [14:24:03] Yippee, build fixed! [14:24:03] Project selenium-VisualEditor » firefox,beta,Linux,BrowserTests build #445: 09FIXED in 2 min 40 sec: https://integration.wikimedia.org/ci/job/selenium-VisualEditor/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/445/ [14:25:12] (03PS1) 10Umherirrender: Clean up DbrQueryUsageSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362423 [14:29:19] (03PS1) 10Hashar: Remove mw-teardown-{database] macros [integration/config] - 10https://gerrit.wikimedia.org/r/362425 [14:41:57] (03CR) 10Hashar: [C: 032] Remove mw-teardown-{database] macros [integration/config] - 10https://gerrit.wikimedia.org/r/362425 (owner: 10Hashar) [14:44:31] (03Merged) 10jenkins-bot: Remove mw-teardown-{database] macros [integration/config] - 10https://gerrit.wikimedia.org/r/362425 (owner: 10Hashar) [15:00:53] 10Release-Engineering-Team (Watching / External), 10Operations, 10Goal, 10Kubernetes, and 3 others: Prepare and maintain base container images - https://phabricator.wikimedia.org/T162042#3395324 (10Joe) 05Open>03Resolved [15:01:35] hey releng folks, I have a huge favour to ask :/ I did a swat deploy yesterday of the CirrusSearch extension for an AB test on Special:Search, but it included new i18n strings, and I didn't know that required a "full scap" (I don't actually know what that does) but would anybody be willing to do a "full scap" of that extension today? on a Friday before a long weekend? [15:05:07] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<33.33%) [15:07:21] greg-g: ^ ? [15:09:13] PROBLEM - Puppet errors on deployment-cache-upload04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:10:35] ebernhardson: jan_drewniak greg-g is out until July 5th. Seems that this feature is not super visible, updates will be sync'd automagically by l10nupdate on Monday at 2am UTC -- is that acceptable? [16:12:24] Project selenium-MobileFrontend » firefox,beta,Linux,BrowserTests build #472: 04FAILURE in 50 min: https://integration.wikimedia.org/ci/job/selenium-MobileFrontend/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=BrowserTests/472/ [16:13:11] PROBLEM - Puppet errors on deployment-ms-be03 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:13:44] thcipriani: hmm, depends on jan. Its an AB test as opposed to a regular feature, so it basically means pushing back the AB test. Not the end of the world but up to jan [16:14:03] thcipriani: yeah it's just for an AB test, so we can discard the data until monday. Just to confirm with ebernhardson, that the l10nupdate update will fix the cirrus l10n? [16:14:29] if so, then that sounds fine to me :D we can just discard the data until monday, and keep the test open a bit longer [16:15:34] jan_drewniak: yes, i double checked and the i18n messages are there and deployed in the extension, the optimized cdb's used by prod just weren't updated with the data [16:16:44] ok! cool, so until monday, 1 / 2000 people might be slightly confused on Special:Search... but hopefully only slightly more confused than usual :P [16:18:00] cool, glad that works :) [16:18:21] thcipriani: thanks for the info! [16:20:34] PROBLEM - Puppet errors on deployment-ms-be04 is CRITICAL: CRITICAL: 100.00% of data above the critical threshold [0.0] [16:29:17] 10Release-Engineering-Team, 10Page-Previews, 10Reading-Web-Backlog, 10Epic: [EPIC] Generate compiled assets from continuous integration - https://phabricator.wikimedia.org/T158980#3395501 (10Jdlrobson) Sure but what would that card look like? Are we ready to work on another extension? Which extension would... [17:56:02] RainbowSprinkles: can i bug you for a minute? [17:57:11] RainbowSprinkles: well 10 max to precise [17:57:30] i want to pull the Minerva skin out of MobileFrontend and just wanted some thoughts from you around that [17:58:51] Hm [17:59:04] Nothing super special I can think of about it [18:01:59] RainbowSprinkles: so... I'm ready to go with this but a few things i wanted to check [18:02:14] 1) I'm planning to deploy the new skin in dormant mode on cluster https://phabricator.wikimedia.org/T166748 [18:02:30] once it's on the train and deployed I'm going to move the code over (it's prepared to be done in a backwards compatible way) [18:03:08] If it's in a back-compat way, wouldn't it be good to merge it and get all the code in place? [18:03:11] 2) When I started this I named the skin MinervaNeue but on hindsight I should have called it Minerva [18:03:13] https://phabricator.wikimedia.org/T164408 [18:03:13] Then we'll get l10n built, etc etc [18:03:19] Then just do the config swaps after? [18:03:44] RainbowSprinkles: I've setup i18n/CI on the MinervaNeue repo [18:03:52] You can't rename repos. [18:03:54] In Gerrit [18:04:03] so im wondering if at this point it matters about the name (the skin is called SkinMinerva not SkinMinervaNeue) [18:04:11] we can fix that later if necessary though [18:04:29] I don't think the repo name is all that consequential in the long run :) [18:04:33] (just renaming a skin causes a lot of pain because of how the skin is architected) [18:04:42] RainbowSprinkles: okay cool [18:04:58] have you got time to play with the setup if I submit some patches? [18:05:02] im just not sure what order to do it in [18:05:14] So if the repo exists, step one is make-wmf-branch [18:05:32] That way it'll be in next week's branch [18:05:45] RainbowSprinkles: okay i can definitely do that now [18:06:52] (side note any reason https://gerrit.wikimedia.org/r/361703 isnt liked by jenkins?) [18:07:26] Ah, hhvm/tidy issue from the other day, CI was borked [18:07:28] Recheck should fix [18:07:34] (03PS2) 10Jdlrobson: Remove Cards from release tools [tools/release] - 10https://gerrit.wikimedia.org/r/361703 (https://phabricator.wikimedia.org/T167452) [18:07:46] (03CR) 10Chad: "recheck" [tools/release] - 10https://gerrit.wikimedia.org/r/361703 (https://phabricator.wikimedia.org/T167452) (owner: 10Jdlrobson) [18:08:04] Hah, mid-air collision [18:08:22] (03CR) 10Chad: [C: 032] Remove Cards from release tools [tools/release] - 10https://gerrit.wikimedia.org/r/361703 (https://phabricator.wikimedia.org/T167452) (owner: 10Jdlrobson) [18:08:55] so there's that > https://gerrit.wikimedia.org/r/362447 Deploy MinervaNeue [18:09:34] +2 [18:10:51] (03Merged) 10jenkins-bot: Deploy MinervaNeue [tools/release] - 10https://gerrit.wikimedia.org/r/362447 (https://phabricator.wikimedia.org/T166748) (owner: 10Jdlrobson) [18:12:24] RainbowSprinkles: okay so now we hve https://gerrit.wikimedia.org/r/362448 Minerva is its own skin AND https://gerrit.wikimedia.org/r/358141 Minerva is its own skin [18:13:01] So next would be 358141, adding the *new* code [18:13:08] We'd want that branched & deployed first [18:13:12] Then do config swaps [18:13:14] Then land the removal [18:13:15] :) [18:13:55] so my only concern is if we have https://gerrit.wikimedia.org/r/358141 deployed and current MobileFrontend it might lead to a lot of confusion [18:14:23] Well we wouldn't *enable* it yet [18:14:26] We just want the code live [18:14:29] ahh okay that's sweet [18:14:29] So everything's primed [18:14:35] i didnt realise that was possible [18:14:49] so should i code freeze everything in MobileFrontend on the Minerva skin? [18:16:27] I mean that's safest I think. Otherwise we've got to deploy the new stuff & the removal at the same time which is a more dangerous change. [18:18:39] If it wasn't friday, I'd say let's do it all today. Hmm next week is weird too, cuz July 4th [18:18:55] shall we put something in the calendar? [18:19:03] happy to take several hours to make sure we do this properly [18:19:08] Yep, no train and no deploys mon/tues [18:19:09] i can run the script whenever we want to [18:19:28] Hmmm, so earliest would be wednesday. Still no train, so we'll need a manual branching [18:19:50] if that's okay your side, I can put some time on my calendar to make sure im around to make sure we do it as cleanly as possible [18:20:06] i need to send an email to wikitech anyhow [18:20:13] just to make sure people are cool with the plan [18:20:24] so doesnt need to be next week if that's too rushed [18:24:16] Maybe week after then [18:24:28] I guess don't bother freezing yet then [18:24:42] Although no changes will go out between now and then anyway :p [18:25:45] RainbowSprinkles: so wednesday 12th? [18:26:15] can we do the first merge that day and then deploy? [18:27:49] RainbowSprinkles: is my understanding corredct? https://etherpad.wikimedia.org/p/minervabigswitcheroo [18:29:21] Yeah [18:29:30] woot. so we can do all of that wednesday? [18:29:34] I mean we could do the merge + deploy today, but that increases your freeze time [18:29:41] nah dont worry it can wait [18:29:42] Or, just do that like wed/thur [18:29:44] That's easy [18:29:47] i'd rather do the switch in one big go [18:29:52] ill schedule some time on calendar [18:29:59] Mmk [18:29:59] what time wed/thur? [18:30:10] i guess we need to talk to greg-g too? [18:30:28] Nah, I'm pretend-greg this week :) [18:30:37] Find some open time and put on calendar and we're good [18:31:13] I like using the time before the train, rather than after (in case that runs long) [18:31:19] But whatever works for you [18:35:19] RainbowSprinkles: by calendar do you mean google calendar or a wiki page somewhere? [18:35:50] [[wikitech:Deployments]] :) [18:36:19] cool gonna do both cause i need it in my gcal so i dont forget :) [18:36:48] RainbowSprinkles: there's a swat right before train [18:36:54] can we use that or before that even? [18:36:58] We can commandeer that swat :p [18:40:45] ill schedule for 10am so we can have 2hrs if neeeded? sound good? [18:44:44] RainbowSprinkles: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_July_10th [18:44:50] any preference on time for Thursday? same again? [19:08:08] jdlrobson: Sounds good [19:42:03] RainbowSprinkles or twentyafterfour hi, could you replicate this https://gerrit.wikimedia.org/r/#/admin/projects/operations/software/servermon repo to diffusion and github please? [20:17:08] paladox: Done [20:19:17] thanks [20:19:18] :) [20:51:03] inquiry: who do I have to push around to get TemplateStyles in production? [20:51:11] (not this upcoming week, I know, I mean in general) [20:55:06] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<11.11%) [21:35:07] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<11.11%) [21:43:20] Working on that ^ [21:43:43] Cheers! [21:48:25] thcipriani: We should work on that "do git gc stuff sometimes" project we kept tossing about [21:48:31] The repos on deployment-tin are huge [21:48:45] taking up most of the junk space [21:55:56] Oh another question I had RainbowSprinkles: where do the releng servers live? are they considered part of Wikimedia Cloud Services? [21:55:59] RainbowSprinkles: indeed. I think all the bits and pieces are there. [21:56:18] harej: Releng servers? You mean Beta? [21:56:29] That's all hosted in cloud vms, yes. As are jenkins slaves [21:56:43] Okay. [21:56:46] But we have a bunch of production hardware too (jenkins master, gerrit + slave, phabricator + slave) [21:59:11] thcipriani: Other problem with space: we have hundreds of extensions we'll never deploy [21:59:16] tbh, we should have the same list as prod [21:59:31] code is on there != enabled :) [21:59:49] yarp. extensions repo is giant [22:00:20] Need to clean up the deploy process :\ [22:00:22] To beta [22:00:38] My todo list is close to a buffer overflow :( [22:01:46] /srv/mediawiki is 20gb [22:01:54] I want to repack that repo, but it broke when I tried [22:01:58] Too big for the VM to handle [22:02:01] damn [22:02:02] OOM? [22:10:07] PROBLEM - Free space - all mounts on deployment-tin is CRITICAL: CRITICAL: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deployment-prep.deployment-tin.diskspace._srv.byte_percentfree (<11.11%) [22:12:18] Delta compression using up to 8 threads. [22:12:18] error: pack-objects died of signal 92580) [22:12:18] error: failed to run repack [22:12:19] :\ [22:19:45] (03PS2) 10Legoktm: Set --parallel=2 by default [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) [22:20:52] (03CR) 10Legoktm: "Sorry, I wasn't awake when I wrote this apparently. I meant to add it to MediaWiki/ruleset.xml. Done now." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362325 (https://phabricator.wikimedia.org/T169189) (owner: 10Legoktm) [22:28:15] (03CR) 10Legoktm: [C: 032] "Nice find :)" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362423 (owner: 10Umherirrender) [22:30:03] (03Merged) 10jenkins-bot: Clean up DbrQueryUsageSniff [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/362423 (owner: 10Umherirrender) [23:08:22] 10Continuous-Integration-Infrastructure, 10Fundraising Tech Backlog, 10Scrum-of-Scrums, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Continuous integration - CiviCRM - https://phabricator.wikimedia.org/T78100#3396507 (10Ejegg)