[00:13:47] 10Release-Engineering-Team (Code Health), 10Release-Engineering-Team-TODO, 10wikimedia.biterg.io, 10Code-Health: Develop canonical/single record of origin, machine readable list of all repos deployed to WMF sites. - https://phabricator.wikimedia.org/T190891 (10Jrbranaa) Recently had a discussion with @mark... [00:21:22] Resource type not found: Wmflib::Service at /etc/puppet/modules/wmflib/functions/service/fetch.pp:4:51 [00:21:43] anyone know how that is possible? it's clearly defined in modules/wmflib/types/service.pp [06:49:42] Hello, beta-mediawiki-config-update-eqiad is stuck again [07:00:19] Can we investigate which this constantly happens? [07:00:23] *why this [07:00:47] I'm going in school now, bye :) [07:00:49] * Zoranzoki21 waves [07:58:59] 10Continuous-Integration-Infrastructure: CI tests fequently fail for BlueSpiceVisualEditorConnector extension - https://phabricator.wikimedia.org/T247053 (10Osnard) [07:59:24] 10Continuous-Integration-Infrastructure: CI tests fequently fail for BlueSpiceVisualEditorConnector extension - https://phabricator.wikimedia.org/T247053 (10Osnard) [08:20:32] 10Continuous-Integration-Infrastructure: CI tests frequently fail for BlueSpiceVisualEditorConnector extension - https://phabricator.wikimedia.org/T247053 (10Osnard) [08:43:10] (03CR) 10DCausse: [C: 03+1] "thanks!" [releng/dev-images] - 10https://gerrit.wikimedia.org/r/576327 (https://phabricator.wikimedia.org/T231864) (owner: 10Kosta Harlan) [09:08:46] (03CR) 10Hashar: [C: 03+2] "That has been fixed by Pwirth :)" [integration/config] - 10https://gerrit.wikimedia.org/r/576654 (https://phabricator.wikimedia.org/T246877) (owner: 10Hashar) [09:09:40] (03Merged) 10jenkins-bot: BlueSpicePermissionManager: enable tests [integration/config] - 10https://gerrit.wikimedia.org/r/576654 (https://phabricator.wikimedia.org/T246877) (owner: 10Hashar) [09:10:10] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable CI on BlueSpicePermissionManager - https://phabricator.wikimedia.org/T246877 (10hashar) 05Open→03Resolved a:03hashar [09:10:25] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable CI on BlueSpicePermissionManager - https://phabricator.wikimedia.org/T246877 (10hashar) [09:10:30] 10Continuous-Integration-Config, 10BlueSpice, 10Patch-For-Review: Enable unit tests on BlueSpice* repos - https://phabricator.wikimedia.org/T130811 (10hashar) [10:01:26] 10Continuous-Integration-Config, 10Pywikibot, 10Pywikibot-tests: Jenkins output for pywikibot job is hard to read - https://phabricator.wikimedia.org/T117570 (10Xqt) I think sth like ` 10:56:08 flake8-py27 run-test: commands[0] | flake8 --doctests 10:56:08 [173] /src$ /src/.tox/flake8-py27/bin/flake8 --doct... [10:39:09] 10Project-Admins: Create a wmfdata-python project - https://phabricator.wikimedia.org/T247060 (10nshahquinn-wmf) [10:39:39] 10Continuous-Integration-Config, 10Pywikibot, 10Pywikibot-tests: Jenkins output for pywikibot job is hard to read - https://phabricator.wikimedia.org/T117570 (10Dvorapa) But it is hard to find in the log. The example in description is also easy to read, but it takes a while to find the issue [10:59:30] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) >>! In T238658#5946564, @Ottomata wrote: > FYI grafana dash here: > > https://grafana.wikimed... [11:02:09] 10Gerrit, 10Analytics, 10Gerrit-Privilege-Requests, 10User-MarcoAurelio: Give access to Wikistats 2 to l10n-bot - https://phabricator.wikimedia.org/T245805 (10MarcoAurelio) 05Open→03Resolved Working smoothly now: https://gerrit.wikimedia.org/r/#/c/analytics/wikistats2/+/577291/ - Closed. [11:04:41] 10Gerrit, 10Analytics, 10Gerrit-Privilege-Requests, 10User-MarcoAurelio: Give access to Wikistats 2 to l10n-bot - https://phabricator.wikimedia.org/T245805 (10fdans) This is great, thank you @MarcoAurelio !! [11:06:21] (03PS1) 10MarcoAurelio: Allow automated translatewiki.net translation updates [services/mobileapps] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/577533 (https://phabricator.wikimedia.org/T246978) [11:09:21] (03CR) 10Joewalsh: [C: 03+2] Allow automated translatewiki.net translation updates [services/mobileapps] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/577533 (https://phabricator.wikimedia.org/T246978) (owner: 10MarcoAurelio) [11:09:59] 10Gerrit, 10Gerrit-Privilege-Requests, 10Patch-For-Review, 10User-MarcoAurelio: Give access to l10n-bot on mediawiki/services/mobileapps.git - https://phabricator.wikimedia.org/T246978 (10MarcoAurelio) p:05Triage→03Medium a:03MarcoAurelio [11:11:03] 10Beta-Cluster-Infrastructure: "Unable to store text to external storage" on betacommons - https://phabricator.wikimedia.org/T247066 (10AlexisJazz) [11:11:23] 10Beta-Cluster-Infrastructure: "Unable to store text to external storage" on betacommons - https://phabricator.wikimedia.org/T247066 (10AlexisJazz) [11:12:00] (03CR) 10MarcoAurelio: "You need to manually V+2 and Submit; jenkins do not operate on refs/meta/config branches." [services/mobileapps] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/577533 (https://phabricator.wikimedia.org/T246978) (owner: 10MarcoAurelio) [11:12:30] (03CR) 10MarcoAurelio: [V: 03+2] Allow automated translatewiki.net translation updates [services/mobileapps] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/577533 (https://phabricator.wikimedia.org/T246978) (owner: 10MarcoAurelio) [11:15:19] (03CR) 10Joewalsh: [V: 03+2 C: 03+2] Allow automated translatewiki.net translation updates [services/mobileapps] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/577533 (https://phabricator.wikimedia.org/T246978) (owner: 10MarcoAurelio) [11:16:22] 10Release-Engineering-Team-TODO, 10Scap, 10MediaWiki-Internationalization, 10Performance-Team, 10Patch-For-Review: Use static php array files for l10n cache at WMF (instead of CDB) - https://phabricator.wikimedia.org/T99740 (10AlexisJazz) >>! In T99740#5945879, @ori wrote: >>>! In T99740#5945217, @Alexis... [11:16:30] 10Gerrit, 10Gerrit-Privilege-Requests, 10User-MarcoAurelio: Give access to l10n-bot on mediawiki/services/mobileapps.git - https://phabricator.wikimedia.org/T246978 (10MarcoAurelio) [11:16:32] 10Gerrit, 10Gerrit-Privilege-Requests, 10User-MarcoAurelio: Give access to l10n-bot on mediawiki/services/mobileapps.git - https://phabricator.wikimedia.org/T246978 (10MarcoAurelio) 05Open→03Resolved [11:18:13] 10Continuous-Integration-Config: Please add mediawiki-i18n-check-docker to repository mediawiki/services/mobileapps - https://phabricator.wikimedia.org/T246979 (10JoeWalsh) 05Open→03Resolved a:03JoeWalsh [11:29:11] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10MediaWiki-Docker, 10User-brennen: TimedMediaHandler's ffmpeg processes get stuck when using resource limits on Docker image - https://phabricator.wikimedia.org/T246942 (10kostajh) `lang=php $wgMaxShellMemory = 0; $wgMaxShellFileSize = 0; $wgMaxShel... [11:32:50] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10MediaWiki-Docker, 10User-brennen: TimedMediaHandler's ffmpeg processes get stuck when using resource limits on Docker image - https://phabricator.wikimedia.org/T246942 (10kostajh) Actually, maybe these make sense to go in DevelopmentSettings.php? W... [11:59:08] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Configure ssh client config properly - https://phabricator.wikimedia.org/T247074 (10LarsWirzenius) [11:59:21] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Configure ssh client config properly - https://phabricator.wikimedia.org/T247074 (10LarsWirzenius) p:05Triage→03Medium [11:59:33] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) @Ottomata merged and pooled 1 kubernetes host with a very low weight (1) in the pool and that o... [12:05:52] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Train Deployments: Write script to apply security patches - https://phabricator.wikimedia.org/T247075 (10LarsWirzenius) [12:06:04] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Train Deployments: Write script to apply security patches - https://phabricator.wikimedia.org/T247075 (10LarsWirzenius) p:05Triage→03Medium [12:11:22] 10Beta-Cluster-Infrastructure, 10MediaWiki-Revision-backend: "Unable to store text to external storage" on betacommons - https://phabricator.wikimedia.org/T247066 (10Aklapper) [12:23:37] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Train Deployments: Script dropping of old staging branches for train - https://phabricator.wikimedia.org/T247076 (10LarsWirzenius) [12:24:00] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Train Deployments: Script dropping of old staging branches for train - https://phabricator.wikimedia.org/T247076 (10LarsWirzenius) p:05Triage→03Medium [12:29:04] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10fgiunchedi) >>! In T238658#5947574, @akosiaris wrote: >>>! In T238658#5946564, @Ottomata wrote: >> FYI gra... [13:10:08] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Urbanecm) [13:12:27] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Urbanecm) p:05Triage→03Unbreak! [13:12:52] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Lucas_Werkmeister_WMDE) The whole Beta cluster? Well, not entirely… one small indomitable page still holds out— Jokes aside – [our Data Bridge test page](http... [13:14:03] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Urbanecm) >>! In T247078#5948126, @Lucas_Werkmeister_WMDE wrote: > The whole Beta cluster? Well, not entirely… one small indomitable page still holds out— > >... [13:14:48] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Dvorapa) en.wikisource.beta.wmflabs.org fails too [13:15:22] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Lucas_Werkmeister_WMDE) Curious – the other wiki I tested was https://de.wikipedia.beta.wmflabs.org/, and that one’s fine. Random guess: English version of “m... [13:16:52] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Urbanecm) >>! In T247078#5948133, @Lucas_Werkmeister_WMDE wrote: > Curious – the other wiki I tested was https://de.wikipedia.beta.wmflabs.org/, and that one’s... [13:18:04] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Lucas_Werkmeister_WMDE) > Random guess: English version of “mainpage” message points to Wikidata for some reason, that’s why the German wiki is unaffected? Bu... [13:20:49] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Dvorapa) Weeeeird: https://de.wikitionary.beta.wmflabs.org/ point to https://en.wikipedia.org/wiki/Hauptseite [13:20:53] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Urbanecm) [13:22:03] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Lucas_Werkmeister_WMDE) >>! In T247078#5948140, @Dvorapa wrote: > Weeeeird: https://de.wiktionary.beta.wmflabs.org/ points to https://en.wikipedia.org/wiki/Hau... [13:26:04] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Dvorapa) Per https://wikidata.beta.wmflabs.org/wiki/Special:SiteMatrix: en and simple content wikis + commons, deployment, meta and test: https://www.wikidata... [13:33:10] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Lucas_Werkmeister_WMDE) > It's interesting that shell.php and `Title::newMainPage()` knows where the main page is. > > ` > urbanecm@deployment-deploy01:~$ mw... [13:33:52] (03PS4) 10Daimona Eaytoy: dockerfiles: coverage: add pcov, use it if we're on PHPUnit 8+ [integration/config] - 10https://gerrit.wikimedia.org/r/567938 (https://phabricator.wikimedia.org/T234020) [13:34:16] 10Beta-Cluster-Infrastructure: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 (10Urbanecm) But yet this seems to be an error within MediaWiki... Internal request from a beta appserver fails too, https://wikitech.wikimedia.org/wiki/Debugging... [13:50:32] !log Live debugging T247078 on deployment-mediawiki-07 [13:50:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:50:34] T247078: Whole beta cluster is redirected to https://www.wikidata.org/wiki/Main_Page - https://phabricator.wikimedia.org/T247078 [13:52:55] 10Beta-Cluster-Infrastructure: Main pages of several Beta Cluster wikis redirect to other production wikis - https://phabricator.wikimedia.org/T247078 (10Lucas_Werkmeister_WMDE) [14:03:27] 10Beta-Cluster-Infrastructure: Main pages of several Beta Cluster wikis redirect to other production wikis - https://phabricator.wikimedia.org/T247078 (10Urbanecm) I was live-debugging this with enwiki beta. Few notes: * As-of `includes/MediaWiki.php:123`, `$ret->getInterwiki()` equals `wikidata`. That explains... [14:17:36] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Zuul, 10Patch-For-Review: Convert zuul to use scap - https://phabricator.wikimedia.org/T215458 (10mmodell) The first issue I see is... [14:18:24] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) Ping @colewhite on all the service runner prometheus stuff above in the last 2 comments! :) Re... [14:37:25] 10Beta-Cluster-Infrastructure: Main pages of several Beta Cluster wikis redirect to other production wikis - https://phabricator.wikimedia.org/T247078 (10Urbanecm) Tried to add `$entry = null` after `includes/cache/MessageCache.php:1085` to stop all rogue cache keys from interfering. That fixed the immediate iss... [14:37:33] !log Live debugging T247078 on deployment-mediawiki-07 ended [14:37:36] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:37:36] T247078: Main pages of several Beta Cluster wikis redirect to other production wikis - https://phabricator.wikimedia.org/T247078 [15:00:57] 10Beta-Cluster-Infrastructure: Add vi to langlist-labs - https://phabricator.wikimedia.org/T247091 (10Dvorapa) [15:04:23] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Add vi to langlist-labs - https://phabricator.wikimedia.org/T247091 (10Reedy) I did already update the interwiki for labs and it looks about right... https://github.com/wikimedia/operations-mediawiki-config/commit/83887cf3a58c8027ad68676cfe822d2bceeb788d [15:05:30] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Add vi to langlist-labs - https://phabricator.wikimedia.org/T247091 (10Dvorapa) >>! In T247091#5948543, @Reedy wrote: > I did already update the interwiki for labs and it looks about right... https://github.com/wikimedia/operations-mediawiki-config/commit/8388... [15:05:55] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Add vi to langlist-labs - https://phabricator.wikimedia.org/T247091 (10Reedy) SiteMatrix is obviously wrong (and the above will correct) [15:06:45] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Add vi to langlist-labs - https://phabricator.wikimedia.org/T247091 (10Dvorapa) Yeah, it should be solved by the patch. [15:07:00] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Add vi to langlist-labs - https://phabricator.wikimedia.org/T247091 (10Dvorapa) [15:13:22] 10Beta-Cluster-Infrastructure, 10Patch-For-Review, 10good first task: en-rtl listed under other projects on beta.wmflabs.org - https://phabricator.wikimedia.org/T195675 (10Dvorapa) Hmm en-rtl seems to have its name missing in https://wikidata.beta.wmflabs.org/wiki/Special:SiteMatrix. Does the patch (https://... [15:14:11] !log unstuck beta auto deploy jobs [15:14:12] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:17:09] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) > merged and pooled 1 kubernetes host with a very low weight (1) in the pool and that on just in... [15:32:12] PROBLEM - SSH on deployment-echostore01 is CRITICAL: (Service Check Timed Out) [15:34:30] Reedy: Thanks. [15:37:00] RECOVERY - SSH on deployment-echostore01 is OK: SSH OK - OpenSSH_7.4p1 Debian-10+deb9u7 (protocol 2.0) [15:37:55] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Analytics: Migrate analytics/refinery/source release jobs to Docker - https://phabricator.wikimedia.org/T210271 (10hashar) @JAllemandou I guess we should pair o... [15:42:01] !log contint1001: docker image prune -f [15:42:02] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [15:58:39] PROBLEM - Host deployment-logstash03 is DOWN: CRITICAL - Host Unreachable (172.16.1.184) [16:20:34] RECOVERY - Host deployment-logstash03 is UP: PING OK - Packet loss = 0%, RTA = 0.75 ms [16:42:42] 10Beta-Cluster-Infrastructure: dumpInterwiki seems to be broken for beta - https://phabricator.wikimedia.org/T247097 (10Reedy) [16:46:19] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: dumpInterwiki is using prod lists in labs, labs lists in prod - https://phabricator.wikimedia.org/T247097 (10Reedy) p:05Triage→03High [16:46:45] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-WikimediaMaintenance, 10Patch-For-Review: dumpInterwiki is using prod lists in labs, labs lists in prod - https://phabricator.wikimedia.org/T247097 (10Reedy) [16:46:54] gj Krinkle and James_F :P [16:47:30] Reedy: Joy. [16:47:39] Fix is simple, patch is up [16:48:48] Reedy: shit, thank you [16:49:17] heh [16:49:21] hm, could this be the cause of T247097? [16:49:22] T247097: dumpInterwiki is using prod lists in labs, labs lists in prod - https://phabricator.wikimedia.org/T247097 [16:49:25] oops [16:49:26] Reedy: I gather from the diff that it hadn't been run yet for realz? [16:49:27] of T247078? [16:49:28] T247078: Main pages of several Beta Cluster wikis redirect to other production wikis - https://phabricator.wikimedia.org/T247078 [16:49:41] Lucas_WMDE: I don't think we'd run it yet, so no. [16:49:44] ok [16:49:58] Krinkle: Nope. I'd just tried to run it and was wtf-ing at the diff [16:50:11] This is a good reason to stop using the scap plugin like we are in prod. [16:50:18] It's a disaster waiting to happen [17:03:20] Most of scap is a disaster waiting to happen. [17:03:33] Containerisation with final built artefacts would avoid this, too. [17:08:04] 10Release-Engineering-Team, 10serviceops, 10Core Platform Team Workboards (Clinic Duty Team): Enable phpdbg on mwdebug* servers - https://phabricator.wikimedia.org/T244549 (10hnowlan) Good to see. If there's more that can be done on my end please feel free to re-open, I was a little quick to close this one o... [17:18:25] (03PS1) 10Bstorm: jjb: test pipeline for cloud/toolforge/ingress-admission-controller [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) [17:19:48] (03CR) 10jerkins-bot: [V: 04-1] jjb: test pipeline for cloud/toolforge/ingress-admission-controller [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [17:28:52] 10Scap: Temporarily disable 'scap update-interwiki-cache' - https://phabricator.wikimedia.org/T247107 (10Krinkle) [17:28:59] 10Scap: Temporarily disable 'scap update-interwiki-cache' - https://phabricator.wikimedia.org/T247107 (10Krinkle) [17:29:06] 10Release-Engineering-Team-TODO, 10Scap: Temporarily disable 'scap update-interwiki-cache' - https://phabricator.wikimedia.org/T247107 (10Krinkle) [17:32:53] Reedy: you deploying btw? [17:33:17] oh it's already done [17:33:23] aa, scroll buffer was stuck darn [17:36:24] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Replace integration-trigger-01 with running the dummy job on contint1001 agent - https://phabricator.wikimedia.org/T247109 (10Jdforrester-W... [17:36:59] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Cloud-VPS (Debian Jessie Deprecation): "integration" Cloud VPS project jessie deprecation - https://phabricator.wikimedia.org/T236576 (... [17:37:49] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Replace integration-trigger-01 with running the dummy job on contint1001 agent - https://phabricator.wikimedia.org/T247109 (10Jdforrester-W... [17:38:24] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Toolforge, and 3 others: Add CI checks for golang admission controllers - https://phabricator.wikimedia.org/T236203 (10Bstorm) @dduvall Presuming my patches are... [17:45:53] (03CR) 10Jforrester: [C: 04-1] jjb: Make mwext-doxygen-publish publish to DOC_PROJECT not DOC_BASENAME [integration/config] - 10https://gerrit.wikimedia.org/r/574563 (https://phabricator.wikimedia.org/T246042) (owner: 10Jforrester) [17:47:53] PROBLEM - Parsoid on deployment-mediawiki-parsoid10 is CRITICAL: connect to address 172.16.0.141 and port 8000: Connection refused [17:48:15] (03CR) 10Hashar: [C: 04-1] "+1 on the general idea!" (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/574563 (https://phabricator.wikimedia.org/T246042) (owner: 10Jforrester) [17:50:50] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Toolforge, and 3 others: Add CI checks for golang admission controllers - https://phabricator.wikimedia.org/T236203 (10Bstorm) The docs definitely got me further... [17:52:29] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10CirrusSearch, and 3 others: Add a PHPUnit group to skip test on gated CI runs - https://phabricator.wikimedia.org/T225068 (10hashar) >>! In T225068#5247536, @Jdforrester-WMF wrote: > OK,... [18:00:07] 10Continuous-Integration-Config, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10BlueSpice: BlueSpice related tests fails on gate-and-submit-1.31 in quibble-composer tests - https://phabricator.wikimedia.org/T235807 (10hashar) Sorry that took time. I talked about this with James. +1 on the `--f... [18:00:12] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10colewhite) I created a [[ https://github.com/wikimedia/service-runner/pull/225 | PR to service-runner for... [18:03:39] 10Continuous-Integration-Config, 10tox-wikimedia, 10Test-Coverage: Standardize way to publish test coverage for Python projects in CI - https://phabricator.wikimedia.org/T244650 (10Jdforrester-WMF) WFM. [18:04:38] 10Continuous-Integration-Config, 10tox-wikimedia, 10Test-Coverage: Standardize way to publish test coverage for Python projects in CI - https://phabricator.wikimedia.org/T244650 (10hashar) To prevent running all the other tools, we can standardize on a specific tox environment that would be common to all rep... [18:05:06] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Configure ssh client config properly - https://phabricator.wikimedia.org/T247074 (10LarsWirzenius) http://git.liw.fi/wmf-ssh-config/ is the test suite, http://git.liw.fi/liw-dot-files/tree/ssh/ is the config. Works for me now. Might be generalizable for... [18:05:15] 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Configure ssh client config properly - https://phabricator.wikimedia.org/T247074 (10LarsWirzenius) 05Open→03Resolved [18:10:02] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Toolforge, and 3 others: Add CI checks for golang admission controllers - https://phabricator.wikimedia.org/T236203 (10Bstorm) Interestingly, I got this from CI... [18:11:59] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Zuul, 10Patch-For-Review: Convert zuul to use scap - https://phabricator.wikimedia.org/T215458 (10hashar) Eek. I guess we can try wi... [18:14:27] (03PS2) 10Bstorm: jjb: test pipeline for cloud/toolforge/ingress-admission-controller [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) [18:16:07] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Toolforge, and 3 others: Add CI checks for golang admission controllers - https://phabricator.wikimedia.org/T236203 (10Bstorm) I added: ` gate-and-submit:... [18:22:28] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Toolforge, and 3 others: Add CI checks for golang admission controllers - https://phabricator.wikimedia.org/T236203 (10hashar) What is written on the can: test_p... [18:22:51] ^ bstorm_ i'll have a closely look shortly but: right on! [18:22:55] er closer [18:23:23] Thanks! [18:23:48] 10Scap, 10MediaWiki-Debug-Logger, 10Performance-Team, 10observability, 10Developer Productivity: Standardise on Logstash channel for fatal exceptions (fatal, exception, DeferredUpdates) - https://phabricator.wikimedia.org/T247113 (10Krinkle) [18:24:58] (03PS1) 10Jforrester: Add new command, phpunit-standalone, for phpunit --group Standalone [integration/quibble] - 10https://gerrit.wikimedia.org/r/577638 (https://phabricator.wikimedia.org/T225068) [18:25:08] (03CR) 10Hashar: [C: 04-1] jjb: test pipeline for cloud/toolforge/ingress-admission-controller (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:25:41] (03CR) 10jerkins-bot: [V: 04-1] Add new command, phpunit-standalone, for phpunit --group Standalone [integration/quibble] - 10https://gerrit.wikimedia.org/r/577638 (https://phabricator.wikimedia.org/T225068) (owner: 10Jforrester) [18:27:51] (03CR) 10Dduvall: jjb: test pipeline for cloud/toolforge/ingress-admission-controller (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:28:48] (03PS3) 10Bstorm: jjb: test pipeline for cloud/toolforge/ingress-admission-controller [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) [18:29:47] 10Phabricator, 10Developer-Advocacy (Jan-Mar 2020): Decrease issues with assignee field set for years without progress (aka cookie licking) - https://phabricator.wikimedia.org/T228575 (10bd808) >>! In T228575#5944466, @Aklapper wrote: > I'm not sure yet how I can create and send 294 emails in an efficient way.... [18:30:17] (03CR) 10Bstorm: "Like that?" [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:36:50] (03CR) 10Dduvall: [C: 04-1] jjb: test pipeline for cloud/toolforge/ingress-admission-controller (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:37:22] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Script dropping of old staging branches for train - https://phabricator.wikimedia.org/T247076 (10greg) [18:37:34] 10Release-Engineering-Team, 10serviceops, 10Core Platform Team Workboards (Clinic Duty Team): Enable phpdbg on mwdebug* servers - https://phabricator.wikimedia.org/T244549 (10EBernhardson) Further improvements are probably not really an SRE thing. Essentially, use of `../../../home/ebernhardson/test.php`, es... [18:37:37] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Write script to apply security patches - https://phabricator.wikimedia.org/T247075 (10greg) [18:39:35] (03CR) 10Krinkle: jjb: Make mwext-doxygen-publish publish to DOC_PROJECT not DOC_BASENAME (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/574563 (https://phabricator.wikimedia.org/T246042) (owner: 10Jforrester) [18:40:52] (03PS2) 10Jforrester: Add new command, phpunit-standalone, for phpunit --group Standalone [integration/quibble] - 10https://gerrit.wikimedia.org/r/577638 (https://phabricator.wikimedia.org/T225068) [18:43:54] (03PS4) 10Bstorm: jjb: test pipeline for cloud/toolforge/ingress-admission-controller [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) [18:44:51] (03CR) 10Bstorm: jjb: test pipeline for cloud/toolforge/ingress-admission-controller (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:48:18] (03CR) 10Dduvall: [C: 03+1] "LGTM so far. I'll generate the jobs." [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:49:23] 10Scap, 10MediaWiki-Debug-Logger, 10Performance-Team, 10observability, and 2 others: Standardise on Logstash channel for fatal exceptions (fatal, exception, DeferredUpdates) - https://phabricator.wikimedia.org/T247113 (10Krinkle) [18:51:57] (03PS2) 10Jforrester: jjb: Make mwext-doxygen-publish publish to DOC_PROJECT not DOC_BASENAME [integration/config] - 10https://gerrit.wikimedia.org/r/574563 (https://phabricator.wikimedia.org/T246042) [18:52:08] !log creating 2 jobs for https://gerrit.wikimedia.org/r/c/integration/config/+/577626 [18:52:09] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:52:59] (03CR) 10Jforrester: jjb: Make mwext-doxygen-publish publish to DOC_PROJECT not DOC_BASENAME (033 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/574563 (https://phabricator.wikimedia.org/T246042) (owner: 10Jforrester) [18:53:05] (03CR) 10Dduvall: [C: 03+2] "INFO:jenkins_jobs.builder:Number of jobs generated: 2" [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:53:59] (03Merged) 10jenkins-bot: jjb: test pipeline for cloud/toolforge/ingress-admission-controller [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [18:56:49] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/577626 [18:56:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:57:54] bstorm_: deployed! now let's see how that .pipeline/config.yaml fares [18:58:01] heh :) [18:58:49] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10CirrusSearch, and 4 others: Add a PHPUnit group to skip test on gated CI runs - https://phabricator.wikimedia.org/T225068 (10Jdforrester-WMF) a:03Jdforrester-WMF [19:00:02] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10serviceops, 10Test-Coverage: Add pcov PHP extension to wikimedia apt so it can be used in Wikimedia CI - https://phabricator.wikimedia.org/T243847 (10Daimona) Alternatively, can we pull... [19:00:22] bstorm_: so far so good https://integration.wikimedia.org/ci/blue/organizations/jenkins/toolforge-ingress-admission-controller-pipeline-test/detail/toolforge-ingress-admission-controller-pipeline-test/1/pipeline [19:01:01] yay! [19:01:54] success! [19:03:35] bstorm_: awesome. thanks for being our first guide user. does the blubber config and pipeline config make sense? [19:03:56] Thanks for bearing with me on it. [19:04:06] I think so. [19:04:13] Mine is a very simple use case, of course :) [19:04:28] right. that's true [19:04:31] I'll set it up for the other repo now...which will probably have a nearly identical config. [19:05:28] Thanks! [19:05:41] the basic pattern is: 1) define how to package up your application and its various test runners with blubber variants; 2) orchestrate the building and running of those variants with pipeline/config.yaml [19:05:55] !log Manually pushing trigger-helloworldoid-pipeline-test over to contint1001 to test T247109 [19:05:57] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:05:57] T247109: Replace integration-trigger-01 with running the dummy job on contint1001 agent - https://phabricator.wikimedia.org/T247109 [19:06:02] Yeah, that makes sense [19:06:08] the more you reuse configuration in blubber between variants, the better the caching will be [19:06:29] That's handy [19:06:34] and of course you can do parallel execution in .pipeline/config.yaml using the `execution` graph configuration [19:06:54] if that's useful for the project [19:08:01] (03PS1) 10Jforrester: jjb: Run trigger jobs on contint1001 agent directly [integration/config] - 10https://gerrit.wikimedia.org/r/577647 (https://phabricator.wikimedia.org/T247109) [19:09:20] (03CR) 10Jforrester: [C: 03+2] "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/577647 (https://phabricator.wikimedia.org/T247109) (owner: 10Jforrester) [19:09:43] bstorm_: btw, next golang study group i'll be talking more about blubber, how it works currently, how it could be improved for future use. i meant to do that last session but unfortunately personal events got in the way [19:10:08] Maybe I should go to it then :) [19:10:13] I've been missing it [19:10:20] (03Merged) 10jenkins-bot: jjb: Run trigger jobs on contint1001 agent directly [integration/config] - 10https://gerrit.wikimedia.org/r/577647 (https://phabricator.wikimedia.org/T247109) (owner: 10Jforrester) [19:11:45] that'd be great. i'm really interested to hear your thoughts about it. iirc, bd808 mentioned something at all hands about wmcs exploring other image building options? would be great to collaborate since we're working in the same problem space with the deployment pipeline [19:12:28] same problem space, very different requirements :) [19:12:30] i actually messed around with blubber as a buildkit frontend a while back [19:12:39] and that's the future path i'm seeing for it [19:13:00] bd808: absolutely. but perhaps there's a common pattern in there somewhere [19:14:02] https://gerrit.wikimedia.org/r/c/blubber/+/504651 [19:14:04] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Replace integration-trigger-01 with running the dummy job on contint1001 agent - https://phabricator.wikimedia.org/T247109 (10Jdforrester-W... [19:14:07] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Cloud-VPS (Debian Jessie Deprecation): "integration" Cloud VPS project jessie deprecation - https://phabricator.wikimedia.org/T236576 (... [19:24:22] (03PS1) 10Bstorm: jjb: test pipeline for labs/tools/registry-admission-webhook [integration/config] - 10https://gerrit.wikimedia.org/r/577653 (https://phabricator.wikimedia.org/T236203) [19:26:56] Could be, definitely [19:28:09] (03CR) 10Dduvall: [C: 04-1] "Just one nit about trailing whitespace. Otherwise LGTM." (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/577653 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [19:33:41] !log creating 2 jenkins jobs for https://gerrit.wikimedia.org/r/c/integration/config/+/577653 [19:33:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:36:54] (03PS2) 10Dduvall: jjb: test pipeline for labs/tools/registry-admission-webhook [integration/config] - 10https://gerrit.wikimedia.org/r/577653 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [19:37:16] (03CR) 10Dduvall: [C: 03+2] "INFO:jenkins_jobs.builder:Number of jobs generated: 2" [integration/config] - 10https://gerrit.wikimedia.org/r/577653 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [19:38:06] (03Merged) 10jenkins-bot: jjb: test pipeline for labs/tools/registry-admission-webhook [integration/config] - 10https://gerrit.wikimedia.org/r/577653 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [19:40:18] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/577653 [19:40:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:40:45] 10Continuous-Integration-Infrastructure (Slipway), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO, 10Release Pipeline, 10Wikimedia-Portals: Migrate wikimedia-portals-build to Docker container - https://phabricator.wikimedia.org/T213806 (10Jdforrester-WMF) We're now re... [19:40:56] (03CR) 10Dduvall: "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/577653 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [19:41:45] (03CR) 10Dduvall: "Deployed." [integration/config] - 10https://gerrit.wikimedia.org/r/577626 (https://phabricator.wikimedia.org/T236203) (owner: 10Bstorm) [19:44:11] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Wikidata, 10Wikidata-Query-Service: Migrate wikidata-query-rdf-release-silent release job to Docker - https://phabricator.wikimedia.org/T247123 (10Jdforrester-WMF) [19:44:17] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Wikidata, 10Wikidata-Query-Service: Migrate wikidata-query-rdf-release-silent release job to Docker - https://phabricator.wikimedia.org/T247123 (10Jdforrester-WMF) We're now reaching crunch time for removing Jessie instances, so in a week's time I... [19:49:26] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Replace integration-trigger-01 with running the dummy job on contint1001 agent - https://phabricator.wikimedia.org/T247109 (10dduvall) Thi... [19:57:08] (03PS4) 10Jforrester: Add pattern based fallback for branches [integration/quibble] - 10https://gerrit.wikimedia.org/r/550087 (owner: 10Robert Vogel) [20:02:12] (03CR) 10Krinkle: [C: 03+1] jjb: Make mwext-doxygen-publish publish to DOC_PROJECT not DOC_BASENAME (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/574563 (https://phabricator.wikimedia.org/T246042) (owner: 10Jforrester) [20:07:02] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Toolforge, and 3 others: Add CI checks for golang admission controllers - https://phabricator.wikimedia.org/T236203 (10Bstorm) 05Open→03Resolved It all works... [21:08:38] 10Release-Engineering-Team (Pipeline), 10Analytics, 10Analytics-Kanban, 10Release Pipeline, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10Ottomata) > Agreed, bear in mind also cardinality here if we're adding metrics for a lot of paths. Perhaps... [22:07:17] (03PS1) 10Dduvall: pipeline: Schedule trigger jobs on master node [integration/config] - 10https://gerrit.wikimedia.org/r/577678 (https://phabricator.wikimedia.org/T247109) [22:15:37] (03CR) 10Hashar: [C: 04-1] "The master node has been disabled. It is running the jobs as the same user as the jenkins server (jenkins) and thus grants access to any s" [integration/config] - 10https://gerrit.wikimedia.org/r/577678 (https://phabricator.wikimedia.org/T247109) (owner: 10Dduvall) [22:17:55] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Patch-For-Review: Replace integration-trigger-01 with running the dummy job on contint1001 a... - https://phabricator.wikimedia.org/T247109 [22:17:58] 10Continuous-Integration-Infrastructure (phase-out-jessie), 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Cloud-VPS (Debian Jessie Deprecation): "integration" Cloud VPS project jessie deprecation - https://phabricator.wikimedia.org/T236576 (... [22:27:11] 10Gerrit, 10Release-Engineering-Team, 10Security-Team: 'forge committer' permission request on wikimedia/security and sub-repos - https://phabricator.wikimedia.org/T247136 (10sbassett) [22:28:19] 10Beta-Cluster-Infrastructure, 10MediaWiki-extensions-WikimediaMaintenance, 10Patch-For-Review: dumpInterwiki is using prod lists in labs, labs lists in prod - https://phabricator.wikimedia.org/T247097 (10Reedy) 05Open→03Resolved a:03Reedy [22:34:15] 10Beta-Cluster-Infrastructure, 10Patch-For-Review: Add vi to langlist-labs - https://phabricator.wikimedia.org/T247091 (10Reedy) 05Open→03Resolved a:03Reedy [22:35:06] 10Gerrit, 10Release-Engineering-Team, 10Security-Team: 'forge committer' permission request on wikimedia/security and sub-repos - https://phabricator.wikimedia.org/T247136 (10Reedy) Try now? :) [22:38:21] 10Gerrit, 10Release-Engineering-Team, 10Security-Team: 'forge committer' permission request on wikimedia/security and sub-repos - https://phabricator.wikimedia.org/T247136 (10sbassett) 05Open→03Resolved p:05Triage→03Low a:03Reedy Works! Thanks. [22:39:39] (03CR) 10Dduvall: "> Patch Set 1: Code-Review-1" [integration/config] - 10https://gerrit.wikimedia.org/r/577678 (https://phabricator.wikimedia.org/T247109) (owner: 10Dduvall) [22:42:18] !log Raised executor count on contint1001 from 3 to 12 for T247109 [22:42:20] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:42:20] T247109: Replace integration-trigger-01 with running the dummy job on contint1001 agent - https://phabricator.wikimedia.org/T247109 [23:30:02] (03CR) 10Jforrester: "🤷🏽‍♂️" [integration/config] - 10https://gerrit.wikimedia.org/r/577678 (https://phabricator.wikimedia.org/T247109) (owner: 10Dduvall) [23:58:49] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)): Puppet fails on Beta Cluster because "did not find a value for the name 'profile::envoy::ensure'" - https://phabricator.wikimedia.org/T247147 (10Jdforrester-WMF) [23:59:03] 10Beta-Cluster-Infrastructure: deployment-puppetmaster04 disc use exploding - https://phabricator.wikimedia.org/T246937 (10Jdforrester-WMF) [23:59:08] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Parsoid, 10Patch-For-Review: Replace deployment-mediawiki-parsoid10 with a "purer" deployment-parsoid11 box - https://phabricator.wikimedia.org/T246854 (10Jdforrester-WMF) [23:59:26] 10Beta-Cluster-Infrastructure: deployment-puppetmaster04 disc use exploding - https://phabricator.wikimedia.org/T246937 (10Jdforrester-WMF) 05Open→03Resolved a:03Krenair Fixed by Krenair. [23:59:29] 10Beta-Cluster-Infrastructure, 10Release-Engineering-Team-TODO (2020-01 to 2020-03 (Q3)), 10Parsoid, 10Patch-For-Review: Replace deployment-mediawiki-parsoid10 with a "purer" deployment-parsoid11 box - https://phabricator.wikimedia.org/T246854 (10Jdforrester-WMF)