[02:14:01] PROBLEM - Free space - all mounts on deployment-snapshot01 is CRITICAL: CRITICAL: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found)deployment-prep.deployment-snapshot01.diskspace.root.byte_percentfree (<10.00%) [02:24:02] RECOVERY - Free space - all mounts on deployment-snapshot01 is OK: OK: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found) [02:54:46] 10MediaWiki-Releasing, 10MW-1.36-release, 10MobileFrontend (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MobileFrontend extension with MediaWiki - https://phabricator.wikimedia.org/T191734 (10Jdlrobson) [03:06:18] (03PS1) 10Reedy: Remove Wikibase dependencies from Score in REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/615910 [03:06:55] (03CR) 10Reedy: [C: 03+2] Remove Wikibase dependencies from Score in REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/615910 (owner: 10Reedy) [03:07:49] (03Merged) 10jenkins-bot: Remove Wikibase dependencies from Score in REL1_31 [integration/config] - 10https://gerrit.wikimedia.org/r/615910 (owner: 10Reedy) [03:08:32] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/615910 [03:08:33] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [03:13:50] (03PS1) 10Reedy: Try ZUUL_PROJECT instead [integration/config] - 10https://gerrit.wikimedia.org/r/615912 [03:14:41] (03PS2) 10Reedy: Try ZUUL_PROJECT instead [integration/config] - 10https://gerrit.wikimedia.org/r/615912 [03:14:55] (03CR) 10Reedy: [C: 03+2] Try ZUUL_PROJECT instead [integration/config] - 10https://gerrit.wikimedia.org/r/615912 (owner: 10Reedy) [03:15:50] (03Merged) 10jenkins-bot: Try ZUUL_PROJECT instead [integration/config] - 10https://gerrit.wikimedia.org/r/615912 (owner: 10Reedy) [03:16:20] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/615912 [03:16:21] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [03:19:35] (03PS1) 10Reedy: Remove PropertySuggestor from Score REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/615914 [03:19:55] (03CR) 10Reedy: [C: 03+2] Remove PropertySuggestor from Score REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/615914 (owner: 10Reedy) [03:20:48] (03Merged) 10jenkins-bot: Remove PropertySuggestor from Score REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/615914 (owner: 10Reedy) [03:21:28] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/615914 [03:21:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [03:41:09] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (CI & Testing services), 10Release-Engineering-Team-TODO: Regularly run mwext-{name}-testextension-* jobs to make sure they are still passing after core or dependency changes - https://phabricator.wikimedia.org/T93414 (10Reedy) >>! In T93414... [03:54:35] 10Continuous-Integration-Config, 10Code-Health, 10Readers-Web-Backlog (Kanbanana-2020-21-Q1), 10Vue.js (Vue.js-Search): Configure ESLint and stylelint for Vue.js search development ahead of it being done for all repos - https://phabricator.wikimedia.org/T249304 (10Niedzielski) [03:55:04] 10Continuous-Integration-Config, 10Code-Health, 10Readers-Web-Backlog (Kanbanana-2020-21-Q1), 10Vue.js (Vue.js-Search): Configure ESLint and stylelint for Vue.js search development ahead of it being done for all repos - https://phabricator.wikimedia.org/T249304 (10Niedzielski) @jdrewniak, updated with refe... [07:42:21] Could someone with phab admin tell me the version because I found a "bug"? [07:46:55] https://discourse.phabricator-community.org/t/the-large-number-of-changes-banner-appears-in-pointless-situation/4114 [07:49:15] according to https://github.com/wikimedia/phabricator/commits/wmf/stable we are running git commit 14409a32e74e2623706be11d44ef36553f798d97 [07:56:12] Majavah: upstream ask for config > version because there's arcanist and stuff separate [07:56:29] I'll see if an admin can give a desicive answer [07:56:39] why just not report at our phab and let them report to upstream? much easier [08:03:54] Because tbh epriestly will probably get back within a day anyway [08:28:27] PROBLEM - Host deployment-changeprop is DOWN: CRITICAL - Host Unreachable (172.16.5.21) [08:28:27] PROBLEM - Host deployment-cpjobqueue is DOWN: CRITICAL - Host Unreachable (172.16.4.124) [08:28:27] PROBLEM - Host deployment-chromium02 is DOWN: CRITICAL - Host Unreachable (172.16.4.14) [08:43:42] (03Abandoned) 1020after4: Edit Repo Config [phabricator/deployment] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/612921 (owner: 1020after4) [09:28:21] 10Phabricator, 10Quality-and-Test-Engineering-Team (QTE), 10Patch-For-Review, 10User-Vidhi-Mody, 10User-zeljkofilipin: Upgrade WebdriverIO in the phab-deployment repository - https://phabricator.wikimedia.org/T255471 (10Vidhi-Mody) [10:14:51] 10Gerrit, 10Phabricator, 10Pywikibot: Make Gerrit web UI clone instructions for cloning pywikibot/core repository mention git clone parameter --recursive - https://phabricator.wikimedia.org/T185949 (10Aklapper) [10:23:31] 10Gerrit, 10TestMe, 10Upstream: Gerrit's ui does not correctly capitalise usernames in the git clone command - https://phabricator.wikimedia.org/T183205 (10Aklapper) [10:53:40] 10VPS-project-codesearch: Index Wikibase JavaScript libraries - https://phabricator.wikimedia.org/T231572 (10Ladsgroup) All are used AFAIK but some are moved to gerrit. [10:57:46] 10MediaWiki-Releasing: Mediawiki 1.34.2 tarball incompatible with 7zip on windows due to Pax format - https://phabricator.wikimedia.org/T257102 (10Ciencia_Al_Poder) Discussions in 7zip: From 2016, apparently tar can use different extensions to handle long filenames. `@PaxHeader` is one, `@LongLink` seems to be... [11:00:35] PROBLEM - Host deployment-mcs01 is DOWN: CRITICAL - Host Unreachable (172.16.5.64) [11:36:08] (03CR) 10Kosta Harlan: "I haven't tested, but seems OK. Thanks for the patch!" [releng/dev-images] - 10https://gerrit.wikimedia.org/r/609427 (https://phabricator.wikimedia.org/T257044) (owner: 10Dbarratt) [11:48:33] 10Phabricator: Custom task forms for #WMNO-General - https://phabricator.wikimedia.org/T258787 (10jhsoby-WMNO) [12:20:30] kostajh: o/ any idea how I can update the go version being used in CI for the cli ? :P [12:20:39] * addshore looks in integration/config [12:23:25] oooh, maybe just the pipeline file, woo [12:37:53] addshore: You can't just change versions arbitarily ;p [12:41:56] Whhhyyyyy [12:57:43] 10Beta-Cluster-Infrastructure, 10Wikimedia-Site-requests: Increase wgAbuseFilterEmergencyDisable on zh Beta Cluster - https://phabricator.wikimedia.org/T230305 (10Xiplus) >>! In T230305#6330605, @Urbanecm wrote: > @Xiplus: Is this still needed? Yes. Or I need to I create 3 or more AFs to prevent reaching the... [13:03:14] 10Beta-Cluster-Infrastructure, 10Wikimedia-Site-requests, 10Patch-For-Review, 10User-Urbanecm: Increase wgAbuseFilterEmergencyDisable on zh Beta Cluster - https://phabricator.wikimedia.org/T230305 (10Urbanecm) a:03Urbanecm Okay, uploaded a patch. I invite both @Xiplus and @Daimona to have a look. [13:23:03] hey folks. i note that users are able to create /sandbox/${username}/$foo branches in gerrit, but they are not able to force-push to them. would it be reasonable to allow that? it _seems_ safe [13:33:00] 10VPS-project-codesearch, 10Patch-For-Review: Index Wikibase JavaScript libraries - https://phabricator.wikimedia.org/T231572 (10Ladsgroup) Added those from list of git submodules of wikibase extension. [13:39:22] (03PS2) 10Zfilipin: Selenium: Remove Jon from MinervaNeue notifications [integration/config] - 10https://gerrit.wikimedia.org/r/615503 (https://phabricator.wikimedia.org/T258528) (owner: 10Edward Tadros) [13:41:27] 10Continuous-Integration-Config, 10Product-Infrastructure-Team-Backlog, 10Proton: chromium-renderer/deploy does not run CI tests - https://phabricator.wikimedia.org/T223405 (10Mholloway) 05Open→03Declined Proton is now deployed on Kubernetes. [13:49:36] 10VPS-project-codesearch, 10Patch-For-Review, 10User-Ladsgroup: Index Wikibase JavaScript libraries - https://phabricator.wikimedia.org/T231572 (10Ladsgroup) 05Open→03Resolved a:03Ladsgroup This is done: https://codesearch.wmcloud.org/search/?q=WbSerializationStrategyProvider&i=nope&files=&repos= [13:50:20] (03CR) 10Zfilipin: [C: 03+2] Selenium: Remove Jon from MinervaNeue notifications [integration/config] - 10https://gerrit.wikimedia.org/r/615503 (https://phabricator.wikimedia.org/T258528) (owner: 10Edward Tadros) [13:51:21] (03Merged) 10jenkins-bot: Selenium: Remove Jon from MinervaNeue notifications [integration/config] - 10https://gerrit.wikimedia.org/r/615503 (https://phabricator.wikimedia.org/T258528) (owner: 10Edward Tadros) [13:53:15] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release, 10Train Deployments: 1.36.0-wmf.1 deployment blockers - https://phabricator.wikimedia.org/T257969 (10daniel) [15:02:19] 10Phabricator: Unable to search a specific term; upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Bugreporter) [15:10:06] 10Continuous-Integration-Config, 10MediaViewer, 10MediaWiki-Core-Testing, 10ORES, and 3 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10Jdlrobson) [15:10:19] 10Continuous-Integration-Config, 10MediaViewer, 10MediaWiki-Core-Testing, 10ORES, and 3 others: Audit tests/selenium/LocalSettings.php file aiming at possibly deprecating the feature - https://phabricator.wikimedia.org/T199939 (10Jdlrobson) MobileFrontend and Popups have been ported to Node.js without Loca... [15:22:00] PROBLEM - Parsoid on deployment-parsoid11 is CRITICAL: connect to address 172.16.1.115 and port 8000: Connection refused [15:25:50] liw: Any idea how to kill/unstick the two Score/REL1_31 jobs on https://integration.wikimedia.org/zuul/ that have been idle nearly 12 hours [15:31:40] Reedy, no, sorry, and can't find instructions, either, nor can I see them on Jenkins [15:31:49] heh, me too [15:32:04] I think it's a kill zuul thing, rather than just a reload [15:33:16] https://www.mediawiki.org/wiki/Continuous_integration/Architecture/Troubleshooting [15:36:06] I don't seem to have access to gallium [15:53:42] Reedy, hmm, I'm a bit slow, but I found the job in Jenkins, it's finished long ago, but Zuul doesn't see that, it seems to me [15:58:42] brennen, can you help with Reedy's Score/REL_31 problem above? [15:59:00] well, i can investigate. [16:01:01] thanks [16:10:53] addshore: it seems like the problem is possibly related to letsencrypt certificates not being installed in the golang image [16:11:06] i can't figure out where the source for the WMF golang image is [16:11:16] brennen: ftr: from my memory of zuul issues and common fixes, this does feel like a restart thing. With all the caveats thereof (it'll miss gerrit events) [16:11:18] :/ [16:11:29] addshore: see https://github.com/golang/go/issues/32966 plus the chain of related issues [16:11:53] yeah, i'd rather not go down that particular rabbithole. [16:12:36] addshore: it seems like with go 1.14 we could use the scary sounding GOINSECURE environment variable [16:22:24] PROBLEM - Free space - all mounts on integration-agent-docker-1009 is CRITICAL: CRITICAL: integration.integration-agent-docker-1009.diskspace._srv.byte_percentfree (<11.11%) [16:32:25] RECOVERY - Free space - all mounts on integration-agent-docker-1009 is OK: OK: All targets OK [16:38:47] kostajh: GOINSECURE sounds fine ;) [16:38:49] xD [16:58:46] hehe [16:59:35] addshore: another alternative is to download the packages via apt, this seems to be what happens with the kask project, I am not sure but I wonder if go mod download would use the apt installed packages rather than attempting to obtain from GitHub [17:05:45] Probably will always get from github [17:24:24] (03PS4) 10Ahmon Dancy: Fix handling of indirect 'copies' references [blubber] - 10https://gerrit.wikimedia.org/r/613701 (https://phabricator.wikimedia.org/T254629) [17:25:07] (03CR) 10Ahmon Dancy: "> Patch Set 3:" [blubber] - 10https://gerrit.wikimedia.org/r/613701 (https://phabricator.wikimedia.org/T254629) (owner: 10Ahmon Dancy) [17:54:10] 10Phabricator: Unable to search a specific term; upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Aklapper) 05Open→03Stalled @Bugreporter: Please always follow https://www.mediawiki.org/wiki/How_to_report_a_bug and provide clear steps to reproduce. Thanks. [17:57:44] Reedy: doing some digging on the Score/REL_31 thing, seems we're seeing an exception while launching the jobs on the ext_deps.remove('PropertySuggestor') call in parameter_functions.py [18:03:18] think this is just a typo'd extension name - PropertySuggest_o_r vs. PropertySuggest_e_r [18:05:23] (03CR) 10Ahmon Dancy: Remove PropertySuggestor from Score REL1_31 deps (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/615914 (owner: 10Reedy) [18:06:13] (03PS1) 10Brennen Bearnes: Fix spelling of PropertySuggester in Score REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/616133 [18:06:38] (03CR) 10Ahmon Dancy: [C: 03+1] Fix spelling of PropertySuggester in Score REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/616133 (owner: 10Brennen Bearnes) [18:07:42] 10Phabricator: Unable to search a specific term; upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Bugreporter) The search term is "gerrit", using the main Phabricator search box. [18:10:52] (03CR) 10Ahmon Dancy: [C: 03+2] Fix spelling of PropertySuggester in Score REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/616133 (owner: 10Brennen Bearnes) [18:11:52] (03Merged) 10jenkins-bot: Fix spelling of PropertySuggester in Score REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/616133 (owner: 10Brennen Bearnes) [18:12:04] 10Phabricator: Unable to search a specific term; upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Bugreporter) 05Stalled→03Open [18:13:36] !log reloading zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/616133 [18:13:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [18:16:18] brennen: dancy: ugh, and a hard typo to notice. [18:16:35] Good work :) [18:17:35] greg-g: we'll see... :) [18:18:53] looks like it worked. :) [18:20:29] Woot! [18:22:28] The symptom of the problem was very visible in zuul.log which I assume has no automated analysis [18:25:03] PROBLEM - Free space - all mounts on deployment-snapshot01 is CRITICAL: CRITICAL: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found)deployment-prep.deployment-snapshot01.diskspace.root.byte_percentfree (<10.00%) [18:31:53] Aha. Thanks brennen dancy [18:32:02] Can we get better handling on it? [18:32:31] I was just going to ask if we have any existing monitoring tools which watch log files for complaints? That should be deployed for /var/log/zuul/error.log [18:33:01] I'll file a phab task [18:34:58] cool [18:35:01] RECOVERY - Free space - all mounts on deployment-snapshot01 is OK: OK: deployment-prep.deployment-snapshot01.diskspace._data.byte_percentfree (No valid datapoints found) [18:35:09] yeah, logs aren't very good if they're not visible/monitored/surfaced somewhere [18:36:06] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10User-dancy: Monitor /var/log/zuul/error.log - https://phabricator.wikimedia.org/T258821 (10dancy) [18:43:41] Why does Wikibase depend on ArticlePlaceholder when we don't have it deployed? [18:46:44] oh, it's loaded via Wikibase.php [18:46:46] Of course it is [18:47:16] (03PS1) 10Reedy: Remove ArticlePlaceholder from Score/REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/616138 [18:47:24] 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Zuul, 10User-brennen, 10User-dancy: Monitor /var/log/zuul/error.log - https://phabricator.wikimedia.org/T258821 (10brennen) [18:47:34] (03CR) 10Reedy: [C: 03+2] Remove ArticlePlaceholder from Score/REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/616138 (owner: 10Reedy) [18:48:40] (03Merged) 10jenkins-bot: Remove ArticlePlaceholder from Score/REL1_31 deps [integration/config] - 10https://gerrit.wikimedia.org/r/616138 (owner: 10Reedy) [18:49:12] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/616138 [18:49:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:20:30] (03CR) 10Brennen Bearnes: [C: 03+2] "This is deployed. Merging, noting that this probably will need future adjustment to be agnostic about which contint box it's running on. " [integration/config] - 10https://gerrit.wikimedia.org/r/615830 (https://phabricator.wikimedia.org/T258626) (owner: 10Ahmon Dancy) [19:21:52] (03Merged) 10jenkins-bot: New maintenance-sample-workspace-sizes job [integration/config] - 10https://gerrit.wikimedia.org/r/615830 (https://phabricator.wikimedia.org/T258626) (owner: 10Ahmon Dancy) [19:22:24] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Aklapper) [19:24:43] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Aklapper) Cannot reproduce. When I go to https://phabricator.wikimedia.org/search/query/advanced/ and enter `gerrit` in the `Query` field, then I get results at http... [19:25:20] (03PS1) 10Catrope: Remove rake job for Flow [integration/config] - 10https://gerrit.wikimedia.org/r/616147 [19:26:57] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout - https://phabricator.wikimedia.org/T258803 (10RhinosF1) I can reproduce using by typing "gerrit" in the search box in the top right. [19:27:36] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Majavah) I can also reproduce by typing"gerrit" into the main search box [19:28:17] Majavah: I wonder why Andre couldn't [19:32:21] I'd guess some setting [19:35:23] Maybe [19:37:50] 10Zuul, 10User-brennen, 10User-dancy: Improve scheduling of CI jobs invoked by zuul - https://phabricator.wikimedia.org/T258630 (10dancy) [19:38:13] WFM too [19:40:32] (03CR) 10Jeena Huneidi: [C: 03+2] Fix handling of indirect 'copies' references [blubber] - 10https://gerrit.wikimedia.org/r/613701 (https://phabricator.wikimedia.org/T254629) (owner: 10Ahmon Dancy) [19:43:25] (03Merged) 10jenkins-bot: Fix handling of indirect 'copies' references [blubber] - 10https://gerrit.wikimedia.org/r/613701 (https://phabricator.wikimedia.org/T254629) (owner: 10Ahmon Dancy) [19:45:01] 10Release-Engineering-Team (Onboarding), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release Pipeline (Blubber), 10User-dancy: Blubber: Allow more than one layer of copying - https://phabricator.wikimedia.org/T254629 (10dancy) 05... [19:45:07] Woot! [19:58:10] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Aklapper) Thanks everyone for confirming! I go to https://phabricator.wikimedia.org/ . The search scope in the upper right corner is set to `All Documents`. I enter... [19:59:43] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout - https://phabricator.wikimedia.org/T258803 (10Bugreporter) A work account may view a number of restricted things. [20:00:52] 10Phabricator: Searching for "gerrit" in global Phabricator search leads to upstream request timeout - https://phabricator.wikimedia.org/T258803 (10RhinosF1) > But trying the same in Chromium 81 with my personal account, I can reproduce the problem (HTTP 504 error). I'm on Chrome as well fwiw [20:06:47] 10Release-Engineering-Team (Onboarding), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Patch-For-Review, 10Release Pipeline (Blubber), 10User-dancy: Blubber: Allow more than one layer of copying - https://phabricator.wikimedia.org/T254629 (10dancy) 05... [20:15:27] (03CR) 10Brennen Bearnes: "Looks good, sorry I let this one slip through the cracks. Needs a changelog update and a rebuild of the -xdebug image for deployment. I'" [releng/dev-images] - 10https://gerrit.wikimedia.org/r/609427 (https://phabricator.wikimedia.org/T257044) (owner: 10Dbarratt) [21:49:53] 10Phabricator: Remove Phabricator 2FA from AndyRussG - https://phabricator.wikimedia.org/T258842 (10jrbs) [21:50:05] 10Phabricator, 10Trust-and-Safety: Remove Phabricator 2FA from AndyRussG - https://phabricator.wikimedia.org/T258842 (10jrbs) [21:54:04] 10Continuous-Integration-Config, 10MediaWiki-Core-Testing: MediaWiki qunit Jenkins jobs should emit a junit result and process it - https://phabricator.wikimedia.org/T153759 (10Krinkle) 05Open→03Declined The general expectation and preference from develoeprs around unit tests is text-based nowadays. This f... [22:02:42] 10Phabricator, 10Trust-and-Safety: Remove Phabricator 2FA from AndyRussG - https://phabricator.wikimedia.org/T258842 (10AndyRussG) > Andrew still has access to Phab so I'll ask him to comment here as confirmation. Hi! Yes, thanks so much for this!!! :) [22:09:24] AndyRussG: hey, quick call? [22:09:26] to verify [22:10:36] greg-g: sure! [22:10:45] see PM :) [22:15:53] 10Phabricator, 10Release-Engineering-Team, 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Trust-and-Safety, 10User-greg: Remove Phabricator 2FA from AndyRussG - https://phabricator.wikimedia.org/T258842 (10greg) 05Open→03Resolved a:03greg After ve... [22:16:33] 10Phabricator, 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (Release-Engineering-Team-TODO (2020-07-01 to 2020-09-30 (Q1))), 10Trust-and-Safety, 10User-greg: Remove Phabricator 2FA from AndyRussG - https://phabricator.wikimedia.org/T258842 (10greg) [22:33:13] (03PS1) 10Jeena Huneidi: Convert kask ci to use pipelinelib [integration/config] - 10https://gerrit.wikimedia.org/r/616177 (https://phabricator.wikimedia.org/T224041) [22:40:26] (03CR) 10Jeena Huneidi: "I don't really know what debian-glue is for...do I need it?" [integration/config] - 10https://gerrit.wikimedia.org/r/616177 (https://phabricator.wikimedia.org/T224041) (owner: 10Jeena Huneidi) [23:08:11] 10Continuous-Integration-Config, 10MediaWiki-Configuration, 10Wikidata, 10Sustainability (Incident Followup): Consider having a linter that could catch config file entries that set unused variables - https://phabricator.wikimedia.org/T248866 (10Legoktm) In theory you can get every possible config option by... [23:19:02] (03PS3) 10Brennen Bearnes: Allow Article Path to be customized in LocalSettings.php [releng/dev-images] - 10https://gerrit.wikimedia.org/r/609427 (https://phabricator.wikimedia.org/T257044) (owner: 10Dbarratt) [23:20:39] (03CR) 10Brennen Bearnes: [V: 03+2 C: 03+2] "Tested locally with changelog additions. Seems to work ok - merging & publishing images." [releng/dev-images] - 10https://gerrit.wikimedia.org/r/609427 (https://phabricator.wikimedia.org/T257044) (owner: 10Dbarratt) [23:22:13] !log Updating dev-images docker-pkg files on primary contint for T257044 [23:22:15] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [23:22:15] T257044: Docker images do not allow for article paths other than /wiki - https://phabricator.wikimedia.org/T257044 [23:45:40] (03CR) 10Alex Dean: "> Patch Set 2:" [ruby/api] - 10https://gerrit.wikimedia.org/r/613666 (owner: 10Alex Dean) [23:54:19] PROBLEM - Host deployment-sentry01 is DOWN: CRITICAL - Host Unreachable (172.16.5.16)