[00:00:16] yea, guess updating wikitech is outdated. I was still doing that for the ones with many shell users [00:01:32] wikitech was definitely the first place I used to look for key fingerprints [00:02:06] but having them all in one text file is nice :) [00:02:48] once I learned about that, I set up a systemd timer to update it every day, it's super convenient [00:03:06] the only thing it doesn't have is CNAMEs like deployment.eqiad.wmnet [00:03:30] which is also the answer to why there isn't bastion.eqiad.wmnet [00:04:18] people would not have to edit their ssh config but they would be surprised by a fingerprint mismatch [00:04:25] heh, that gerrit conversation is what led me to it :) [00:08:06] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2363.codfw.wmnet'] ` an... [00:09:06] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2365.codfw.wmnet'] ` an... [00:10:08] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2367.codfw.wmnet'] ` an... [00:10:40] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2369.codfw.wmnet'] ` an... [01:22:04] 10LibUp, 10Phabricator-Bot-Requests: Create Phabricator bot for LibUp - https://phabricator.wikimedia.org/T271229 (10Legoktm) >>! In T271229#6743105, @Aklapper wrote: > @libup user account created (though I now realize that there is also a project #libup with the same name, maybe renaming to `@libup-bot` or so... [01:25:12] 10MediaWiki-Codesniffer: Add sniff to discourage new use Wikimedia\AtEase - https://phabricator.wikimedia.org/T272554 (10Krinkle) [02:26:19] 10Release-Engineering-Team (Pipeline), 10Add-Link, 10Growth-Structured-Tasks, 10Growth-Team (Current Sprint), 10Patch-For-Review: Add Link engineering: Deployment Pipeline setup - https://phabricator.wikimedia.org/T265893 (10Tgr) >>! In T265893#6761792, @akosiaris wrote: > That would work, but would also... [03:13:53] (03Abandoned) 10DannyS712: ParenthesesAroundKeywordSniff whitespace handling cleanup [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/647286 (https://phabricator.wikimedia.org/T265741) (owner: 10DannyS712) [03:38:56] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10Dzahn) [04:31:31] James_F looking through https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/core/+/refs/heads/master/tests/phpunit/suite.xml for something else, just realized - will https://gerrit.wikimedia.org/r/c/mediawiki/core/+/657429 making ReleaseNotesTest a unit test break the `documentation` test suite? [04:53:58] DannyS712: Oh, hmm. Does anyone use that suite? [04:54:02] (Did I add it?) [07:54:48] 10Phabricator, 10I18n: Many i18n strings in Phabricator i18n contain trailing whitespace - https://phabricator.wikimedia.org/T272562 (10Nikerabbit) [08:00:04] Project mwcore-phpunit-coverage-master build #1167: 04STILL FAILING in 5 hr 0 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/1167/ [09:12:56] 10Continuous-Integration-Config: Upgrade bundler to 2.x in rake-docker jobs - https://phabricator.wikimedia.org/T243280 (10Nikerabbit) Exactly one year later (can it be a coincidence?): > Gem::InstallError: pathspec requires Ruby version >= 2.6.0. [09:13:26] 10Continuous-Integration-Config, 10translatewiki.net: Upgrade bundler to 2.x in rake-docker jobs - https://phabricator.wikimedia.org/T243280 (10Nikerabbit) [09:39:51] (03CR) 10Thiemo Kreuz (WMDE): "Note: https://github.com/squizlabs/PHP_CodeSniffer/pull/2990 is merged. It will most probably be part of squizlabs/php_codesniffer version" [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/606157 (owner: 10Thiemo Kreuz (WMDE)) [10:36:53] (03PS6) 10Hashar: Fix read infinite loop under Java 11 [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/655663 (https://phabricator.wikimedia.org/T271683) [10:36:55] (03PS1) 10Hashar: Reduce number iterations in GearmanClientJobExecTest [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657544 [10:39:48] (03CR) 10jerkins-bot: [V: 04-1] Fix read infinite loop under Java 11 [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/655663 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [10:39:56] bah [10:40:27] (03CR) 10Hashar: "recheck" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657544 (owner: 10Hashar) [10:42:46] (03PS13) 10DannyS712: New sniff: MediaWiki.PHPUnit.SpecificAssertions [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/649913 (https://phabricator.wikimedia.org/T253618) [10:42:58] (03CR) 10DannyS712: New sniff: MediaWiki.PHPUnit.SpecificAssertions (031 comment) [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/649913 (https://phabricator.wikimedia.org/T253618) (owner: 10DannyS712) [10:45:56] (03PS14) 10DannyS712: New sniff: MediaWiki.PHPUnit.SpecificAssertions [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/649913 (https://phabricator.wikimedia.org/T253618) [10:52:47] (03CR) 10Hashar: "recheck" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657544 (owner: 10Hashar) [11:33:25] 10Phabricator: "New WMF-NDA Task" form does not allow subscribers to access the task - https://phabricator.wikimedia.org/T272476 (10Aklapper) Thanks for realizing this and taking the time to create a task about it! Appreciated. I'm not convinced this should be fixed by the proposed solution. Stuff I could imagi... [12:21:39] 10phan-taint-check-plugin: Improve caused-by lines as seen for GlobalBlocking - https://phabricator.wikimedia.org/T247428 (10Daimona) 05Open→03Resolved [12:38:26] 10phan-taint-check-plugin, 10MediaWiki-Core-Testing, 10Security-Team, 10MW-1.35-notes (1.35.0-wmf.32; 2020-05-12), 10MW-1.36-notes (1.36.0-wmf.22; 2020-12-15): Suppress or fix non-double escape phan-taint-check warnings for MW core - https://phabricator.wikimedia.org/T216348 (10Daimona) [13:00:09] 10Continuous-Integration-Config, 10translatewiki.net: Upgrade bundler to 2.x in rake-docker jobs - https://phabricator.wikimedia.org/T243280 (10hashar) I don't think the rake image has received any substantial update since it got created. The [[ https://integration.wikimedia.org/ci/job/translatewiki-rake-dock... [13:31:07] 10Phabricator, 10DBA: Restart m3 (phabricator) database master db1132 - https://phabricator.wikimedia.org/T272596 (10Marostegui) [13:31:21] 10Phabricator, 10DBA: Restart m3 (phabricator) database master db1132 - https://phabricator.wikimedia.org/T272596 (10Marostegui) p:05Triage→03Medium [13:32:29] 10Phabricator, 10DBA: Restart m3 (phabricator) database master db1132 - https://phabricator.wikimedia.org/T272596 (10Marostegui) [14:44:31] 10Release-Engineering-Team (Pipeline), 10Add-Link, 10Growth-Structured-Tasks, 10Growth-Team (Current Sprint), 10Patch-For-Review: Add Link engineering: Deployment Pipeline setup - https://phabricator.wikimedia.org/T265893 (10akosiaris) >>! In T265893#6764004, @Tgr wrote: >>>! In T265893#6761792, @akosiar... [15:06:37] (03PS1) 10Lars Wirzenius: refactor: drop scap/sh.py, use subprocess directly [tools/scap] - 10https://gerrit.wikimedia.org/r/657616 [15:07:25] (03CR) 10Jforrester: [C: 03+2] Add SpaceBeforeBracketSniff for spaces between variable and array offset [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/591486 (https://phabricator.wikimedia.org/T154103) (owner: 10DannyS712) [15:09:09] (03Merged) 10jenkins-bot: Add SpaceBeforeBracketSniff for spaces between variable and array offset [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/591486 (https://phabricator.wikimedia.org/T154103) (owner: 10DannyS712) [15:10:35] (03CR) 10Jforrester: [C: 03+1] New sniff: MediaWiki.PHPUnit.SpecificAssertions [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/649913 (https://phabricator.wikimedia.org/T253618) (owner: 10DannyS712) [15:30:40] (03CR) 10Lars Wirzenius: "Commit message has more detail, but TLDR: git rm scap/sh.py" [tools/scap] - 10https://gerrit.wikimedia.org/r/657616 (owner: 10Lars Wirzenius) [15:46:51] (03PS2) 10Lars Wirzenius: refactor: drop scap/sh.py, use subprocess directly [tools/scap] - 10https://gerrit.wikimedia.org/r/657616 (https://phabricator.wikimedia.org/T222372) [16:07:06] (03PS1) 10Hashar: zuul: gearman-java is not ready for java 11 yet [integration/config] - 10https://gerrit.wikimedia.org/r/657628 [16:09:19] (03CR) 10Hashar: [C: 03+2] zuul: gearman-java is not ready for java 11 yet [integration/config] - 10https://gerrit.wikimedia.org/r/657628 (owner: 10Hashar) [16:10:35] (03Merged) 10jenkins-bot: zuul: gearman-java is not ready for java 11 yet [integration/config] - 10https://gerrit.wikimedia.org/r/657628 (owner: 10Hashar) [16:12:57] (03PS1) 10Hashar: Revert "zuul: gearman-java is not ready for java 11 yet" [integration/config] - 10https://gerrit.wikimedia.org/r/657629 [16:21:01] (03PS2) 10Hashar: Do less iterations in GearmanClientJobExecTest [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657544 [16:21:03] (03PS7) 10Hashar: Fix read infinite loop under Java 11 [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/655663 (https://phabricator.wikimedia.org/T271683) [16:25:22] (03CR) 10Hashar: [C: 03+2] Do less iterations in GearmanClientJobExecTest [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657544 (owner: 10Hashar) [16:26:21] 10Continuous-Integration-Config, 10phan, 10User-Addshore: Allow use of phan 0.8.5+ in wikimedia CI - https://phabricator.wikimedia.org/T174339 (10hashar) [16:28:27] (03Merged) 10jenkins-bot: Do less iterations in GearmanClientJobExecTest [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657544 (owner: 10Hashar) [16:31:38] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10MW-on-K8s, 10Release Pipeline: Move private settings to a k8s compatible location - https://phabricator.wikimedia.org/T271475 (10dduvall) @akosiaris or @joe, the current `/srv/mediawiki-staging/private... [16:35:48] (03CR) 10Hashar: [C: 03+2] Revert "zuul: gearman-java is not ready for java 11 yet" [integration/config] - 10https://gerrit.wikimedia.org/r/657629 (owner: 10Hashar) [16:37:15] (03PS1) 10Zfilipin: Create selenium-daily-beta-CentralNotice Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/657636 (https://phabricator.wikimedia.org/T262684) [16:37:58] (03Merged) 10jenkins-bot: Revert "zuul: gearman-java is not ready for java 11 yet" [integration/config] - 10https://gerrit.wikimedia.org/r/657629 (owner: 10Hashar) [16:40:13] (03CR) 10Hashar: "recheck with java 11 job enabled again" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/655663 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [16:42:44] (03PS2) 10Zfilipin: Create selenium-daily-beta-CentralNotice Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/657636 (https://phabricator.wikimedia.org/T262684) [16:44:13] (03CR) 10Zfilipin: "PS2 adds Depends-On" [integration/config] - 10https://gerrit.wikimedia.org/r/657636 (https://phabricator.wikimedia.org/T262684) (owner: 10Zfilipin) [17:09:23] 10MediaWiki-Codesniffer, 10User-DannyS712: Add sniff for disallow spaces between variable expression and array offset - https://phabricator.wikimedia.org/T154103 (10DannyS712) 05Open→03Resolved [17:13:34] 10MediaWiki-Codesniffer, 10Release, 10User-DannyS712: Release mediawiki-codesniffer v35.0.0 - https://phabricator.wikimedia.org/T271392 (10DannyS712) [17:16:23] (03PS3) 10Zfilipin: Create selenium-daily-beta-CentralNotice Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/657636 (https://phabricator.wikimedia.org/T262684) [17:16:27] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10MW-on-K8s, 10Release Pipeline, 10serviceops: Request volume for Docker images and container filesystems on releases machines - https://phabricator.wikimedia.org/T272092 (10dduvall) >>! In T272092#676... [17:16:54] (03PS4) 10Zfilipin: Create selenium-daily-beta-CentralNotice Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/657636 (https://phabricator.wikimedia.org/T262684) [17:21:53] mutante: sorry, i was out yesterday so didn't see your issues with releases1/2002. were you able to get the vms restarted? [17:24:58] (03PS1) 10David Caro: Review access change [cloud/wmcs-ansible] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/657648 [17:28:41] (03CR) 10Paladox: [C: 03+2] Review access change [cloud/wmcs-ansible] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/657648 (owner: 10David Caro) [17:35:21] (03CR) 10Zfilipin: [C: 03+2] Create selenium-daily-beta-CentralNotice Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/657636 (https://phabricator.wikimedia.org/T262684) (owner: 10Zfilipin) [17:36:55] (03Merged) 10jenkins-bot: Create selenium-daily-beta-CentralNotice Jenkins job [integration/config] - 10https://gerrit.wikimedia.org/r/657636 (https://phabricator.wikimedia.org/T262684) (owner: 10Zfilipin) [17:39:44] (03PS1) 10David Caro: Review access change [cloud/wmcs-ansible] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/657649 [17:40:54] (03CR) 10David Caro: "Duplicated of https://gerrit.wikimedia.org/r/c/cloud/wmcs-ansible/+/657649" [cloud/wmcs-ansible] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/657648 (owner: 10David Caro) [17:41:02] (03Abandoned) 10David Caro: Review access change [cloud/wmcs-ansible] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/657648 (owner: 10David Caro) [17:42:35] (03CR) 10Paladox: [V: 03+2 C: 03+2] Review access change [cloud/wmcs-ansible] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/657649 (owner: 10David Caro) [17:53:28] (03CR) 10Hashar: "Merely self note for later:" (031 comment) [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/655663 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [18:09:05] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10MW-on-K8s, 10Release Pipeline, 10serviceops: Request volume for Docker images and container filesystems on releases machines - https://phabricator.wikimedia.org/T272092 (10Dzahn) unfortunately T27255... [18:11:59] (03CR) 10Ahmon Dancy: refactor: drop scap/sh.py, use subprocess directly (037 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/657616 (https://phabricator.wikimedia.org/T222372) (owner: 10Lars Wirzenius) [18:14:19] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:15:14] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:15:57] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:19:49] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:55:50] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2371.codfw.wmnet'] ` an... [18:56:45] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2373.codfw.wmnet'] ` an... [18:58:22] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2375.codfw.wmnet'] ` an... [19:37:33] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2226.codfw.wmnet'] ` an... [20:00:03] Project mwcore-phpunit-coverage-master build #1168: 04STILL FAILING in 5 hr 0 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/1168/ [20:05:33] 10MediaWiki-Codesniffer, 10Patch-For-Review: ParenthesesAroundKeywordSniff leaves extraneous whitespace - https://phabricator.wikimedia.org/T265741 (10Umherirrender) 05Open→03Resolved a:03Umherirrender [20:11:53] 10Phabricator: "New WMF-NDA Task" form does not allow subscribers to access the task - https://phabricator.wikimedia.org/T272476 (10Urbanecm) >>! In T272476#6765016, @Aklapper wrote: > Thanks for realizing this and taking the time to create a task about it! Appreciated. > > I'm not convinced this should be fixe... [20:38:46] 10MediaWiki-Codesniffer: ParenthesesAroundKeywordSniff leaves extraneous whitespace - https://phabricator.wikimedia.org/T265741 (10DannyS712) [20:44:19] 10Phabricator, 10DBA: Restart m3 (phabricator) database master db1132 - https://phabricator.wikimedia.org/T272596 (10mmodell) @Marostegui I can do 06:00 UTC, I don't usually go to bed until a bit later than that. I guess any day is fine, I think 06:00-07:00 UTC is actually the best time that would overlap both... [20:51:03] 10Phabricator: "New WMF-NDA Task" form does not allow subscribers to access the task - https://phabricator.wikimedia.org/T272476 (10Dzahn) I think that the issue for the specific example is that for a task like T272470 WMF-NDA is simply not the right group. It does both directions, why would all staff and NDAed... [21:21:51] Project mediawiki-core-doxygen-docker build #22057: 04FAILURE in 17 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/22057/ [21:35:14] 10Phabricator: "New WMF-NDA Task" form does not allow subscribers to access the task - https://phabricator.wikimedia.org/T272476 (10Aklapper) Taking a step back (and maybe derailing?): IIRC we use(d) #WMF-NDA for tasks imported from [RT](https://wikitech.wikimedia.org/wiki/RT) in the 2014 #RT-Migration (see e.g.... [21:35:30] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.27 deployment blockers - https://phabricator.wikimedia.org/T271341 (10Jdlrobson) [21:54:02] 10Phabricator: "New WMF-NDA Task" form does not allow subscribers to access the task - https://phabricator.wikimedia.org/T272476 (10Dzahn) > IIRC we use(d) WMF-NDA for tasks imported from RT in the 2014 Yea, but the only reason I know of was "in case there were some tickets that need to stay private" and the... [21:56:01] 10Phabricator: "New WMF-NDA Task" form does not allow subscribers to access the task - https://phabricator.wikimedia.org/T272476 (10Dzahn) >>! In T272476#6766992, @Aklapper wrote: > Is it nowadays a common use case that folks want to create a task with the (1) initial task view criterion being (2) to have an NDA... [22:19:52] Yippee, build fixed! [22:19:52] Project mediawiki-core-doxygen-docker build #22058: 09FIXED in 15 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/22058/ [22:30:26] 10Release-Engineering-Team (Logspam), 10Growth-Team, 10StructuredDiscussions, 10User-brennen, 10Wikimedia-production-error: Flow: could not locate workflow for revision {rev} - https://phabricator.wikimedia.org/T270334 (10brennen) Saw a spike of these under 1.36.0-wmf.27. [23:07:13] 10Phabricator, 10DBA, 10SRE: Grant phstats user SELECT rights to phstats user - https://phabricator.wikimedia.org/T272654 (10Urbanecm) [23:08:23] 10Phabricator, 10DBA, 10SRE: Grant phstats user SELECT rights to phstats user - https://phabricator.wikimedia.org/T272654 (10Urbanecm) [23:10:59] 10Phabricator, 10DBA, 10SRE, 10Patch-For-Review: Grant phstats user SELECT rights for phabricator_policy database - https://phabricator.wikimedia.org/T272654 (10Urbanecm) [23:24:09] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Phatality, 10Wikimedia-Logstash, 10observability: Phatality doesn't work with Kibana 7 - https://phabricator.wikimedia.org/T272655 (10thcipriani) Tagging #observability for their visibility -- we'll need to deploy an updated version of this... [23:33:08] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [23:34:02] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [23:34:53] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [23:35:32] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [23:51:15] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2374.codfw.wmnet'] ` Of... [23:56:09] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2374.codfw.wmnet'] ` Of...