[00:00:01] (03CR) 10Dduvall: "I have just a couple more concerns, but barring those I'm good for a merge when they're addressed." (033 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [00:00:19] (03CR) 10Dduvall: [C: 04-1] apt.go: Add ability to target releases [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [00:11:18] (03CR) 10Jeena Huneidi: apt.go: Add ability to target releases (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [00:28:08] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2248.codfw.wmnet'] ` an... [00:28:23] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2249.codfw.wmnet'] ` an... [00:38:23] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.28 deployment blockers - https://phabricator.wikimedia.org/T271342 (10dancy) 1.36.0-wmf.28 is running all wikis. Notable errors: T273101: WikiPage related error... [00:49:27] (03PS7) 10Jeena Huneidi: apt.go: Add ability to target releases [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) [00:50:04] (03CR) 10Jeena Huneidi: apt.go: Add ability to target releases (033 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [01:00:47] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2283.codfw.wmnet', 'mw22... [01:15:51] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by legoktm on cumin1001.eq... [02:37:34] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2251.codfw.wmnet', 'mw22... [02:48:20] 10MediaWiki-Releasing, 10MediaWiki-extensions-OATHAuth, 10MW-1.36-release: Bundle WebAuthn extension with MediaWiki - https://phabricator.wikimedia.org/T258007 (10Reedy) p:05Triage→03Low [02:48:56] 10MediaWiki-Releasing, 10MW-1.36-release, 10MinervaNeue (Tracking), 10Readers-Web-Backlog (Tracking): Bundle MinervaNeue skin with MediaWiki - https://phabricator.wikimedia.org/T191743 (10Reedy) [03:51:25] (03PS1) 10BrandonXLF: zuul: Replace TemplateScripts with UseResource [integration/config] - 10https://gerrit.wikimedia.org/r/659553 [06:24:13] 10MediaWiki-Codesniffer, 10Regression: PHPCS incorrectly autofixing array key access over multiple lines - https://phabricator.wikimedia.org/T273264 (10Legoktm) [06:42:01] 10LibUp: LibUp should support Rust - https://phabricator.wikimedia.org/T273265 (10Legoktm) [07:47:42] (03CR) 10Gehel: "See comment inline" (031 comment) [software/gerrit] (deploy/wmf/stable-3.2) - 10https://gerrit.wikimedia.org/r/659289 (https://phabricator.wikimedia.org/T268020) (owner: 10Hashar) [07:52:29] (03CR) 10Gehel: [C: 03+1] "LGTM" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 (owner: 10Hashar) [08:48:24] 10Beta-Cluster-Infrastructure, 10Dumps-Generation: mediawiki scripts fail on new buster image in deployment-prep - https://phabricator.wikimedia.org/T273089 (10ArielGlenn) >>! In T273089#6784159, @MoritzMuehlenhoff wrote: > This appears to be an intentional change: https://bugs.debian.org/cgi-bin/bugreport.cgi... [09:00:04] Project mwcore-phpunit-coverage-master build #1184: 04STILL FAILING in 6 hr 0 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/1184/ [09:08:28] (03CR) 10Hashar: [C: 03+2] Fix read infinite loop under Java 11 [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/655663 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [09:11:01] (03Merged) 10jenkins-bot: Fix read infinite loop under Java 11 [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/655663 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [09:12:37] (03CR) 10Hashar: [C: 03+2] "Maven 3 got released in 2010, 3.0 is eol so really no point in supporting maven 2 :)" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657996 (owner: 10Hashar) [09:13:03] (03CR) 10Hashar: "Thank you! That was quite an adventure!" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 (owner: 10Hashar) [09:15:06] (03Merged) 10jenkins-bot: Drop maven 3 config and update site plugin [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657996 (owner: 10Hashar) [09:28:00] (03CR) 10Hashar: "recheck" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [09:51:38] 10Phabricator, 10Project-Admins, 10phabricator maintenance bot: #phabricator_maintenance_bot should be under #tools, not #toolforge - https://phabricator.wikimedia.org/T273273 (10Majavah) [10:02:42] (03PS2) 10Hashar: zuul: move meta-jobs at the top [integration/config] - 10https://gerrit.wikimedia.org/r/659223 (https://phabricator.wikimedia.org/T270976) [10:05:21] 10Phabricator, 10Project-Admins, 10phabricator maintenance bot: #phabricator_maintenance_bot should be under #tools, not #toolforge - https://phabricator.wikimedia.org/T273273 (10Aklapper) There is [no easy way](https://wikitech.wikimedia.org/wiki/Phabricator#Converting_a_parent_project_into_a_subproject) to... [10:12:15] (03CR) 10Hashar: [C: 03+2] "Zuul diff shows it is hopefully a noop :)" [integration/config] - 10https://gerrit.wikimedia.org/r/659223 (https://phabricator.wikimedia.org/T270976) (owner: 10Hashar) [10:13:55] (03Merged) 10jenkins-bot: zuul: move meta-jobs at the top [integration/config] - 10https://gerrit.wikimedia.org/r/659223 (https://phabricator.wikimedia.org/T270976) (owner: 10Hashar) [10:18:16] 10Continuous-Integration-Config, 10Release-Engineering-Team, 10Patch-For-Review, 10Regression, 10Test-Coverage: Patches against release branches generate coverage that is published to doc.wikimedia.org - https://phabricator.wikimedia.org/T270976 (10hashar) Moved all the meta jobs definitions (those havin... [10:22:32] (03CR) 10Gehel: [C: 03+1] "LGTM" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [10:33:08] (03PS6) 10Hashar: pom: move release to Wikimedia [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) [10:49:15] (03CR) 10Hashar: [C: 03+2] "Thank you everyone for all the support! I am going to try to cut the release once this is merged." [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [10:57:46] (03CR) 10Hashar: [C: 03+2] Replace Emma coverage by Jacoco [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 (owner: 10Hashar) [11:00:28] (03Merged) 10jenkins-bot: Replace Emma coverage by Jacoco [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 (owner: 10Hashar) [11:01:26] (03Merged) 10jenkins-bot: pom: move release to Wikimedia [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [11:15:05] (03CR) 10Hashar: [C: 03+2] "Thanks a ton for dropping that third party library! Lars confirmed it ran fine on train-dev, I guess next step is to update scap on deploy" [tools/scap] - 10https://gerrit.wikimedia.org/r/657616 (https://phabricator.wikimedia.org/T222372) (owner: 10Lars Wirzenius) [11:16:27] (03Merged) 10jenkins-bot: refactor: drop scap/sh.py, use subprocess directly [tools/scap] - 10https://gerrit.wikimedia.org/r/657616 (https://phabricator.wikimedia.org/T222372) (owner: 10Lars Wirzenius) [13:39:00] (03PS1) 10Hashar: Add .gitreview [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/659855 [13:39:02] (03PS1) 10Hashar: pom: update maven-source-plugin and use jar-no-fork [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/659856 [13:39:52] (03CR) 10Hashar: [C: 03+2] Add .gitreview [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/659855 (owner: 10Hashar) [13:40:30] (03CR) 10Gehel: [C: 03+1] "LGTM" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/659856 (owner: 10Hashar) [13:40:59] (03CR) 10Hashar: [C: 03+2] pom: update maven-source-plugin and use jar-no-fork [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/659856 (owner: 10Hashar) [13:42:57] (03Merged) 10jenkins-bot: Add .gitreview [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/659855 (owner: 10Hashar) [13:43:49] (03Merged) 10jenkins-bot: pom: update maven-source-plugin and use jar-no-fork [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/659856 (owner: 10Hashar) [14:07:03] (03PS1) 10Hashar: Switch gearman-java to Wikimedia fork [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) [14:12:36] (03PS2) 10Hashar: jjb: jobs for integration/jenkinsci/gearman-plugin [integration/config] - 10https://gerrit.wikimedia.org/r/655419 (https://phabricator.wikimedia.org/T271683) [14:16:06] (03PS3) 10Hashar: Add jobs for integration/jenkinsci/gearman-plugin [integration/config] - 10https://gerrit.wikimedia.org/r/655419 (https://phabricator.wikimedia.org/T271683) [14:18:01] (03CR) 10Hashar: [C: 03+2] "Jobs deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/655419 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [14:20:02] (03Merged) 10jenkins-bot: Add jobs for integration/jenkinsci/gearman-plugin [integration/config] - 10https://gerrit.wikimedia.org/r/655419 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [14:24:15] (03CR) 10Hashar: "check experimental" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655415 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [14:24:15] do folks have any ideas/best practices wrt renaming 'master' branch to 'main' in existing repos? [14:24:24] (03CR) 10Hashar: "check experimental" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655416 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [14:24:30] I could just push a new 'main' branch but it would be confusing I think. [14:24:31] (03CR) 10Hashar: "check experimental" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [14:59:19] (03PS2) 10Hashar: Add back repo.jenkins-ci.org [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655415 (https://phabricator.wikimedia.org/T271683) [14:59:49] (03PS2) 10Hashar: Update deps for Java 11 [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655416 (https://phabricator.wikimedia.org/T271683) [14:59:57] (03PS2) 10Hashar: Switch gearman-java to Wikimedia fork [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) [15:01:26] (03CR) 10Hashar: [V: 03+2 C: 03+2] Add back repo.jenkins-ci.org [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655415 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [15:57:44] 10Gerrit, 10Wikimedia-GitHub: mediawiki/extensions/WSOAuth Github and Gerrit repo have diverged - https://phabricator.wikimedia.org/T263955 (10Xxmarijnw) 05Open→03Resolved a:03Xxmarijnw I have deleted the defunct REL1_35 branch. [16:36:53] 10Phabricator (Upstream), 10I18n, 10Upstream: Many i18n strings in Phabricator i18n contain trailing whitespace - https://phabricator.wikimedia.org/T272562 (10Aklapper) [16:50:37] 10Phabricator: If elasticsearch phabricator indices do not exist, phab throws an error - https://phabricator.wikimedia.org/T181428 (10Aklapper) p:05Triage→03Lowest How [not] to create an elasticsearch phabricator index? Doing this on a local instance, `config/cluster/search` simply shows "MySQL" under "Searc... [16:59:58] (03PS1) 10Hashar: Adjust .gitreview for Wikimedia Gerrit [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659955 [17:00:17] (03CR) 10Hashar: [V: 03+2 C: 03+2] Adjust .gitreview for Wikimedia Gerrit [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659955 (owner: 10Hashar) [17:00:35] 10Phabricator: 6MB profile picture upload fails (and gives you a broken photo instead of erroring) - https://phabricator.wikimedia.org/T127564 (10Aklapper) 05Open→03Resolved Cannot reproduce (anymore): Tried the same for a 6.4MB image on this instance. Got an error message (`No configured storage engine can... [17:01:03] (03PS3) 10Hashar: Add back repo.jenkins-ci.org [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655415 (https://phabricator.wikimedia.org/T271683) [17:02:45] 10Gerrit, 10Phabricator, 10SRE, 10Traffic, 10periodic-update: Phabricator and Gerrit: Improve the way that maintenance downtime is communicated to users. - https://phabricator.wikimedia.org/T180655 (10Aklapper) >>! In T180655#6566245, @Dzahn wrote: > I think this is done meanwhile. Both Phabricator and G... [17:04:16] (03CR) 10Ahmon Dancy: [C: 03+1] apt.go: Add ability to target releases [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [17:07:30] (03PS3) 10Hashar: Update deps for Java 11 [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655416 (https://phabricator.wikimedia.org/T271683) [17:07:55] (03CR) 10Hashar: "check experimental" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/655416 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [17:15:37] 10Phabricator (Search): "Tags" field in Maniphest Advanced Search does not offer MediaWiki-API in proposals when using "any" prefix - https://phabricator.wikimedia.org/T218103 (10Aklapper) Still a problem. [17:16:18] 10Phabricator: @Phabricator_maintenance is sending email notifications - https://phabricator.wikimedia.org/T216867 (10Aklapper) p:05Triage→03Lowest [17:18:50] 10Phabricator: Phab presumes ldap account has a wikitech account on Phab user pages - https://phabricator.wikimedia.org/T218526 (10Aklapper) I don't see how that's fixable on the Phab side; proposing to decline. [17:18:53] 10Phabricator: Phab presumes ldap account has a wikitech account on Phab user pages - https://phabricator.wikimedia.org/T218526 (10Aklapper) p:05Triage→03Lowest [17:20:27] (03PS1) 10Lars Wirzenius: fix: bugs from sh.py and _call_rebuildLocalisationCache changes [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 [17:23:09] (03CR) 10Lars Wirzenius: "This fixes several things from changes we've merged to Scap recently. I take responsibilty for them, having failed to test them under trai" [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [17:25:18] 10Phabricator: Disable "Browse Gerrit Projects" on https://phabricator.wikimedia.org/r/ - https://phabricator.wikimedia.org/T228507 (10Aklapper) >>! In T228507#5449317, @mmodell wrote: > I intend to automate the updates of this page @mmodell: If there is no working concept to keep yet another listing page [upda... [17:28:13] 10Phabricator, 10User-LokalProfil, 10WMSE (IT): Move subproject into a user project - https://phabricator.wikimedia.org/T240710 (10Aklapper) This was brought up again as {T272137} / https://www.mediawiki.org/wiki/Topic:W1kmfra4w26s3gav and it looks like there's been some confusion. [17:28:35] 10Phabricator, 10User-LokalProfil, 10WMSE (IT): Move a WMSE subproject into a separate top-level user project - https://phabricator.wikimedia.org/T240710 (10Aklapper) [17:31:39] (03CR) 10Ahmon Dancy: [C: 04-1] "Thanks for the fixes! Just one minor tweak requested." (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [17:34:40] (03CR) 10Lars Wirzenius: "I'll push a new patch set momentarily." (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [17:38:53] (03PS2) 10Lars Wirzenius: fix: bugs from sh.py and _call_rebuildLocalisationCache changes [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 [17:39:36] (03CR) 10Ahmon Dancy: [C: 03+1] fix: bugs from sh.py and _call_rebuildLocalisationCache changes [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [18:00:55] 10Beta-Cluster-Infrastructure, 10Dumps-Generation: mediawiki scripts fail on new buster image in deployment-prep - https://phabricator.wikimedia.org/T273089 (10ArielGlenn) As I was able to do testing by making the symlink mentioned in an earlier comment, this is no longer a buster migration blocking task and I... [18:09:03] (03CR) 10Thcipriani: [C: 03+1] "I think there's one tiny problem in main.py, feel free to self +2 if I'm wrong or once changed." (035 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [18:11:33] (03CR) 10Ahmon Dancy: [C: 03+1] fix: bugs from sh.py and _call_rebuildLocalisationCache changes (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [18:12:50] (03CR) 10Lars Wirzenius: "Thanks, Tyler. Good catch on exit_code vs exitcode. I'll fix that and push a new patch set, and unless someone says otherwise, I'll self-+" (035 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [18:13:19] (03PS3) 10Lars Wirzenius: fix: bugs from sh.py and _call_rebuildLocalisationCache changes [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 [18:15:15] (03CR) 10Lars Wirzenius: [C: 03+2] fix: bugs from sh.py and _call_rebuildLocalisationCache changes [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [18:16:32] (03Merged) 10jenkins-bot: fix: bugs from sh.py and _call_rebuildLocalisationCache changes [tools/scap] - 10https://gerrit.wikimedia.org/r/659958 (owner: 10Lars Wirzenius) [18:27:10] (03PS3) 10Hashar: Switch gearman-java to Wikimedia fork [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) [18:27:40] (03CR) 10Hashar: "check experimental" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [18:27:58] (03CR) 10Hashar: "Tests fail with:" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [18:43:51] (03PS4) 10Hashar: Switch gearman-java to Wikimedia fork [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) [18:44:17] (03CR) 10Hashar: "check experimental" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [18:49:20] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: performance degradation on appservers after buster upgrade? - https://phabricator.wikimedia.org/T273312 (10Dzahn) [18:49:33] DannyS712: hi, make sure to not CR+2 too many patches at once ;] That tends to overload CI [18:50:11] I think LibUp has some support to throttle the rate of CR+2 it is issueing by watching the status of the gate-and-submit queue at https://integration.wikimedia.org/zuul/ [18:50:31] but since those changes are being manually approved, you gotta be cautious [18:51:25] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: performance degradation on appservers after buster upgrade? - https://phabricator.wikimedia.org/T273312 (10Dzahn) [18:51:39] !log CI slightly overloaded due to a surge of library updates but is otherwise processing changes [18:51:40] 10MediaWiki-Codesniffer, 10Regression: PHPCS incorrectly autofixing array key access over multiple lines - https://phabricator.wikimedia.org/T273264 (10Umherirrender) Regression from https://gerrit.wikimedia.org/r/c/mediawiki/tools/codesniffer/+/591486 ` the newline part seems not to work, because it is trig... [18:51:41] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [19:01:09] 10MediaWiki-Codesniffer, 10Regression: PHPCS incorrectly autofixing array key access over multiple lines - https://phabricator.wikimedia.org/T273264 (10DannyS712) p:05Triage→03Medium [19:01:26] (03Restored) 10DannyS712: ParenthesesAroundKeywordSniff whitespace handling cleanup [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/647286 (https://phabricator.wikimedia.org/T265741) (owner: 10DannyS712) [19:01:30] (03Abandoned) 10DannyS712: ParenthesesAroundKeywordSniff whitespace handling cleanup [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/647286 (https://phabricator.wikimedia.org/T265741) (owner: 10DannyS712) [19:14:13] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: administrators are intermitintly unable to set pending changes on enwiki - https://phabricator.wikimedia.org/T273317 (10Xaosflux) [19:14:27] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: administrators are intermitintly unable to set pending changes on enwiki - https://phabricator.wikimedia.org/T273317 (10Xaosflux) p:05Triage→03High [19:16:08] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: administrators are intermitintly unable to set pending changes on enwiki - https://phabricator.wikimedia.org/T273317 (10Xaosflux) See report with tests on enwiki. https://en.wikipedia.org/w/index.php?title=Wikipedia:Village_pump_(tec... [19:16:38] 10Release-Engineering-Team, 10MediaWiki-User-management, 10User-DannyS712: administrators are intermittently unable to configure pending changes on enwiki - https://phabricator.wikimedia.org/T273317 (10Xaosflux) [19:17:15] 10Release-Engineering-Team, 10MediaWiki-extensions-FlaggedRevs: administrators are intermittently unable to configure pending changes on enwiki - https://phabricator.wikimedia.org/T273317 (10Xaosflux) [19:18:02] 10Release-Engineering-Team, 10MediaWiki-extensions-FlaggedRevs, 10Regression: administrators are intermittently unable to configure pending changes on enwiki - https://phabricator.wikimedia.org/T273317 (10JJMC89) Possibly related to {T273296} [19:38:23] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: performance degradation on appservers after buster upgrade? - https://phabricator.wikimedia.org/T273312 (10Reedy) [19:46:40] 10Phabricator: Disable "Browse Gerrit Projects" on https://phabricator.wikimedia.org/r/ - https://phabricator.wikimedia.org/T228507 (10mmodell) @aklapper: it is sufficiently obsolete at this point... [19:51:18] 10Phabricator, 10User-LokalProfil, 10WMSE (IT): Move a WMSE subproject into a separate top-level user project - https://phabricator.wikimedia.org/T240710 (10mmodell) transforming a subproject into a top level project is not currently supported by the script {src PHAB:scripts/move_beneath.php} so this will re... [19:52:02] 10Phabricator, 10User-LokalProfil, 10WMSE (IT): Move a WMSE subproject into a separate top-level user project - https://phabricator.wikimedia.org/T240710 (10mmodell) p:05Triage→03Medium [19:52:15] (03CR) 10DannyS712: "This change is ready for review." [tools/codesniffer] - 10https://gerrit.wikimedia.org/r/659885 (https://phabricator.wikimedia.org/T273264) (owner: 10DannyS712) [19:52:30] 10MediaWiki-Codesniffer, 10Patch-For-Review, 10Regression: PHPCS incorrectly autofixing array key access over multiple lines - https://phabricator.wikimedia.org/T273264 (10DannyS712) Would this warrant releasing a new `35.1.0`? [19:53:39] 10Phabricator: If elasticsearch phabricator indices do not exist, phab throws an error - https://phabricator.wikimedia.org/T181428 (10mmodell) 05Open→03Declined I believe this was fixed in the upstream, however, we no longer use elasticsearch in production so I can't currently test this easily and there is v... [20:01:02] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10jijiki) [20:01:20] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10jijiki) [20:23:50] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10jijiki) The problem is more evident on the API,... [20:28:36] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10jijiki) The problem is more evident on the API,... [20:42:00] 10MediaWiki-Releasing, 10Release-Engineering-Team, 10Security-Team: Write a script to create security release task tree - https://phabricator.wikimedia.org/T256285 (10Reedy) [20:49:12] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.28 deployment blockers - https://phabricator.wikimedia.org/T271342 (10dancy) [20:49:31] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Release, 10Train Deployments: 1.36.0-wmf.29 deployment blockers - https://phabricator.wikimedia.org/T271343 (10dancy) [20:55:56] Yippee, build fixed! [20:55:57] Project mwcore-phpunit-coverage-master build #1185: 09FIXED in 5 hr 55 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/1185/ [21:01:08] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10CDanis) Here are overall, whole-cluster mean lat... [21:03:38] (03CR) 10Hashar: "Gotta test the plugin now :D" [integration/jenkinsci/gearman-plugin] - 10https://gerrit.wikimedia.org/r/659860 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [21:06:52] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Krinkle) [21:12:21] 10Phabricator: Phab presumes ldap account has a wikitech account on Phab user pages - https://phabricator.wikimedia.org/T218526 (10bd808) If there is a thing to fix here it is the Developer account attachment on the Wikitech side. There is an existing maintenance script in #mediawiki-extensions-openstackmanager... [21:12:37] 10Continuous-Integration-Config, 10API-Portal, 10MediaWiki-extensions-WikimediaApiPortalOAuth: Disable unit tests in CI for WikimediaApiPortalOAuth extension - https://phabricator.wikimedia.org/T273326 (10Reedy) [21:46:36] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10jijiki) > > Something I haven't looked at yet,... [22:03:04] 10Phabricator (Upstream), 10Upstream: Memes can have ridiculously short/non-unique names and confuse users - https://phabricator.wikimedia.org/T113814 (10Dzahn) Seems like this has been solved because it only happens when these words appear on a line by themselves and haven't heard complaints in the last coupl... [22:41:19] 10Release-Engineering-Team, 10SRE: Re-imaged mw app servers can end up with missing l10n cache for old versons of MW needed for rollback - https://phabricator.wikimedia.org/T273334 (10Reedy) [22:51:13] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.28 deployment blockers - https://phabricator.wikimedia.org/T271342 (10dancy) T273296 was not able to be resolved in a timely manner so we decided to roll all wik... [23:01:39] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10SRE: Re-imaged mw app servers can end up with missing l10n cache for old versons of MW needed for rollback - https://phabricator.wikimedia.org/T273334 (10thcipriani) [23:02:21] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Scap, 10SRE: Re-imaged mw app servers can end up with missing l10n cache for old versons of MW needed for rollback - https://phabricator.wikimedia.org/T273334 (10thcipriani) [23:15:27] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Legoktm) p:05Triage→03High [23:39:40] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, and 2 others: Investigate possible performance degradation on mediawiki servers after Debian Buster upgrade - https://phabricator.wikimedia.org/T273312 (10Legoktm) From `#wikimedia-perf`: ` 04:45:33