[00:18:22] Ahem... Anybody around to unblock me on mw.org while I facepalm hard? https://www.mediawiki.org/wiki/Special:Contributions/Daimona_Eaytoy [00:18:51] Yippee, build fixed! [00:18:51] Project mediawiki-core-doxygen-docker build #22180: 09FIXED in 14 min: https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen-docker/22180/ [00:21:54] Daimona: nope [00:22:09] (done) [00:22:37] Aye, thank you :D [00:30:50] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by legoktm on cumin1001.eq... [00:45:53] 10Release-Engineering-Team (Pipeline), 10Release-Engineering-Team-TODO, 10Release Pipeline: Experiment with continuous deployment using Blubberoid - https://phabricator.wikimedia.org/T214158 (10jeena) a:05LarsWirzenius→03jeena [01:01:42] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Wikimedia-General-or-Unknown, 10Performance-Team (Radar): Document and automate updating of static/project-logos in mediawiki-config - https://phabricator.wikimedia.org/T98640 (10Legoktm) @Urbanecm and I d... [01:02:55] Daimona: hehe, admins no longer have unblockself by default :D [01:03:05] Yeah, I know :-/ [01:03:42] isn't that what sockpuppets are for? [01:12:47] Daimona https://phabricator.wikimedia.org/T232908 [01:14:07] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2295.codfw.wmnet', 'mw22... [01:18:02] Heh [01:47:02] James_F: https://libraryupgrader2.wmcloud.org/r/mediawiki/extensions/UserProtect?branch=master has popped up on a few repos so far [01:47:09] https://eslint.org/docs/rules/no-nonoctal-decimal-escape says it was added in 7.14.0 [01:47:20] in the log it has: + eslint@7.18.0 [01:47:29] Hmm. That means it’s not replacing eslint correctly. [01:47:43] Yeah. [01:48:11] is `npm update eslint -depth 1` not good enough? [01:48:24] https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/UserProtect/+/refs/heads/master/package-lock.json interestingly has two "eslint" blocks [01:48:25] I know Volker ran into that locally if he didn’t fully delete node_modules. [01:48:38] It “should” but… oh, yeah, that could do it. [01:48:46] * legoktm plays locally [01:48:59] Isn’t npm fun? [01:49:18] the best part of my day [01:51:15] > As of npm@2.6.1, the npm update will only inspect top-level packages. Prior versions of npm would also recursively inspect all dependencies. To get the old behavior, use npm --depth 9999 update. [01:51:33] ahahaha [01:51:34] km@d749b8fa1a97:/UserProtect$ npm --depth 9999 update eslint [01:51:34] npm ERR! Maximum call stack size exceeded [01:59:21] James_F: think I got it, looks like we just need to bump up --depth 1 to like --depth 10 [02:06:49] (deployed) [02:13:32] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Wikimedia-General-or-Unknown, 10Performance-Team (Radar): Document and automate updating of static/project-logos in mediawiki-config - https://phabricator.wikimedia.org/T98640 (10Urbanecm) >>! In T98640#67... [02:34:59] (03PS1) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [03:48:08] (03PS1) 10Dduvall: Avoid CPS failures in ExecutionContext exceptions [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 [03:53:52] (03PS1) 10Dduvall: Namespace build parameters to `setup.params.[name]` [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 [05:10:53] (03PS2) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:14:12] (03PS3) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:15:03] (03PS4) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:24:33] (03PS5) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:25:54] (03PS6) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:26:17] (03PS7) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:27:37] (03PS8) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:29:47] (03PS9) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:37:18] (03PS10) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:38:10] (03PS11) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [05:42:48] 10Phabricator, 10DBA: Restart m3 (phabricator) database master db1132 - https://phabricator.wikimedia.org/T272596 (10Marostegui) Pre restart steps done [06:04:29] 10Jenkins, 10VideoCutTool, 10Patch-For-Review: Create mocha tests in the tool - https://phabricator.wikimedia.org/T272955 (10Gopavasanth) Its weird tests are passing fine locally but not with Jenkins, Any clue? {F34036566} [06:04:34] (03PS12) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [06:06:10] 10Phabricator, 10DBA: Restart m3 (phabricator) database master db1132 - https://phabricator.wikimedia.org/T272596 (10Marostegui) This was done. RO time for phabricator was around: 06:01:53 ON 06:03:12 OFF Thanks @mmodell for the help! ` root@db1132.eqiad.wmnet[(none)]> select @@report_host; +---------------... [06:06:34] 10Phabricator, 10DBA: Restart m3 (phabricator) database master db1132 - https://phabricator.wikimedia.org/T272596 (10Marostegui) 05Open→03Resolved a:03Marostegui [06:06:40] (03PS13) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [06:21:41] (03PS14) 10Wolfgang Kandek: initial commit gerrit [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [09:00:04] Project mwcore-phpunit-coverage-master build #1180: 04STILL FAILING in 6 hr 0 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/1180/ [10:17:08] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO: Remove "php-" from wiki version numbers - https://phabricator.wikimedia.org/T63733 (10Aklapper) @hashar: Hmm, what is this stalled on [by definition](https://www.mediawiki.org/wiki/Bug_management/Bug_report_life... [10:20:28] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10Aklapper) > As I am in the process of chopping the overlong phab Help page into manageable subpages Hmm, which problem would that solve, apart from making it harder to Ctrl+F thing... [10:25:40] (03PS1) 10Hashar: EventBus: add experimental wmf-quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/658925 (https://phabricator.wikimedia.org/T272863) [10:25:42] (03PS1) 10Hashar: Add EventBus to the gate [integration/config] - 10https://gerrit.wikimedia.org/r/658946 (https://phabricator.wikimedia.org/T272863) [10:26:08] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Analytics, 10Better Use Of Data, and 5 others: EventLogging PHP EventServiceClient should use EventBus->send(). - https://phabricator.wikimedia.org/T272863 (10hashar) [10:26:20] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10Aklapper) I'm not a fan of the vagueness of titles such as "Working_with_Phabricator" or "Advanced_features". When do I not "work with Phabricator" while I am on the Phabricator we... [10:26:29] (03CR) 10Hashar: [C: 03+2] "Will be tested on https://gerrit.wikimedia.org/r/658922" [integration/config] - 10https://gerrit.wikimedia.org/r/658925 (https://phabricator.wikimedia.org/T272863) (owner: 10Hashar) [10:28:09] (03Merged) 10jenkins-bot: EventBus: add experimental wmf-quibble jobs [integration/config] - 10https://gerrit.wikimedia.org/r/658925 (https://phabricator.wikimedia.org/T272863) (owner: 10Hashar) [10:29:59] !log decommissioned deployment-snapshot01 at last, long since replaced by deployment-snapshot02 [10:30:01] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [10:30:40] 10Project-Admins, 10Security, 10user-sbassett: Create security-related project tags secteam-reviewed and wikimedia-project-event - https://phabricator.wikimedia.org/T271729 (10Aklapper) I favor `processed"`(thanks for finding better words!) as it implies a process has finished in contrast to `reviewed`'s "we... [10:32:00] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10danshick-wmde) We had discussed my revamping the help page for Phabricator, which at the time I thought we agreed needed some serious work, and you invited me to go in and make chan... [10:33:20] 10Phabricator-Bot-Requests, 10observability: Create Phabricator bot for Alertmanager - https://phabricator.wikimedia.org/T272391 (10Aklapper) @fgiunchedi Sure, done! [10:33:47] 10Phabricator-Bot-Requests, 10observability: Create "phaultfinder" Phabricator bot account for Alertmanager - https://phabricator.wikimedia.org/T272391 (10Aklapper) [10:36:41] 10Project-Admins: Create Wikimedia Affiliates Data Portal project - https://phabricator.wikimedia.org/T272974 (10Aklapper) [10:37:38] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Analytics, 10Better Use Of Data, and 5 others: EventLogging PHP EventServiceClient should use EventBus->send(). - https://phabricator.wikimedia.org/T272863 (10hashar) The CI config change to add EventBus to the wmf-quibb... [10:43:14] 10Project-Admins: Create Wikimedia Affiliates Data Portal project - https://phabricator.wikimedia.org/T272974 (10Aklapper) 05Open→03Resolved a:03Aklapper Thanks a lot! (I asked as I'd like to avoid conversation venue fragmentation, and I also wanted to be absolutely sure that the Phab project and its workb... [10:51:10] (03CR) 10Gehel: [C: 03+1] "LGTM" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 (owner: 10Hashar) [10:52:26] (03CR) 10Gehel: "> Patch Set 4:" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [10:54:38] (03CR) 10Gehel: [C: 04-1] "see inline comments about disabling Maven Central" (031 comment) [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [10:55:24] 10Project-Admins: Create Wikimedia Affiliates Data Portal project - https://phabricator.wikimedia.org/T272974 (10DAlangi_WMF) Thank you very much @Aklapper. Much appreciated! [11:11:29] 10Phabricator-Bot-Requests, 10observability: Create "phaultfinder" Phabricator bot account for Alertmanager - https://phabricator.wikimedia.org/T272391 (10fgiunchedi) 05Open→03Resolved Amazing, thank you @Aklapper ! I've committed the token to production `private.git`, resolving. [11:20:52] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10Aklapper) Hmm... maybe we had a bit different aspects of "more readable" in mind, sorry. :-/ I'd love to better understand the advantages of moving content to subpages, I guess, gi... [12:05:12] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10danshick-wmde) As always, it's a question of what the audience finds most usable. Personally, I think if the audience is likely to search for things using Ctrl-F then my input is no... [12:05:30] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10danshick-wmde) 05Open→03Declined [12:14:44] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10danshick-wmde) (I reinserted the "Creating an account" section into the main document with my clarifications and changes.) [12:42:20] 10Continuous-Integration-Config, 10Release-Engineering-Team (CI & Testing services), 10Analytics, 10Better Use Of Data, and 5 others: EventLogging PHP EventServiceClient should use EventBus->send(). - https://phabricator.wikimedia.org/T272863 (10hashar) On the dummy change https://gerrit.wikimedia.org/r/c/... [12:43:58] (03PS2) 10Hashar: Add EventBus to the gate [integration/config] - 10https://gerrit.wikimedia.org/r/658946 (https://phabricator.wikimedia.org/T272863) [12:44:25] (03CR) 10Hashar: "Not ready yet. There is a dummy change https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EventBus/+/658922/ on which we can try the ex" [integration/config] - 10https://gerrit.wikimedia.org/r/658946 (https://phabricator.wikimedia.org/T272863) (owner: 10Hashar) [12:44:32] gehel: merci! [12:45:32] gehel: i will try the archiva magical proxy later tonight and report back [12:47:45] 10Beta-Cluster-Infrastructure: deployment-snapshot01.deployment-prep.eqiad.wmflabs keeps running out of space - https://phabricator.wikimedia.org/T245402 (10ArielGlenn) 05Open→03Resolved a:03ArielGlenn snapshot01 has been decommissoned, so this problem is officially gone. [13:05:46] hashar: good luck! Today is a bit crazy for me, but I can have time tomorrow to go over it if you want [13:09:57] gehel: same here :] Will poke you tomorrow morning [13:10:02] gehel: thanks for the reviews! [13:10:07] np [13:15:21] 10Deployments, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO: Remove "php-" from wiki version numbers - https://phabricator.wikimedia.org/T63733 (10hashar) Well that was open and showed up as is in our work board so I have explicitly marked it stalled which hide it from ou... [14:02:26] 10Release-Engineering-Team, 10Analytics-Radar, 10observability, 10serviceops, and 2 others: Create a separate 'mwdebug' cluster - https://phabricator.wikimedia.org/T262202 (10jijiki) [14:19:36] 10Phabricator: Protect Phabricator/Help subpages in the same way as Help page itself - https://phabricator.wikimedia.org/T272989 (10Aklapper) Apart from `Ctrl+F` (might not be very popular, indeed), I'd hope some folks look at the ToC of that central help page: What exactly could I expect behind terms like "adva... [15:05:35] Project beta-scap-eqiad build #335714: 04FAILURE in 1 min 12 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/335714/ [15:18:02] Yippee, build fixed! [15:18:02] Project beta-scap-eqiad build #335715: 09FIXED in 3 min 35 sec: https://integration.wikimedia.org/ci/job/beta-scap-eqiad/335715/ [15:46:12] (03CR) 10Hashar: Replace Emma coverage by Jacoco (031 comment) [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 (owner: 10Hashar) [15:47:46] (03CR) 10Hashar: "> Patch Set 4:" (031 comment) [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [15:48:01] (03PS2) 10Hashar: Replace Emma coverage by Jacoco [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 [15:48:03] (03PS5) 10Hashar: pom: move release to Wikimedia [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) [15:52:07] (03CR) 10Ahmon Dancy: [C: 03+1] Replace Emma coverage by Jacoco [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/658421 (owner: 10Hashar) [15:52:49] 10LibUp: Libup converts spaces to tab in package-lock.json - https://phabricator.wikimedia.org/T273070 (10hashar) [15:53:22] (03CR) 10jerkins-bot: [V: 04-1] pom: move release to Wikimedia [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [15:53:34] (03CR) 10Hashar: [C: 04-1] "Filed T273070 about space indentation becoming tabulations. It is not the end of the world (just ignore whitespace when reviewing) but I w" [integration/docroot] - 10https://gerrit.wikimedia.org/r/658892 (owner: 10Libraryupgrader) [15:53:41] bah [15:56:22] 10LibUp: Libup converts spaces to tab in package-lock.json - https://phabricator.wikimedia.org/T273070 (10Jdforrester-WMF) No, this is eslint doing this, because this is what our coding standards say you should do. We finally got proper JSON linting/fixing in eslint-config-wikimedia 0.18.0, hence why it suddenly... [16:00:14] 10LibUp: Libup converts spaces to tab in package-lock.json - https://phabricator.wikimedia.org/T273070 (10hashar) I will manually reindent the file and rebase the change on top of it to make a nice clean diff. I imagine npm is smart enough to detect whether it should use spaces or tabs? [16:00:43] (03PS1) 10Hashar: build: reindent package-lock.json to tabs [integration/docroot] - 10https://gerrit.wikimedia.org/r/659015 (https://phabricator.wikimedia.org/T273070) [16:02:23] 10LibUp, 10Patch-For-Review: Libup converts spaces to tab in package-lock.json - https://phabricator.wikimedia.org/T273070 (10Jdforrester-WMF) >>! In T273070#6780748, @hashar wrote: > I will manually reindent the file and rebase the change on top of it to make a nice clean diff. > > I imagine npm is smart eno... [16:03:06] 10LibUp, 10Patch-For-Review: Libup converts spaces to tab in package-lock.json - https://phabricator.wikimedia.org/T273070 (10Jdforrester-WMF) Oh, sorry, npm. Yes, I think npm follows precedent? Eh. [16:07:59] (03PS2) 10Hashar: build: Updating eslint-config-wikimedia to 0.18.0 [integration/docroot] - 10https://gerrit.wikimedia.org/r/658892 (owner: 10Libraryupgrader) [16:53:57] (03CR) 10Hashar: "Lame reindent for libup updating eslint-config-wikimedia to 0.18.0: https://gerrit.wikimedia.org/r/c/integration/docroot/+/658892/2" [integration/docroot] - 10https://gerrit.wikimedia.org/r/659015 (https://phabricator.wikimedia.org/T273070) (owner: 10Hashar) [16:57:43] (03CR) 10Hashar: [C: 03+2] build: Updating eslint-config-wikimedia to 0.18.0 [integration/docroot] - 10https://gerrit.wikimedia.org/r/658892 (owner: 10Libraryupgrader) [17:02:24] 10LibUp, 10Patch-For-Review: Libup converts spaces to tab in package-lock.json - https://phabricator.wikimedia.org/T273070 (10hashar) Gave it a try with npm 6.5.0 I have edit the package-lock.json to drop a dependency and change the indentation then ran `npm install --package-lock-only`. It has added back the... [17:03:40] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [17:03:51] (03CR) 10Hashar: "The CI job fails after disabling Maven Central. Apparently because fetching from our Archiva is way slower for some reason :-\" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [17:06:12] (03PS1) 10Hashar: Raise timeout for gearman-java jobs [integration/config] - 10https://gerrit.wikimedia.org/r/659025 [17:11:20] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [17:12:25] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [17:13:53] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [17:18:38] (03CR) 10Jeena Huneidi: [C: 03+1] "What does ns stand for?" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 (owner: 10Dduvall) [17:18:57] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [17:20:26] (03CR) 10Dduvall: "> Patch Set 1: Code-Review+1" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 (owner: 10Dduvall) [17:22:58] (03CR) 10Ahmon Dancy: "+1 I guess. :-)" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 (owner: 10Dduvall) [17:25:36] (03PS2) 10Hashar: Raise timeout for gearman-java jobs [integration/config] - 10https://gerrit.wikimedia.org/r/659025 (https://phabricator.wikimedia.org/T273086) [17:25:40] 10Phabricator, 10Release-Engineering-Team-TODO, 10Developer Productivity: Implement more phabricator project metrics - https://phabricator.wikimedia.org/T273087 (10mmodell) [17:25:51] (03CR) 10Hashar: "recheck I have raised the jobs timeout from 5 minutes to 10 minutes https://gerrit.wikimedia.org/r/c/integration/config/+/659025" [integration/gearman-java] - 10https://gerrit.wikimedia.org/r/657811 (https://phabricator.wikimedia.org/T271683) (owner: 10Hashar) [17:26:06] (03CR) 10Hashar: "That fixed it on https://gerrit.wikimedia.org/r/c/integration/gearman-java/+/657811/" [integration/config] - 10https://gerrit.wikimedia.org/r/659025 (https://phabricator.wikimedia.org/T273086) (owner: 10Hashar) [17:26:42] (03PS2) 10Dduvall: Avoid CPS failures in ExecutionContext exceptions [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 [17:27:03] 10Phabricator, 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Developer Productivity: Implement more phabricator project metrics - https://phabricator.wikimedia.org/T273087 (10mmodell) [17:27:54] (03CR) 10Dduvall: [C: 03+2] Avoid CPS failures in ExecutionContext exceptions [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 (owner: 10Dduvall) [17:28:29] (03Merged) 10jenkins-bot: Avoid CPS failures in ExecutionContext exceptions [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 (owner: 10Dduvall) [17:28:59] (03CR) 10Ahmon Dancy: Avoid CPS failures in ExecutionContext exceptions (031 comment) [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658745 (owner: 10Dduvall) [17:29:01] (03PS2) 10Dduvall: Namespace build parameters to `setup.params.[name]` [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 [17:34:42] 10Beta-Cluster-Infrastructure, 10Dumps-Generation: mediawiki scripts fail on new buster image in deployment-prep - https://phabricator.wikimedia.org/T273089 (10ArielGlenn) [17:35:53] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [17:38:07] (03CR) 10Hashar: "That fixed it on https://gerrit.wikimedia.org/r/c/integration/gearman-java/+/657811" [integration/config] - 10https://gerrit.wikimedia.org/r/659025 (https://phabricator.wikimedia.org/T273086) (owner: 10Hashar) [17:38:13] (03CR) 10Hashar: [C: 03+2] Raise timeout for gearman-java jobs [integration/config] - 10https://gerrit.wikimedia.org/r/659025 (https://phabricator.wikimedia.org/T273086) (owner: 10Hashar) [17:39:35] (03Merged) 10jenkins-bot: Raise timeout for gearman-java jobs [integration/config] - 10https://gerrit.wikimedia.org/r/659025 (https://phabricator.wikimedia.org/T273086) (owner: 10Hashar) [17:40:12] (03CR) 10Jeena Huneidi: Namespace build parameters to `setup.params.[name]` (031 comment) [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 (owner: 10Dduvall) [17:43:02] (03CR) 10Ahmon Dancy: [C: 04-1] apt.go: Add ability to target releases (035 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [17:44:38] (03CR) 10Dduvall: Namespace build parameters to `setup.params.[name]` (031 comment) [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 (owner: 10Dduvall) [17:46:44] (03PS3) 10Dduvall: Namespace build parameters to `setup.params.[name]` [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 [17:47:18] (03CR) 10Dduvall: Namespace build parameters to `setup.params.[name]` (031 comment) [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 (owner: 10Dduvall) [17:51:33] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw1407.eqiad.wmnet'] ` an... [17:52:20] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw1406.eqiad.wmnet'] ` an... [17:53:55] (03CR) 10Ahmon Dancy: [C: 03+1] Namespace build parameters to `setup.params.[name]` [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 (owner: 10Dduvall) [17:59:07] (03PS4) 10Dduvall: Namespace build parameters to `setup.params.[name]` [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 [17:59:48] (03CR) 10Dduvall: [C: 03+1] "My `getAt` implementation was bugging me a little so I simplified it." [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 (owner: 10Dduvall) [18:00:20] (03CR) 10Hashar: "Lars confirmed it ran fine on train-dev. I will give a look at the patch tomorrow and I guess +2 it. With Ahmon, Lars and me, that is prob" [tools/scap] - 10https://gerrit.wikimedia.org/r/657616 (https://phabricator.wikimedia.org/T222372) (owner: 10Lars Wirzenius) [18:00:59] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2301.codfw.wmnet'] ` an... [18:03:53] (03CR) 10Jforrester: [C: 03+1] "LGTM, do you want to deploy?" [integration/docroot] - 10https://gerrit.wikimedia.org/r/659015 (https://phabricator.wikimedia.org/T273070) (owner: 10Hashar) [18:04:07] James_F: yeah can be deployed using scap nowadays :] [18:04:15] /srv/deployment/integration/docroot [18:04:24] hashar: Yes, but I'm busy. :-) [18:04:24] I can take care of it after the team meeting [18:04:27] (Cool.) [18:04:29] will do :) [18:04:31] thx for the review!!! [18:04:35] Always. [18:06:23] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Release, 10Train Deployments: 1.36.0-wmf.29 deployment blockers - https://phabricator.wikimedia.org/T271343 (10hashar) Acknowledging I am running the train next week. [18:08:16] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:10:55] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:14:07] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:14:30] (03CR) 10Jeena Huneidi: apt.go: Add ability to target releases (033 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [18:19:20] (03CR) 10Hashar: [C: 03+2] "Thanks James!" [integration/docroot] - 10https://gerrit.wikimedia.org/r/659015 (https://phabricator.wikimedia.org/T273070) (owner: 10Hashar) [18:20:28] Jdlrobson: can I have the stack trace for T273094 please? [18:20:29] T273094: Uncaught SyntaxError: Unexpected identifier - CentralAuthLogin throwing SyntaxError - https://phabricator.wikimedia.org/T273094 [18:20:34] (03Merged) 10jenkins-bot: build: reindent package-lock.json to tabs [integration/docroot] - 10https://gerrit.wikimedia.org/r/659015 (https://phabricator.wikimedia.org/T273070) (owner: 10Hashar) [18:20:47] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw1268.eqiad.wmnet'] ` an... [18:20:59] or just the location of the syntax error? [18:23:08] 10LibUp, 10Patch-For-Review: Libup converts spaces to tab in package-lock.json - https://phabricator.wikimedia.org/T273070 (10hashar) 05Open→03Resolved a:03Jdforrester-WMF Done thanks! [18:23:14] (03PS15) 10Wolfgang Kandek: initial commit for gerrit please see README.md for more information [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 [18:24:31] (03CR) 10Wolfgang Kandek: "Hi, please help me with a review for this demo project for k8s 😊" [blubber-doc/example/calculator-service] - 10https://gerrit.wikimedia.org/r/658737 (owner: 10Wolfgang Kandek) [18:25:00] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [18:31:05] (03PS1) 10Majavah: zuul: allowlist: Change Majavah's email domain [integration/config] - 10https://gerrit.wikimedia.org/r/659054 [18:33:14] (03CR) 10DannyS712: [C: 03+1] zuul: allowlist: Change Majavah's email domain [integration/config] - 10https://gerrit.wikimedia.org/r/659054 (owner: 10Majavah) [18:33:46] (03CR) 10Dduvall: apt.go: Add ability to target releases (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [18:44:05] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2215.codfw.wmnet'] ` an... [18:53:57] (03CR) 10Dduvall: apt.go: Add ability to target releases (031 comment) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [18:54:23] (03CR) 10Ahmon Dancy: [C: 03+1] "> Patch Set 4: Code-Review+1" [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 (owner: 10Dduvall) [18:58:09] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2216.codfw.wmnet'] ` an... [19:01:42] (03CR) 10Jeena Huneidi: [C: 03+1] Namespace build parameters to `setup.params.[name]` [integration/pipelinelib] - 10https://gerrit.wikimedia.org/r/658746 (owner: 10Dduvall) [19:09:44] (03CR) 10Dduvall: [C: 04-1] apt.go: Add ability to target releases (035 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [19:15:27] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [19:26:45] (03CR) 10Jeena Huneidi: apt.go: Add ability to target releases (033 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [19:28:03] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2217.codfw.wmnet'] ` an... [19:28:28] 10Release-Engineering-Team, 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10MediaWiki-Docker, 10dev-images, 10User-brennen: dev-images: upgrade images for MediaWiki-Docker from wikimedia-stretch to wikimedia-buster - https://phabricator.wikimedia.org/T273100 (10brennen) [19:30:04] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2218.codfw.wmnet'] ` an... [19:30:53] 10Release-Engineering-Team, 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10MediaWiki-Docker, 10dev-images, 10User-brennen: dev-images: upgrade images for MediaWiki-Docker from wikimedia-stretch to wikimedia-buster - https://phabricator.wikimedia.org/T273100 (10brennen) p:05Triage→0... [19:31:45] 10Release-Engineering-Team (Development services), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10MediaWiki-Docker, 10dev-images, 10User-brennen: dev-images: upgrade images for MediaWiki-Docker from wikimedia-stretch to wikimedia-buster - https://phabricator.wikimedia.org/T273100 (10br... [19:32:07] 10Release-Engineering-Team (Local Dev), 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10MediaWiki-Docker, 10dev-images, 10User-brennen: dev-images: upgrade images for MediaWiki-Docker from wikimedia-stretch to wikimedia-buster - https://phabricator.wikimedia.org/T273100 (10brennen) [19:32:37] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2219.codfw.wmnet'] ` an... [19:38:28] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw1263.eqiad.wmnet'] ` an... [19:45:52] (03PS4) 10Jeena Huneidi: apt.go: Add ability to target releases [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) [19:47:38] (03CR) 10Jeena Huneidi: apt.go: Add ability to target releases (034 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [20:03:31] (03CR) 10Hashar: [C: 03+2] zuul: allowlist: Change Majavah's email domain [integration/config] - 10https://gerrit.wikimedia.org/r/659054 (owner: 10Majavah) [20:05:13] (03Merged) 10jenkins-bot: zuul: allowlist: Change Majavah's email domain [integration/config] - 10https://gerrit.wikimedia.org/r/659054 (owner: 10Majavah) [20:05:43] (03CR) 10Hashar: "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/659054 (owner: 10Majavah) [20:12:12] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [20:16:24] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [20:22:58] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [20:25:26] (03PS5) 10Jeena Huneidi: apt.go: Add ability to target releases [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) [20:25:33] 10Release-Engineering-Team (Logspam), 10Wikimedia-General-or-Unknown, 10Wikimedia-production-error: TypeError: format.replace is not a function in randomToken function used by SearchSatisfaction schema - https://phabricator.wikimedia.org/T272904 (10Krinkle) >>! Task description: > ` > at Date.prototype.toStr... [20:25:35] 10Release-Engineering-Team (Logspam), 10Wikimedia-General-or-Unknown, 10Wikimedia-production-error: TypeError: format.replace is not a function in randomToken function used by SearchSatisfaction schema - https://phabricator.wikimedia.org/T272904 (10Krinkle) [20:25:59] (03CR) 10Jeena Huneidi: apt.go: Add ability to target releases (034 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [20:26:10] (03CR) 10jerkins-bot: [V: 04-1] apt.go: Add ability to target releases [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [20:29:12] 10Release-Engineering-Team (Logspam), 10Wikimedia-General-or-Unknown, 10Wikimedia-production-error: TypeError: format.replace is not a function in randomToken function used by SearchSatisfaction schema - https://phabricator.wikimedia.org/T272904 (10Jdlrobson) I do agree it looks a little suspect. 170 errors... [20:35:15] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2221.codfw.wmnet'] ` an... [20:45:47] Jdlrobson: hrm, i take it client errors don't know mw version? [20:51:06] (03PS6) 10Jeena Huneidi: apt.go: Add ability to target releases [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) [20:51:53] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw1405.eqiad.wmnet'] ` an... [20:54:07] (03CR) 10Jeena Huneidi: apt.go: Add ability to target releases (032 comments) [blubber] - 10https://gerrit.wikimedia.org/r/658432 (https://phabricator.wikimedia.org/T272759) (owner: 10Jeena Huneidi) [21:00:08] Project mwcore-phpunit-coverage-master build #1181: 04STILL FAILING in 6 hr 0 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/1181/ [21:05:13] 10Release-Engineering-Team (Logspam), 10Editing-team, 10MediaWiki-extensions-Graph, 10JavaScript, 10Wikimedia-production-error: Uncaught TypeError: Cannot read property 'type' of undefined at axis_def - https://phabricator.wikimedia.org/T270508 (10Krinkle) [21:05:54] brennen: indeed, not yet. would be nice to add, though! [21:06:03] mwversion: wgVersion :) [21:06:32] yeah, would be handy if we're going to be blocking the train on an increase in errors in a given version. [21:23:50] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10Scap, 10serviceops: Define a mediawiki "version" - https://phabricator.wikimedia.org/T218412 (10Legoktm) [21:36:26] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2222.codfw.wmnet'] ` an... [21:37:40] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['mw2246.codfw.wmnet'] ` an... [21:48:32] 10Release-Engineering-Team-TODO, 10MediaWiki-Docker, 10Developer Productivity, 10Patch-For-Review, 10User-Addshore: Port mediawiki-docker-dev "mwdd" v1 cli in to go - https://phabricator.wikimedia.org/T253313 (10kostajh) >>! In T253313#6773720, @Addshore wrote: > I also commented on the gerrit change, bu... [21:51:39] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.28 deployment blockers - https://phabricator.wikimedia.org/T271342 (10aaron) [21:54:59] 10Beta-Cluster-Infrastructure, 10Dumps-Generation: mediawiki scripts fail on new buster image in deployment-prep - https://phabricator.wikimedia.org/T273089 (10ArielGlenn) A little more info. On the new instance, I run curl from the command line with the url mediawiki is trying to get: ` curl -H 'Content-Type:... [22:17:38] 10Phabricator: Assign/claim option seems to be gone in 'production error' Phabricator task type - https://phabricator.wikimedia.org/T273119 (10Tgr) [22:24:11] 10Release-Engineering-Team-TODO, 10MediaWiki-Docker, 10Developer Productivity, 10Patch-For-Review, 10User-Addshore: Port mediawiki-docker-dev "mwdd" v1 cli in to go - https://phabricator.wikimedia.org/T253313 (10jeena) >I think this would be worth discussing and reaching some agreement on, because yeah I... [22:26:25] 10Beta-Cluster-Infrastructure, 10Dumps-Generation: mediawiki scripts fail on new buster image in deployment-prep - https://phabricator.wikimedia.org/T273089 (10ArielGlenn) If I pass --cacert /etc/ssl/certs/ca-certificates.crt on sn03, the command works. On stretch, libcurl is compiled to find the ca-certific... [22:27:48] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.28 deployment blockers - https://phabricator.wikimedia.org/T271342 (10Urbanecm) [22:36:47] 10Release-Engineering-Team-TODO (2021-01-01 to 2021-03-31 (Q3)), 10Patch-For-Review, 10Release, 10Train Deployments, 10User-brennen: 1.36.0-wmf.28 deployment blockers - https://phabricator.wikimedia.org/T271342 (10dancy) Other new noise: T273099: Undefined class constant 'BASE_CSS_CLASS' T273101: Access... [22:56:10] 10Beta-Cluster-Infrastructure, 10Dumps-Generation: mediawiki scripts fail on new buster image in deployment-prep - https://phabricator.wikimedia.org/T273089 (10ArielGlenn) And the reason the symlink in /etc/ssl/certs isn't picked up as a fallback: ` dumpsgen@deployment-snapshot03:/etc/ssl/certs$ ls -l Puppet_I... [23:01:08] 10Release-Engineering-Team-TODO, 10MediaWiki-Docker, 10Developer Productivity, 10Patch-For-Review, 10User-Addshore: Port mediawiki-docker-dev "mwdd" v1 cli in to go - https://phabricator.wikimedia.org/T253313 (10Addshore) > Hmm, I don't see them as fundamentally different, I believe both are tools aiming... [23:19:08] Krinkle: is creeping on my terrible WIP rushed port patches :P [23:41:18] 10Phabricator: Assign/claim option seems to be gone in 'production error' Phabricator task type - https://phabricator.wikimedia.org/T273119 (10thcipriani) 05Open→03Resolved a:03thcipriani Noticed this in the train log triage meeting as well. I noticed on the form "owner:hidden" was set on production errors... [23:56:15] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia... [23:57:30] 10Release-Engineering-Team (Deployment services), 10Release-Engineering-Team-TODO, 10SRE, 10serviceops, 10User-jijiki: Upgrade MediaWiki clusters to Debian Buster (debian 10) - https://phabricator.wikimedia.org/T245757 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by dzahn on cumin1001.eqia...