[00:03:29] (03approved) 10thcipriani: spiderpig: Render progress reports [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/730 (owner: 10dancy) [00:05:05] (03approved) 10thcipriani: JobCard.vue: Use font-weight: bold for the job status [repos/releng/scap] (master-I0e61cabaaacb47aebb064a04e8cc30de7261d717) - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/736 (https://phabricator.wikimedia.org/T383835) (owner: 10dancy) [01:53:37] (03open) 10egardner: releases: Update Codex from v1.21.1 to v1.22.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/69 [03:15:45] (03approved) 10volker-e: releases: Update Codex from v1.21.1 to v1.22.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/69 (owner: 10egardner) [03:15:48] (03merge) 10volker-e: releases: Update Codex from v1.21.1 to v1.22.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/69 (owner: 10egardner) [07:20:03] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 06collaboration-services: GitLab Runner job logs are truncated - https://phabricator.wikimedia.org/T390816 (10Jelto) 03NEW [07:20:26] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 06collaboration-services: GitLab Runner job logs are truncated - https://phabricator.wikimedia.org/T390816#10702356 (10Jelto) p:05Triage→03Medium [07:23:45] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 10Wikidata, 10Wikidata Query UI, and 3 others: move query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10702359 (10karapayneWMDE) @Jelto Today works fine! [07:27:38] Minor question: Should I add a special deployment window for running a fairly safe maintenance script (on 100 wikis), or is this something I can just do at any time? Or should I be avoiding other deployment windows? [07:28:12] For context, the script is making narrowly-constrained edits to Common.css on each site. [07:59:00] (03open) 10jelto: gitlab_runner: increase job output_limit to 20MB [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/467 (https://phabricator.wikimedia.org/T390816) [08:04:30] awight: should be fine to run outside other deploymebt windows, but you can add a special window if you'd like too [08:06:45] 10Gerrit (Gerrit 3.10): Upgrade to Gerrit 3.10.5 - https://phabricator.wikimedia.org/T390666#10702439 (10hashar) [08:07:24] 10Gerrit (Gerrit 3.10): Upgrade to Gerrit 3.10.5 - https://phabricator.wikimedia.org/T390666#10702442 (10hashar) [08:07:25] 10Gerrit (Gerrit 3.10), 07Upstream: Inverted search operators are not autocompleted - https://phabricator.wikimedia.org/T388672#10702443 (10hashar) [08:07:27] 10Gerrit, 07Upstream: Gerrit editor replaces tabs with spaces - https://phabricator.wikimedia.org/T355816#10702444 (10hashar) [08:07:28] 10Gerrit, 07Upstream: Gerrit notification emails are missing the content of inline comments on unchanged files - https://phabricator.wikimedia.org/T355259#10702445 (10hashar) [08:08:55] 10Gerrit (Gerrit 3.10), 07Upstream: Gerrit editor replaces tabs with spaces - https://phabricator.wikimedia.org/T355816#10702448 (10hashar) The fix has been released in 3.10.5 and 3.11.2 [08:10:18] 10Gerrit (Gerrit 3.10), 07Upstream: Gerrit notification emails are missing the content of inline comments on unchanged files - https://phabricator.wikimedia.org/T355259#10702452 (10hashar) The fix has been released in v3.11.2, **v3.10.5** and v3.9.10 [08:38:50] 10Continuous-Integration-Infrastructure: Find and document how to debug a NodeJS process on CI/Docker - https://phabricator.wikimedia.org/T390125#10702571 (10hashar) [08:48:17] 10MediaWiki-Releasing, 10MediaWiki-Documentation, 05MW-1.44-notes, 05MW-1.44-release: Finish up RELEASE-NOTES for 1.44.0 - https://phabricator.wikimedia.org/T390796#10702606 (10Peachey88) [10:20:03] (03open) 10cgoubert: mediawiki-cli: Add moreutils [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/158 (https://phabricator.wikimedia.org/T388538) [10:24:29] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703052 (10OKarakaya-WMF) a:03brennen [10:26:58] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703056 (10OKarakaya-WMF) hi @brennen , I've recently started at WMF in the ml-team. I think my gitlab account needs activation: https:... [10:28:18] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703058 (10Peachey88) @OKarakaya-WMF As a start, please associate your Developer account (LDAP) with your Phabricator account using https:/... [10:28:31] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703059 (10Peachey88) a:05brennen→03None [10:31:51] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703073 (10OKarakaya-WMF) thank you @Peachey88 , I've linked my Developer account (LDAP) with Phabricator now. [10:39:56] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703118 (10Peachey88) I've added you to the Phabricator #trusted-contributors project, so a automated bot should approve the request in the... [11:06:22] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703174 (10Aklapper) 05Open→03Resolved a:03Peachey88 @OKarakaya-WMF: Hi and welcome! Ideally, https://ldap.toolforge.org/user/ozg... [11:14:21] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for ozge okarakaya@wikimedia.org - https://phabricator.wikimedia.org/T390842#10703181 (10OKarakaya-WMF) hi thank you for your help. Indeed it's in the onboarding doc. I missed it. Thank you! [11:54:40] 10Phabricator (Upstream), 07Upstream: Exception: "Call to phutil_nonempty_string() expected null or a string, got: int" in PhabricatorRepository.php (due to Importing) - https://phabricator.wikimedia.org/T347483#10703306 (10Aklapper) 05Open→03Stalled a:03Aklapper [12:08:08] (03PS1) 10Hashar: Zuul: [operations/software/bitu] add debian-glue (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/1133369 [12:12:52] (03CR) 10Hashar: [C:03+2] "When the CI job becomes a SUCCESS, we can amend this config file and replace the template by `debian-glue`. CI will then block whenever t" [integration/config] - 10https://gerrit.wikimedia.org/r/1133369 (owner: 10Hashar) [12:14:08] (03Merged) 10jenkins-bot: Zuul: [operations/software/bitu] add debian-glue (non voting) [integration/config] - 10https://gerrit.wikimedia.org/r/1133369 (owner: 10Hashar) [12:18:14] (03PS1) 10Reedy: Revert^2 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133373 (https://phabricator.wikimedia.org/T390754) [12:18:20] (03PS2) 10Reedy: Revert^2 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133373 (https://phabricator.wikimedia.org/T390754) [12:18:27] (03CR) 10Reedy: [C:03+2] Revert^2 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133373 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [12:19:46] Eurgh. [12:19:51] (03Merged) 10jenkins-bot: Revert^2 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133373 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [12:20:10] * Reedy hands James_F a turtle or 5 [12:20:33] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1133373 [12:20:34] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:21:22] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, and 2 others: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10703412 (10Reedy) Parsoid is probably the only thing in MW land currently running PHP 8.2/8... [12:23:41] (03PS1) 10Reedy: zuul: Explicitly remove WebAuthn from parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/1133379 (https://phabricator.wikimedia.org/T390754) [12:23:42] lint won't like it [12:24:22] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, and 2 others: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10703419 (10Jdforrester-WMF) >>! In T390754#10703412, @Reedy wrote: > Parsoid is probably th... [12:25:06] (03CR) 10CI reject: [V:04-1] zuul: Explicitly remove WebAuthn from parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/1133379 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [12:26:15] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, and 2 others: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10703421 (10Reedy) >>! In T390754#10703419, @Jdforrester-WMF wrote: >>>! In T390754#10703412... [12:27:20] (03PS2) 10Reedy: zuul: Explicitly remove WebAuthn from parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/1133379 (https://phabricator.wikimedia.org/T390754) [12:29:06] (03PS3) 10Reedy: zuul: Explicitly remove WebAuthn from parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/1133379 (https://phabricator.wikimedia.org/T390754) [12:29:09] (03CR) 10CI reject: [V:04-1] zuul: Explicitly remove WebAuthn from parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/1133379 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [12:30:12] 10Continuous-Integration-Config, 10MediaWiki-Releasing, 05MW-1.44-release: Configure CI to support REL1_44 - https://phabricator.wikimedia.org/T390695#10703430 (10hashar) [12:31:04] (03CR) 10Reedy: [C:03+2] zuul: Explicitly remove WebAuthn from parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/1133379 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [12:32:25] (03PS1) 10Reedy: zuul: Simplify CommunityConfiguration if to one liner [integration/config] - 10https://gerrit.wikimedia.org/r/1133380 [12:32:29] (03Merged) 10jenkins-bot: zuul: Explicitly remove WebAuthn from parsoid [integration/config] - 10https://gerrit.wikimedia.org/r/1133379 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [12:33:08] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10Testing Support, and 3 others: CI jobs failing with various timeouts (March 2025) - https://phabricator.wikimedia.org/T388416#10703442 (10hashar) > For this specific task, I was thinking that maybe we co... [12:33:44] (03CR) 10Reedy: [C:03+2] zuul: Simplify CommunityConfiguration if to one liner [integration/config] - 10https://gerrit.wikimedia.org/r/1133380 (owner: 10Reedy) [12:34:45] (03CR) 10Ananimous57: [C:03+1] zuul: Simplify CommunityConfiguration if to one liner [integration/config] - 10https://gerrit.wikimedia.org/r/1133380 (owner: 10Reedy) [12:34:53] (03Merged) 10jenkins-bot: zuul: Simplify CommunityConfiguration if to one liner [integration/config] - 10https://gerrit.wikimedia.org/r/1133380 (owner: 10Reedy) [12:36:30] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1133379 https://gerrit.wikimedia.org/r/1133380 [12:36:31] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [12:38:44] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, and 2 others: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10703468 (10Reedy) Maybe there's other edge cases that we just haven't learned are broken ye... [12:39:30] (03PS1) 10Reedy: Revert^3 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133383 [12:43:58] taavi: Thanks for the feedback! I'll keep the special window this time but good to know it's not strictly needed. [12:44:04] (03PS2) 10Reedy: Revert^3 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133383 (https://phabricator.wikimedia.org/T390754) [12:47:39] 10Continuous-Integration-Infrastructure, 10CampaignEvents, 10Campaigns-Product-Team (Campaign-Tools-Current-Sprint), 07ci-test-error: api-testing CI failure: Timeout of 5000ms exceeded in "before all" hook in "POST /campaignevents/v0/event_registration" - https://phabricator.wikimedia.org/T389863#10703485 (... [13:09:01] 10Phabricator (Upstream), 10Release-Engineering-Team (Doing 😎), 07Upstream: Exception: "Call to phutil_nonempty_string() expected null or a string, got: int" in PhabricatorRepository.php (due to Importing) - https://phabricator.wikimedia.org/T347483#10703587 (10Aklapper) [13:09:42] 06Release-Engineering-Team, 10Scap: Remove hard dependencies on GitLab, Toolforge And Phorge/Phab - https://phabricator.wikimedia.org/T358876#10703589 (10hashar) Thank you for having fixed the dependency on toolforge (I had it filed as T358876 immediately after it blocked me while running a train). [13:11:13] 10Phabricator (Upstream), 10Release-Engineering-Team (Doing 😎), 07Upstream: Exception: "Call to phutil_nonempty_string() expected null or a string, got: int" in PhabricatorRepository.php (due to Importing) - https://phabricator.wikimedia.org/T347483#10703591 (10Aklapper) [13:11:14] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥): Update to Phorge upstream 2025.xx release - https://phabricator.wikimedia.org/T386558#10703592 (10Aklapper) [13:11:20] 10Phabricator (Upstream), 10Release-Engineering-Team (Doing 😎), 07Upstream: Exception: "Call to phutil_nonempty_string() expected null or a string, got: int" in PhabricatorRepository.php (due to Importing) - https://phabricator.wikimedia.org/T347483#10703593 (10Aklapper) [13:11:22] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥): Update to Phorge upstream 2025.xx release - https://phabricator.wikimedia.org/T386558#10703594 (10Aklapper) [13:11:29] 10Phabricator (Upstream), 10Release-Engineering-Team (Doing 😎), 07Upstream: Exception: "Call to phutil_nonempty_string() expected null or a string, got: int" in PhabricatorRepository.php (due to Importing) - https://phabricator.wikimedia.org/T347483#10703596 (10Aklapper) [13:11:31] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥): Update to Phorge upstream 2025.xx release - https://phabricator.wikimedia.org/T386558#10703597 (10Aklapper) [13:18:17] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release: Mark REL1_43 in ExtensionDistributor as a stable release - https://phabricator.wikimedia.org/T390856 (10Atieno) 03NEW [13:18:29] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release, 05Release: Release MediaWiki 1.44.0 - https://phabricator.wikimedia.org/T390686#10703623 (10Atieno) [13:18:30] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release: Mark REL1_43 in ExtensionDistributor as a stable release - https://phabricator.wikimedia.org/T390856#10703622 (10Atieno) [13:18:47] (03CR) 10Hashar: [C:03+2] "I have updated the job :)" [integration/config] - 10https://gerrit.wikimedia.org/r/1130325 (owner: 10Jforrester) [13:19:56] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release, 05Release: Release MediaWiki 1.44.0 - https://phabricator.wikimedia.org/T390686#10703627 (10Atieno) @Aklapper they were in the blocker column that's why I added them...if they don't block then that's fine [13:20:04] (03Merged) 10jenkins-bot: jjb: [mwcore-phpunit-coverage-patch] lower timeout from 60 to 20 mins [integration/config] - 10https://gerrit.wikimedia.org/r/1130325 (owner: 10Jforrester) [13:20:13] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release: Mark REL1_43 in ExtensionDistributor as a stable release - https://phabricator.wikimedia.org/T390856#10703629 (10Atieno) [13:20:15] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release, 05Release: Release MediaWiki 1.44.0 - https://phabricator.wikimedia.org/T390686#10703630 (10Atieno) [13:20:25] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release: Mark REL1_43 in ExtensionDistributor as a stable release - https://phabricator.wikimedia.org/T390856#10703631 (10Atieno) 05Open→03Invalid [13:26:22] 10GitLab (Pipeline Services Migration🐤), 06collaboration-services, 10Wikidata, 10Wikidata Query UI, and 3 others: move query.wikidata.org to kubernetes - https://phabricator.wikimedia.org/T350793#10703648 (10Jelto) We tested `/querybuilder` on wikikube but had to revert it. The querybuilder returned a `404... [13:37:00] (03PS3) 10Reedy: Revert^3 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133383 (https://phabricator.wikimedia.org/T390754) [13:37:07] (03CR) 10Reedy: [C:03+2] "Third time lucky" [integration/config] - 10https://gerrit.wikimedia.org/r/1133383 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [13:37:27] 10Continuous-Integration-Config, 10Math, 10MediaWiki-Platform-Team (Radar), 10MW-1.44-notes (1.44.0-wmf.24; 2025-04-08), 13Patch-For-Review: Allow control over which extra extensions are installed (Math REL1_43 jobs exceed 60min timeout) - https://phabricator.wikimedia.org/T389998#10703721 (10Daimona) Dr... [13:38:21] (03Merged) 10jenkins-bot: Revert^3 "layout.yaml: Remove quibble-composer-mysql-php8[32] from parsoid gate" [integration/config] - 10https://gerrit.wikimedia.org/r/1133383 (https://phabricator.wikimedia.org/T390754) (owner: 10Reedy) [13:39:02] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, and 2 others: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10703727 (10Jdforrester-WMF) >>! In T390754#10703421, @Reedy wrote: >>>! In T390754#10703419... [13:39:17] !log Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1133383 T390754 [13:39:19] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:39:19] T390754: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754 [13:40:45] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, and 2 others: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10703750 (10Jdforrester-WMF) Options: * Switch Parsoid to vendor jobs, and carve out the spe... [13:41:00] 10Gerrit, 06Release-Engineering-Team, 06Security-Team, 07SecTeam-Processed, 07Security: Develop a means for preventing developers from accidentally pushing embargoed security patches to gerrit - https://phabricator.wikimedia.org/T388247#10703769 (10Lucas_Werkmeister_WMDE) Semi-relatedly, I just realized... [13:41:12] (03PS1) 10Atieno: Zuul: Configure the REL1_44 test and gate pipelines [integration/config] - 10https://gerrit.wikimedia.org/r/1133403 (https://phabricator.wikimedia.org/T390695) [13:42:16] (03CR) 10CI reject: [V:04-1] Zuul: Configure the REL1_44 test and gate pipelines [integration/config] - 10https://gerrit.wikimedia.org/r/1133403 (https://phabricator.wikimedia.org/T390695) (owner: 10Atieno) [13:44:17] 10MediaWiki-Releasing, 05MW-1.44-notes, 05MW-1.44-release, 05Release: Release MediaWiki 1.44.0 - https://phabricator.wikimedia.org/T390686#10703780 (10Aklapper) @Atieno: See the blue box which you added in the description of this task. [13:45:03] 10Continuous-Integration-Infrastructure, 10CampaignEvents, 10Campaigns-Product-Team (Campaign-Tools-Current-Sprint), 07ci-test-error: api-testing CI failure: Timeout of 5000ms exceeded in "before all" hook in "POST /campaignevents/v0/event_registration" - https://phabricator.wikimedia.org/T389863#10703782 (... [13:49:48] (03CR) 10Jforrester: Zuul: Configure the REL1_44 test and gate pipelines (032 comments) [integration/config] - 10https://gerrit.wikimedia.org/r/1133403 (https://phabricator.wikimedia.org/T390695) (owner: 10Atieno) [13:52:09] 10Continuous-Integration-Infrastructure, 10CampaignEvents, 10Campaigns-Product-Team (Campaign-Tools-Current-Sprint), 07ci-test-error: api-testing CI failure: Timeout of 5000ms exceeded in "before all" hook in "POST /campaignevents/v0/event_registration" - https://phabricator.wikimedia.org/T389863#10703831 (... [13:55:05] James_F: why do we keep edit-conflicting on everything we do? :P [13:55:26] Daimona: Because you're awesome and I'm a shameless follower of interesting tasks. [13:58:08] Apparently that was the wrong thing to say? ;-) [13:58:33] Ye olde "randomly mess something up while cleaning the keyboard" [13:59:09] It's traditional to blame a cat, or the ghost of a cat. [13:59:31] But I mean, I can only be honoured of conflicting with you :D [14:00:02] * James_F grins. [14:00:25] I blame having lunch too close to the keyboard, heh. [14:00:59] Cleaning the keyboard always makes me discover shortcuts I never knew existed. [14:02:14] every couple of weeks I hit the “mess up the screen arrangement” shortcut in gnome, that one’s annoying [14:07:08] 10Scap, 06Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service: scap service restarts for WDQS are inconsistent - https://phabricator.wikimedia.org/T221709#10703943 (10bking) [14:10:04] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, and 2 others: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10703978 (10kostajh) >>! In T390754#10703749, @Jdforrester-WMF wrote: > Options: > * Drop We... [14:10:12] 10Scap, 06Data-Platform-SRE, 10Wikidata, 10Wikidata-Query-Service: scap service restarts for WDQS are inconsistent - https://phabricator.wikimedia.org/T221709#10703981 (10dcausse) With the graph split deploying wdqs is even harder since you have to run cuming to apply a restart on wider set of nodes possib... [14:11:11] Now it's time to see if that patch actually did anything... [14:14:51] Eh, it seems close to the 5s timeout still. Welp. [14:15:15] still in Torblock? [14:16:00] I don't think so, but I'll check the logs to confirm. Waiting for the build to finish. [14:16:24] I mean, the change is surely a good thing, it's just that it probably didn't solve the timeout I thought it would cause. [14:16:36] you mean we have many issues in our test? [14:19:31] I know right, you'll never believe that. You must be absolutely shocked, astonished, flabbergasted. [14:20:25] "You'll never believe what he found in CI logs" [14:21:18] "He ran tests in CI, what happens next will SHOCK you", etc. [14:22:24] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06Release-Engineering-Team, 06cloud-services-team, 10Cloud-VPS (Project-requests), 13Patch-For-Review: Request creation of zuul3 VPS project - https://phabricator.wikimedia.org/T390081#10704124 (10aborrero) 05Open→03Resolved a:03aborrero [14:24:48] 10Continuous-Integration-Infrastructure, 10CampaignEvents, 10Campaigns-Product-Team (Campaign-Tools-Current-Sprint), 07ci-test-error: api-testing CI failure: Timeout of 5000ms exceeded in "before all" hook in "POST /campaignevents/v0/event_registration" - https://phabricator.wikimedia.org/T389863#10704144 (... [14:27:28] "27 reasons why CI is slow. Number 6 will surprise you!" [14:46:15] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, 05MW-1.43-release: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10704285 (10Jdforrester-WMF) >>! In T390754#10703978, @kostajh wrote: >>>! In T390754... [14:51:32] * James_F wonders if there's a nice way to get mw-debug-log to have finer-grained time logging. [15:08:36] Huh? You mean that "make a hacky patch for MediaWiki core, butchering and replacing the logging logic entirely, and have your other patches Depends-On it" is not a nice way? [15:09:28] I was thinking more of adding a TS_MOARTIMING constant that logs at the milisecond level rather than second. [15:09:56] But so much of our MWDebug code seems to assume 1s granularity. [15:12:19] In theory we wouldn't be forced to TS constants, no? But I don't know about the assumptions. [15:13:31] TS_MW/TS_DB/TS_UNIX etc. assumptions of "formatting" include rounding times. In at least one line I spotted, we take an ms value and divide it by 1000 to report it. [15:13:50] Maybe I'll file a task to nerd-snipe someone in future. Hopefully that person won't be me. [15:15:16] I suppose there's T155552 which would help a bit? [15:15:16] T155552: Make Monolog the default debug processing layer and deprecate wfDebug* and LegacyLogger - https://phabricator.wikimedia.org/T155552 [15:23:02] Project beta-code-update-eqiad build #541872: 04FAILURE in 1.3 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/541872/ [15:30:29] what nowwwww [15:30:39] 16:23:01 fatal: unable to access 'https://gerrit.wikimedia.org/r/operations/mediawiki-config/': The requested URL returned error: 503 [15:30:39] 16:23:01 (scap version: 4.139.0) [15:30:56] gerrit failover is in progress [15:31:03] that'll explain it :) [15:35:02] Yippee, build fixed! [15:35:02] Project beta-code-update-eqiad build #541873: 09FIXED in 2 min 1 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/541873/ [15:35:25] Project mediawiki-core-phpmetrics build #349: 04FAILURE in 1 min 24 sec: https://integration.wikimedia.org/ci/job/mediawiki-core-phpmetrics/349/ [15:43:00] Reedy: try again now. should be good, right? [16:05:15] 10Continuous-Integration-Config, 10Parsoid, 10ci-test-error (WMF-deployed Build Failure), 05MW-1.42-release, 05MW-1.43-release: quibble-composer-mysql-php8[23] fail since 31/3 - https://phabricator.wikimedia.org/T390754#10704764 (10kostajh) >>! In T390754#10704285, @Jdforrester-WMF wrote: >>>! In T390754... [16:05:37] 10Gerrit, 06Release-Engineering-Team, 06Security-Team, 07SecTeam-Processed, 07Security: Develop a means for preventing developers from accidentally pushing embargoed security patches to gerrit - https://phabricator.wikimedia.org/T388247#10704768 (10Tgr) "No top-level `.patch` files" sounds like a very re... [16:14:02] where did the stuff in gate and submit just go... [16:29:32] I'm updating CodeMirrors colours in Gerrit's CM. Old: https://imgur.com/a/old-cm-theme-wZ5846v New: https://imgur.com/a/A5SGLhm. https://gerrit-review.googlesource.com/c/plugins/codemirror-editor/+/463562 (not yet merged) [16:30:27] new colours are to align with highlightjs but also so we can highlight more. CodeMirror v6 doesn't highlight everything by default. [16:31:47] Also added edit preference changes apply live: https://imgur.com/a/FJ7K7nc (https://gerrit-review.googlesource.com/c/gerrit/+/463141 merged) [16:32:38] dancy: the task I had in mind about docker registry corruption was https://phabricator.wikimedia.org/T214441 from 2019. Due to HEAD requests being made [16:33:51] so essentially unrelated [16:34:39] I think there was another similar task involving a split brain but I can't find it [16:37:28] why are master patches deciding htey need to be blocked on wmf branch patches because of depends-on... [16:37:31] didn't we fix that before? [16:40:15] also [16:40:22] WTB cherry pick to many branches at once [16:40:23] 10Scap (SpiderPig 🕸️): User uid=bd808 unable to finish authentication with spiderpig - https://phabricator.wikimedia.org/T389869#10705029 (10bd808) 05Open→03Resolved a:03dancy I had to use https://idp.wikimedia.org/logout and drop cookies for idp and spiderpig to get in the first time, but it all seems... [16:41:08] 10Gerrit, 06Release-Engineering-Team, 06Security-Team, 07SecTeam-Processed, 07Security: Develop a means for preventing developers from accidentally pushing embargoed security patches to gerrit - https://phabricator.wikimedia.org/T388247#10705034 (10sbassett) 05Open→03In progress p:05Triage→03Low [16:56:04] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 06Security-Team: Allow to change subtype of Security subtype tasks (via mutations config setting) - https://phabricator.wikimedia.org/T389738#10705099 (10sbassett) 05Open→03In progress p:05Triage→03Low a:03sbassett [16:57:15] 10Continuous-Integration-Infrastructure, 10CampaignEvents, 10Campaigns-Product-Team (Campaign-Tools-Current-Sprint), 07ci-test-error: api-testing CI failure: Timeout of 5000ms exceeded in "before all" hook in "POST /campaignevents/v0/event_registration" - https://phabricator.wikimedia.org/T389863#10705107 (... [17:04:40] jeena: [17:04:42] err [17:04:47] \o/ [17:04:47] :) [17:16:38] 06Release-Engineering-Team, 06Security-Team, 07SecTeam-Processed, 07Security: Split PrivateSettings into config and business logic - https://phabricator.wikimedia.org/T390773#10705175 (10sbassett) [17:17:49] (03open) 10jgleeson: Add wmf-cv wrapper script to CiviCRM Docker image [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/74 (https://phabricator.wikimedia.org/T383097) [17:18:41] (03update) 10jgleeson: Add wmf-cv wrapper script to CiviCRM Docker image [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/74 (https://phabricator.wikimedia.org/T383097) [17:26:49] Reedy: do you have an example? [17:27:30] 10Gerrit, 10Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services: Remove explicit enablement of G1 garbage collector for Gerrit - https://phabricator.wikimedia.org/T387223#10705223 (10hashar) {F58967066, layout=inline} Eden space spikes ---- {F58967065, layout=inline} Old generation seem... [17:27:38] jeena: What of? [17:28:14] well I thought hashar pinged me about that but now I'm not sure hahaha...the master patches being blocked on wmf branch patches [17:28:39] jeena: oh I merely ping you because you were saying hi at the end of our meeting :) [17:28:47] :D [17:28:49] so I wanted to wave back `\o/` [17:28:49] :b [17:28:54] Hi :) [17:29:09] also your mic was broken, I could barely hear you [17:29:20] yeah it's annoying [17:29:29] is that the mac builtin mic? [17:29:41] it gets louder when I keep talking. something about firefox and google meet [17:29:54] fun :/ [17:30:16] or the Mac is autoadjusting volume [17:30:20] who knows [17:30:24] anyway, dinner time! [17:30:40] 👋 [17:33:17] https://silviustroe.com/prevent-browser-from-adjusting-your-microphone-levels/ [17:33:34] ooh [17:33:39] (03update) 10jgleeson: Add wmf-cv wrapper script to CiviCRM Docker image [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/74 (https://phabricator.wikimedia.org/T383097) [17:34:54] hmm, would that affect it like when there is background noise and stuff too though? [17:35:12] Probably. :-) [17:37:34] (03update) 10jgleeson: Add wmf-cv wrapper script to CiviCRM Docker image [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/74 (https://phabricator.wikimedia.org/T383097) [18:05:05] (03merge) 10dancy: gitlab_runner: increase job output_limit to 20MB [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/467 (https://phabricator.wikimedia.org/T390816) (owner: 10jelto) [18:17:56] (03update) 10jgleeson: Add wmf-cv wrapper script to CiviCRM Docker image [repos/releng/dev-images] - 10https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/74 (https://phabricator.wikimedia.org/T383097) [18:47:48] 10Phabricator (phabricator-next), 07Regression: Incorrect "Tasks completed this week" number on Project pages - https://phabricator.wikimedia.org/T390756#10705629 (10Aklapper) 05Open→03Resolved Fixed in https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/commit/18faa838bbed525d6362871854789055... [18:48:00] 10Phabricator (phabricator-next), 10Release-Engineering-Team (Doing 😎), 07Regression: Incorrect "Tasks completed this week" number on Project pages - https://phabricator.wikimedia.org/T390756#10705631 (10Aklapper) [19:28:52] 10Continuous-Integration-Infrastructure, 10CampaignEvents, 10Campaigns-Product-Team (Campaign-Tools-Current-Sprint), 07ci-test-error: api-testing CI failure: Timeout of 5000ms exceeded in "before all" hook in "POST /campaignevents/v0/event_registration" - https://phabricator.wikimedia.org/T389863#10705738... [20:45:18] 06Project-Admins, 10Tech-Product API Roadmap: Consider archiving #Tech-Product API Roadmap - https://phabricator.wikimedia.org/T390909 (10Pppery) 03NEW [21:07:47] 10Continuous-Integration-Config, 10Math, 10MediaWiki-Platform-Team (Radar), 10MW-1.44-notes (1.44.0-wmf.24; 2025-04-08), 13Patch-For-Review: Allow control over which extra extensions are installed (Math REL1_43 jobs exceed 60min timeout) - https://phabricator.wikimedia.org/T389998#10706059 (10Jdforrester-... [21:24:33] beta logstash is super slow to load [21:24:46] (i've been sitting on the loading screen for over a minute now) [21:30:10] MatmaRex: the observability folks run that service. [21:31:05] https://beta-logs.wmcloud.org/ loaded quickly for me, but that's just a second data point [21:32:32] 3.69s for a full load triggered by shift-ctrl-R [21:44:45] 10GitLab: Gitlab MFA reset for Esuvat Bomani - https://phabricator.wikimedia.org/T383123#10706144 (10Aklapper) Thank you, great! [23:14:58] 10Beta-Cluster-Infrastructure, 10Abstract Wikipedia team (25Q4 (Apr–Jun)), 13Patch-For-Review: Beta Cluster orchestrator / evaluator broken, blocking WikiLambda CI (and use of Beta Cluster) - https://phabricator.wikimedia.org/T374242#10706324 (10Jdforrester-WMF) a:03Jdforrester-WMF [23:18:58] (03approved) 10swfrench: mediawiki-cli: Add moreutils [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/158 (https://phabricator.wikimedia.org/T388538) (owner: 10cgoubert) [23:34:29] if someone can give +1 on https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1133575 , I'll deploy it now [23:35:37] can't focus on anything else as long as this is spewing 1000 exceptions per day [23:37:48] 10Release-Engineering-Team (Doing 😎), 07OKR-Work, 10Test-Platform (Radar): [WE6.2.6] Create design document for Pretrain (née Group -1) deployment - https://phabricator.wikimedia.org/T379683#10706378 (10bd808) I apparently only tracked the work on this task in the on-wiki [[https://www.mediawiki.org/wiki/Wik... [23:41:14] James_F: ^ I see you're awake [23:58:23] TimStarling: :shipit: +1 given [23:59:05] thanks