[02:07:52] 10Beta-Cluster-Infrastructure: Suggestion: Give stewards userrights-interwiki on metawiki beta cluster and remove the global userrights, userrights-interwiki - https://phabricator.wikimedia.org/T188874#9765783 (10Pppery) [07:37:14] 10Phabricator: Make it possible to autocomplete task references in comments and task descriptions - https://phabricator.wikimedia.org/T364072 (10kostajh) 03NEW [07:38:35] o/ Where do I find the MW core sonarcloud reports? [07:39:44] 10Phabricator, 10Release-Engineering-Team (Radar), 03Wikimedia-Hackathon-2024: Phorge (Phabricator) Code Review Sprint - https://phabricator.wikimedia.org/T356384#9766149 (10kostajh) @valerio.bozzolan do you know if there's an upstream equivalent to {T364072}? That could be a nice Hackathon project :) [07:44:00] addshore: https://sonarcloud.io/summary/new_code?id=mediawiki-core&branch=1026675-4 is the latest one that landed. [07:44:10] https://sonarcloud.io/project/overview?id=mediawiki-core for the top-level. [08:02:26] 10Beta-Cluster-Infrastructure, 06Moderator-Tools-Team: en.beta sysop rights for Moderator Tools team - https://phabricator.wikimedia.org/T363913#9766221 (10Samwalton9-WMF) [08:29:53] 10Beta-Cluster-Infrastructure, 06Moderator-Tools-Team: en.beta sysop rights for Moderator Tools team - https://phabricator.wikimedia.org/T363913#9766284 (10TheresNoTime) a:03TheresNoTime [08:32:42] 10Beta-Cluster-Infrastructure, 06Moderator-Tools-Team: en.beta sysop rights for Moderator Tools team - https://phabricator.wikimedia.org/T363913#9766301 (10TheresNoTime) Done :) ([[ https://en.wikipedia.beta.wmflabs.org/w/index.php?title=Special:Log&logid=416342 | 1 ]], [[ https://en.wikipedia.beta.wmflabs.org... [08:33:07] 10Beta-Cluster-Infrastructure, 06Moderator-Tools-Team: en.beta sysop rights for Moderator Tools team - https://phabricator.wikimedia.org/T363913#9766314 (10TheresNoTime) 05Openβ†’03Resolved [08:48:29] 10Release-Engineering-Team (Yakisfaction): Clean up shellcheck warnings in logspam-watch.sh - https://phabricator.wikimedia.org/T364083 (10brennen) 03NEW [09:07:38] 10Phabricator (Upstream): Make it possible to autocomplete task references in comments and task descriptions - https://phabricator.wikimedia.org/T364072#9766474 (10Peachey88) This would probably be best proposed upstream in phorge so all installs can benefit from the feature. [09:16:29] 10Phabricator: Remove custom Github tarball link from Diffusion - https://phabricator.wikimedia.org/T364087 (10Aklapper) 03NEW p:05Triageβ†’03Low [09:29:05] 10Phabricator, 07Technical-Debt: Remove custom Legalpad API downstream changes - https://phabricator.wikimedia.org/T364088 (10Aklapper) 03NEW p:05Triageβ†’03Low [09:29:30] 10Phabricator, 07Technical-Debt: Remove custom Legalpad API downstream changes - https://phabricator.wikimedia.org/T364088#9766548 (10Aklapper) [09:29:33] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 13Patch-For-Review, 07Technical-Debt: Remove custom WMF Phab downstream hacks superseded by upstream Phorge changes - https://phabricator.wikimedia.org/T341799#9766549 (10Aklapper) [09:31:15] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 13Patch-For-Review, 07Technical-Debt: Remove custom WMF Phab downstream hacks superseded by upstream Phorge changes - https://phabricator.wikimedia.org/T341799#9766550 (10Aklapper) [09:35:31] James_F: thanks! [09:44:42] addshore: … you're welcome, though I know not why. [09:48:34] 10GitLab, 06collaboration-services: Login on GitLab test intancen is not working - https://phabricator.wikimedia.org/T364091 (10Jelto) 03NEW [10:34:34] 10GitLab, 10Release-Engineering-Team (Radar), 06collaboration-services: Login on GitLab test instance is not working - https://phabricator.wikimedia.org/T364091#9766806 (10brennen) [10:34:36] 10GitLab, 10Release-Engineering-Team (Radar), 06collaboration-services: Login on GitLab test instance is not working - https://phabricator.wikimedia.org/T364091#9766805 (10brennen) [11:09:28] !log created logspam-watch tag: https://phabricator.wikimedia.org/project/profile/7157/ [11:09:29] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:09:55] 10Beta-Cluster-Infrastructure, 10logspam-watch, 06SRE-OnFire, 10Sustainability (Incident Followup): (Beta cluster) Running logspam-watch on deployment-mwlog01 gives repeated `Use of uninitialized value $host` errors - https://phabricator.wikimedia.org/T315379#9766924 (10brennen) [11:10:13] 10Release-Engineering-Team (Yakisfaction), 10logspam-watch: Clean up shellcheck warnings in logspam-watch.sh - https://phabricator.wikimedia.org/T364083#9766929 (10brennen) [11:12:39] 10Release-Engineering-Team (Yak Shaving πŸƒπŸͺ’), 10logspam-watch: logspam-watch: distinct error count is off-by-one when no or 1 errors are found - https://phabricator.wikimedia.org/T364102 (10brennen) 03NEW [11:31:59] 10Release-Engineering-Team (Radar), 03Wikimedia-Hackathon-2024: [Session] Using kokkuri to build container images on GitLab CI - https://phabricator.wikimedia.org/T361937#9767056 (10brennen) Notes: https://etherpad.wikimedia.org/p/wmh2024-Using_kokkuri_to_build_container_images [11:42:07] 10GitLab (Pipeline Services Migration🐀), 10MediaWiki-extensions-PropertySuggester, 10Wikidata: Migrate propertysuggester/RecommenderServer to GitLab - https://phabricator.wikimedia.org/T344746#9767091 (10Sjoerddebruin) Has the code been moved yet? [11:52:42] brennen: did something change in the past 1-2 years with gitlab auth that might have caused this for my automated CI script? :P https://gitlab.wikimedia.org/repos/releng/cli/-/jobs/250979 [12:22:07] 10Release-Engineering-Team (Radar), 03Wikimedia-Hackathon-2024: [Session] Using kokkuri to build container images on GitLab CI - https://phabricator.wikimedia.org/T361937#9767280 (10debt) [12:34:13] addshore: guess: we mandated 2fa more broadly and it hit your account? [12:56:20] Project beta-scap-sync-world build #153280: 04FAILURE in 1 min 2 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/153280/ [12:57:26] brennen: aaah, I see. I wonder if there is a way for me to work around that for my account that was used only from within giylab workflows [13:06:39] Yippee, build fixed! [13:06:39] Project beta-scap-sync-world build #153281: 09FIXED in 1 min 20 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/153281/ [13:20:36] 10Continuous-Integration-Infrastructure, 10Gerrit, 07Jenkins, 03Wikimedia-Hackathon-2024: jenkins-bot should clear the attention flag for the patch uploader after a new patchset passes tests, if it had set the flag after a previous patchset failed tests - https://phabricator.wikimedia.org/T363289#9767522 (1... [13:28:40] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap, 10Wikidata, 10Wikidata-Query-Service, and 2 others: wdqs: replace git-fat with git-lfs - https://phabricator.wikimedia.org/T316876#9767588 (10bking) 05Openβ†’03Resolved After merging the PR above and cloning the repo, it does appear that the ar... [13:51:30] 06Release-Engineering-Team, 10Temporary accounts, 06Trust and Safety Product Team, 13Patch-For-Review: Make PHPUnit, Selenium, and API testing tests pass with temp account feature flag enabled - https://phabricator.wikimedia.org/T355879#9767705 (10kostajh) [13:53:13] (03PS1) 10Jforrester: Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 [13:56:35] (03CR) 10Reedy: [C:03+1] Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 (owner: 10Jforrester) [13:58:10] (03CR) 10Majavah: [C:03+1] Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 (owner: 10Jforrester) [13:59:45] (03CR) 10CI reject: [V:04-1] Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 (owner: 10Jforrester) [14:02:50] (03PS2) 10Jforrester: Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 [14:04:06] 10Phabricator (Upstream), 07Upstream: Make it possible to autocomplete task references in comments and task descriptions - https://phabricator.wikimedia.org/T364072#9767766 (10Aklapper) Trying to understand why this is wanted, I assume the perceived advantage is about showing a list with both task IDs **and**... [14:05:14] 10Phabricator (Upstream), 07Upstream: Make it possible to autocomplete task references in comments and task descriptions - https://phabricator.wikimedia.org/T364072#9767771 (10kostajh) >>! In T364072#9767764, @Aklapper wrote: > Trying to understand why this is wanted, I assume the perceived advantage is about... [14:06:23] Project beta-scap-sync-world build #153287: 04FAILURE in 1 min 5 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/153287/ [14:06:44] (03CR) 10CI reject: [V:04-1] Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 (owner: 10Jforrester) [14:06:50] (03PS3) 10Jforrester: Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 [14:08:31] (03CR) 10Jforrester: [C:03+2] Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 (owner: 10Jforrester) [14:10:50] Just a heads-up, I'm killing some failing CI jobs to try and reclaim some resources [14:11:02] Daimona: See above as well. [14:11:34] ("failing" as in "running jobs when another job for the same patch has already failed") [14:11:50] Ack. [14:12:25] (03Merged) 10jenkins-bot: Zuul: As an emergency, drop CI for BlueSpice extensions and skins [integration/config] - 10https://gerrit.wikimedia.org/r/1026934 (owner: 10Jforrester) [14:12:58] !log Zuul: As an emergency, drop CI for BlueSpice extensions and skins [14:12:59] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:16:35] Yippee, build fixed! [14:16:35] Project beta-scap-sync-world build #153288: 09FIXED in 1 min 16 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/153288/ [14:16:42] Aaaaaand part of the gate-and-submit queue has just been reset by T352319 in https://integration.wikimedia.org/ci/job/wmf-quibble-core-vendor-mysql-php74/1825/console [14:16:43] T352319: castor-save-workspace-cache aborted during postbuild - https://phabricator.wikimedia.org/T352319 [14:41:35] Project beta-scap-sync-world build #153290: 04FAILURE in 6 min 15 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/153290/ [14:47:46] 10GitLab: Upgrade to buildkit v13.2 - https://phabricator.wikimedia.org/T364013#9767997 (10dancy) @jelto Thanks for merging https://gerrit.wikimedia.org/r/1026607 but I notice that the old buildkitd is still running on gitlab-runner1002.eqiad.wmnet. [14:50:11] can somebody help me figure out gerrit permissions in https://gerrit.wikimedia.org/r/admin/repos/operations/software/envoyproxy/ratelimiter,general ? [14:50:32] I tried to sync master from upstream, which fails with: ERROR: commit 3fcc360: email address noreply@github.com is not registered in your account, and you lack 'forge committer' permission. [14:50:48] I tried pushing a branch which fails with: [14:50:49] remote: error: branch refs/heads/git20240505.3fcc360-vendor: [14:50:51] remote: use a SHA1 visible to you, or get update permission on the ref [14:51:30] 10GitLab: Upgrade to buildkit v13.2 - https://phabricator.wikimedia.org/T364013#9768028 (10dancy) >>! In T364013#9767997, @dancy wrote: > @jelto Thanks for merging https://gerrit.wikimedia.org/r/1026607 but I notice that the old buildkitd is still running on gitlab-runner1002.eqiad.wmnet. I see now that hiera... [14:51:31] from what I can tell from the gerrit UI I *should* have permissions inherited (via ldap/ops group) [14:56:23] Yippee, build fixed! [14:56:24] Project beta-scap-sync-world build #153291: 09FIXED in 11 min: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/153291/ [15:00:51] jayme, can you show me the push command that you used? [15:02:24] dancy: for the first thing I tried a force push after rebasing to upstream's main branch (so git push --force), the second one is a plain "git push" [15:10:31] jayme: Upstream is https://github.com/envoyproxy/ratelimit ? [15:10:44] dancy: correct [15:26:46] dancy: I gtg for today, thanks for taking a look! lmk if in can/need to do anything :) [15:27:04] Ok. I'm filing a ticket about the topic, then I'll add the permission you need. [15:27:15] <3 thanks! [15:29:02] 10Gerrit, 06Release-Engineering-Team: Configure Gerrit permissions on operations/software/envoyproxy/ratelimiter for merging from upstream - https://phabricator.wikimedia.org/T364148 (10dancy) 03NEW [15:33:17] 10Gerrit, 06Release-Engineering-Team: Configure Gerrit permissions on operations/software/envoyproxy/ratelimiter for merging from upstream - https://phabricator.wikimedia.org/T364148#9768218 (10dancy) p:05Triageβ†’03Medium [15:33:19] jayme: Try again when you have a chance. [15:33:28] 10Gerrit, 06Release-Engineering-Team: Configure Gerrit permissions on operations/software/envoyproxy/ratelimiter for merging from upstream - https://phabricator.wikimedia.org/T364148#9768217 (10dancy) @JMeybohm I added "Forge Committer Identity" permission to the `operations-software-envoyproxy-ratelimiter` g... [15:41:08] 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.05.06 - 2024.05.26), 07Security: Investigate replacing Archiva with Gitlab repositories - https://phabricator.wikimedia.org/T358612#9768276 (10Gehel) [16:04:45] 10Release-Engineering-Team (Yakisfaction): git-fat replacement/removal - https://phabricator.wikimedia.org/T279509#9768401 (10dancy) 05Openβ†’03Resolved All subtasks of this task are closed, so I'm considering this ticket resolved. [16:13:36] 10Phabricator, 10Release-Engineering-Team (Yakisfaction): Automate quarterly WMF QLS request for Phabricator data (tasks reported by community, resolved by WMF) - https://phabricator.wikimedia.org/T362804#9768440 (10Aklapper) 05Openβ†’03Resolved From a test run (thanks to dzahn) this seems to work as exp... [16:44:10] 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.05.06 - 2024.05.26), 07Security: Investigate replacing Archiva with Gitlab repositories - https://phabricator.wikimedia.org/T358612#9768554 (10BTullis) [16:44:47] 06Release-Engineering-Team, 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.05.06 - 2024.05.26), 07Security: Investigate replacing Archiva with Gitlab repositories - https://phabricator.wikimedia.org/T358612#9768556 (10BTullis) [16:48:23] 10Phabricator (phabricator-next): Unhandled Exception ("PhutilAggregateException") when using Phabricator in languages that translated "AM" - https://phabricator.wikimedia.org/T363215#9768563 (10Aklapper) >>! In T363215#9741670, @Pppery wrote: > - For #phabricator-upstream : fix the above code to use some user... [16:52:49] 10Phabricator (phabricator-next): Unhandled Exception ("PhutilAggregateException") when using Phabricator in languages that translated "AM" - https://phabricator.wikimedia.org/T363215#9768581 (10Pppery) Looks reasonable in principle to me. And I don't think it would reset localized time formats - the code below... [16:54:03] 06Project-Admins: Create project tag for probenet - https://phabricator.wikimedia.org/T364155 (10CDanis) 03NEW [16:55:33] 10Release-Engineering-Team (Deployment Training Requests): Next steps for MediaWiki deployment training program - https://phabricator.wikimedia.org/T354318#9768597 (10jsn.sherman) @thcipriani, I've gone through the steps outlined in the docs and lurked in a deployment or two. I think I'm ready to pair up! I have... [16:58:18] 06Project-Admins: Create project tag for probenet - https://phabricator.wikimedia.org/T364155#9768605 (10taavi) 05Openβ†’03Resolved a:03taavi #probenet [17:21:59] 10GitLab (Project Migration), 10CSSJanus, 10MediaWiki-Codesniffer, 10MinusX, and 5 others: Consolidate all Wikimedia CI tools into a single Wikimedia GitLab project group - https://phabricator.wikimedia.org/T334615#9768761 (10Jdforrester-WMF) [17:22:10] 10GitLab (Project Migration), 10CSSJanus, 10MediaWiki-Codesniffer, 10MinusX, and 6 others: Consolidate all Wikimedia CI tools into a single Wikimedia GitLab project group - https://phabricator.wikimedia.org/T334615#9768763 (10Jdforrester-WMF) [18:31:18] 10GitLab: Upgrade to buildkit v13.2 - https://phabricator.wikimedia.org/T364013#9768903 (10dancy) [18:35:27] 10GitLab, 13Patch-For-Review: Upgrade to buildkit v13.2 - https://phabricator.wikimedia.org/T364013#9768912 (10dancy) [18:42:30] 10GitLab, 13Patch-For-Review: Upgrade to buildkit v13.2 - https://phabricator.wikimedia.org/T364013#9768914 (10dancy) p:05Triageβ†’03Medium a:03dancy [18:52:56] 10GitLab, 06collaboration-services, 13Patch-For-Review: Upgrade to buildkit v13.2 - https://phabricator.wikimedia.org/T364013#9768956 (10Jelto) [19:20:01] Project beta-update-databases-eqiad build #75717: 04FAILURE in 0.78 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/75717/ [19:23:36] 10GitLab, 10Release-Engineering-Team (Radar), 06collaboration-services: Login on GitLab test instance is not working - https://phabricator.wikimedia.org/T364091#9768993 (10Dzahn) I went to gitlab-prod-1002.devtools and grep'ed recursively in /var/log/gitlab to search for a request ID shown on the error page.... [19:35:27] 10GitLab, 10Release-Engineering-Team (Radar), 06collaboration-services: Login on GitLab test instance is not working - https://phabricator.wikimedia.org/T364091#9769076 (10Dzahn) Looking at the config in `/etc/gitlab/gitlab.rb` on gitlab-prod-1002.devtools I see the omniauth provider is set to nothing: ` g... [19:40:25] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9769084 (10valerio.bozzolan) >>! In T107254#9765585, @Pppery wrote: > appears to be truncated. It's truncated because it seems you've found a bug in the GitLab frontend.... [19:56:18] 10GitLab, 06collaboration-services: Upgrade to buildkit v13.2 - https://phabricator.wikimedia.org/T364013#9769106 (10dancy) 05Openβ†’03Resolved [19:59:49] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9769131 (10valerio.bozzolan) Can somebody please run this SQL command in production? `sql SELECT closedEpoch FROM maniphest_task WHERE id = 3189; ` [20:10:25] Yippee, build fixed! [20:10:25] Project beta-update-databases-eqiad build #75718: 09FIXED in 10 min: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/75718/ [20:15:34] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9769178 (10Dzahn) ` +-------------+ | closedEpoch | +-------------+ | 1714527215 | +-------------+ ` [20:15:51] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9769179 (10valerio.bozzolan) Ignore my last comment. We can obtain that information using Arcanist and Conduit APIs 🌈 πŸ¦„ `bash echo '{ "constraints": { "ids": [ 3189 ] }... [20:19:40] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9769200 (10valerio.bozzolan) Oh, thanks Dzahn :3 So everything seems under control since these situations are covered by the `WHERE closedEpoch IS NULL` condition. So th... [20:38:45] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9769235 (10Pppery) LGTM from a quick glance [20:54:19] 10Phabricator, 10wikimedia.biterg.io: Closed tickets in Bugzilla migrated without a closing date - https://phabricator.wikimedia.org/T107254#9769257 (10valerio.bozzolan) To any RelEng hero: To make the above thing more production-friendly, Would you appreciate the above SQL file already batched in small tran... [21:12:47] 10Phabricator (phabricator-next): Unhandled Exception ("PhutilAggregateException") when using Phabricator in languages that translated "AM" - https://phabricator.wikimedia.org/T363215#9769274 (10Pppery) And the commit message of your commit is wrong - it blows up all searches for calendar events AFAICS. [23:10:34] 10GitLab, 10Release-Engineering-Team (Radar), 06collaboration-services: Login on GitLab test instance is not working - https://phabricator.wikimedia.org/T364091#9769404 (10Dzahn) @Jelto do you still have the actual secret? I stopped puppet and edited the gitlab.rb like this: `diff /root/gitlab.rb.T364091.o...