[01:06:46] (03PS1) 10Samwilson: zuul/dependencies.yaml: Add MediaSearch as dep for InputBox [integration/config] - 10https://gerrit.wikimedia.org/r/1154909 (https://phabricator.wikimedia.org/T378756) [02:53:48] 10Diffusion, 10Phabricator, 06collaboration-services: Repository source is temporary not available. - https://phabricator.wikimedia.org/T396274#10897949 (10Pppery) Also note (in case this is done again) that "temporary not available" should be "temporarily not available". [04:57:37] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 10Data-Persistence-Backup: Backups for new m1 database: zuul - https://phabricator.wikimedia.org/T396322#10898011 (10Marostegui) m1 is currently backed-up once a week I believe. [06:45:47] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06collaboration-services, 06Data-Persistence, 10Data-Persistence-Backup, and 2 others: Request mariadb database for Zuul - https://phabricator.wikimedia.org/T394844#10898122 (10jcrespo) Having a look at backups. [07:55:02] 10Phabricator, 10Release-Engineering-Team (Seen), 07Developer Productivity, 07SecTeam-Processed: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users - https://phabricator.wikimedia.org/T214579#10898291 (10A_smart_kitten) @sbassett Thank you! Do you kn... [08:09:44] 10Deployments, 10Release-Engineering-Team (Radar), 06serviceops, 13Patch-For-Review, 07Wikimedia-production-error: httpb sometimes fails upon deployment with a HTTP 503 - https://phabricator.wikimedia.org/T380958#10898302 (10akosiaris) I 've run a battery of tests in the previous days against mwdebug2001... [08:35:25] 10GitLab (Infrastructure), 10Ceph, 06collaboration-services, 10Data-Persistence-Backup, and 3 others: Migrate gitlab storage to apus (also: backups from S3?) - https://phabricator.wikimedia.org/T378922#10898434 (10Jelto) [09:12:00] (03update) 10jelto: set ci_delete_pipelines_in_seconds for all projects [repos/releng/gitlab-settings] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-settings/-/merge_requests/70 (https://phabricator.wikimedia.org/T395014) [09:20:26] (03merge) 10jelto: set ci_delete_pipelines_in_seconds for all projects [repos/releng/gitlab-settings] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-settings/-/merge_requests/70 (https://phabricator.wikimedia.org/T395014) [09:21:07] maintenance-disconnect-full-disks build 709291 integration-agent-docker-1041 (/: 26%, /srv: 11%, /var/lib/docker: 99%): OFFLINE due to disk space [09:29:43] (03PS2) 10Hashar: Zuul: [mediawiki/extensions/InputBox] add MediaSearch as dep [integration/config] - 10https://gerrit.wikimedia.org/r/1154909 (https://phabricator.wikimedia.org/T378756) (owner: 10Samwilson) [09:30:17] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/InputBox] add MediaSearch as dep [integration/config] - 10https://gerrit.wikimedia.org/r/1154909 (https://phabricator.wikimedia.org/T378756) (owner: 10Samwilson) [09:31:31] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/InputBox] add MediaSearch as dep [integration/config] - 10https://gerrit.wikimedia.org/r/1154909 (https://phabricator.wikimedia.org/T378756) (owner: 10Samwilson) [09:32:00] 10Continuous-Integration-Config, 07Developer Productivity: Improve brevity of Jenkins console output - https://phabricator.wikimedia.org/T393847#10898748 (10hashar) [09:32:05] 10Continuous-Integration-Infrastructure, 14Release-Engineering-Team (Doing), 06SRE, 13Patch-For-Review, 07Technical-Debt: debian-glue jobs ignored error messages about libeatmydata.so in LD_PRELOAD - https://phabricator.wikimedia.org/T240430#10898749 (10hashar) [09:40:03] maintenance-disconnect-full-disks build 709295 integration-agent-docker-1041 (/: 26%, /srv: 11%, /var/lib/docker: 98%): still OFFLINE due to disk space [09:54:42] (03CR) 10Hashar: [C:03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/1154909 (https://phabricator.wikimedia.org/T378756) (owner: 10Samwilson) [10:01:30] (03PS1) 10Bartosz WΓ³jtowicz: inference-services: Add CI job for pre-commit in inference-services. [integration/config] - 10https://gerrit.wikimedia.org/r/1155161 (https://phabricator.wikimedia.org/T393865) [10:04:49] Hi releng, what would be the way to make a gitlab-ci build a dockerfile? I tried to copy the approach from wikitech-static-docker repo in https://gitlab.wikimedia.org/repos/sre/cfssl/-/blob/wmf-1.6.5/.gitlab-ci.yml but that does not seem to work on trusted runners(?) - it fails with "'docker/dockerfile:latest' is not an allowed gateway source" [10:05:03] maintenance-disconnect-full-disks build 709300 integration-agent-docker-1041 (/: 26%, /srv: 11%, /var/lib/docker: 98%): still OFFLINE due to disk space [10:07:03] 10Phabricator, 06Security-Team, 07SecTeam-Processed, 07Security: Audit members of acl*security for more than 12 months of no activity (May 2025) - https://phabricator.wikimedia.org/T368224#10898940 (10Aklapper) @EMill-WMF: sure, here you go [10:26:42] 10Continuous-Integration-Config, 10phan, 10phan-taint-check-plugin, 07PHP 8.3 support, 07Upstream: Figure out why php-ast sometimes loses MAGIC_* flags in PHP 8.3 - https://phabricator.wikimedia.org/T396312#10899004 (10hashar) From what I gather the bug happens due to the php 8.3 package from sury.org?... [10:30:03] maintenance-disconnect-full-disks build 709305 integration-agent-docker-1041 (/: 26%, /srv: 11%, /var/lib/docker: 98%): still OFFLINE due to disk space [10:55:03] maintenance-disconnect-full-disks build 709310 integration-agent-docker-1041 (/: 26%, /srv: 11%, /var/lib/docker: 98%): still OFFLINE due to disk space [11:20:03] maintenance-disconnect-full-disks build 709315 integration-agent-docker-1041 (/: 26%, /srv: 11%, /var/lib/docker: 98%): still OFFLINE due to disk space [11:29:31] Please please could somebody with rights to `repos/releng` check and merge this for me? I've been blocked for a week on it. Thanks. https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/181 [11:31:48] (03update) 10cgoubert: Fix the paths of some of the dumps scripts and config files [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/181 (https://phabricator.wikimedia.org/T394389) (owner: 10btullis) [11:33:30] btullis: on it, will need a rebuild afterwards obviously [11:34:09] (03merge) 10cgoubert: Fix the paths of some of the dumps scripts and config files [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/181 (https://phabricator.wikimedia.org/T394389) (owner: 10btullis) [11:35:49] !log jforrester@integration-castor05:/srv/castor$ sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mwext-node20-rundoc/ # T396426 [11:35:51] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [11:35:51] T396426: mwext-node20-rundoc failing post-merge on some repos - https://phabricator.wikimedia.org/T396426 [11:36:16] claime: Many thanks. I can probably wait for the next scheduled rebuild, unless you advise me to do something like this: https://wikitech.wikimedia.org/wiki/MediaWiki_On_Kubernetes#Full_image_rebuild_and_deployment [11:36:31] btullis: I'm rebuilding right now [11:36:46] claime: Oh cool, that's excellent, thanks. [11:36:48] It doesn't need a full rebuild, just a scap sync-world --k8s-only [11:38:43] 10Continuous-Integration-Config, 10MediaWiki-extensions-CodeMirror, 10Page-Previews, 10ci-test-error (WMF-deployed Build Failure): mwext-node20-rundoc failing post-merge on some repos - https://phabricator.wikimedia.org/T396426#10899219 (10Jdforrester-WMF) > But why does it keep happening? Is there som... [11:38:45] 10Continuous-Integration-Config, 10MediaWiki-extensions-CodeMirror, 10Page-Previews, 10ci-test-error (WMF-deployed Build Failure): mwext-node20-rundoc failing post-merge on some repos - https://phabricator.wikimedia.org/T396426#10899221 (10Jdforrester-WMF) 05Openβ†’03Resolved a:03Jdforrester-WMF [11:40:03] maintenance-disconnect-full-disks build 709319 integration-agent-docker-1041 (/: 26%, /srv: 11%, /var/lib/docker: 37%): RECOVERY disk space OK [12:00:34] 10Phabricator, 10Legalpad, 06SRE: Allow aklapper to view/edit L3 - https://phabricator.wikimedia.org/T394966#10899262 (10Aklapper) Thank you! Confirming it works [12:06:47] 10Phabricator: Make sure anti-vandalism features are up to snuff - https://phabricator.wikimedia.org/T84#10899293 (10Aklapper) [12:19:27] 10Diffusion, 10Phabricator, 06collaboration-services: Drop our mirroring of code to Diffusion and empty the repos - https://phabricator.wikimedia.org/T359549#10899369 (10Tacsipacsi) >>! In T359549#10897604, @Peachey88 wrote: > (except those that don't keep sessions open) And except those who use multiple de... [12:31:43] (03open) 10taavi: releases: Fix jsdoc-wmf-theme to 1.1.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/80 (https://phabricator.wikimedia.org/T396417) [12:31:48] (03update) 10taavi: releases: Fix jsdoc-wmf-theme to 1.1.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/80 (https://phabricator.wikimedia.org/T396417) [12:31:59] (03update) 10taavi: releases: Fix jsdoc-wmf-theme to 1.1.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/80 (https://phabricator.wikimedia.org/T396417) [13:28:57] 10Phabricator, 06Release-Engineering-Team, 06collaboration-services, 06Security-Team, 07Security: 2025-05-12 vulnerability scan of phabricator - https://phabricator.wikimedia.org/T393932#10899635 (10Aklapper) FYI based on all the spew in Logstash created by their fuzzing, I filed some upstream ticket... [13:31:47] !log set version in GrowthSuggestedEdits schema `foreachwiki extensions/CommunityConfiguration/maintenance/setVersionData.php GrowthSuggestedEdits 1.0.0` [13:31:48] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:32:19] (03PS1) 10Hashar: Move strategy formatting logic from business to display [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1155225 [13:33:36] !log run migration in GrowthSuggestedEditsSchema `foreachwikiindblist growthexperiments extensions/CommunityConfiguration/maintenance/migrateConfig.php GrowthSuggestedEdits` T395383 [13:33:38] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [13:33:39] T395383: Community Configuration: Restrict "Add a link" suggested tasks based on newcomer total edit count - https://phabricator.wikimedia.org/T395383 [13:49:13] 10GitLab (Account Approval), 10Release-Engineering-Team (Doing 😎): Requesting GitLab account activation for GreenReaper - https://phabricator.wikimedia.org/T396344#10899783 (10GreenReaper) Thank you, this seems to have worked! 😼 [14:28:17] hashar: Are you going to mark maps/* as archived in gerrit, too? :-) [14:29:46] (03PS1) 10Jforrester: Zuul: [maps/*] Mark all as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1155249 [14:34:16] (03CR) 10Jforrester: [C:03+2] Zuul: [maps/*] Mark all as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1155249 (owner: 10Jforrester) [14:34:20] 10Phabricator, 06Release-Engineering-Team, 06collaboration-services, 06Security-Team, 07Security: 2025-05-12 vulnerability scan of phabricator - https://phabricator.wikimedia.org/T393932#10900050 (10sbassett) >>! In T393932#10899635, @Aklapper wrote: > FYI based on all the spew in Logstash created by... [14:34:58] 10Phabricator, 10Release-Engineering-Team (Seen), 07Developer Productivity, 07SecTeam-Processed: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users - https://phabricator.wikimedia.org/T214579#10900052 (10sbassett) >>! In T214579#10898291, @A_smart_ki... [14:35:58] (03Merged) 10jenkins-bot: Zuul: [maps/*] Mark all as archived [integration/config] - 10https://gerrit.wikimedia.org/r/1155249 (owner: 10Jforrester) [14:36:52] (03merge) 10jforrester: releases: Fix jsdoc-wmf-theme to 1.1.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/80 (https://phabricator.wikimedia.org/T396417) (owner: 10taavi) [14:37:47] !log Zuul: [maps/*] Mark all as archived [14:37:48] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [14:42:52] (03update) 10aklapper: Related GitLab patches: Ignore partial task ID matches [repos/phabricator/extensions] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/extensions/-/merge_requests/55 (https://phabricator.wikimedia.org/T395728) [14:49:49] 10Phabricator: Unhandled Exception ("PhutilAggregateException") - https://phabricator.wikimedia.org/T372227#10900089 (10Polygnotus) @Aklapper Currently, when you search for "meta description" in the Phabricator search box in the top right of this page you get: Unhandled Exception ("PhutilAggregateException"... [14:50:29] 10Phabricator: Unhandled Exception ("PhutilAggregateException") - https://phabricator.wikimedia.org/T372227#10900091 (10Polygnotus) 05Declinedβ†’03Open [14:56:14] 10Phabricator: Unhandled Exception ("PhutilAggregateException") - https://phabricator.wikimedia.org/T372227#10900119 (10Aklapper) 05Openβ†’03Declined Thanks for the additional info! That's helpful. In any case, the "solution" here is to either use more specific search terms and/or operators for that query... [14:57:10] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900122 (10Aklapper) [14:58:09] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900142 (10Aklapper) Also note that we cannot see the files `F62283715` or `F62283730` in the previous comment as they are not attached: ht... [14:59:08] James_F: I forgot to mark maps/* archived in integration/config sorry :b [15:01:52] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900160 (10Polygnotus) @Aklapper Thanks, you should now be able to see the screenshots. It may be a good idea to have the error page mentio... [15:04:27] 10Phabricator (phabricator-next): Deploy Phabricator/Phorge 2025-06-10 - https://phabricator.wikimedia.org/T396490 (10brennen) 03NEW [15:05:11] (03open) 10brennen: update submodules for 2025-06-10 deploy [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/70 (https://phabricator.wikimedia.org/T396490) [15:05:21] (03update) 10dancy: Drop several php_fpm* config parameters [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/829 (https://phabricator.wikimedia.org/T396166) [15:05:24] 10Phabricator (phabricator-next), 13Patch-For-Review: Deploy Phabricator/Phorge 2025-06-10 - https://phabricator.wikimedia.org/T396490#10900197 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=290c2d3c-a034-442a-93f8-dc7a369a31bd) set by aokoth@cumin1002 for 0:30:00 on 1 host(s) and their se... [15:06:03] (03merge) 10brennen: update submodules for 2025-06-10 deploy [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/70 (https://phabricator.wikimedia.org/T396490) [15:06:40] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900205 (10Aklapper) Yeah that is true, just wondering how to intercept here. :-/ Let me think about that [15:07:14] 10Phabricator (phabricator-next), 13Patch-For-Review: Deploy Phabricator/Phorge 2025-06-10 - https://phabricator.wikimedia.org/T396490#10900208 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=9db245c5-003d-4c27-86c2-68bef04e4cb0) set by aokoth@cumin1002 for 0:30:00 on 1 host(s) and their se... [15:15:48] 10Phabricator (phabricator-next), 10Release-Engineering-Team (Doing 😎), 07Essential-Work: Deploy Phabricator/Phorge 2025-06-10 - https://phabricator.wikimedia.org/T396490#10900256 (10Aklapper) 05Openβ†’03Resolved a:03brennen Thanks brennen! Changes: * AVA: Increased logging of users getting close to... [15:15:53] (03PS1) 10Xqt: Zuul: [pywikibot/i18n] Remove pywikibot-i18n-tox tests [integration/config] - 10https://gerrit.wikimedia.org/r/1155261 (https://phabricator.wikimedia.org/T396399) [15:18:45] (03CR) 10Hashar: [C:03+2] Move strategy formatting logic from business to display [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1155225 (owner: 10Hashar) [15:19:09] (03Merged) 10jenkins-bot: Move strategy formatting logic from business to display [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1155225 (owner: 10Hashar) [15:31:29] (03PS1) 10Hashar: Add emojis to differentiate mismatches [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1155264 [15:40:43] (03update) 10dancy: Drop several php_fpm* config parameters [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/829 (https://phabricator.wikimedia.org/T396166) [15:47:27] (03update) 10dancy: mods for deploy02 [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/93 [15:52:35] 06Gerrit-Privilege-Requests: Request membership in extension-SphinxSearch group for NicJansma - https://phabricator.wikimedia.org/T396496 (10NicJansma) 03NEW [15:59:20] 06Gerrit-Privilege-Requests: Request membership in extension-SphinxSearch group for NicJansma - https://phabricator.wikimedia.org/T396496#10900513 (10Aklapper) Hi, > I would bring this to Gerrit if given access To avoid misunderstandings: [Anyone can *propose* patches in Gerrit; access is not restricted.](http... [16:02:55] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900545 (10Aklapper) Looking at the screenshot, I wonder why you search for `Could not read the status of the file` (8 separate terms, like... [16:07:01] (03open) 10aklapper: Show a more useful error message when fulltext search fails. [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/71 [16:08:06] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900579 (10Aklapper) >>! In T372227#10900151, @Polygnotus wrote: > It may be a good idea to have the error page mention that users should u... [16:11:23] (03PS1) 10Hashar: Support filtering root projects [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1155274 [16:23:00] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900684 (10Polygnotus) @Aklapper Yeah I was intentionally recreating the error reported by Yann. I know what these errors mean and how to a... [16:23:34] 10Phabricator, 10Release-Engineering-Team (Seen), 07Developer Productivity, 07SecTeam-Processed: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users - https://phabricator.wikimedia.org/T214579#10900687 (10sguebo_WMF) >>! In T214579#10900051, @sbassett... [16:26:11] 10Continuous-Integration-Config, 10phan, 10phan-taint-check-plugin, 07PHP 8.3 support, 07Upstream: Figure out why php-ast sometimes loses MAGIC_* flags in PHP 8.3 - https://phabricator.wikimedia.org/T396312#10900697 (10Daimona) >>! In T396312#10899004, @hashar wrote: > From what I gather the bug happens... [16:27:02] ^ 0, 2, 4, 7, 9, 11, 13, 15, 17, 20, 22. I wonder if PHP is trying to communicate something using a secret code. [16:28:14] Up until 15 (first 8 terms), it happens to match https://oeis.org/A029924, "Convert n from kilograms (kg) to pounds (lbs)" :P [16:29:04] 10Phabricator, 10Release-Engineering-Team (Seen), 07Developer Productivity, 07SecTeam-Processed: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users - https://phabricator.wikimedia.org/T214579#10900708 (10sbassett) >>! In T214579#10900687, @sguebo_WMF... [16:29:05] Next up: "How I convert kilograms to pounds using a bug in the PHP 8.3 interpreter" [16:30:45] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Doing 😎): Spike: Experiment with nodepool drivers for untrusted workloads - https://phabricator.wikimedia.org/T396246#10900713 (10thcipriani) 05In progressβ†’03Resolved Some notes from our meeting on this work: we're goin... [16:34:20] Daimona: my guess is in the CI images php get upgraded and since we copy a version of php-ast that got built with an older PHP that ends up with the mismatch [16:34:37] we need php-ast to be compiled in the same build stage as installing php [16:35:07] Yes, the only reason why it isn't as obivous as that is that yesterday James tried rebuilding php-ast and apparently it didn't fix it. [16:35:19] !!!! :-/ [16:35:36] But I imagine there's just some small difference, and that your theory is largely correct [16:35:49] I wish we could find the root cause [16:35:56] Probably some minor detail I still need to find. But now I was focused on writing the kg to lbs converter. [16:36:03] I'll look into the root cause later [16:36:05] the php-ast.so does not have any ref to the PHP version as far as I can tell [16:36:22] but maybe it can be md5sum() as a point of comparison [16:36:41] also the php images tags do not match the ersion of php that is installed [16:38:27] I'll gladly defer the "how to best handle it in CI" part to you :D [16:41:18] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Doing 😎), 06collaboration-services, 13Patch-For-Review: Build zuul images for production - https://phabricator.wikimedia.org/T396245#10900810 (10thcipriani) We were able to update existing blubber files, there was some main... [16:53:31] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯): Plan for porting PipelineLib to Zuul Ansible - https://phabricator.wikimedia.org/T390119#10900879 (10thcipriani) Note: @Corvus mentions zuul has a standard "promote" job that may be useful here. It triggers... [16:54:43] (03update) 10aklapper: Show a more useful error message when fulltext search fails. [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/71 [16:55:20] 10Phabricator (Search): Unhandled Exception ("PhutilAggregateException") on large global searches which time out after 30sec - https://phabricator.wikimedia.org/T372227#10900889 (10Aklapper) Thanks again, that's helpful. I rephrased my patch a bit to hopefully be a bit "less techy". [16:56:24] (03update) 10aklapper: Show a more useful error message when fulltext search fails. [repos/phabricator/deployment] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/71 [16:56:27] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Release-Engineering-Team (Priority Backlog πŸ“₯): Experiment with Quibble job migration - https://phabricator.wikimedia.org/T392117#10900896 (10thcipriani) This will require some caching mechanism for dependencies from npm/composer/etc [16:58:53] Daimona: the issue is figuring out the root cause :] [17:10:13] 10GitLab (Pipeline Services Migration🐀), 06collaboration-services, 13Patch-For-Review: move os-reports.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350794#10900953 (10Arnoldokoth) [18:46:35] 10Release-Engineering-Team (Doing 😎), 07Essential-Work, 05Release, 05Train Deployments: 1.45.0-wmf.5 deployment blockers - https://phabricator.wikimedia.org/T392175#10901428 (10thcipriani) p:05Triageβ†’03Medium [19:06:38] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 10Metrics Platform, 10ci-test-error (WMF-deployed Build Failure), and 2 others: error: failed to solve: ParseAddr("ns-recursor.openstack.eqiad1.wikimediacloud.org"): unexpected character (at "ns-rec... - https://phabricator.wikimedia.org/T393856#10901511 [19:07:08] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work: Buildkit v0.22.0 released - https://phabricator.wikimedia.org/T394931#10901512 (10dancy) 05Stalledβ†’03Open T393856 has been resolved. This ticket is good to go. [19:08:18] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work: Buildkit v0.22.0 released - https://phabricator.wikimedia.org/T394931#10901516 (10brennen) Cool, will run through this now. [19:42:29] (03open) 10brennen: staging: update buildkitd_tag to v0.22.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/473 (https://phabricator.wikimedia.org/T394931) [19:43:26] (03merge) 10brennen: staging: update buildkitd_tag to v0.22.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/473 (https://phabricator.wikimedia.org/T394931) [19:59:57] (03open) 10brennen: production: update buildkitd_tag to v0.22.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/474 (https://phabricator.wikimedia.org/T394931) [20:00:53] (03merge) 10brennen: production: update buildkitd_tag to v0.22.0 [repos/releng/gitlab-cloud-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/474 (https://phabricator.wikimedia.org/T394931) [20:02:50] !log Updating buildkitd to v0.22.0 in gitlab-cloud-runners (T394931) [20:02:52] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:02:52] T394931: Buildkit v0.22.0 released - https://phabricator.wikimedia.org/T394931 [20:12:43] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 13Patch-For-Review: Buildkit v0.22.0 released - https://phabricator.wikimedia.org/T394931#10901780 (10brennen) 05Openβ†’03In progress [20:32:22] (03open) 10brennen: use buildkit v0.22.0 [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/123 (https://phabricator.wikimedia.org/T394931) [20:33:46] (03approved) 10dancy: use buildkit v0.22.0 [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/123 (https://phabricator.wikimedia.org/T394931) (owner: 10brennen) [20:38:29] (03merge) 10brennen: use buildkit v0.22.0 [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/123 (https://phabricator.wikimedia.org/T394931) [20:38:50] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 07Essential-Work, 13Patch-For-Review: Buildkit v0.22.0 released - https://phabricator.wikimedia.org/T394931#10901899 (10brennen) [21:50:25] (03update) 10dduvall: spiderpig: Support MediaWiki train deployments [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/808 (https://phabricator.wikimedia.org/T392610) [21:50:30] (03update) 10dduvall: spiderpig: Support MediaWiki train deployments [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/808 (https://phabricator.wikimedia.org/T392610) [21:50:32] (03update) 10dduvall: spiderpig: Support MediaWiki train deployments [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/808 (https://phabricator.wikimedia.org/T392610) [21:50:38] (03update) 10dduvall: spiderpig: Support MediaWiki train deployments [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/808 (https://phabricator.wikimedia.org/T392610) [22:06:08] 10Phabricator (Search), 10Release-Engineering-Team (Priority Backlog πŸ“₯): Revisit Elasticsearch in Phorge - https://phabricator.wikimedia.org/T373130#10902160 (10brennen) Discussion worth noting upstream: https://we.phorge.it/T15891#21872 > Given that approximately nobody uses the elastic backend anymore, it m... [22:07:30] 10Continuous-Integration-Config, 10phan, 10phan-taint-check-plugin, 07PHP 8.3 support, 07Upstream: Figure out why php-ast sometimes loses MAGIC_* flags in PHP 8.3 - https://phabricator.wikimedia.org/T396312#10902162 (10Daimona) As a first step, I spun up a container again using the ci-bookworm image. I s... [22:50:48] (03PS1) 10Jforrester: Zuul: [css-sanitizer] Add coverage reporting [integration/config] - 10https://gerrit.wikimedia.org/r/1155337 [22:52:31] (03CR) 10Jforrester: [C:03+2] Zuul: [css-sanitizer] Add coverage reporting [integration/config] - 10https://gerrit.wikimedia.org/r/1155337 (owner: 10Jforrester) [22:53:42] (03Merged) 10jenkins-bot: Zuul: [css-sanitizer] Add coverage reporting [integration/config] - 10https://gerrit.wikimedia.org/r/1155337 (owner: 10Jforrester) [22:53:49] !log Zuul: [css-sanitizer] Add coverage reporting [22:53:50] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [22:58:36] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Cloud-VPS (Project-requests): Request creation of zuul-runners VPS project - https://phabricator.wikimedia.org/T396540 (10bd808) 03NEW [22:58:39] 10Continuous-Integration-Infrastructure (Zuul upgrade): Set up new project for Zuulv3+ pre-merge and non-image-build workloads - https://phabricator.wikimedia.org/T396247#10902234 (10bd808) [22:58:43] 10Continuous-Integration-Infrastructure (Zuul upgrade), 10Cloud-VPS (Project-requests): Request creation of zuul-runners VPS project - https://phabricator.wikimedia.org/T396540#10902235 (10bd808) [23:02:13] (03PS1) 10Jforrester: jjb: [composer-coverage-patch] Bump phpunit-patch-coverage to 0.0.15 [integration/config] - 10https://gerrit.wikimedia.org/r/1155338 [23:21:26] (03open) 10dduvall: ci: Add a .gitlab-ci.yml for building new images from upstream [repos/releng/buildx] - 10https://gitlab.wikimedia.org/repos/releng/buildx/-/merge_requests/1 [23:21:38] (03update) 10dduvall: ci: Add a .gitlab-ci.yml for building new images from upstream [repos/releng/buildx] - 10https://gitlab.wikimedia.org/repos/releng/buildx/-/merge_requests/1 [23:25:23] (03update) 10dduvall: ci: Add a .gitlab-ci.yml for building new images from upstream [repos/releng/buildx] - 10https://gitlab.wikimedia.org/repos/releng/buildx/-/merge_requests/1 [23:31:40] (03merge) 10dduvall: ci: Add a .gitlab-ci.yml for building new images from upstream [repos/releng/buildx] - 10https://gitlab.wikimedia.org/repos/releng/buildx/-/merge_requests/1 [23:50:59] (03open) 10dduvall: Add repos/releng/buildx project [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/114 (https://phabricator.wikimedia.org/T390119) [23:51:19] (03update) 10dduvall: Add repos/releng/buildx project [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/114 (https://phabricator.wikimedia.org/T390119)