[01:17:26] 10GitLab: Could not authenticate you from OpenIDConnect because "Upstream connect error or disconnect/reset before headers. reset reason: connection failure" - https://phabricator.wikimedia.org/T382687#10828540 (10BCornwall) 05Resolved→03Open idp1004 just had the same issue and has this in the logs: ` 16-Ma... [01:18:05] 10GitLab: Could not authenticate you from OpenIDConnect because "Upstream connect error or disconnect/reset before headers. reset reason: connection failure" - https://phabricator.wikimedia.org/T382687#10828542 (10BCornwall) 05Open→03Resolved a:03BCornwall Oh shoot, I didn't realize the scope of the ti... [03:39:10] 10GitLab (Account Approval), 06Release-Engineering-Team, 07Essential-Work: Requesting GitLab account activation for LLugo-WMF - https://phabricator.wikimedia.org/T394083#10828588 (10thcipriani) [03:40:30] 10Phabricator-Bot-Requests, 10Release-Engineering-Team (Doing 😎), 07Essential-Work: Request a bot for a Slack integration - https://phabricator.wikimedia.org/T393773#10828589 (10thcipriani) [03:40:59] 10GitLab (CI & Job Runners), 06Release-Engineering-Team, 07Essential-Work: buildkit v0.21.1 released - https://phabricator.wikimedia.org/T393731#10828590 (10thcipriani) [03:44:47] 10Gerrit, 10Release-Engineering-Team (Doing 😎), 06Language and Product Localization, 07Essential-Work: Delete two branches from mediawiki/extensions/Translate Gerrit extension - https://phabricator.wikimedia.org/T392787#10828591 (10thcipriani) [07:10:19] (03CR) 10Hashar: [C:03+2] "Well done! I have deployed the job and it can be run from https://integration.wikimedia.org/ci/job/wmf-jvm-utils-maven-release/build" [integration/config] - 10https://gerrit.wikimedia.org/r/1145174 (https://phabricator.wikimedia.org/T367405) (owner: 10Peter Fischer) [07:11:36] (03Merged) 10jenkins-bot: jjb: add maven-release job to search/wmf-jvm-utils [integration/config] - 10https://gerrit.wikimedia.org/r/1145174 (https://phabricator.wikimedia.org/T367405) (owner: 10Peter Fischer) [08:06:11] 10Deployments, 10Gerrit: Automatic branch cut failure due to Gerrit - https://phabricator.wikimedia.org/T394472 (10hashar) 03NEW [08:29:36] 10Deployments, 10Gerrit: Automatic branch cut failure due to Gerrit - https://phabricator.wikimedia.org/T394472#10828899 (10hashar) From the access log: May 15, 2025 @ 23:39:41.000 from IP 172.16.6.174 and in the Apache error logs: ` [Thu May 15 23:39:41.985449 2025] [proxy_http:error] [pid 1950438:tid 1950452... [08:29:43] 10Deployments, 10Gerrit: Automatic branch cut failure due to Gerrit - https://phabricator.wikimedia.org/T394472#10828900 (10hashar) [08:30:16] 10Deployments, 10Gerrit: Automatic branch cut failure due to Gerrit - https://phabricator.wikimedia.org/T394472#10828902 (10hashar) 05Open→03Declined I could not find the root cause :/ [08:56:30] 10Beta-Cluster-Infrastructure, 10CirrusSearch, 06Data-Platform-SRE, 06Discovery-Search, 07Puppet: Puppet failing on deployment-cirrussearch{12,13,14}.deployment-prep.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T393924#10828996 (10Gehel) p:05Triage→03Medium [09:01:29] 10Beta-Cluster-Infrastructure, 10CirrusSearch, 06Discovery-Search, 10Data-Platform-SRE (2025.05.02 - 2025.05.23), 07Puppet: Puppet failing on deployment-cirrussearch{12,13,14}.deployment-prep.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T393924#10829022 (10Gehel) [09:09:21] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: Automatically abandon old changes after some time - https://phabricator.wikimedia.org/T393376#10829056 (10hashar) p:05Triage→03Low [09:15:56] 10Beta-Cluster-Infrastructure, 10observability, 07Grafana: deployment-etcd05: Function lookup() did not find a value for the name 'prometheus::instances_defaults' - https://phabricator.wikimedia.org/T393866#10829077 (10hashar) 05Open→03Resolved a:03bd808 That was solved by @bd808 who applied the se... [09:39:06] 10Gerrit: Incorrect "CI has completed checks" popup appears when navigating from a change with tests in progress to one with no tests in progress - https://phabricator.wikimedia.org/T394485 (10A_smart_kitten) 03NEW [09:51:52] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: Automatically abandon old changes after some time - https://phabricator.wikimedia.org/T393376#10829207 (10Aklapper) See also {T113706} [09:55:36] 10Gerrit: Incorrect "CI has completed checks" popup appears when navigating from a change with tests in progress to one with no tests in progress - https://phabricator.wikimedia.org/T394485#10829223 (10hashar) That comes from the `wm-zuul-status` JavaScript plugin https://gerrit.wikimedia.org/g/operations/softwa... [10:00:49] 10Gerrit: Incorrect "CI has completed checks" popup appears when navigating from a change with tests in progress to one with no tests in progress - https://phabricator.wikimedia.org/T394485#10829225 (10hashar) @A_smart_kitten thank you so much for having filed that task. I did notice the popup showing up but nev... [10:30:01] 10Phabricator (Upstream), 07Upstream: Searching for tasks using the 'In Any' project tag filtering option doesn't return tasks in subprojects of the selected project - https://phabricator.wikimedia.org/T386830#10829335 (10A_smart_kitten) [10:35:14] 10Phabricator: Too many relationships of type "task.has-subtask" - https://phabricator.wikimedia.org/T394493 (10Tgr) 03NEW [10:36:07] 10Phabricator: Too many relationships of type "task.has-subtask" - https://phabricator.wikimedia.org/T394493#10829367 (10Tgr) You can reproduce e.g. by opening and trying to save the subtasks menu on T2212. [10:36:28] 10Phabricator: Too many relationships of type "task.has-subtask" - https://phabricator.wikimedia.org/T394493#10829370 (10A_smart_kitten) →14Duplicate dup:03T376301 [10:36:29] 10Phabricator, 10Release-Engineering-Team (Doing 😎), 13Patch-Needs-Improvement: Can't edit subtasks: "Too many relationships (25, of type "task.has-subtask"). Must be less than 20." - https://phabricator.wikimedia.org/T376301#10829372 (10A_smart_kitten) [10:56:50] 10Gerrit: Incorrect "CI has completed checks" popup appears when navigating from a change with tests in progress to one with no tests in progress - https://phabricator.wikimedia.org/T394485#10829412 (10A_smart_kitten) >>! In T394485#10829225, @hashar wrote: > @A_smart_kitten thank you so much for having filed th... [12:40:25] 10Gerrit: Incorrect "CI has completed checks" popup appears when navigating from a change with tests in progress to one with no tests in progress - https://phabricator.wikimedia.org/T394485#10829758 (10hashar) a:03hashar [12:40:43] (03PS1) 10Hashar: wm-zuul-status: do not popup when navigating changes [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1146976 (https://phabricator.wikimedia.org/T394485) [13:19:52] (03CR) 10Hashar: [C:03+2] "Verified with the browser debugger." [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1146976 (https://phabricator.wikimedia.org/T394485) (owner: 10Hashar) [13:20:25] (03Merged) 10jenkins-bot: wm-zuul-status: do not popup when navigating changes [software/gerrit] (deploy/wmf/stable-3.10) - 10https://gerrit.wikimedia.org/r/1146976 (https://phabricator.wikimedia.org/T394485) (owner: 10Hashar) [13:25:47] 10Gerrit, 13Patch-For-Review: Incorrect "CI has completed checks" popup appears when navigating from a change with tests in progress to one with no tests in progress - https://phabricator.wikimedia.org/T394485#10829906 (10hashar) @A_smart_kitten I have tested my fix with the browser debugger and it worked for... [13:33:06] (03PS1) 10Hashar: zuul-migrate: ignore pipeline jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1111296 [13:33:06] (03PS1) 10Hashar: zuul-migrate: visit builders/publishers [integration/config] - 10https://gerrit.wikimedia.org/r/1111297 [13:33:08] (03CR) 10Hashar: [C:03+2] zuul-migrate: ignore pipeline jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1111296 (owner: 10Hashar) [13:33:13] (03CR) 10Hashar: [C:03+2] zuul-migrate: visit builders/publishers [integration/config] - 10https://gerrit.wikimedia.org/r/1111297 (owner: 10Hashar) [13:34:47] (03Merged) 10jenkins-bot: zuul-migrate: ignore pipeline jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1111296 (owner: 10Hashar) [13:34:59] (03Merged) 10jenkins-bot: zuul-migrate: visit builders/publishers [integration/config] - 10https://gerrit.wikimedia.org/r/1111297 (owner: 10Hashar) [13:44:30] (03PS1) 10Hashar: fab: stop pulling base images [integration/config] - 10https://gerrit.wikimedia.org/r/1146995 (https://phabricator.wikimedia.org/T219398) [13:50:19] 10Phabricator-Bot-Requests, 10Release-Engineering-Team (Doing 😎), 07Essential-Work: Request a bot account for a Slack integration - https://phabricator.wikimedia.org/T393773#10830015 (10Aklapper) [13:52:09] (03Abandoned) 10Hashar: fab: stop pulling base images [integration/config] - 10https://gerrit.wikimedia.org/r/1146995 (https://phabricator.wikimedia.org/T219398) (owner: 10Hashar) [14:00:55] 10Phabricator, 10Release-Engineering-Team (Doing 😎), 13Patch-For-Review: Add actor membership condition for "Restrict maximum number of connected objects when editing edges" - https://phabricator.wikimedia.org/T375122#10830063 (10Tgr) Ideally you'd want a rate limit for this kind of thing, ie. "cannot change... [14:02:13] 10MediaWiki-Releasing, 10MediaWiki-Installer, 06MediaWiki-Stakeholders-Group, 05MW-1.45-release: Expand the set of bundled extensions and skins in MediaWiki 1.45 - https://phabricator.wikimedia.org/T392080#10830064 (10Aklapper) >>! In T392080#10824974, @Bugreporter2 wrote: > I think it would be prudent to... [14:15:55] (03PS1) 10Peter Fischer: jjb: use local settings for all maven goals [integration/config] - 10https://gerrit.wikimedia.org/r/1147003 (https://phabricator.wikimedia.org/T367405) [14:19:10] (03CR) 10Jaime Nuche: [C:03+2] jjb: use local settings for all maven goals [integration/config] - 10https://gerrit.wikimedia.org/r/1147003 (https://phabricator.wikimedia.org/T367405) (owner: 10Peter Fischer) [14:20:26] (03Merged) 10jenkins-bot: jjb: use local settings for all maven goals [integration/config] - 10https://gerrit.wikimedia.org/r/1147003 (https://phabricator.wikimedia.org/T367405) (owner: 10Peter Fischer) [14:24:55] (03PS1) 10Hashar: Also refresh the cached list of projects [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1147007 [14:25:26] (03CR) 10Hashar: [C:03+2] Also refresh the cached list of projects [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1147007 (owner: 10Hashar) [14:25:51] (03Merged) 10jenkins-bot: Also refresh the cached list of projects [integration/gerrit-admin] - 10https://gerrit.wikimedia.org/r/1147007 (owner: 10Hashar) [14:45:42] (03CR) 10Elukey: [C:03+1] "Again, as stated for the companion change I have limited understanding of the local puppet test, but it works on my local env and it is wo" [integration/config] - 10https://gerrit.wikimedia.org/r/1142674 (owner: 10JHathaway) [15:17:57] (03PS1) 10Hashar: Revert "jjb: use local settings for all maven goals" [integration/config] - 10https://gerrit.wikimedia.org/r/1147017 (https://phabricator.wikimedia.org/T367405) [15:22:20] (03CR) 10Hashar: [C:03+2] Revert "jjb: use local settings for all maven goals" [integration/config] - 10https://gerrit.wikimedia.org/r/1147017 (https://phabricator.wikimedia.org/T367405) (owner: 10Hashar) [15:24:02] (03Merged) 10jenkins-bot: Revert "jjb: use local settings for all maven goals" [integration/config] - 10https://gerrit.wikimedia.org/r/1147017 (https://phabricator.wikimedia.org/T367405) (owner: 10Hashar) [15:40:58] FIRING: [3x] PuppetAgentNoResources: No Puppet resources found on instance deployment-cirrussearch12 on project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [15:49:48] (03open) 10dancy: Dockerfile.deploy: Add sqlite3 to package list [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/137 [15:49:51] (03update) 10dancy: Dockerfile.deploy: Add sqlite3 to package list [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/137 [15:50:59] (03merge) 10dancy: Dockerfile.deploy: Add sqlite3 to package list [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/137 [15:52:09] it's been a long while since I've actually thought through/remembered how to deploy CentralNotice given it's weird/different branching setup [15:53:39] should SpiderPig have accepted this to deploy? https://spiderpig.wikimedia.org/jobs/69 [15:54:16] or do I need to backport/cherry-pick to wmf/1.45.0-wmf.1? [15:54:45] I'm about to disappear into 2 hours of meetings on this here silent Friday, but I'll be around afterward [15:55:03] * Reedy wonders why he needs to provide a OTP just to view the job [15:55:13] greg-g: the latter [15:55:44] Reedy: I don't think spiderpig has a notion of "public non-logged in viewing" [15:55:49] taavi: ty! [15:56:03] I'll... do that later, given the 2 hours of calls :) [15:56:15] sure, but even if I've logged in? :P [15:56:22] Reedy: oh? dunno [16:05:56] Reedy: If you haven't used SpiderPig for 14 days, you'll be required requires to redo 2FA [16:06:16] If you're finding that you have to do it more often than that, lemme know and we can do some debugging. [16:23:29] (03open) 10swfrench: Draft: Switch mw-(debug|web) to 8.1 images [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/138 (https://phabricator.wikimedia.org/T391057) [16:46:47] (03PS1) 10Jforrester: Zuul: Split Quibble jobs into selenium-only and non-selenium for skins [integration/config] - 10https://gerrit.wikimedia.org/r/1147030 [16:46:47] (03PS1) 10Jforrester: Zuul, jjb: Simplify the regular Quibble job name to drop 'noselenium' [integration/config] - 10https://gerrit.wikimedia.org/r/1147031 [16:52:30] hashar: I exist to make you sad ^ [16:53:42] (03CR) 10Jforrester: [C:03+2] Zuul: Split Quibble jobs into selenium-only and non-selenium for skins [integration/config] - 10https://gerrit.wikimedia.org/r/1147030 (owner: 10Jforrester) [16:55:37] (03Merged) 10jenkins-bot: Zuul: Split Quibble jobs into selenium-only and non-selenium for skins [integration/config] - 10https://gerrit.wikimedia.org/r/1147030 (owner: 10Jforrester) [16:57:02] !log Zuul: Split Quibble jobs into selenium-only and non-selenium for skins [16:57:03] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [16:58:53] (03PS2) 10Jforrester: Zuul, jjb: Simplify the regular Quibble job name to drop 'noselenium' [integration/config] - 10https://gerrit.wikimedia.org/r/1147031 [16:58:54] (03PS1) 10Jforrester: jjb: Actively set quibble_args for Wikidata daily 'nongated' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1147033 [17:01:56] (03CR) 10Jforrester: [C:03+2] jjb: Actively set quibble_args for Wikidata daily 'nongated' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1147033 (owner: 10Jforrester) [17:03:14] (03Merged) 10jenkins-bot: jjb: Actively set quibble_args for Wikidata daily 'nongated' jobs [integration/config] - 10https://gerrit.wikimedia.org/r/1147033 (owner: 10Jforrester) [17:03:44] (03CR) 10Jforrester: "@hashar, what do you think? It simplifies most jobs and CI things, but I want to check with you." [integration/config] - 10https://gerrit.wikimedia.org/r/1147031 (owner: 10Jforrester) [17:04:48] (03open) 10btullis: mediawiki-cli: Add the dcat repository and enable some dumps scripts [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/171 (https://phabricator.wikimedia.org/T394389) [17:44:42] (03open) 10swfrench: Draft: make-container-image: stop building the "publish" flavour [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/172 (https://phabricator.wikimedia.org/T391057) [18:12:56] (03update) 10brennen: SpiderPig log view [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/767 (https://phabricator.wikimedia.org/T391005) [18:17:53] (03update) 10brennen: SpiderPig log view [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/767 (https://phabricator.wikimedia.org/T391005) [18:38:12] uh, James_F, since you're online and you're a beautiful person... why did quibble fail on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CentralNotice/+/1147043 ? [18:39:46] brb, family just returned from a camping trip.... [18:50:29] >19:34:53 PHP Fatal error: Class MediaWiki\Extensions\FlaggedRevs\Tests\Structure\BundleSizeTest contains 1 abstract method and must therefore be declared abstract or implement the remaining methods (MediaWiki\Tests\Structure\BundleSizeTestBase::getBundleSizeConfigData) in /workspace/src/extensions/CentralNotice/tests/phpunit/structure/BundleSizeTest.php on line 13 [18:50:29] 19:34:53 Script phpunit handling the phpunit event returned with error code 255 [18:53:00] xSavitar: ^^ [18:57:02] https://phabricator.wikimedia.org/T394542 filed [19:08:57] Weird! [19:26:42] and I was hoping to do a friday morning (not afternoon, pacific time) deploy with spiderpig (as my first spiderpig deloy) today, oh well. [20:16:54] greg-g: you can deploy two patches now ;P [20:27:17] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: Automatically abandon old changes after some time - https://phabricator.wikimedia.org/T393376#10831364 (10Jdlrobson-WMF) I've been wanting this for years. As a maintainer of over 30+ codebases, stale patchsets disrupt my ability to get code revi... [20:59:47] 10Continuous-Integration-Config, 10Testing Support: Only alert when selenium-daily-{sitename}-{project} tests fail on consecutive runs - https://phabricator.wikimedia.org/T394551#10831471 (10bd808) [21:08:06] 10Continuous-Integration-Config, 10Testing Support: Only alert when selenium-daily-{sitename}-{project} tests fail on consecutive runs - https://phabricator.wikimedia.org/T394551#10831495 (10bd808) * https://docs.openstack.org/infra/jenkins-job-builder/attic/publishers.html#publishers.email-ext * https://gerri... [21:24:37] 10Continuous-Integration-Config, 10Testing Support: Only alert when selenium-daily-{sitename}-{project} tests fail on consecutive runs - https://phabricator.wikimedia.org/T394551#10831546 (10bd808) I can't find an obvious mapping in JJB for the "Failure -> Unstable (Test Failures)" status, but `still-failing`... [21:39:01] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: Automatically abandon old changes after some time - https://phabricator.wikimedia.org/T393376#10831580 (10Krinkle) If I understand correclty, we're proposing reducing the number of open patchsets, not drive by a benefit to patch writers or code... [21:40:13] 10Continuous-Integration-Config, 10Testing Support: Only alert when selenium-daily-{sitename}-{project} tests fail on consecutive runs - https://phabricator.wikimedia.org/T394551#10831582 (10bd808) The `selenium-daily-{sitename}-{project}` job template is used in jjb/mediawiki.yaml to configure jobs for `selen... [21:59:09] (03update) 10brennen: SpiderPig log view [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/767 (https://phabricator.wikimedia.org/T391005) [21:59:12] (03update) 10brennen: SpiderPig log view [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/767 (https://phabricator.wikimedia.org/T391005) [23:35:44] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: Automatically abandon old changes after some time - https://phabricator.wikimedia.org/T393376#10831729 (10thcipriani) >>! In T393376#10831580, @Krinkle wrote: > How useful is this feature? Who is using this? And, if we wanted to, is there a way... [23:52:28] 10Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work, 05Release, 05Train Deployments: 1.45.0-wmf.2 deployment blockers - https://phabricator.wikimedia.org/T392172#10831741 (10SecurityPatchBot)