[00:00:53] FIRING: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:05:53] RESOLVED: DatasourceError: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [03:35:32] Yippee, build fixed! [03:35:33] Project mwcore-phpunit-coverage-master build #3852: 09FIXED in 35 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/3852/ [08:03:42] (03CR) 10Kosta Harlan: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/1073542 (https://phabricator.wikimedia.org/T365976) (owner: 10Hashar) [08:05:38] (03CR) 10Kosta Harlan: [C:03+1] jjb: switch jobs to Quibble 1.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1073542 (https://phabricator.wikimedia.org/T365976) (owner: 10Hashar) [08:08:00] (03CR) 10Arthur taylor: [C:03+1] "let's do it!" [integration/config] - 10https://gerrit.wikimedia.org/r/1073542 (https://phabricator.wikimedia.org/T365976) (owner: 10Hashar) [08:35:14] kostajh: codders: I am switching the Jenkins jobs to Quibble 1.10.0 [08:35:49] (03CR) 10Hashar: [C:03+2] jjb: switch jobs to Quibble 1.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1073542 (https://phabricator.wikimedia.org/T365976) (owner: 10Hashar) [08:36:25] !log Updating Quibble Jenkins jobs to quibble 1.10.0 | https://gerrit.wikimedia.org/r/c/integration/config/+/1073542 | T365976 | T50217 [08:36:28] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [08:36:28] T365976: [REPO][CLIENT][SW] Create a `composer phpunit:prepare-parallel-test-suites` command to split suite into smaller groups - https://phabricator.wikimedia.org/T365976 [08:36:29] T50217: Speed up MediaWiki PHPUnit build by running integration tests in parallel - https://phabricator.wikimedia.org/T50217 [08:37:07] (03Merged) 10jenkins-bot: jjb: switch jobs to Quibble 1.10.0 [integration/config] - 10https://gerrit.wikimedia.org/r/1073542 (https://phabricator.wikimedia.org/T365976) (owner: 10Hashar) [08:37:25] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T373642#10156191 (10jnuche) [08:37:47] @hashar: great - thank you! [08:41:38] codders: deployed! :) [08:42:14] fingers crossed then [08:45:00] (03CR) 10Hashar: "That was requested by Reedy for the purpose of removing a polyfill from `mediawiki/vendor`. So I guess yes we want `php-uuid` in all image" [integration/config] - 10https://gerrit.wikimedia.org/r/1072320 (https://phabricator.wikimedia.org/T373752) (owner: 10Jforrester) [08:55:12] 10Release-Engineering-Team (Radar), 06collaboration-services, 06SRE, 06Traffic, 13Patch-For-Review: implement anti-abuse features for GitLab (Move GitLab behind the CDN) - https://phabricator.wikimedia.org/T366882#10156264 (10Jelto) In `wikimedia-gitlab`, there have been some reports of failing jobs (cc... [09:18:44] (03open) 10akosiaris: Remove Docker image pulling functionality [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/447 (https://phabricator.wikimedia.org/T366778) [09:18:57] (03update) 10akosiaris: Remove Docker image pulling functionality [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/447 (https://phabricator.wikimedia.org/T366778) [09:26:39] (03PS1) 10Dreamy Jazz: Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) [09:27:26] (03CR) 10Reedy: "I think we're still waiting on 7.4 packages building - https://phabricator.wikimedia.org/T373752#10136087" [integration/config] - 10https://gerrit.wikimedia.org/r/1072320 (https://phabricator.wikimedia.org/T373752) (owner: 10Jforrester) [09:27:52] (03PS2) 10Dreamy Jazz: Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) [09:27:55] (03CR) 10CI reject: [V:04-1] Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) (owner: 10Dreamy Jazz) [09:29:07] (03CR) 10CI reject: [V:04-1] Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) (owner: 10Dreamy Jazz) [09:29:41] (03CR) 10Dreamy Jazz: "recheck" [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) (owner: 10Dreamy Jazz) [09:31:51] (03PS3) 10Dreamy Jazz: Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) [09:34:19] (03PS2) 10Hashar: zuul: show change queues window value [integration/docroot] - 10https://gerrit.wikimedia.org/r/1071197 [09:44:38] (03CR) 10Hashar: "I will use it to test a Puppet config change on the deployment servers Ib94b02f51dbbd259e4617230b205e8a712934b46" [integration/docroot] - 10https://gerrit.wikimedia.org/r/1071197 (owner: 10Hashar) [09:48:23] (03CR) 10Kosta Harlan: [C:03+1] Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) (owner: 10Dreamy Jazz) [11:42:38] 10Phabricator (Upstream), 07Upstream: Calendar: Call to a member function format() on null at $this->getQueryDateFrom($query)->getDateTime() - https://phabricator.wikimedia.org/T372857#10156631 (10Aklapper) p:05Triage→03Low a:03Aklapper [12:16:58] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥): Update to Phorge upstream 2024.35 release - https://phabricator.wikimedia.org/T370266#10156784 (10LSobanski) Would there be interest in getting a DB snapshot (replica on a real-size host) to test this on? We took this approach when upgrading VRTS:... [12:18:31] 10Phabricator (Upstream), 07Upstream: Calendar: Call to a member function format() on null at $this->getQueryDateFrom($query)->getDateTime() - https://phabricator.wikimedia.org/T372857#10156788 (10Aklapper) Boy oh boy... After reading this piece of code to understand it better, I realize how easy this is to tr... [12:24:40] 10Release-Engineering-Team (Priority Backlog 📥), 10Structured Data Engineering, 06Structured-Data-Backlog, 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295#10156798 (10Seddon) 05Open→03Stalled Just a note, test-commons might be u... [12:30:21] 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review, 05Release, 05Train Deployments: 1.43.0-wmf.23 deployment blockers - https://phabricator.wikimedia.org/T373642#10156811 (10jnuche) [12:36:35] (03open) 10lwatson: releases: Bump Codex to 1.13.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/34 [12:50:20] 10Phabricator (Upstream), 07Upstream: Calendar: Call to a member function format() on null at $this->getQueryDateFrom($query)->getDateTime() - https://phabricator.wikimedia.org/T372857#10156855 (10Aklapper) [12:57:54] (03Abandoned) 10Hashar: Add credentials for publishing Maven artifacts to Gitlab. [integration/config] - 10https://gerrit.wikimedia.org/r/1056079 (https://phabricator.wikimedia.org/T367403) (owner: 10Gehel) [13:08:34] 10Release-Engineering-Team (Priority Backlog 📥), 10Structured Data Engineering, 06Structured-Data-Backlog, 10Wiki-Setup (Delete / Redirect): Close and delete TestCommons from production - https://phabricator.wikimedia.org/T213295#10156934 (10Zabe) 05Stalled→03Declined Partialy resolved by closing t... [13:18:26] (03merge) 10annet: releases: Bump Codex to 1.13.0 [repos/ci-tools/libup-config] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup-config/-/merge_requests/34 (owner: 10lwatson) [13:46:30] (03merge) 10jnuche: allow deletion of environments when in read-only mode [repos/ci-tools/patchdemo] - 10https://gitlab.wikimedia.org/repos/ci-tools/patchdemo/-/merge_requests/631 (https://phabricator.wikimedia.org/T374285) [14:04:22] is there a known issue with gitlab trusted CI runners? https://gitlab.wikimedia.org/repos/sre/conftool/-/jobs/364088 [14:05:05] cdanis: jelto or jnuche might know about the state of CI runners [14:07:51] don't really know that much about those runner I'm afraid [14:18:20] we are following up in _security [14:39:43] (03open) 10jnuche: offer sign-in prompt when in read-only mode [repos/ci-tools/patchdemo] - 10https://gitlab.wikimedia.org/repos/ci-tools/patchdemo/-/merge_requests/632 (https://phabricator.wikimedia.org/T374285) [14:41:09] (03merge) 10jnuche: offer sign-in prompt when in read-only mode [repos/ci-tools/patchdemo] - 10https://gitlab.wikimedia.org/repos/ci-tools/patchdemo/-/merge_requests/632 (https://phabricator.wikimedia.org/T374285) [14:53:30] (03open) 10aklapper: Revert "Add temporary debug output for T372857" [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/70 [14:54:04] (03merge) 10aklapper: Revert "Add temporary debug output for T372857" [repos/phabricator/phabricator] (wmf/stable) - 10https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/merge_requests/70 [17:33:10] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) (owner: 10Dreamy Jazz) [17:34:23] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/CheckUser] Add AbuseFilter dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1073743 (https://phabricator.wikimedia.org/T375063) (owner: 10Dreamy Jazz) [18:35:38] Project beta-code-update-eqiad build #513737: 04FAILURE in 6.6 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/513737/ [18:41:50] 10Phabricator: Investigate adding actor membership condition for "Restrict maximum number of connected objects when editing edges" - https://phabricator.wikimedia.org/T375122 (10Aklapper) 03NEW p:05Triage→03Medium [18:45:17] Yippee, build fixed! [18:45:17] Project beta-code-update-eqiad build #513738: 09FIXED in 2 min 16 sec: https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/513738/ [19:23:53] (03PS1) 10Subramanya Sastry: Diffserver: Add both desktop & mobile web urls [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1073877 [19:43:24] (03PS1) 10Subramanya Sastry: MFE config: Hide all kartographer maps to work around loading issues [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1073883 [19:45:07] (03CR) 10Subramanya Sastry: "I am going to enable this on the visual diff server and rerun MFE tests. Local testing shows that this eliminates all noise (pixel-perfect" [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1073883 (owner: 10Subramanya Sastry) [20:00:25] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Elliottetzkorn] - https://phabricator.wikimedia.org/T375129 (10etz) 03NEW [20:08:45] (03PS1) 10JHathaway: operations-puppet: Upgrade to bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1073902 [20:10:11] (03CR) 10CI reject: [V:04-1] operations-puppet: Upgrade to bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1073902 (owner: 10JHathaway) [20:11:21] (03PS2) 10JHathaway: operations-puppet: Upgrade to bullseye [integration/config] - 10https://gerrit.wikimedia.org/r/1073902 [20:18:43] (03PS2) 10Subramanya Sastry: MFE config: Hide all kartographer maps to work around loading issues [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1073883 [20:32:20] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Elliottetzkorn] - https://phabricator.wikimedia.org/T375129#10158796 (10etz) [21:41:00] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for [Elliottetzkorn] - https://phabricator.wikimedia.org/T375129#10159078 (10Pppery) 05Open→03Resolved a:03Pppery Welcome. [22:55:14] 10Release-Engineering-Team (Priority Backlog 📥): Draft and get approval for next hypothesis to follow WE6.2.1 - https://phabricator.wikimedia.org/T375145 (10bd808) 03NEW [22:55:51] 10Release-Engineering-Team (Priority Backlog 📥): Draft and get approval for next hypothesis to follow WE6.2.1 - https://phabricator.wikimedia.org/T375145#10159180 (10bd808) p:05Triage→03High [23:03:45] 10Release-Engineering-Team (Priority Backlog 📥): Draft and get approval for next hypothesis to follow WE6.2.1 - https://phabricator.wikimedia.org/T375145#10159182 (10bd808) @thcipriani For your consideration. I would love some help thinking about what our measurable outcomes might be for this next phase of the p... [23:11:45] (03open) 10dancy: Establish a status file for the spiderpig jobrunner [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/448 [23:11:48] (03update) 10dancy: Establish a status file for the spiderpig jobrunner [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/448 [23:13:40] (03update) 10dancy: Establish a status file for the spiderpig jobrunner [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/448 [23:20:05] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Release-Engineering-Team (Priority Backlog 📥), 07ci-test-error, and 2 others: Various CI jobs failing after "mkdir: cannot create directory ‘log’: Permission denied" - https://phabricator.wikimedia.org/T282893#10159197 (10Pppery) Still happening: https:... [23:23:41] (03CR) 10Ahmon Dancy: [C:03+2] "This should be fully available at Chrome Web Store and Firefox Add-Ons." [performance/WikimediaDebug] - 10https://gerrit.wikimedia.org/r/1070275 (https://phabricator.wikimedia.org/T371537) (owner: 10Effie Mouzeli)