[05:09:16] (03PS1) 10QChris: Allow “Gerrit Managers” to import history [extensions/Wanda] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1193302 [05:09:16] (03CR) 10QChris: [V:03+2 C:03+2] Allow “Gerrit Managers” to import history [extensions/Wanda] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1193302 (owner: 10QChris) [05:09:20] (03PS1) 10QChris: Import done. Revoke import grants [extensions/Wanda] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1193303 [05:09:20] (03CR) 10QChris: [V:03+2 C:03+2] Import done. Revoke import grants [extensions/Wanda] (refs/meta/config) - 10https://gerrit.wikimedia.org/r/1193303 (owner: 10QChris) [05:17:02] (03PS1) 10QChris: Zuul: [mediawiki/extensions/ReadMode] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1193304 [05:20:55] (03Abandoned) 10QChris: Zuul: [mediawiki/extensions/ReadMode] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1193304 (owner: 10QChris) [05:22:13] (03Restored) 10QChris: Zuul: [mediawiki/extensions/ReadMode] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1193304 (owner: 10QChris) [05:22:19] (03PS2) 10QChris: Zuul: [mediawiki/extensions/ReadMode] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1193304 [05:36:51] qchris: :) [05:36:54] good morning! [05:37:02] good morning! [05:42:08] 10Gerrit, 06Release-Engineering-Team: Investigate Gerrit accounts having the same address - https://phabricator.wikimedia.org/T406297 (10hashar) 03NEW [05:42:24] (03CR) 10Hashar: [C:03+2] "More extensions! Thank you :)" [integration/config] - 10https://gerrit.wikimedia.org/r/1193304 (owner: 10QChris) [05:42:37] Error undefined: Account 'christian@quelltextlich.at' is ambiguous (at most 3 shown): [05:42:37] 79: QChris [05:42:37] 994: Wp-zero-data-bot [05:42:42] fun time, you have a dupe! [05:43:04] that is when I try to send a review stating: "thank you @christian@quelltextlich.at" [05:43:10] the API complains there are two accounts [05:43:14] (which is true) [05:43:36] even though Gerrit supposedly enforce uniqueness of emails :] [05:43:43] at least, nowadays it enforces it [05:43:54] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ReadMode] Add basic CI [integration/config] - 10https://gerrit.wikimedia.org/r/1193304 (owner: 10QChris) [05:50:33] bearloga: James_F: there was some rate limiting put in place yesterday that throttled normal traffic. The limit was set too low apparently [05:50:42] that got rolled back [05:52:56] Oooooooo ... wp-zero-data-bot ... that was more than a decade ago. [05:53:28] That one can get deleted. [05:54:00] qchris: yup I guess I will disable it :] [05:54:12] Thanks! [05:54:21] I have reloaded Zuul to add ReadMode [05:54:39] Double thanks! [05:55:46] !log gerrit: gerrit set-account wp-zero-data-bot --inactive # T406297 [05:55:49] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [05:55:50] T406297: Investigate Gerrit accounts having the same address - https://phabricator.wikimedia.org/T406297 [05:56:10] I wonder how many such cases we have in our user database [05:56:20] I guess I should see to getting it cleaned up in LDAP as well ... [05:56:59] ah probably yeah [05:58:41] I'll see if I can find the official-WMF-procedure-to-get-accounts-deactivated WikiPage :-) [06:04:21] qchris: I think that is done via https://idm.wikimedia.org/ nowadays [06:04:35] I don't have access to the block page though [06:05:37] But for the wpzero account I did not get any email etc about moving the account to idm (for my qchris account I did receive such emails) ... I'll dig around a bit :-) [06:17:32] maybe two emails were sent and then deduplicated by the mail servers [06:17:36] or only was sent [06:25:04] 10Gerrit, 06Release-Engineering-Team, 06collaboration-services: gerrit: mod_qos allowlist and monitoring improvements - https://phabricator.wikimedia.org/T406017#11239454 (10hashar) We had an outage yesterday related to the QoS limit, it was only reported on IRC/Slack. For the record: ` lang=irc 16:25:38... [06:33:40] 10Gerrit, 06Release-Engineering-Team: Investigate Gerrit accounts having the same address - https://phabricator.wikimedia.org/T406297#11239467 (10QChris) [06:42:12] !log gerrit set-account BarryTheBrowserTestBot --inactive # T388662 T390070 [06:42:14] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [06:42:15] T388662: Disable BarryTheBrowserTestBot LDAP account - https://phabricator.wikimedia.org/T388662 [07:39:14] 06Project-Admins: PendingChangesBot has two issue trackers - https://phabricator.wikimedia.org/T406300 (10Aklapper) 03NEW [09:12:32] FIRING: PuppetAgentFailure: Puppet agent failure detected on instance deployment-maps-master02 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentFailure [11:07:59] 10Diffusion, 10Phabricator, 06Release-Engineering-Team (Doing 😎), 06Diffusion-Repository-Administrators: Deactivate and disable ORES' draftquality and drafttopic repositories in Diffusion - https://phabricator.wikimedia.org/T406316 (10Aklapper) 03NEW p:05Triage→03Low [11:08:51] 10Diffusion, 10Phabricator, 06Release-Engineering-Team (Doing 😎), 06Diffusion-Repository-Administrators: Deactivate and disable ORES' draftquality and drafttopic repositories in Diffusion - https://phabricator.wikimedia.org/T406316#11240574 (10Aklapper) 05Open→03Resolved [11:13:50] 10Phabricator, 06Security-Team, 07Security: Create a security issue reporting template - https://phabricator.wikimedia.org/T406313#11240578 (10A_smart_kitten) [11:25:23] 10Phabricator, 06Security-Team, 07Security: Create a security issue reporting template - https://phabricator.wikimedia.org/T406313#11240606 (10Aklapper) I assume this about changing the (currently empty) default value for the Description field in https://phabricator.wikimedia.org/transactions/editengine/mani... [11:33:54] 10Phabricator, 06Security-Team, 07Security: Create a security issue reporting template - https://phabricator.wikimedia.org/T406313#11240633 (10SomeRandomDeveloper) I think it would be good if there was a template for the description similar to [[ https://phabricator.wikimedia.org/maniphest/task/edit/form/43/... [11:45:38] 10MediaWiki-Releasing, 05MW-1.39-release, 05MW-1.43-release, 05MW-1.44-release: Write and send release announcements for MediaWiki 1.39.15/1.43.5/1.44.2 - https://phabricator.wikimedia.org/T406321 (10Reedy) 03NEW [11:46:27] 10MediaWiki-Releasing, 05MW-1.39-release, 05MW-1.43-release, 05MW-1.44-release: Write and send release announcements for MediaWiki 1.39.15/1.43.5/1.44.2 - https://phabricator.wikimedia.org/T406321#11240692 (10Reedy) [11:49:14] 10MediaWiki-Releasing, 05MW-1.39-release, 05MW-1.43-release, 05MW-1.44-release: Write and send release announcements for MediaWiki 1.39.15/1.43.5/1.44.2 - https://phabricator.wikimedia.org/T406321#11240696 (10Reedy) [11:49:52] 10MediaWiki-Releasing, 05MW-1.39-release, 05MW-1.43-release, 05MW-1.44-release: Write and send release announcements for MediaWiki 1.39.15/1.43.5/1.44.2 - https://phabricator.wikimedia.org/T406321#11240697 (10Reedy) p:05Triage→03High [11:50:47] 10MediaWiki-Releasing, 05MW-1.39-release, 05MW-1.43-release, 05MW-1.44-release: Write and send release announcements for MediaWiki 1.39.15/1.43.5/1.44.2 - https://phabricator.wikimedia.org/T406321#11240700 (10Reedy) [11:53:12] 10Continuous-Integration-Config, 10Math, 06MediaWiki-Platform-Team (Radar), 05MW-1.45-notes (1.45.0-wmf.22; 2025-10-07), 13Patch-For-Review: Allow control over which extra extensions are installed (Math REL1_43 jobs exceed 60min timeout) - https://phabricator.wikimedia.org/T389998#11240735 (10hashar) [12:20:01] Project beta-update-databases-eqiad build #88118: 04FAILURE in 0.5 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/88118/ [13:22:55] Yippee, build fixed! [13:22:55] Project beta-update-databases-eqiad build #88119: 09FIXED in 2 min 54 sec: https://integration.wikimedia.org/ci/job/beta-update-databases-eqiad/88119/ [13:32:11] 10Gerrit, 06collaboration-services: gerrit: config tweaks - https://phabricator.wikimedia.org/T406333 (10ABran-WMF) 03NEW [13:45:37] 10Phabricator, 06Release-Engineering-Team (Priority Backlog 📥): Clean up invalid Dashboard chart panels in database - https://phabricator.wikimedia.org/T405710#11241177 (10Aklapper) I deleted those chart panel with a nonsense value (thus no chart is actually displayed) not embedded into any dashboard by queryi... [13:50:25] 10Phabricator (Upstream), 07JavaScript, 07Upstream: "Uncaught TypeError: spec is undefined" for hovercards in Aphlict notifications - https://phabricator.wikimedia.org/T366118#11241200 (10Aklapper) Still happens after our recent upstream pull: ` Uncaught TypeError: can't access property "objectPHID", spec i... [14:26:19] (03PS2) 10SomeRandomDeveloper: Switch CommentStreams CI to extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/1193425 [14:26:58] (03PS3) 10SomeRandomDeveloper: Zuul: Switch CommentStreams CI to extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/1193425 [14:27:13] (03CR) 10Paladox: [C:03+1] Zuul: Switch CommentStreams CI to extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/1193425 (owner: 10SomeRandomDeveloper) [14:36:21] (03CR) 10Hashar: [C:03+2] Zuul: Switch CommentStreams CI to extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/1193425 (owner: 10SomeRandomDeveloper) [14:37:41] (03Merged) 10jenkins-bot: Zuul: Switch CommentStreams CI to extension-quibble-composer [integration/config] - 10https://gerrit.wikimedia.org/r/1193425 (owner: 10SomeRandomDeveloper) [14:41:29] paladox: done! and I have reloaded Zuul [14:48:09] (03PS16) 10Hashar: Script to sync dependencies with extension registry [integration/config] - 10https://gerrit.wikimedia.org/r/1182115 (https://phabricator.wikimedia.org/T389998) [14:53:35] 10GitLab, 10bacula, 06collaboration-services, 10Data-Persistence-Backup, 13Patch-For-Review: Split repository backups (gerrit and gitlab) into its own dedicated storage daemons - https://phabricator.wikimedia.org/T403946#11241420 (10jcrespo) @Jelto @Dzahn The backup seems to be progressing correctly. I w... [15:00:32] Attempt #5: Started running MediaWiki jobs with non recursive dependencies injected, excluding selenium jobs and using 24 workers. From contint1002 in a screen. Log written to /home/hashar/run.20251003.log # T389998 [15:00:32] T389998: Allow control over which extra extensions are installed (Math REL1_43 jobs exceed 60min timeout) - https://phabricator.wikimedia.org/T389998 [15:03:32] FIRING: PuppetSyncFailure: Failed to update Puppet repository /srv/git/operations/puppet on instance deployment-puppetserver-1 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetSyncFailure [15:33:32] RESOLVED: PuppetSyncFailure: Failed to update Puppet repository /srv/git/operations/puppet on instance deployment-puppetserver-1 in project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetSyncFailure [15:45:34] RESOLVED: PuppetAgentNoResources: No Puppet resources found on instance deployment-puppetserver-1 on project deployment-prep - https://prometheus-alerts.wmcloud.org/?q=alertname%3DPuppetAgentNoResources [15:49:35] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: PHPUnit result cache polluted by pending changes - https://phabricator.wikimedia.org/T406357 (10hashar) 03NEW [15:49:57] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team: PHPUnit result cache polluted by pending changes - https://phabricator.wikimedia.org/T406357#11241905 (10hashar) [15:56:03] fun finding mediawiki/core is not gated with CentralAuth [15:56:22] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 07ci-test-error: PHPUnit result cache polluted by pending changes - https://phabricator.wikimedia.org/T406357#11242014 (10hashar) Verifying the CI checkout. From the build l... [15:57:14] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 07ci-test-error: MediaWiki core interface change breaks CentralAuth - https://phabricator.wikimedia.org/T406357#11242038 (10hashar) [16:10:40] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 07ci-test-error: MediaWiki core interface change breaks CentralAuth - https://phabricator.wikimedia.org/T406357#11242149 (10mszwarc) This patch, which has already been submi... [16:13:22] hmm, https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-php81-selenium/36883/console just seems stuck? Says last wrote at 16:37:43 [16:15:39] paladox: I cancelled it [16:15:46] thanks! [16:18:43] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 07ci-test-error: MediaWiki core interface change breaks CentralAuth - https://phabricator.wikimedia.org/T406357#11242187 (10Daimona) 05Open→03Resolved a:03mszwarc... [16:19:02] 10Phabricator, 06Release-Engineering-Team (Seen), 07Developer Productivity, 07SecTeam-Processed: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users - https://phabricator.wikimedia.org/T214579#11242192 (10Aklapper) 05Open→03Resolved I believe... [16:20:05] 10Phabricator, 06collaboration-services, 06Trust-and-Safety, 10Znuny: Sunset / Retire Legalpad Phabricator application? - https://phabricator.wikimedia.org/T363009#11242194 (10Aklapper) 05Stalled→03Declined Some Legalpad items are in use, thus declining to reflect reality. [16:21:17] 10Phabricator, 06Release-Engineering-Team (Radar), 06Traffic: Phabricator videos fail in Firefox ("Range" request gets 503 from Varnish) - https://phabricator.wikimedia.org/T397661#11242201 (10Aklapper) I have not managed yet to reproduce either. Is this still an issue that folks experience? [16:42:20] 10Continuous-Integration-Infrastructure, 06Release-Engineering-Team, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, 07ci-test-error: MediaWiki core interface change breaks CentralAuth - https://phabricator.wikimedia.org/T406357#11242249 (10hashar) Thank you very much and for referenci... [16:43:25] 10Phabricator, 06Release-Engineering-Team (Seen), 07Developer Productivity, 07SecTeam-Processed: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users - https://phabricator.wikimedia.org/T214579#11242250 (10A_smart_kitten) Yeah, I meant to get back... [16:58:32] 10GitLab: GitLab Private Repository Request for: Client-side Bot Detection logic - https://phabricator.wikimedia.org/T404885#11242291 (10thcipriani) 05Open→03Resolved https://gitlab.wikimedia.org/repos/data-engineering/clientside-bot-detection now exists as a blank, private repo. @Milimetric you should... [17:04:05] 10Phabricator, 06Release-Engineering-Team (Seen), 07Developer Productivity, 07SecTeam-Processed: Some very specific Maniphest search queries by RelEng, Sec Team and WMCS are global and shown for all users - https://phabricator.wikimedia.org/T214579#11242314 (10sbassett) >>! In T214579#11242250, @A_smar... [17:14:02] 10Gerrit, 06collaboration-services: gerrit: config tweaks - https://phabricator.wikimedia.org/T406333#11242355 (10Dzahn) re: test platform - that is also T363196 (T329444, T240933, T256563, .. ) - there is/was a gerrit test instance in devtools. puppetized.. so using the same config. but it was shut down beca... [17:18:00] 10Continuous-Integration-Config, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team: Add CentralAuth to gated extensions - https://phabricator.wikimedia.org/T333541#11242362 (10Jdforrester-WMF) Can I suggest either re-purposing this task, or creating a different one, for "Provide a CI job that run... [17:26:15] 10Phabricator, 06Release-Engineering-Team (Radar), 06Traffic: Phabricator videos fail in Firefox ("Range" request gets 503 from Varnish) - https://phabricator.wikimedia.org/T397661#11242382 (10A_smart_kitten) Yeah, I can still repro on a couple of devices: for me in Firefox on Windows I experience what's des... [18:58:09] 10Continuous-Integration-Config, 06Editing-team, 10VisualEditor, 06MediaWiki-Platform-Team (Radar): In CI explicitly define VisualEditor as a dependency - https://phabricator.wikimedia.org/T406376 (10hashar) 03NEW [19:10:19] (03CR) 10Hashar: "I think that one is good enough for now and I need in repo so I can easily regenerate Ia268663f87efbf5f6d4e37a4a4ffff2efddbb16e whenever `" [integration/config] - 10https://gerrit.wikimedia.org/r/1182115 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [19:10:26] (03CR) 10Hashar: [C:03+2] Script to sync dependencies with extension registry [integration/config] - 10https://gerrit.wikimedia.org/r/1182115 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [19:11:53] (03Merged) 10jenkins-bot: Script to sync dependencies with extension registry [integration/config] - 10https://gerrit.wikimedia.org/r/1182115 (https://phabricator.wikimedia.org/T389998) (owner: 10Hashar) [19:16:36] 10Continuous-Integration-Config, 06Editing-team, 10VisualEditor, 06MediaWiki-Platform-Team (Radar): In CI explicitly define VisualEditor as a dependency - https://phabricator.wikimedia.org/T406376#11242671 (10DLynch) You may / may-not want to exclude extensions that have a RL module that's defined with a V... [19:16:51] (03PS1) 10Hashar: Zuul: add VisualEditor dependency explicitly [integration/config] - 10https://gerrit.wikimedia.org/r/1193486 (https://phabricator.wikimedia.org/T406376) [19:37:29] 10Diffusion, 10Phabricator, 06collaboration-services: Disable IO for diffusion repositories - https://phabricator.wikimedia.org/T405596#11242761 (10thcipriani) Sorry the ambiguous "IO" reference. As @Dzahn points out, that's a [[https://we.phorge.it/book/phorge/article/diffusion_uris/#reference-i-o-types|Pha... [19:52:59] 10Continuous-Integration-Infrastructure (Zuul upgrade): Add a zuul tenant config on the zuul scheduler host (zuul1001) - https://phabricator.wikimedia.org/T406384 (10thcipriani) 03NEW [19:57:15] 10Continuous-Integration-Infrastructure (Zuul upgrade), 06Release-Engineering-Team (Priority Backlog 📥), 07Essential-Work: Add a zuul tenant config on the zuul scheduler host (zuul1001) - https://phabricator.wikimedia.org/T406384#11242814 (10thcipriani) Tagging in #together since it seems like this will requ... [20:22:56] 10Diffusion, 10Phabricator, 06collaboration-services: Disable IO for diffusion repositories - https://phabricator.wikimedia.org/T405596#11242867 (10Aklapper) For the records, we have at least two customizations in this area: https://gitlab.wikimedia.org/repos/phabricator/phabricator/-/commit/f3d0345c028babc8... [20:23:04] 10Diffusion, 10Phabricator, 06collaboration-services: Disable IO for diffusion repositories - https://phabricator.wikimedia.org/T405596#11242868 (10Aklapper) As a test, I changed the I/O Type for **all** Read Only URIs listed on https://phabricator.wikimedia.org/source/tool-jouncebot/manage/uris/ (I picked a... [20:37:53] 10MediaWiki-Releasing, 06Security-Team, 05MW-1.39-release, 05MW-1.43-release, and 3 others: Write and send release announcements for MediaWiki 1.39.15/1.43.5/1.44.2 - https://phabricator.wikimedia.org/T406321#11242915 (10sbassett) p:05Triage→03High [20:43:56] 10Diffusion, 10Phabricator, 06collaboration-services: Disable IO for diffusion repositories - https://phabricator.wikimedia.org/T405596#11242932 (10Aklapper) >>! In T405596#11242761, @thcipriani wrote: > If a diffusion repo has a `gerrit.wikimedia.org` or `gerrit-replica.wikimedia.org` URI that is set to `Ob... [21:09:21] 10Continuous-Integration-Config, 06Editing-team, 10VisualEditor, 06MediaWiki-Platform-Team (Radar), 13Patch-For-Review: In CI explicitly define VisualEditor as a dependency - https://phabricator.wikimedia.org/T406376#11243025 (10hashar) @DLynch thank you for your comment! I am trying to avoid injecting... [21:17:06] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392 (10dancy) 03NEW [21:20:46] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243074 (10dancy) [21:22:56] 10Gerrit, 06Release-Engineering-Team: Investigate Gerrit accounts having the same address - https://phabricator.wikimedia.org/T406297#11243081 (10hashar) p:05Triage→03Low [21:31:46] 10Phabricator, 06Security-Team, 07SecTeam-Processed, 07Security: Create a security issue reporting template - https://phabricator.wikimedia.org/T406313#11243115 (10sbassett) [21:32:16] 10Gerrit, 06Release-Engineering-Team: Investigate Gerrit accounts having the same address - https://phabricator.wikimedia.org/T406297#11243117 (10thcipriani) Possibly relevant discussion upstream from long ago: https://issues.gerritcodereview.com/issues/40009262 and very old related change https://gerrit-revie... [21:51:14] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243129 (10Scott_French) In t... [21:52:59] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243132 (10Scott_French) @dan... [21:55:08] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243139 (10dancy) >>! In T406... [21:58:53] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243143 (10dancy) >>! In T406... [22:45:42] 10GitLab (CI & Job Runners), 06serviceops: failed to push docker-registry.discovery.wmnet/repos/data-engineering/airflow-dags:airflow-2.10.5-py3.11-2025-10-03-192132-3003d4328df66a0086a350fdd2ba1dbd80a235c5: unknown: blob upload invalid - https://phabricator.wikimedia.org/T406392#11243219 (10Scott_French) Than... [23:15:51] (03CR) 10C. Scott Ananian: [C:03+2] diffs.sh: Don't emit broken urls for ' ' chars in titles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1193004 (owner: 10Subramanya Sastry) [23:16:27] (03Merged) 10jenkins-bot: diffs.sh: Don't emit broken urls for ' ' chars in titles [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1193004 (owner: 10Subramanya Sastry)