[06:25:57] (03PS1) 10Kevin Bazira: inference-services: remove filters for old model-server paths [integration/config] - 10https://gerrit.wikimedia.org/r/1069029 (https://phabricator.wikimedia.org/T369344) [06:34:53] (03CR) 10Kevin Bazira: "Hi Antoine, 👋" [integration/config] - 10https://gerrit.wikimedia.org/r/1069029 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [07:14:47] 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review, 05Release, 05Train Deployments: 1.43.0-wmf.20 deployment blockers - https://phabricator.wikimedia.org/T366965#10105266 (10hashar) 05Open→03Resolved I am claiming 1.43.0-wmf.20 to have been successfully deployed. [07:16:29] (03CR) 10Hashar: [C:03+2] Revert "Docker: Drop ajv, no longer used" (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1066717 (owner: 10Hashar) [07:18:05] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/ParserMigration] Add MobileFrontend phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1067936 (owner: 10Fomafix) [07:19:23] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/ParserMigration] Add MobileFrontend phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1067936 (owner: 10Fomafix) [07:21:28] (03CR) 10Hashar: [C:03+2] "Awesome! Thank you for the cleanup." [integration/config] - 10https://gerrit.wikimedia.org/r/1069029 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [07:22:54] (03Merged) 10jenkins-bot: inference-services: remove filters for old model-server paths [integration/config] - 10https://gerrit.wikimedia.org/r/1069029 (https://phabricator.wikimedia.org/T369344) (owner: 10Kevin Bazira) [08:22:00] (03approved) 10jnuche: Remove use of -Dhistory_log from branch-cut-test-patches [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/113 (owner: 10dancy) [08:24:51] (03merge) 10hashar: use default system Java in Jenkins systemd override file [repos/releng/jenkins-deploy] - 10https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/70 (https://phabricator.wikimedia.org/T359795) (owner: 10jnuche) [09:02:40] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 06collaboration-services: releases1003 file system over 90% full - https://phabricator.wikimedia.org/T368239#10105480 (10hashar) `releases1003` has the following partitions: ` # lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT... [09:07:39] 10Continuous-Integration-Infrastructure, 07Jenkins, 06collaboration-services: Switch Jenkins instances from Java 11 to Java 17 - https://phabricator.wikimedia.org/T359795#10105516 (10jnuche) The two Jenkins instances running on `releases1003.eqiad.wmnet` and `releases2003.codfw.wmnet` have been updated and n... [10:25:52] 06Release-Engineering-Team, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem persist, use the findB... - https://phabricator.wikimedia.org/T373668 [10:26:38] 06Release-Engineering-Team, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem persist, use ... - https://phabricator.wikimedia.org/T373668#10105662 [10:28:13] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10105669 [10:28:29] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10105681 [10:30:20] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 13Patch-For-Review: Remove or replace deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370460#10105684 (10Jgiannelos) The same title direc... [10:35:16] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10105693 [10:40:40] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10105729 [10:47:12] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 13Patch-For-Review: Remove or replace deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370460#10105833 (10Jgiannelos) cloudsearch still re... [10:51:56] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Tests, 07Browser-Tests: Run Selenium tests targeting Beta cluster - https://phabricator.wikimedia.org/T373680 (10zeljkofilipin) 03NEW [10:52:14] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-Tests, 07Browser-Tests: Run Selenium tests targeting Beta cluster - https://phabricator.wikimedia.org/T373680#10105880 (10zeljkofilipin) [10:58:58] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 13Patch-For-Review: Remove or replace deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370460#10105917 (10Jgiannelos) Ok it works now: ht... [11:22:19] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Buster Deprecation): Migrate deployment-prep away from Debian Buster to Bullseye/Bookworm - https://phabricator.wikimedia.org/T327742#10105971 (10Jgiannelos) [11:23:43] 06Release-Engineering-Team, 06collaboration-services: Upgrade phab (phorge) hosts to bookworm - https://phabricator.wikimedia.org/T372619#10105973 (10Aklapper) A [new upstream release 2024.35 is out](https://we.phorge.it/w/changelog/2024.35/) and personally I'd prefer to wait with upgrading to Bookworm (PHP 8.... [11:50:55] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10106028 [12:05:19] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10106066 [12:53:25] hashar: o/ sorry to ping you again, but I am really blocked with the spicerack CI failures :( [12:53:56] if https://phabricator.wikimedia.org/T372485#10096224 could be an option, I can check jjb's config and file a patch [13:07:30] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10106217 [13:16:39] 10Deployments, 06serviceops, 10Shellbox, 10Wikibase-Quality-Constraints, and 4 others: Burst of GuzzleHttp Exception for http://localhost:6025/call/constraint-regex-checker - https://phabricator.wikimedia.org/T371633#10106220 (10Joe) >>! In T371633#10102614, @ItamarWMDE wrote: > Is this somehow related to... [13:21:06] 10Deployments, 06serviceops, 10Shellbox, 10Wikibase-Quality-Constraints, and 4 others: Burst of GuzzleHttp Exception for http://localhost:6025/call/constraint-regex-checker - https://phabricator.wikimedia.org/T371633#10106229 (10Joe) Let me add some prospect, as I've heard people are complaining about this... [13:54:28] (03CR) 10Hashar: "Note: if you change the invoked entry point to `phpunit:parallel:extensions` it MUST be available in all the MediaWiki supported branches " [integration/quibble] - 10https://gerrit.wikimedia.org/r/1039669 (https://phabricator.wikimedia.org/T365976) (owner: 10Arthur taylor) [13:57:43] elukey: yeah the repo is broken on my machine as well. Looks like I haven't sent the comment I have made earlier this week [13:59:21] hashar: o/ locally it should work fine, it is just timing out in CI for too may py versions supported. Am I missing something? [14:01:34] I am copleting my comment, I will post on the task [14:01:41] we should pair on it next week to optimize the envs [14:01:46] it is doing toooooo many things [14:02:03] also each of the env seems to install all the dependencies [14:13:16] 06Release-Engineering-Team, 06Infrastructure-Foundations: Spicerack's tox config times out all the time after T342019 - https://phabricator.wikimedia.org/T372485#10106379 (10hashar) On my local machine, with warmed cache, setting up the test environment takes 43 seconds, so that is pretty similar to what CI is... [14:13:44] [tox:jenkins] [14:13:45] # If CI misses a python version we require, it should fail! [14:13:45] skip_missing_interpreters = false [14:13:45] envlist = py{39,310,311}-{flake8,unit},py39-style,bandit,mypy,prospector,sphinx} [14:13:47] elukey: ^ :) [14:14:17] and I apologize for the lack of follow up after my initial comment on Monday evening [14:14:39] I went to run the MediaWiki train this week, preparing the Java upgrade for the CI Jenkins, catching up with mails etc :] [14:20:18] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.21 deployment blockers - https://phabricator.wikimedia.org/T373640#10106412 (10DLynch) [14:20:27] no need, on the contrary thanks a ton for the help! [14:21:27] elukey: I have sent a draft change [14:21:36] https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/1069220 [14:25:20] hashar: just sent https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/1069224 as well [14:26:20] cuminXXXX offers only py39 so for the moment it could be a quick fix [14:26:22] wdyt? [14:33:13] (03open) 10jnuche: housekeeping [repos/releng/scap3-dev] - 10https://gitlab.wikimedia.org/repos/releng/scap3-dev/-/merge_requests/41 [14:34:06] (03merge) 10jnuche: housekeeping [repos/releng/scap3-dev] - 10https://gitlab.wikimedia.org/repos/releng/scap3-dev/-/merge_requests/41 [14:37:28] seems to work fine :) [14:48:40] (03merge) 10dancy: Remove use of -Dhistory_log from branch-cut-test-patches [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/113 [14:49:27] elukey: yeah https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/1069220/ got it down to 10 minutes [14:49:27] :) [14:49:57] I have send another one to speed up flake8 by no more installing every single deps in that env: https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/1069220/ [14:50:40] there are a few more optimization that can be done such as no more installing Spicerack in environments that do not need it installed. That can be done with `skip_install = True` (and probably want to add `skipsdist = True` as well) [14:51:21] hashar: one thing that I don't get from your CR is why it runs only on 39 [14:51:40] given that 310/311 are listed, and skip_missing_interpreters is false [14:51:50] I would have thought that it ended up in a failure [14:53:34] 06Release-Engineering-Team, 06Infrastructure-Foundations, 13Patch-For-Review: Spicerack's tox config times out all the time after T342019 - https://phabricator.wikimedia.org/T372485#10106491 (10hashar) Self note: in Quibble I did some optimization to sdist / install which can be seen at: https://gerrit.wikim... [14:54:04] py{39,310,311}-{flake8,unit} [14:54:09] that expands to six envs [14:54:09] (03open) 10jnuche: jobs: fix indentation [repos/releng/jenkins-deploy] - 10https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/72 [14:54:26] py39-flake8, py310-flake8 .... py310-unit, py311-unit [14:54:33] the other one py39-{style,bandit,mypy,prospector,sphinx} [14:54:45] expands to 5 envs which are all using python 3.9 [14:54:58] the image does have python 3.10 and 3.11 [14:55:22] so the py310-flake8 / py310-unit / py311-flake8 / py311-unit do work [14:55:27] (03merge) 10jnuche: jobs: fix indentation [repos/releng/jenkins-deploy] - 10https://gitlab.wikimedia.org/repos/releng/jenkins-deploy/-/merge_requests/72 [14:57:03] hashar: ahhh right okok [14:57:12] sorry got lost in the config [14:57:21] yeah it is tricky :( [14:57:42] I use: `tox3 --showconf -e ` to review the config [14:58:25] of course tox v4 is breaking stuff :] [14:58:39] anyway. I am off, I am exhausted by this week! But we can resume next week! [14:58:43] thanks! [14:58:52] at least there is patch that speedsup CI, though it might be wrong since less things are tested [14:59:07] but I think it is probably fine to run bandit/prospector/sphinx etc against a single python version [15:01:52] yes yes definitely, it is a bandaid [15:01:59] and we unblock things, then we can revisit [15:03:03] 10Release-Engineering-Team (Priority Backlog 📥): Automatically handle manual release notes for MediaWiki - https://phabricator.wikimedia.org/T347207#10106510 (10Sandeeps) 05Open→03In progress [15:03:18] yup [15:03:56] elukey: some OpenStack projects have migrated from tox to nox : https://nox.thea.codes/en/stable/index.html [15:04:06] and maybe I can trick volans into migrating our python projects to it :D [15:06:43] anyway [15:06:47] I am off ! [15:10:21] have a good weekend! [16:21:27] (03update) 10sandeeps: cli.py: add scap version to fatal error meessages for better logging [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/407 (https://phabricator.wikimedia.org/T311080) [16:25:37] (03update) 10sandeeps: cli.py: add scap version to fatal error meessages for better logging [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/407 (https://phabricator.wikimedia.org/T311080) [16:35:56] (03open) 10dancy: scap prep: Make mediawiki cache dir world writable immediately after cloning [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/424 (https://phabricator.wikimedia.org/T373425) [16:35:58] (03update) 10dancy: scap prep: Make mediawiki cache dir world writable immediately after cloning [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/424 (https://phabricator.wikimedia.org/T373425) [16:36:51] 06Release-Engineering-Team, 06serviceops, 13Patch-For-Review: Investigate scap fails to create /srv/mediawiki-staging/php-1.43.0-wmf.20/cache/l10n - https://phabricator.wikimedia.org/T373425#10106774 (10dancy) a:03dancy [16:37:00] 06Release-Engineering-Team, 06serviceops, 13Patch-For-Review: Investigate scap fails to create /srv/mediawiki-staging/php-1.43.0-wmf.20/cache/l10n - https://phabricator.wikimedia.org/T373425#10106776 (10dancy) Reproduced in train-dev. [16:38:27] (03update) 10dancy: scap prep: Make mediawiki cache dir world writable immediately after cloning [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/424 (https://phabricator.wikimedia.org/T373425) [17:00:14] (03open) 10dancy: deploy: Add /etc/gitconfig [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/85 [17:00:16] (03update) 10dancy: deploy: Add /etc/gitconfig [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/85 [17:01:08] (03merge) 10dancy: deploy: Add /etc/gitconfig [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/85 [17:05:31] (03open) 10dancy: Dockerfile.base: pip install SQLAlchemy [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/86 [17:05:34] (03update) 10dancy: Dockerfile.base: pip install SQLAlchemy [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/86 [17:13:04] (03merge) 10dancy: Dockerfile.base: pip install SQLAlchemy [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/86 [17:39:00] 10Continuous-Integration-Infrastructure, 07Jenkins, 06Release-Engineering-Team, 06collaboration-services: releases1003 file system over 90% full - https://phabricator.wikimedia.org/T368239#10106979 (10Dzahn) It's possible to add a new virtual disk to the ganeti VM. It does not require recreating the VM fro... [17:45:23] 10Continuous-Integration-Infrastructure, 07Jenkins, 06collaboration-services: Switch Jenkins instances from Java 11 to Java 17 - https://phabricator.wikimedia.org/T359795#10106984 (10Dzahn) Thank you. I removed the JDK 11 packages manually from both hosts. Puppet is not managing them anymore. ` sudo apt-... [17:49:25] 06Release-Engineering-Team, 06serviceops, 13Patch-For-Review: Investigate scap fails to create /srv/mediawiki-staging/php-1.43.0-wmf.20/cache/l10n - https://phabricator.wikimedia.org/T373425#10107010 (10thcipriani) Got it. I see two problems: 1. `Automatic branch cut` jenkins job assumption that `mediawiki... [17:51:48] (03approved) 10thcipriani: scap prep: Make mediawiki cache dir world writable immediately after cloning [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/424 (https://phabricator.wikimedia.org/T373425) (owner: 10dancy) [17:51:53] (03merge) 10thcipriani: scap prep: Make mediawiki cache dir world writable immediately after cloning [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/424 (https://phabricator.wikimedia.org/T373425) (owner: 10dancy) [18:07:49] 06Release-Engineering-Team, 06serviceops, 13Patch-For-Review: Investigate scap fails to create /srv/mediawiki-staging/php-1.43.0-wmf.20/cache/l10n - https://phabricator.wikimedia.org/T373425#10107029 (10thcipriani) 05Open→03Resolved Scap problem solved. Adding the `netrc` problem info on {T373441}. [18:21:46] 06Release-Engineering-Team: Train: automatic-branch-cut does not account for changes between branching and adding submodules - https://phabricator.wikimedia.org/T373709 (10thcipriani) 03NEW [18:22:48] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 13Patch-For-Review: Remove or replace deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370460#10107090 (10Jdlrobson) https://integration.w... [18:29:54] (03open) 10dduvall: readme: Publishing image provenance [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/107 [18:29:55] (03update) 10dduvall: readme: Publishing image provenance [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/107 [18:34:23] (03update) 10dduvall: readme: Publishing image provenance [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/107 [18:34:34] (03update) 10dduvall: readme: Publishing image provenance [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/107 [19:21:13] (03open) 10dancy: Dockerfile.base: Add python3-venv [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/87 [19:21:15] (03update) 10dancy: Dockerfile.base: Add python3-venv [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/87 [19:22:12] (03merge) 10dancy: Dockerfile.base: Add python3-venv [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/87 [19:36:43] (03open) 10dancy: branch.py: clone(): Use tempfile.TemporaryDirectory [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/114 [19:36:45] (03update) 10dancy: branch.py: clone(): Use tempfile.TemporaryDirectory [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/114 [19:37:47] (03update) 10dancy: branch.py: clone(): Use tempfile.TemporaryDirectory [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/114 [19:38:25] 06Release-Engineering-Team, 10docker-pkg, 06serviceops: Attach opencontainers image metadata to docker images - https://phabricator.wikimedia.org/T345070#10107259 (10dduvall) re: Blubber, I just want to give an update which might be relevant to this work. As of version 1.0.0 Blubber supports [[ https://gitl... [19:45:56] 10Phabricator (2024-08-20): Avoid the need to update Herald exclusion rules everytime a new team sprint project is created - https://phabricator.wikimedia.org/T144041#10107277 (10MusikAnimal) >>! In T144041#10093486, @Aklapper wrote: > @MusikAnimal: Would your team be interested in trying this? :) (Basically... [19:57:40] (03merge) 10thcipriani: readme: Publishing image provenance [repos/releng/kokkuri] - 10https://gitlab.wikimedia.org/repos/releng/kokkuri/-/merge_requests/107 (owner: 10dduvall) [20:13:01] (03update) 10jhuneidi: cli.py: add scap version to fatal error messages for better logging [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/407 (https://phabricator.wikimedia.org/T311080) (owner: 10sandeeps) [20:15:21] (03merge) 10thcipriani: branch.py: clone(): Use tempfile.TemporaryDirectory [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/114 (owner: 10dancy) [20:52:10] (03open) 10dancy: gerrit: project.config: Add [receive] section [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/88 (https://phabricator.wikimedia.org/T373709) [20:52:12] (03update) 10dancy: gerrit: project.config: Add [receive] section [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/88 (https://phabricator.wikimedia.org/T373709) [20:52:48] (03merge) 10dancy: gerrit: project.config: Add [receive] section [repos/releng/train-dev] - 10https://gitlab.wikimedia.org/repos/releng/train-dev/-/merge_requests/88 (https://phabricator.wikimedia.org/T373709) [21:11:26] 06Release-Engineering-Team, 06Growth-Team: [testwiki-wmf.20] MediaWiki pages cannot be edited - Failed to load data blob from Unable to fetch blob error - https://phabricator.wikimedia.org/T373718 (10Etonkovidova) 03NEW [21:11:42] (03open) 10dancy: branch.py: Always check out the remote wmf/ [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/115 (https://phabricator.wikimedia.org/T373709) [21:11:44] (03update) 10dancy: branch.py: Always check out the remote wmf/ [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/115 (https://phabricator.wikimedia.org/T373709) [21:13:16] (03update) 10dancy: branch.py: Always check out the remote wmf/ [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/115 (https://phabricator.wikimedia.org/T373709) [21:15:52] 06Release-Engineering-Team, 06Growth-Team: [testwiki-wmf.20] MediaWiki pages cannot be edited - Failed to load data blob from Unable to fetch blob error - https://phabricator.wikimedia.org/T373718#10107560 (10Etonkovidova) [21:18:49] 06Release-Engineering-Team, 06Growth-Team: [testwiki-wmf.20] MediaWiki pages cannot be edited - Failed to load data blob from Unable to fetch blob error - https://phabricator.wikimedia.org/T373718#10107567 (10Umherirrender) →14Duplicate dup:03T373668 [21:20:08] 06Release-Engineering-Team, 06DBA, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Engineering, 07Wikimedia-production-error: MediaWiki\Revision\RevisionAccessException: Failed to load data blob from {address} for revision {revision}. If this problem pers... - https://phabricator.wikimedia.org/T373668#10107569 [23:45:25] 10Continuous-Integration-Infrastructure, 07Jenkins, 06collaboration-services, 13Patch-For-Review: Switch Jenkins instances from Java 11 to Java 17 - https://phabricator.wikimedia.org/T359795#10107845 (10Dzahn) 05Open→03In progress [23:47:15] 10Continuous-Integration-Infrastructure, 07Jenkins, 06collaboration-services, 13Patch-For-Review: Switch Jenkins instances from Java 11 to Java 17 - https://phabricator.wikimedia.org/T359795#10107850 (10Dzahn) > Java 17 is available on Debian system since Bullseye. We would need the contint servers to be u...