[01:36:52] 10Phabricator: Allow pasting description of previous milestone when creating next milestone - https://phabricator.wikimedia.org/T371449 (10Aklapper) 03NEW [01:36:56] 10Phabricator: Allow pasting description of previous milestone when creating next milestone - https://phabricator.wikimedia.org/T371449#10030389 (10Aklapper) p:05Triage→03Low [01:40:59] 10Phabricator: Allow pasting description of previous milestone when creating next milestone - https://phabricator.wikimedia.org/T371449#10030391 (10Aklapper) {F56801425} As I'm clueless how to insert directly, go for copying to clipboard. This should work but it feels ugly (especially the `get_class` call). `... [01:42:46] 10Phabricator: Allow pasting description of previous milestone when creating next milestone - https://phabricator.wikimedia.org/T371449#10030392 (10Aklapper) [01:43:15] 10Phabricator: Allow pasting description of previous milestone when creating next milestone - https://phabricator.wikimedia.org/T371449#10030393 (10Aklapper) I wonder whether this could be something to upstream or not (and how to make that code a bit cleaner) [03:29:04] Project mwcore-phpunit-coverage-master build #3749: 04STILL FAILING in 29 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/3749/ [04:03:33] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10030455 (10Bugreporter) Another example of ticket that can be considered "stale" is T190129. The task itself has little activity in 3 years, but is a big goal tha... [07:29:29] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 06Content-Transform-Team-WIP, 10Cloud-VPS (Debian Buster Deprecation): Rebuild or delete deployment-docker-proton01 - https://phabricator.wikimedia.org/T369916#10030684 (10Jgiannelos) [07:33:39] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 06Content-Transform-Team-WIP, 10Cloud-VPS (Debian Buster Deprecation): Rebuild or delete deployment-docker-proton01 - https://phabricator.wikimedia.org/T369916#10030691 (10Jgiannelos) I created a new bookworm instance for proton and turned off the old o... [07:34:20] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 06Content-Transform-Team-WIP, 10Cloud-VPS (Debian Buster Deprecation): Rebuild or delete deployment-docker-proton01 - https://phabricator.wikimedia.org/T369916#10030696 (10Jgiannelos) ` curl https://proton-beta.wmflabs.org/_info {"name":"proton","versio... [07:36:34] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 06Content-Transform-Team-WIP, 10Cloud-VPS (Debian Buster Deprecation): Rebuild or delete deployment-docker-proton01 - https://phabricator.wikimedia.org/T369916#10030698 (10Jgiannelos) 05Open→03Resolved a:03Jgiannelos [08:14:32] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10030753 (10Aklapper) This entire conversation seems to only repeat the aspect of eventualism [08:25:21] andre: that "abandon stale tickets" task is an elephant in the room :) I'll decline it [08:25:39] there are plenty of tasks that are kept open cause they are valid issues / feature request [08:25:53] I'm still torn on that [08:26:19] Gerrit has a way to abandon patches as well [08:26:39] I think the root cause is that we are kind and hopeful [08:26:47] kindness cause us to not be rude and not close tickets [08:27:02] and hopefulness causes us to think that MAYBE ONE DAY THAT BUG WILL BE FIXED [08:27:23] or that patch sent to Gerrit X years ago might eventually be visited and merged [08:28:01] in the end, the owners of the tagged projects / repo should do the triage/garbage collecting [08:28:13] and eventually decline a task / abandon or change themselves [08:28:22] rather than having an automatic process doing so under the hood [08:29:03] anyway, you know about all of that ;] [08:29:08] GitLab closes tickets labeled as Needinfo after a bunch of months, RedHat mass-closes tickets about old Fedora versions automatically. There are pros and cons. [08:29:52] How much more spare time do owners have to do things that could be automated? [08:29:56] it's... complicated. [08:30:26] yeah :) [08:30:39] so that depends on the class of ticket I guess [08:31:01] I have 100+ tickets on https://phabricator.wikimedia.org/tag/continuous-integration-infrastructure/ :/ [08:31:11] you're free to decline old ones :D [08:31:47] ;) [08:33:21] then [08:33:29] T177826 is from 2017 and is a valid one to act on! :] [08:33:29] T177826: Upgrade ci ssh key to ecdsa - https://phabricator.wikimedia.org/T177826 [08:50:40] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Release-Engineering-Team (Seen), 06collaboration-services, 06SRE: Upgrade ci ssh key to ecdsa - https://phabricator.wikimedia.org/T177826#10030822 (10hashar) I think that one covers the ssh key pairs used by the Jenkins controller to the agent in prod... [09:43:10] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10030980 (10Bugreporter) Eventualism may be good, since things may be more relevant after years. When doing a new project we may find we need to solve some old tas... [09:55:43] 10Phabricator, 07PM: Decrease issues created many years ago with no recent activity (aka stale tickets) - https://phabricator.wikimedia.org/T248034#10031035 (10Aklapper) I do not oppose (1) or (2) if there are good task criteria. [10:34:54] How am I supposed to find and verify the SSH fingerprint for the new deployment server deploy1003 if https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/deploy1003.wikimedia.org does not exist and if https://wikitech.wikimedia.org/wiki/Wmf-laptop is not an option as I don't run a Debian-based distro? [10:35:22] (context: T364417) [10:35:23] T364417: deploy1003 implementation tracking - https://phabricator.wikimedia.org/T364417 [11:01:10] andre: the script at https://gerrit.wikimedia.org/r/plugins/gitiles/operations/debs/wmf-sre-laptop/+/refs/heads/master/scripts/wmf-update-known-hosts-production can run on non-debian distros too [11:01:49] I run it on my own system using https://gist.github.com/lucaswerkmeister/3c4f366bdb88fb6855f5f444a11628aa [11:02:01] thanks! [11:02:26] (someone™ should probably still create that wikitech page though) [11:07:19] Lucas_WMDE: you are missing `set -e -o pipefail` [11:07:20] :D [11:08:30] I’ll spare you my rant on that stupid “bash strict mode” that everyone unthinkingly copy+pastes into their scripts [11:08:38] hehehe [11:09:01] then my guess is curl might well just exit 0 in all cases [11:09:39] anyway, it is a good idea to wrap the one liner in a user systemd service. That is a neat trick [11:29:42] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation): Remove or replace deployment-restbase04.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370460#10031454 (10Jgiannelos) I don't think the bookworm instance is going t... [11:32:57] Page created btw [12:06:17] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation): Replace deployment-maps-master01 with a Bullseye or Bookworm instance - https://phabricator.wikimedia.org/T361381#10031578 (10hnowlan) It appears there have been issues imaging a new host which is hampering reimagi... [13:14:33] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 06Content-Transform-Team-WIP, 10Cloud-VPS (Debian Buster Deprecation): Rebuild or delete deployment-docker-proton01 - https://phabricator.wikimedia.org/T369916#10031826 (10Andrew) thank you! [13:17:13] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation): Replace deployment-maps-master01 with a Bullseye or Bookworm instance - https://phabricator.wikimedia.org/T361381#10031828 (10Andrew) Puppet is failing on the new host because of ` Error: Could not retrieve catalo... [14:29:26] (03open) 10jelto: update wikidata-query-gui path [repos/releng/gitlab-trusted-runner] - 10https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/94 (https://phabricator.wikimedia.org/T350793) [14:42:32] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 10Data-Platform-SRE (2024.07.29 - 2024.08.16): Remove or replace deployment-snapshot03.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370465#10032161 (10bking) [14:45:21] 10Beta-Cluster-Infrastructure: "Error: Class '(random class)' not found" logspam in beta - https://phabricator.wikimedia.org/T371507 (10Daimona) 03NEW [14:50:41] 10Release-Engineering-Team (Radar), 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.29 - 2024.08.16): Setup a test project to validate upload to the Gitlab package registry - https://phabricator.wikimedia.org/T367391#10032213 (10bking) [15:07:00] 10Continuous-Integration-Config: Migrate docker-registry.wikimedia.org/releng/release-notes from Buster to Bookworm - https://phabricator.wikimedia.org/T371511 (10hashar) 03NEW [15:14:42] 10GitLab (Upstream pit of despair 🕳️), 10Release-Engineering-Team (Seen), 07Upstream: GitLab merge request pages show an error when logged out - https://phabricator.wikimedia.org/T340062#10032311 (10hashar) 05Resolved→03Open This is still happening. ` git push origin HEAD:refs/heads/ci-php-8.2 Enumeratin... [15:16:19] (03open) 10hashar: Test php code with php 8.2 as shipped by Debian Bookworm [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/97 (https://phabricator.wikimedia.org/T371511) [15:17:19] (03update) 10hashar: Test php code with php 8.2 as shipped by Debian Bookworm [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/97 (https://phabricator.wikimedia.org/T371511) [15:25:47] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.29 - 2024.08.16): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#10032349 (10bking) [15:29:45] Project mwcore-phpunit-coverage-master build #3750: 04STILL FAILING in 29 min: https://integration.wikimedia.org/ci/job/mwcore-phpunit-coverage-master/3750/ [15:31:01] 10Release-Engineering-Team (Seen), 06collaboration-services, 10Data Pipelines, 06Data-Engineering, and 2 others: Upgrade Airflow to 2.9.3 - https://phabricator.wikimedia.org/T365449#10032411 (10bking) [15:31:39] (03close) 10hashar: Test php code with php 8.2 as shipped by Debian Bookworm [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/97 (https://phabricator.wikimedia.org/T371511) [15:37:11] Project beta-scap-sync-world build #165846: 04FAILURE in 1 min 57 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/165846/ [15:42:15] 10GitLab (Administration, Settings & Policy), 10Release-Engineering-Team (Priority Backlog 📥), 06collaboration-services, 06Java-Scala-Standardization, 10Data-Platform-SRE (2024.07.29 - 2024.08.16): Create a Maven package registry in Gitlab - https://phabricator.wikimedia.org/T367322#10032460 (10Ottomata)... [15:44:06] (03open) 10hashar: ci: run python tests with both Bullseye and Bookworm [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/98 [15:45:16] (03PS1) 10Hashar: dockerfiles: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058632 (https://phabricator.wikimedia.org/T371511) [15:46:09] (03PS2) 10Hashar: dockerfiles: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058632 (https://phabricator.wikimedia.org/T371511) [15:47:18] Yippee, build fixed! [15:47:18] Project beta-scap-sync-world build #165847: 09FIXED in 2 min 8 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/165847/ [15:47:35] (03CR) 10CI reject: [V:04-1] dockerfiles: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058632 (https://phabricator.wikimedia.org/T371511) (owner: 10Hashar) [15:56:36] (03PS3) 10Hashar: dockerfiles: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058632 (https://phabricator.wikimedia.org/T371511) [15:58:30] (03CR) 10Hashar: [C:03+2] dockerfiles: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058632 (https://phabricator.wikimedia.org/T371511) (owner: 10Hashar) [15:59:41] (03Merged) 10jenkins-bot: dockerfiles: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058632 (https://phabricator.wikimedia.org/T371511) (owner: 10Hashar) [15:59:45] (03PS1) 10Hashar: jjb: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058639 (https://phabricator.wikimedia.org/T371511) [16:03:57] (03CR) 10Hashar: [C:03+2] jjb: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058639 (https://phabricator.wikimedia.org/T371511) (owner: 10Hashar) [16:05:13] (03Merged) 10jenkins-bot: jjb: migrate release-notes to Bookworm [integration/config] - 10https://gerrit.wikimedia.org/r/1058639 (https://phabricator.wikimedia.org/T371511) (owner: 10Hashar) [16:27:06] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T366962#10032760 (10hashar) [16:27:07] 10Continuous-Integration-Config, 13Patch-For-Review: Migrate docker-registry.wikimedia.org/releng/release-notes from Buster to Bookworm - https://phabricator.wikimedia.org/T371511#10032761 (10hashar) [16:27:12] 10Continuous-Integration-Config, 13Patch-For-Review: Migrate docker-registry.wikimedia.org/releng/release-notes from Buster to Bookworm - https://phabricator.wikimedia.org/T371511#10032762 (10hashar) The job triggers when creating the deployment branch on Tuesday ( https://gerrit.wikimedia.org/r/c/mediawiki/co... [16:29:37] 10Release-Engineering-Team (Priority Backlog 📥), 05Release, 05Train Deployments: 1.43.0-wmf.17 deployment blockers - https://phabricator.wikimedia.org/T366962#10032775 (10hashar) I have changed the [[ https://integration.wikimedia.org/ci/job/train-deploy-notes/ | train-deploy-notes job ]] from Buster to Boo... [16:43:51] 10Release-Engineering-Team (Priority Backlog 📥): Fix/remove deployment-charts update_version.py - https://phabricator.wikimedia.org/T369884#10032860 (10thcipriani) p:05Triage→03Low [16:44:05] 10Release-Engineering-Team (Priority Backlog 📥), 07Epic, 07OKR-Work: [WE6.2.1] Publish pre-train single version containers - https://phabricator.wikimedia.org/T369115#10032868 (10thcipriani) [16:44:34] 10Release-Engineering-Team (Radar), 06Data-Engineering, 06Discovery-Search, 06Java-Scala-Standardization: Java projects hosted on Gerrit should publish artifacts to Gitlab - https://phabricator.wikimedia.org/T370400#10032871 (10thcipriani) [16:45:00] 10Release-Engineering-Team (Priority Backlog 📥), 07Epic, 10Quality-and-Test-Engineering-Team (Test Infrastructure): Group -1 pre-train QTE validation environment - https://phabricator.wikimedia.org/T369112#10032876 (10thcipriani) [16:47:04] 10Phabricator, 10Release-Engineering-Team (Priority Backlog 📥), 13Patch-For-Review: Do not autolink shard names (e.g. s1) as Phabricator Spaces - https://phabricator.wikimedia.org/T371131#10032889 (10thcipriani) [16:47:45] 10GitLab (Account Approval), 06Release-Engineering-Team: Requesting GitLab account activation for Taychemu - https://phabricator.wikimedia.org/T370949#10032892 (10Aklapper) 05Open→03Resolved a:03Aklapper Hi, sorry that this took so long - approved now [16:47:54] (03update) 10hashar: ci: run python tests with both Bullseye and Bookworm [repos/releng/release] - 10https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/98 (https://phabricator.wikimedia.org/T371511) [16:49:49] 10Continuous-Integration-Config: Migrate docker-registry.wikimedia.org/releng/release-notes from Buster to Bookworm - https://phabricator.wikimedia.org/T371511#10032902 (10hashar) a:03hashar [16:50:23] 10Release-Engineering-Team (Radar), 06collaboration-services, 06serviceops, 06SRE: replace production buster deployment servers - https://phabricator.wikimedia.org/T364656#10032916 (10thcipriani) [16:50:30] 10Release-Engineering-Team (Priority Backlog 📥), 10Scap: Confusing scap backport behavior on gate-and-submit failure - https://phabricator.wikimedia.org/T367302#10032903 (10thcipriani) p:05Triage→03Medium [16:51:00] 10Continuous-Integration-Config: Migrate docker-registry.wikimedia.org/releng/release-notes from Buster to Bookworm - https://phabricator.wikimedia.org/T371511#10032925 (10hashar) [16:51:01] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure: Migrate all CI jobs from buster to bullseye or later and drop buster testing support - https://phabricator.wikimedia.org/T335765#10032924 (10hashar) [16:51:26] (03open) 10addshore: Gerrit command formmatted JSON output [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/573 [16:51:36] 10Continuous-Integration-Config, 10Continuous-Integration-Infrastructure: Migrate all CI jobs from buster to bullseye or later and drop buster testing support - https://phabricator.wikimedia.org/T335765#10032930 (10hashar) [16:52:57] (03update) 10addshore: Bump docker-registry.wikimedia.org/releng/quibble-buster-php83 from 1.8.0 to 1.9.1 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/571 (owner: 10addbot) [16:54:00] (03update) 10addshore: Bump docker-registry.wikimedia.org/releng/quibble-buster-php83 from 1.8.0 to 1.9.1 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/571 (owner: 10addbot) [16:54:53] 10GitLab (Administration, Settings & Policy), 10gitlab-settings, 06Release-Engineering-Team, 10Tools: Mirroring from one Wikimedia GitLab repository to another one no longer works - https://phabricator.wikimedia.org/T364199#10032965 (10thcipriani) p:05Triage→03Low @LucasWerkmeister is this mirroring a... [16:55:18] 10Release-Engineering-Team (Radar), 06Data-Platform-SRE, 06Discovery-Search, 06Java-Scala-Standardization, and 2 others: Validate CI integration so that Ci can release Maven artifacts on user's demand - https://phabricator.wikimedia.org/T367403#10032971 (10thcipriani) [17:14:07] gitlab CI question...trying to get an image tag published here https://gitlab.wikimedia.org/repos/data-engineering/git-sync/-/blob/main/.gitlab-ci.yml?ref_type=heads#L30 and defining the var here https://gitlab.wikimedia.org/repos/data-engineering/git-sync/-/blob/main/.gitlab-ci.yml?ref_type=heads#L43 but it doesn't seem to publish: https://docker-registry.wikimedia.org/repos/data-engineering/git-sync/tags/ . Should I just try to [17:14:08] define the var in the same build step, or any other suggestions? [17:25:50] (03merge) 10addshore: Bump docker-registry.wikimedia.org/releng/quibble-buster-php83 from 1.8.0 to 1.9.1 [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/571 (owner: 10addbot) [17:32:50] 10GitLab (Administration, Settings & Policy), 10gitlab-settings, 06Release-Engineering-Team, 10Tools: Mirroring from one Wikimedia GitLab repository to another one no longer works - https://phabricator.wikimedia.org/T364199#10033102 (10LucasWerkmeister) Yes – I initially put the repository on GitLab before... [17:43:51] 10Beta-Cluster-Infrastructure: "Error: Class '(random class)' not found" logspam in beta - https://phabricator.wikimedia.org/T371507#10033120 (10Umherirrender) Sounds similiar to {T348136} [18:17:35] (03open) 10migr: docs: fix `mw update --version` example [repos/releng/cli] - 10https://gitlab.wikimedia.org/repos/releng/cli/-/merge_requests/574 [21:49:12] (03open) 10dduvall: version: 1.0.1 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/116 [21:54:33] (03merge) 10dduvall: version: 1.0.1 [repos/releng/blubber] - 10https://gitlab.wikimedia.org/repos/releng/blubber/-/merge_requests/116 [22:17:54] 10Release-Engineering-Team (Yak Shaving 🐃🪒), 10logspam-watch: Add a version column to logspam-watch, and group identical errors - https://phabricator.wikimedia.org/T371566 (10brennen) 03NEW [23:31:00] 10Continuous-Integration-Infrastructure, 07Jenkins, 10Release-Engineering-Team (Seen), 06collaboration-services, 06SRE: Upgrade ci ssh key to ecdsa - https://phabricator.wikimedia.org/T177826#10034118 (10Dzahn) ACK! I see the key in `modules/profile/manifests/ci/agent.pp` and of course we could make a ne...