[08:30:08] (03CR) 10Hashar: "If the job no more send any notification we might as well remove them entirely since nobody will notice the issues, I am thus in favor of " [integration/config] - 10https://gerrit.wikimedia.org/r/801808 (https://phabricator.wikimedia.org/T309655) (owner: 10SBassett) [08:53:24] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10MoritzMuehlenhoff) >>! In T309646#7972421, @Dzahn wrote: > "dpkg-source: error: can't build with source format '3.0 (quilt)': no upstream tarball found at ../jwt-authorizer... [08:57:44] 10Release-Engineering-Team, 10DBA, 10Blocked-on-schema-change: Review schema changes for T307896 - https://phabricator.wikimedia.org/T309686 (10Marostegui) @Physikerwelt I am not sure what this ticket is about, but DBAs do not handle table creation. That is handled during the release process. Unless this is... [08:57:53] 10Release-Engineering-Team: Review schema changes for T307896 - https://phabricator.wikimedia.org/T309686 (10Marostegui) [08:59:27] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.39.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T308067 (10TheDJ) [09:01:26] 10Release-Engineering-Team: Review schema changes for T307896 - https://phabricator.wikimedia.org/T309686 (10Ladsgroup) https://wikitech.wikimedia.org/wiki/Creating_new_tables has more info. If you want it to be in mw in production. We need some info (as outlined in the wiki page) but once we sign it off, you ne... [09:03:17] (03CR) 10Hashar: "I am not familiar with reviewing package-lock.json files and all the changes introduced to dependencies :-\ Should we add an intermediar" [integration/docroot] - 10https://gerrit.wikimedia.org/r/793623 (owner: 10Libraryupgrader) [09:15:40] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Physikerwelt) [09:18:20] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Physikerwelt) @Ladsgroup thank you. Sorry I missed the first point in https://wikitech.wikimedia.org/wiki/Schema_changes#What_is_not_a_schema_change I honestly don't know if it should be in production or not. How... [09:43:57] 10Release-Engineering-Team (Priority Backlog 📥), 10Patch-For-Review, 10Release, 10Train Deployments: 1.39.0-wmf.14 deployment blockers - https://phabricator.wikimedia.org/T308067 (10Ladsgroup) [10:01:07] 10Continuous-Integration-Infrastructure, 10MediaWiki-Core-Tests, 10MediaWiki-Internationalization, 10I18n: Test that namespace names are not identical to language codes - https://phabricator.wikimedia.org/T309688 (10Amire80) [10:08:51] 10Release-Engineering-Team, 10Scap, 10SRE, 10serviceops: Deploy Scap version 4.8.0 - https://phabricator.wikimedia.org/T309116 (10MoritzMuehlenhoff) p:05Triage→03Medium [10:13:13] 10Beta-Cluster-Infrastructure, 10Wikidata, 10Wikidata-Termbox, 10wdwb-tech, and 3 others: Move Termbox SSR for Beta Wikidata into deployment-prep project - https://phabricator.wikimedia.org/T304328 (10Lucas_Werkmeister_WMDE) >>! In T304328#7969664, @ItamarWMDE wrote: > @Lucas_Werkmeister_WMDE I mean shutti... [10:30:31] maintenance-disconnect-full-disks build 391096 integration-agent-docker-1037 (/: 30%, /srv: 95%, /var/lib/docker: 47%): OFFLINE due to disk space [10:40:41] maintenance-disconnect-full-disks build 391098 integration-agent-docker-1037 (/: 30%, /srv: 47%, /var/lib/docker: 46%): RECOVERY disk space OK [11:19:20] 10Project-Admins: Create a project user-eudoh board - https://phabricator.wikimedia.org/T309696 (10EUdoh-WMF) [11:19:41] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Ladsgroup) Thanks! Does this mean this table will be always empty? We need these numbers to plan the growth. [11:21:28] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Physikerwelt) Yes. I wanted to express that with the zeros in the ticket description. [11:28:46] <_joe_> jnuche: if I want to deploy the scap change I made yesterday, I still need to build a deb right? [11:28:56] <_joe_> me/janis [11:29:07] _joe_: yeah, correct [11:29:38] <_joe_> ack, thanks! [11:31:20] _joe_: just in case you were not aware, we have a script to help with that: https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/tools/scap/+/refs/heads/master/release-scripts/prepare-scap-release [11:31:54] <_joe_> ah yeah saw it yesterday, thanks :) [11:32:03] <_joe_> I wasn't sure if we were already transitioned or not [11:32:28] we'll do it soon (hopefully) ^_^ [11:33:31] <_joe_> yeah saw you experimenting yesterday, hence I asked again :) [11:35:51] (03PS1) 10Giuseppe Lavagetto: Release 4.8.1-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/802101 [11:51:07] 10Project-Admins: Create a project user-eudoh board - https://phabricator.wikimedia.org/T309696 (10Aklapper) 05Open→03Resolved a:03Aklapper Requested public project #user-eudoh-wmf has been created: https://phabricator.wikimedia.org/project/view/5970/ (In case you need to edit the project or project workb... [11:52:35] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Relocate Jenkins agents root directory to /srv/jenkins - https://phabricator.wikimedia.org/T309698 (10hashar) [12:08:42] 10Project-Admins: Create a project user-eudoh board - https://phabricator.wikimedia.org/T309696 (10EUdoh-WMF) Thanks a lot, @Aklapper ! [12:16:08] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Ladsgroup) I think it won't be issue but to double check. It will stay as an empty even when we switch to php 8 in production? If it's not being read or written in production, you can simply avoid creating it, f... [12:17:11] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Marostegui) Yeah, if we don't really need it - I would rather not get it created. For example in s3 that means around 1800 new files (900 wikis) on the hosts themselves. [12:26:29] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Physikerwelt) >>! In T309686#7973635, @Ladsgroup wrote: > I think it won't be issue but to double check. It will stay as an empty even when we switch to php 8 in production? yes. it does not depend on the PHP ver... [12:27:21] (03PS1) 10Jaime Nuche: install-world: add new operation [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) [12:31:17] (03CR) 10CI reject: [V: 04-1] install-world: add new operation [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) (owner: 10Jaime Nuche) [12:34:07] (03PS2) 10Jaime Nuche: install-world: add new operation [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) [12:38:03] (03CR) 10CI reject: [V: 04-1] install-world: add new operation [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) (owner: 10Jaime Nuche) [12:40:56] (03PS3) 10Jaime Nuche: install-world: add new operation [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) [12:49:20] 10Beta-Cluster-Infrastructure, 10Inuka-Team (Kanban), 10Wikistories (MVP): Call to undefined method ForeignDBFile::getExtendedMetadata() - https://phabricator.wikimedia.org/T309668 (10SBisson) [12:50:28] (03CR) 10Jaime Nuche: "Tested manually from deploy server. Version 4.8.0 of scap is currently installed on all our target hosts and executes correctly (at least " [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) (owner: 10Jaime Nuche) [12:57:03] (03CR) 10Jaime Nuche: install-world: add new operation (031 comment) [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) (owner: 10Jaime Nuche) [13:54:24] (03PS1) 10Lucas Werkmeister (WMDE): Update Wikibase section [integration/docroot] - 10https://gerrit.wikimedia.org/r/802138 [13:55:35] 10Release-Engineering-Team (Next), 10Scap: Bootstrap new scap targets - https://phabricator.wikimedia.org/T309713 (10jnuche) [13:55:57] 10Release-Engineering-Team (Next), 10Scap: Bootstrap new scap targets - https://phabricator.wikimedia.org/T309713 (10jnuche) 05Open→03In progress [13:56:00] 10Release-Engineering-Team (Priority Backlog 📥), 10Scap, 10Infrastructure-Foundations, 10serviceops: Use scap to deploy itself to scap targets - https://phabricator.wikimedia.org/T303559 (10jnuche) [13:56:44] (03CR) 10Lucas Werkmeister (WMDE): Update Wikibase section (031 comment) [integration/docroot] - 10https://gerrit.wikimedia.org/r/802138 (owner: 10Lucas Werkmeister (WMDE)) [14:08:25] (03CR) 10Jforrester: [C: 03+1] build: Updating eslint-config-wikimedia to 0.22.1 (031 comment) [integration/docroot] - 10https://gerrit.wikimedia.org/r/793623 (owner: 10Libraryupgrader) [14:44:55] 10Project-Admins: Create project tag for MediaWiki-extensions-Shibboleth - https://phabricator.wikimedia.org/T309719 (10DaAwesomeP) [14:54:00] 10GitLab (Infrastructure), 10serviceops, 10Patch-For-Review: bring new gitlab hardware servers into production - https://phabricator.wikimedia.org/T307142 (10Jelto) [15:31:47] 10Release-Engineering-Team: Create mathlatexml table? - https://phabricator.wikimedia.org/T309686 (10Ladsgroup) We can override it in production to make sure it never gets turned on by mistake. That's much easier than maintaining 1000 tables in production :P [15:34:52] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10dduvall) >>! In T309646#7972421, @Dzahn wrote: > We will need an upstream tarball that includes a ./vendor/ directory with all the needed artifacts. > I originally had it... [15:54:31] (03PS4) 10Jaime Nuche: install-world: add new operation [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) [16:02:41] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team (Seen), 10SRE, 10serviceops, 10Patch-For-Review: replace doc1001.eqiad.wmnet with a buster VM and create the codfw equivalent - https://phabricator.wikimedia.org/T247653 (10hashar) A few people poked me about that instance. Looks like th... [16:12:59] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10dduvall) I also went ahead and added `dh_auto_install -- --no-source` to omit all the vendor files from the .deb. [16:19:12] 10Project-Admins: Create a project user-eudoh board - https://phabricator.wikimedia.org/T309696 (10EUdoh-WMF) Hi @Aklapper > (In case you need to edit the project or project workboard itself at some point and lack permissions, please see Trusted-Contributors.) I tried to create a workboard and found out tha... [16:21:20] 10Project-Admins: Create a project user-eudoh board - https://phabricator.wikimedia.org/T309696 (10RhinosF1) I've added you, please shout if you have any questions! [16:26:52] 10Beta-Cluster-Infrastructure: Create deployment-deploy04 as future secondary/upgrade - https://phabricator.wikimedia.org/T309437 (10TheresNoTime) 05Open→03Stalled **Stalled**: working through getting incompatibilities resolved (i.e. {T309449}) //nb. attaching a volume as mentioned above is blocked by {T309... [16:34:33] 10Project-Admins: Create project tag for MediaWiki-extensions-Shibboleth - https://phabricator.wikimedia.org/T309719 (10Aklapper) 05Open→03Stalled Hi, is this request supported by the author/maintainer @N0rthway? [16:40:38] 10Beta-Cluster-Infrastructure, 10Cloud-VPS, 10cloud-services-team (Kanban): Two volumes not deleting/creating on deployment-prep - https://phabricator.wikimedia.org/T309659 (10Majavah) I suspect this one is caused by RabbitMQ losing the commands to create/delete those instances. I tried restating various Cin... [16:57:11] 10Beta-Cluster-Infrastructure, 10Cloud-VPS, 10cloud-services-team (Kanban): Two volumes not deleting/creating on deployment-prep - https://phabricator.wikimedia.org/T309659 (10TheresNoTime) Thank you @Majavah — I dare not create //another// one to connect to `deploy04`, seeing how well that went with `3c31b9... [16:58:19] 10Beta-Cluster-Infrastructure, 10Cloud-VPS, 10cloud-services-team (Kanban): Two volumes not deleting/creating on deployment-prep - https://phabricator.wikimedia.org/T309659 (10Majavah) >>! In T309659#7974447, @TheresNoTime wrote: > Thank you @Majavah — I dare not create //another// one to connect to `deploy0... [16:59:36] 10Beta-Cluster-Infrastructure, 10Cloud-VPS, 10cloud-services-team (Kanban): Two volumes not deleting/creating on deployment-prep - https://phabricator.wikimedia.org/T309659 (10TheresNoTime) That worked! (`43071b78-084e-416f-9465-9e2b812c8310`) [18:18:05] 10Phabricator, 10Patch-For-Review: Delete unused custom /src/other/CustomLoginHandler.php in Phab extensions - https://phabricator.wikimedia.org/T228518 (10Dylsss) 05Open→03Resolved a:03mmodell Was done in rPHEX1d9b463a4f1cb540fc6922b64a8d6bbc130a62f9. [18:47:59] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10dancy) Nice work @dduvall ! [18:50:23] 10Phabricator: Delete unused custom /src/other/CustomLoginHandler.php in Phab extensions - https://phabricator.wikimedia.org/T228518 (10Mainframe98) [19:52:43] (03CR) 10Ahmon Dancy: install-world: add new operation (0315 comments) [tools/scap] - 10https://gerrit.wikimedia.org/r/802131 (https://phabricator.wikimedia.org/T307081) (owner: 10Jaime Nuche) [19:57:50] (03CR) 10Ahmon Dancy: [C: 03+2] Release 4.8.1-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/802101 (owner: 10Giuseppe Lavagetto) [20:03:47] (03Merged) 10jenkins-bot: Release 4.8.1-1 [tools/scap] - 10https://gerrit.wikimedia.org/r/802101 (owner: 10Giuseppe Lavagetto) [20:11:34] 10Release-Engineering-Team, 10Scap, 10SRE, 10serviceops: Deploy Scap version 4.8.1 - https://phabricator.wikimedia.org/T309116 (10dancy) [20:31:24] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) I did a fresh git clone of the repo and attempt a build on deneb (USENETWORK=yes DIST=bullseye pdebuild). It looks very promising, starting to set up all the go pack... [20:38:33] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) Might be like this, where they needed golang 1.16. We have 1.18 in our go.mod but it seems to use 1.15. https://stackoverflow.com/questions/68752103/package-io-fs... [21:06:42] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) Yea, indeed we needed golang >=1.16. Both on deneb (buster) and build2001 (bullseye) we only have 1.15 but as Moritz pointed out a newer version is in bullseye-back... [21:07:44] What happened to the hashtags feature in Gerrit UI? I used it, and I'm still seeing them, but the UI for adding/removing them seems to have disappeared? [21:19:07] Jdlrobson: I think it's just collapsed by default? Look for the "show all" link a the top of the change info block [21:20:25] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) uploaded and imported on apt1001 with: `[apt1001:/srv/wikimedia/incoming] $ sudo -i reprepro --ignore=wrongdistribution -C main include bullseye-wikimedia /home/dza... [21:21:23] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) a:05dduvall→03Dzahn [21:21:31] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) 05Open→03In progress [21:21:37] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Patch-For-Review, 10User-brennen: Authenticate trusted runners for registry access against GitLab using temporary JSON Web Token - https://phabricator.wikimedia.org/T308501 (10Dzahn) [21:47:14] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) my first merge request https://gitlab.wikimedia.org/repos/releng/jwt-authorizer/-/merge_requests/3 [21:55:59] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10dduvall) Thanks @dzahn! Can you verify that the package is installable on the docker registry hosts? [22:08:06] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) @dduvall It's not installable on production docker registry hosts because those are on buster. [22:10:03] 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) @dduvall But now it is.. after I imported it for buster-wikimedia as well, again using the "ignore wrong distro" option. simulated (-s) install: ` [registry1003:~]... [22:11:28] 10GitLab (Infrastructure), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10brennen) [22:12:37] 10GitLab (Infrastructure), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10dduvall) Excellent! Thanks so much. [22:14:18] 10GitLab (Infrastructure), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10serviceops: Debianize releng/jwt-authorizer - https://phabricator.wikimedia.org/T309646 (10Dzahn) 05In progress→03Resolved [22:14:23] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (GitLab-a-thon 🦊), 10Patch-For-Review, 10User-brennen: Authenticate trusted runners for registry access against GitLab using temporary JSON Web Token - https://phabricator.wikimedia.org/T308501 (10Dzahn) [23:03:17] 10Phabricator: Remove unneeded translation overrides - https://phabricator.wikimedia.org/T309746 (10Dylsss)