[00:00:34] (DatasourceError) firing: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:01:57] Hello! Fresh new question regarding kokkuri/blubber! I'm getting a mysterious error on the buildctl image build step: "error: failed to solve: exit code: 2". Has anyone run into this before? I'm having a hard time debugging with only the command output and the rather unhelpful error message :) [00:02:06] https://gitlab.wikimedia.org/repos/sre/knead-wikidough/-/jobs/163526 is the full output [00:04:22] 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.42.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T350080 (10thcipriani) The new train blocker gives us two options: 1. Hold back `labswiki` (pin to `wmf.3`) and continue on to group2 2. Ro... [00:05:34] (DatasourceError) resolved: Queue (Jenkins jobs + Zuul functions) alert - https://grafana.wikimedia.org/alerting/grafana/iS0FSjJ4z/view - https://wikitech.wikimedia.org/wiki/Monitoring/DatasourceError - https://alerts.wikimedia.org/?q=alertname%3DDatasourceError [00:14:15] brett: "failed to solve" sounds like buildkit problems to me. Like Whatever blubber passed to buildkit on the backend is confusing it. I wonder if this extraneous "- custom:" might be causing it: https://gitlab.wikimedia.org/repos/sre/knead-wikidough/-/blob/ci/.pipeline/blubber.yaml?ref_type=heads#L13 (otherwise you might have to wait for real experts to help :P) [00:16:16] 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.42.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T350080 (10TTO) On English Wiktionary, one of our gadgets suddenly broke. This brokenness was first reported at 18:52 UTC and I was able to... [00:22:32] oh shit! that's gotta be it [00:22:34] 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.42.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T350080 (10thcipriani) >>! In T350080#9318075, @TTO wrote: > On English Wiktionary, one of our gadgets suddenly broke. This brokenness was f... [00:23:52] thcipriani: My hero! [00:24:10] :D second pair of eyes never hurts! [04:39:32] 10Phabricator maintenance bot, 10API Platform, 10Content-Transform-Team, 10MediaWiki-Engineering: Stop adding Platform Engineering to new wiki creation tasks - https://phabricator.wikimedia.org/T346811 (10Kappakayala) @MSantos ACK! Let me check and get back on this. [05:20:52] 10Phabricator maintenance bot, 10API Platform, 10Content-Transform-Team, 10MediaWiki-Engineering: Stop adding Platform Engineering to new wiki creation tasks - https://phabricator.wikimedia.org/T346811 (10Kappakayala) @MSantos I checked with the team, and it seems like we never had been involved in creati... [07:38:54] 10Phabricator maintenance bot, 10API Platform, 10Content-Transform-Team, 10MediaWiki-Engineering: Stop adding Platform Engineering to new wiki creation tasks - https://phabricator.wikimedia.org/T346811 (10daniel) >>! In T346811#9318302, @Kappakayala wrote: > @MSantos I checked with the team, and it seems... [08:23:06] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Migrate mobileapps to k8s - https://phabricator.wikimedia.org/T350846 (10Joe) [08:23:24] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Migrate mobileapps to k8s - https://phabricator.wikimedia.org/T350846 (10Joe) [08:24:00] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Migrate mobileapps to k8s - https://phabricator.wikimedia.org/T350846 (10Joe) a:05Clement_Goubertβ†’03Joe [08:43:13] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Migrate mobileapps to k8s - https://phabricator.wikimedia.org/T350846 (10JMeybohm) Couldn't we just add another mobileapps deployment (like a canary) that connects to mw-api-int and scale that up slowly while scaling the exis... [08:55:08] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team: Remove Java 8 images from integration/config - https://phabricator.wikimedia.org/T350587 (10hashar) Thanks! Given there are a few use cases for keeping Java 8 for now, I will migrate the Docker images from Buster to Bullseye since we have por... [08:59:43] (03PS1) 10Hashar: Add Java 11 jobs to some search/* repositories [integration/config] - 10https://gerrit.wikimedia.org/r/973083 (https://phabricator.wikimedia.org/T350587) [09:01:13] (03PS1) 10Kevin Bazira: inference-services: add CI pipeline jobs for article-descriptions model-server [integration/config] - 10https://gerrit.wikimedia.org/r/972517 (https://phabricator.wikimedia.org/T343123) [09:28:14] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Patch-For-Review: Remove Java 8 images from integration/config - https://phabricator.wikimedia.org/T350587 (10hashar) [09:31:54] (03PS1) 10Hashar: zuul: comment Blazegraph is sticking to Java 8 [integration/config] - 10https://gerrit.wikimedia.org/r/973088 (https://phabricator.wikimedia.org/T350587) [09:33:11] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Patch-For-Review: Remove Java 8 images from integration/config - https://phabricator.wikimedia.org/T350587 (10hashar) [09:34:24] (03PS1) 10Hashar: zuul: document Refinery is sticking to Java 8 [integration/config] - 10https://gerrit.wikimedia.org/r/973089 (https://phabricator.wikimedia.org/T350587) [09:35:16] (03CR) 10Elukey: [C: 03+1] inference-services: add CI pipeline jobs for article-descriptions model-server [integration/config] - 10https://gerrit.wikimedia.org/r/972517 (https://phabricator.wikimedia.org/T343123) (owner: 10Kevin Bazira) [09:35:29] 10Continuous-Integration-Infrastructure, 10Release-Engineering-Team, 10Patch-For-Review: Remove Java 8 images from integration/config - https://phabricator.wikimedia.org/T350587 (10hashar) [09:36:30] kevinbazira: I am deploying the CI jobs for article-descriptions model-server :) [09:37:18] hashar: thanks :) [09:38:03] (03CR) 10Hashar: [C: 03+2] "INFO:jenkins_jobs.builder:Number of jobs generated: 4" [integration/config] - 10https://gerrit.wikimedia.org/r/972517 (https://phabricator.wikimedia.org/T343123) (owner: 10Kevin Bazira) [09:39:18] (03Merged) 10jenkins-bot: inference-services: add CI pipeline jobs for article-descriptions model-server [integration/config] - 10https://gerrit.wikimedia.org/r/972517 (https://phabricator.wikimedia.org/T343123) (owner: 10Kevin Bazira) [09:40:52] !log Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/972517/ "inference-services: add CI pipeline jobs for article-descriptions model-server" | T343123 [09:40:55] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [09:40:56] T343123: Migrate Machine-generated Article Descriptions from toolforge to liftwing. - https://phabricator.wikimedia.org/T343123 [09:41:20] kevinbazira: done and reloaded so you can comment `recheck` and that should trigger the CI jobs [09:44:31] hashar: I have run `recheck` and the CI jobs are running. thanks again :) [09:44:38] amazing :) [09:55:00] 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ), 10Patch-For-Review, 10Release, 10Train Deployments: 1.42.0-wmf.4 deployment blockers - https://phabricator.wikimedia.org/T350080 (10jnuche) SAL ended up here: https://phabricator.wikimedia.org/T350836#9318538 > Mentioned in SAL (#wikimedia-operations) [2023-1... [10:03:52] (03Abandoned) 10Hashar: Plugin to process Puppet Catalog Compiler results [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/972906 (owner: 10Hashar) [10:08:37] 10GitLab (CI & Job Runners), 10collaboration-services, 10Patch-For-Review: GitLab Trusted Runner configuration fails: 404 Project Not Found - https://phabricator.wikimedia.org/T350679 (10CodeReviewBot) jelto merged https://gitlab.wikimedia.org/repos/releng/gitlab-trusted-runner/-/merge_requests/49 remove de... [10:14:48] 10Phabricator, 10Release-Engineering-Team, 10collaboration-services, 10User-AKlapper: Establish a workflow that scales for requesting Phab 2FA resets - https://phabricator.wikimedia.org/T306708 (10Aklapper) Namely goes away anyway. :) It would mean finding a person who both the requestor and the resetter k... [10:36:44] 10Phabricator, 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ): Disable inactive "jenkins" bot account in Phabricator - https://phabricator.wikimedia.org/T350850 (10Aklapper) p:05Triageβ†’03Low [10:52:14] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯): Uninstall Harbormaster (Phabricator application) - https://phabricator.wikimedia.org/T348115 (10Aklapper) [10:52:17] 10Phabricator: Uninstall Differential (Phabricator application) - https://phabricator.wikimedia.org/T330797 (10Aklapper) [10:52:23] 10Phabricator: Uninstall Differential (Phabricator application) - https://phabricator.wikimedia.org/T330797 (10Aklapper) [10:52:27] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯): Uninstall Harbormaster (Phabricator application) - https://phabricator.wikimedia.org/T348115 (10Aklapper) [10:52:32] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯): Uninstall Harbormaster (Phabricator application) - https://phabricator.wikimedia.org/T348115 (10Aklapper) Harbormaster creates noise notifications in cases like `https://phabricator.wikimedia.org/D919#24643`. So better switch off Harbormaster **be... [10:53:05] (03PS9) 10Hashar: Plugin to process Puppet Catalog Compiler results [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/969981 [10:53:29] (03CR) 10CI reject: [V: 04-1] Plugin to process Puppet Catalog Compiler results [software/gerrit] (deploy/wmf/stable-3.5) - 10https://gerrit.wikimedia.org/r/969981 (owner: 10Hashar) [11:07:54] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, 10serviceops: Migrate mobileapps to k8s - https://phabricator.wikimedia.org/T350846 (10Joe) >>! In T350846#9318457, @JMeybohm wrote: > Couldn't we just add another mobileapps release (like a canary) that connects to mw-api-int and scale th... [11:41:02] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services: Migrate to using new GitLab CI runner authentication scheme - https://phabricator.wikimedia.org/T344951 (10Jelto) I migrated the two devtools test runners in WMCS to the new authentication scheme. The step... [11:41:14] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services: Migrate to using new GitLab CI runner authentication scheme - https://phabricator.wikimedia.org/T344951 (10Jelto) [12:01:37] 10Phabricator maintenance bot, 10API Platform, 10Content-Transform-Team, 10MediaWiki-Engineering: Stop adding Platform Engineering to new wiki creation tasks - https://phabricator.wikimedia.org/T346811 (10daniel) A while ago, I wrote a doc about why creating wikis is hard: https://docs.google.com/document/... [12:06:53] 10Phabricator maintenance bot, 10API Platform, 10Content-Transform-Team, 10MediaWiki-Engineering: Stop adding Platform Engineering to new wiki creation tasks - https://phabricator.wikimedia.org/T346811 (10Ladsgroup) Creating wikis is broken in many different ways but we improved that a bit. We made a major... [13:27:45] 10GitLab (Infrastructure), 10collaboration-services: Record metrics for Gitlab backup/restore times - https://phabricator.wikimedia.org/T347593 (10eoghan) We're starting to see metrics being recorded. |gitlab_backup_duration_seconds{cluster="prometheus", instance="gitlab2002:0", job="gitlab_backup", prometheu... [14:35:36] (03CR) 10DCausse: [C: 03+1] Add Java 11 jobs to some search/* repositories [integration/config] - 10https://gerrit.wikimedia.org/r/973083 (https://phabricator.wikimedia.org/T350587) (owner: 10Hashar) [14:37:51] 10Phabricator, 10Release-Engineering-Team, 10User-brennen: Deploy Phabricator/Phorge 2023-11-14 - https://phabricator.wikimedia.org/T350876 (10brennen) [14:47:49] 10Release-Engineering-Team (Radar), 10Tech-Docs-Team, 10Documentation: Deployment pipeline (GitLab/Kokkuri/Blubber) documentation improvements - https://phabricator.wikimedia.org/T342317 (10KBach) [14:48:10] 10Release-Engineering-Team (Radar), 10Tech-Docs-Team, 10Documentation: Deployment pipeline (GitLab/Kokkuri/Blubber) documentation improvements - https://phabricator.wikimedia.org/T342317 (10KBach) Plan shared with the team for review and discussion. [14:56:05] 10Phabricator, 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ), 10Privacy Engineering, 10Patch-For-Review, 10Privacy: Phabricator account email address requirement contradicts linked wiki Privacy Policy - https://phabricator.wikimedia.org/T214251 (10CodeReviewBot) brennen merged https://gitlab.wikimedia.org... [14:56:45] 10Phabricator, 10Patch-For-Review: Uninstall Owners (Phabricator application) - https://phabricator.wikimedia.org/T336907 (10CodeReviewBot) brennen merged https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/24 Remove unused "Owners" application from default settings [15:10:25] 10GitLab (CI & Job Runners), 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services: Migrate to using new GitLab CI runner authentication scheme - https://phabricator.wikimedia.org/T344951 (10Jelto) Unregistering and re-registering runners with the new authentication scheme still works and... [15:12:59] 10Phabricator, 10Release-Engineering-Team, 10Patch-For-Review, 10User-brennen: Deploy Phabricator/Phorge 2023-11-14 - https://phabricator.wikimedia.org/T350876 (10CodeReviewBot) aklapper opened https://gitlab.wikimedia.org/repos/phabricator/deployment/-/merge_requests/26 2023-11-14 release [15:23:32] 10Release-Engineering-Team (Seen), 10MW-on-K8s, 10SRE, 10Traffic, and 2 others: Migrate mobileapps to k8s - https://phabricator.wikimedia.org/T350846 (10Joe) As it's clear from the patches, I chose to take the sage advice of @JMeybohm and go down the path of least resistance :) [16:23:26] 10Gitlab-Application-Security-Pipeline, 10Security-Team, 10Patch-For-Review, 10SecTeam-Processed, and 2 others: gosec CI include default path that is set as initial option produces "No packages found" fatal - https://phabricator.wikimedia.org/T350828 (10CodeReviewBot) mmartorana merged https://gitlab.wikim... [16:29:28] 10Fresnel, 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ), 10patch-welcome: Add scenario options to Fresnel comparison output - https://phabricator.wikimedia.org/T217856 (10Krinkle) Scenario's are configured like this in `.fresnel.yml`: `lang=yaml runs: 7 scenarios: View history of a page: url: "{MW_SER... [16:44:54] 10Phabricator maintenance bot, 10API Platform, 10Content-Transform-Team, 10MediaWiki-Engineering: Stop adding Platform Engineering to new wiki creation tasks - https://phabricator.wikimedia.org/T346811 (10hnowlan) >>! In T346811#9318953, @Ladsgroup wrote: > Creating wikis is broken in many different ways b... [16:50:15] 10Phabricator (Upstream), 10Upstream: "Unhandled Exception: Call to a member function getAppliedTransactionPHIDs() on bool" when viewing old Herald Transcript - https://phabricator.wikimedia.org/T294860 (10Aklapper) [Move tasks resolved in upstream from #phabricator-next (as not every deployment will also pull... [16:50:25] 10Phabricator (Upstream), 10CSS, 10Upstream: Upload popup overflows box with a long filename - https://phabricator.wikimedia.org/T316305 (10Aklapper) [Move tasks resolved in upstream from #phabricator-next (as not every deployment will also pull an updated upstream) to the "Solved upstream" column on the #ph... [16:50:28] 10Phabricator (Upstream), 10CSS, 10Upstream: Incorrect height of class "phui-oi-frame" - https://phabricator.wikimedia.org/T307492 (10Aklapper) [Move tasks resolved in upstream from #phabricator-next (as not every deployment will also pull an updated upstream) to the "Solved upstream" column on the #phabrica... [16:50:39] 10Phabricator (Upstream), 10Upstream: Unhandled Exception ("RuntimeException"): Undefined offset: 5 when trying to access T16235 - https://phabricator.wikimedia.org/T284397 (10Aklapper) [Move tasks resolved in upstream from #phabricator-next (as not every deployment will also pull an updated upstream) to the "... [16:50:43] 10Phabricator (Upstream), 10Upstream: Add link to atom feed in each main blog page - https://phabricator.wikimedia.org/T205181 (10Aklapper) [Move tasks resolved in upstream from #phabricator-next (as not every deployment will also pull an updated upstream) to the "Solved upstream" column on the #phabricator-up... [16:50:45] 10Phabricator (Upstream), 10Upstream: Give transparent embedded image files in Phabricator a checkered background - https://phabricator.wikimedia.org/T78644 (10Aklapper) [Move tasks resolved in upstream from #phabricator-next (as not every deployment will also pull an updated upstream) to the "Solved upstream"... [16:50:48] 10Phabricator (phabricator-next), 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ), 10Privacy Engineering, 10Privacy: Phabricator account email address requirement contradicts linked wiki Privacy Policy - https://phabricator.wikimedia.org/T214251 (10Aklapper) [16:50:50] 10Phabricator (phabricator-next), 10Release-Engineering-Team (Quid Pro Crow πŸ¦ƒ): Uninstall Owners (Phabricator application) - https://phabricator.wikimedia.org/T336907 (10Aklapper) [16:53:36] 10Gitlab-Application-Security-Pipeline, 10Security-Team, 10SecTeam-Processed, 10Security, 10user-sbassett: gosec CI include default path that is set as initial option produces "No packages found" fatal - https://phabricator.wikimedia.org/T350828 (10sbassett) 05In progressβ†’03Resolved [16:53:38] 10Gitlab-Application-Security-Pipeline, 10Security-Team, 10SecTeam-Processed, 10Security, 10user-sbassett: [EPIC] Application Security Pipeline Components for Gitlab - Phase 2 Work - https://phabricator.wikimedia.org/T342177 (10sbassett) [16:56:22] 10Gitlab-Application-Security-Pipeline, 10Security-Team, 10SecTeam-Processed, 10Security, 10user-sbassett: gosec CI include default path that is set as initial option produces "No packages found" fatal - https://phabricator.wikimedia.org/T350828 (10sbassett) Excellent, this seems to have fixed at least t... [17:10:41] BTW.... it looks like the web IDE from gitlab attempts to reach the gitlab CDN... https://0lddf9sbjmlo443dp3up7giq91v5amfug4brnpcsbm8jidc3j3uf.cdn.web-ide.gitlab-static.net/web-ide-vscode/stable/a791b7694c09f5980bbe2223124613c7afa18448/out/vs/workbench/contrib/webview/browser/pre/ --> is that expected? [17:30:05] vgutierrez: Uhm, privacy. Could you please file a task? Thanks! [18:43:52] 10GitLab (Project Migration), 10SRE, 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [18:46:13] (03PS1) 10BCornwall: Remove knead-wikidough project [integration/config] - 10https://gerrit.wikimedia.org/r/973220 (https://phabricator.wikimedia.org/T347623) [19:28:34] 10Phabricator, 10Release-Engineering-Team, 10collaboration-services, 10User-AKlapper: Establish a workflow that scales for requesting Phab 2FA resets - https://phabricator.wikimedia.org/T306708 (10sbassett) >>! In T306708#9318592, @Aklapper wrote: > Namely goes away anyway. :) I would hope that Dayforce h... [19:34:03] 10Phabricator: Uninstall Differential (Phabricator application) - https://phabricator.wikimedia.org/T330797 (10Aklapper) [19:34:11] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯): Uninstall Harbormaster (Phabricator application) - https://phabricator.wikimedia.org/T348115 (10Aklapper) 05Stalledβ†’03Open a:03Aklapper [19:49:09] 10Phabricator (phabricator-next), 10Release-Engineering-Team, 10Patch-For-Review, 10User-brennen: Deploy Phabricator/Phorge 2023-11-14 - https://phabricator.wikimedia.org/T350876 (10Aklapper) [20:11:32] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [20:16:43] (03PS1) 10Catrope: zuul: Add Ty Hopp to the trusted users list [integration/config] - 10https://gerrit.wikimedia.org/r/973231 [20:18:18] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [21:30:23] (03CR) 10Hashar: [C: 03+2] zuul: Add Ty Hopp to the trusted users list [integration/config] - 10https://gerrit.wikimedia.org/r/973231 (owner: 10Catrope) [21:32:13] (03Merged) 10jenkins-bot: zuul: Add Ty Hopp to the trusted users list [integration/config] - 10https://gerrit.wikimedia.org/r/973231 (owner: 10Catrope) [21:32:52] (03CR) 10Hashar: [C: 03+2] "Deployed" [integration/config] - 10https://gerrit.wikimedia.org/r/973231 (owner: 10Catrope) [21:41:56] 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯): Uninstall Harbormaster (Phabricator application) - https://phabricator.wikimedia.org/T348115 (10Dzahn) So.. what keeps us from hitting the "uninstall" button in the UI? [21:48:28] 10GitLab (Project Migration), 10Phabricator, 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10collaboration-services, and 3 others: Migrate active repositories in Phabricator Differential to GitLab - https://phabricator.wikimedia.org/T191182 (10Dzahn) @Aklapper Let's just archive R2344 (I can't see it th... [21:53:15] 10Gerrit, 10VPS-project-Codesearch, 10VPS-project-Extdist, 10collaboration-services: Move clients off of gerrit-replica.wikimedia.org back to gerrit.wikimedia.org - https://phabricator.wikimedia.org/T336710 (10Dzahn) 05Openβ†’03Stalled stalled since we have no consensus which direction to go if both ger... [21:57:57] 10GitLab (Infrastructure), 10collaboration-services: Automate setup of GitLab test instance - https://phabricator.wikimedia.org/T302976 (10Dzahn) out of the manual steps listed the: Edit /etc/fstab Edit /etc/interfaces Run initial cerbot command can be added to puppet. but other steps involve using some API... [22:23:09] 10GitLab (Pipeline Services Migration🐀), 10collaboration-services: move design.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350791 (10Dzahn) Yea, style-guide is deployed by scap and other parts are not. This is because there were large files in there afair. We gotta have a chat with @Volke... [22:35:15] 10GitLab (Pipeline Services Migration🐀), 10collaboration-services: move design.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350791 (10Volker_E) @Jelto @Dzahn That actually comes at a perfect timing. We want to deploy Design Style Guide one more time (with a deprecation notice) and can then... [22:35:42] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [23:14:21] (03PS1) 10BCornwall: Remove purged project [integration/config] - 10https://gerrit.wikimedia.org/r/973269 (https://phabricator.wikimedia.org/T347623) [23:28:22] 10GitLab (Project Migration), 10Traffic, 10Patch-For-Review: Migrate Traffic repositories from Gerrit to Gitlab - https://phabricator.wikimedia.org/T347623 (10BCornwall) [23:38:55] 10Phabricator maintenance bot, 10API Platform, 10Content-Transform-Team, 10MediaWiki-Engineering: Stop adding Platform Engineering to new wiki creation tasks - https://phabricator.wikimedia.org/T346811 (10Ladsgroup) >>! In T346811#9319997, @hnowlan wrote: > Given recent development work on restbase, could...