[01:20:05] 06Project-Admins: Create project tag for title normalizing - https://phabricator.wikimedia.org/T379989 (10Pppery) 03NEW [01:20:31] 06Project-Admins: Create project tag for title normalizing - https://phabricator.wikimedia.org/T379989#10325079 (10Pppery) [08:07:18] beta appears to be down: "... deployment-cache-text08 deployment-cache-text08, Varnish XID 180761278 [08:07:18] Error: 503, Backend fetch failed at Fri, 15 Nov 2024 08:06:46 GMT" [08:55:51] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-HTTP-Cache, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Platform-Team: Caching on beta.metawiki playing up - https://phabricator.wikimedia.org/T379841#10325608 (10daniel) [09:36:18] (03CR) 10Kosta Harlan: Add daily job for quibble linear phpunit testing (031 comment) [integration/config] - 10https://gerrit.wikimedia.org/r/1087458 (https://phabricator.wikimedia.org/T372618) (owner: 10Arthur taylor) [09:37:21] (03CR) 10Kosta Harlan: "If we rename the job (https://gerrit.wikimedia.org/r/c/integration/config/+/1087458/comment/3134e889_9963dff9/), I don't think we need thi" [integration/config] - 10https://gerrit.wikimedia.org/r/1087442 (https://phabricator.wikimedia.org/T372618) (owner: 10Arthur taylor) [09:38:35] 10GitLab (Pipeline Services Migration🐀), 06collaboration-services: move os-reports.wikimedia.org to kubernetes - https://phabricator.wikimedia.org/T350794#10325780 (10MoritzMuehlenhoff) >>! In T350794#10323046, @Arnoldokoth wrote: > The blocker right now is figuring out firewall access to Puppet DB. @MoritzMue... [12:21:33] (03open) 10taavi: runner: Ignore progress bar from phpcs [repos/ci-tools/libup] (master-I7e0d18f9460a512a102c35d08d4c8c5188c6d8a7) - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/64 [12:21:33] (03open) 10taavi: Ignore git directory owner mismatch [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/63 [12:21:34] (03update) 10taavi: Ignore git directory owner mismatch [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/63 [12:21:34] (03update) 10taavi: runner: Ignore progress bar from phpcs [repos/ci-tools/libup] (master-I7e0d18f9460a512a102c35d08d4c8c5188c6d8a7) - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/64 [12:21:40] (03update) 10taavi: Ignore git directory owner mismatch [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/63 [12:21:47] (03update) 10taavi: runner: Ignore progress bar from phpcs [repos/ci-tools/libup] (master-I7e0d18f9460a512a102c35d08d4c8c5188c6d8a7) - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/64 [12:35:15] (03update) 10taavi: runner: Ignore progress bar from phpcs [repos/ci-tools/libup] (master-I7e0d18f9460a512a102c35d08d4c8c5188c6d8a7) - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/64 [12:35:38] (03update) 10taavi: Ignore git directory owner mismatch [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/63 [12:35:39] (03merge) 10taavi: Ignore git directory owner mismatch [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/63 [12:35:41] (03update) 10taavi: runner: Ignore progress bar from phpcs [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/64 [12:42:12] (03update) 10taavi: runner: Ignore progress bar from phpcs [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/64 [12:42:12] (03merge) 10taavi: runner: Ignore progress bar from phpcs [repos/ci-tools/libup] - 10https://gitlab.wikimedia.org/repos/ci-tools/libup/-/merge_requests/64 [12:54:07] (03PS1) 10Dreamy Jazz: Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalBlocking dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1091655 (https://phabricator.wikimedia.org/T375869) [13:43:32] Hello there! Beta seems to be down at the moment. Is this known / being worked on, or should I file a task? [13:44:00] https://meta.wikimedia.beta.wmflabs.org/wiki/Main_Page [13:44:07] 1) file a task [13:44:10] it never hurts :b [13:46:27] 10Beta-Cluster-Infrastructure: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056 (10Daimona) 03NEW [13:46:33] There you go [13:54:23] I am wondering how many editions we had so far [14:03:33] Yeah I imagine it's one of the most common task titles :P [14:16:23] (03PS1) 10Jelto: helm-linter: Bump version to update kubeconform-json-schema (k8s 1.31.2) [integration/config] - 10https://gerrit.wikimedia.org/r/1091734 (https://phabricator.wikimedia.org/T379919) [14:16:38] Daimona: looks like that is Apache trafficserver not being able to read from the backend [14:16:45] which in turn can be MediaWiki servers having issues :b [14:16:56] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10326896 (10hashar) //The issue seems related to Apache Traffic server on `deployment-cache-text08.deployment-prep.eqiad1.wikimedia.cloud` and I guess #traffic team might be able to as... [14:18:58] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10326903 (10ssingh) Thanks for the task. We are aware of this issue and trying some fixes, including having reported this upstream https://github.com/apache/trafficserver/issues/11869. [14:19:16] (03CR) 10JMeybohm: [C:03+1] helm-linter: Bump version to update kubeconform-json-schema (k8s 1.31.2) [integration/config] - 10https://gerrit.wikimedia.org/r/1091734 (https://phabricator.wikimedia.org/T379919) (owner: 10Jelto) [14:32:02] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10326994 (10hashar) Looking at `/var/log/apache2/other_vhosts_access.log`, on `deployment-mediawiki13` the last entry is at 6:21, but on `deployment-mediawiki14` there are accesses bei... [14:34:08] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10326997 (10ssingh) >>! In T380056#10326994, @hashar wrote: > Looking at `/var/log/apache2/other_vhosts_access.log`, on `deployment-mediawiki13` the last entry is at 6:21, but on `depl... [14:34:18] (03PS1) 10Jelto: jjb: bump helm-linter image to newest version (0.6.1) [integration/config] - 10https://gerrit.wikimedia.org/r/1091737 (https://phabricator.wikimedia.org/T379919) [14:35:19] (03CR) 10JMeybohm: [C:03+1] jjb: bump helm-linter image to newest version (0.6.1) [integration/config] - 10https://gerrit.wikimedia.org/r/1091737 (https://phabricator.wikimedia.org/T379919) (owner: 10Jelto) [14:41:06] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10327016 (10hashar) The #beta-cluster-infrastructure uses unattended upgrade and packages uploaded to apt.wikimedia.org are thus installed automatically at the next 6:20am. That was d... [14:42:02] Daimona: so that is some upstream issue in Apache Trafficserver and ssingh knows/works on it. They found out about it this morning [14:42:14] well your get the email notifications, I am not sure why I repeat there [14:42:15] :b [14:42:41] Yup, read about it. And today I learned about the "6AM issue" category :P [14:42:44] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10327019 (10ssingh) >>! In T380056#10327016, @hashar wrote: > The #beta-cluster-infrastructure uses unattended upgrade and packages uploaded to apt.wikimedia.org are thus installed aut... [14:48:28] it is convenient cause European shows up at work immediately after [14:48:38] s/European/EMEA people/ [14:48:51] well or soonish at least [14:49:20] that is either 7:20 in winter or 8:20 in summer (again assuming European CET/CEST timezones) [14:50:07] (03PS1) 10Amire80: Add User:Neriah to Gerrit Zuul allow list [integration/config] - 10https://gerrit.wikimedia.org/r/1091739 [14:59:08] hashar: could i get some help adding a secret to jenkins? Most details in https://phabricator.wikimedia.org/T379203 [14:59:28] yeah that should be doable? :b [15:03:45] hmm [15:03:52] so magically I do have access to that wmfpackage repo [15:03:58] hashar: i added you :) [15:04:20] * hashar feels like he got handed a cookie to lick [15:04:34] what I don't get is why the CI Jenkins is involved? [15:04:35] lol, it's release related anyways :) [15:04:41] isn't it Gitlab CI that is doing the release? [15:04:53] hashar: we are getting rid of archiva, things that live in jenkins need a place to publish to [15:05:01] oh [15:05:14] so the repos are in Gerrit [15:05:25] still use the same Jenkins job they used before that did the `mvn release` or whatever [15:05:27] right, gitlab is acting as a maven repository here [15:05:40] but now the parent pom would get them to push to another storage than archiva [15:05:43] correct? [15:05:50] yup, and that parent pom needs the secret [15:05:56] AHHHHHHHHHHHH [15:06:16] cause anytime I hear "GitLab" I feel like it is the magic unicorn / 5 feet lambs, and its self sufficient [15:06:23] so I wasn't sure why Jenkins was involved :b [15:06:34] so we need the token to be added to the Jenkins credential store [15:06:51] for publishing within gitlab, it is. honestly if we could have gerrit for code review + the ci/package repo/maybe more from gitlab that would be enough for me [15:06:53] add a step in the jenkins job to read from the store and expose that as an environment variable [15:06:56] update the jobs [15:06:58] magic happens [15:07:22] yup, in theory we add the token and it "just works" with an updated version of the parent pom [15:07:40] wanna pair it over Google Meet ?: ) [15:07:45] sure [15:08:12] let me relocate from my kitchen to my cave^Woffice [15:15:31] (03CR) 10Hashar: [C:03+2] Zuul: add BetaFeatures as CodeMirror phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1091390 (https://phabricator.wikimedia.org/T376735) (owner: 10MusikAnimal) [15:16:12] (03PS2) 10Hashar: Add User:Neriah to Gerrit Zuul allow list [integration/config] - 10https://gerrit.wikimedia.org/r/1091739 (owner: 10Amire80) [15:16:28] (03CR) 10Hashar: [C:03+2] Add User:Neriah to Gerrit Zuul allow list [integration/config] - 10https://gerrit.wikimedia.org/r/1091739 (owner: 10Amire80) [15:16:50] (03Merged) 10jenkins-bot: Zuul: add BetaFeatures as CodeMirror phan dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1091390 (https://phabricator.wikimedia.org/T376735) (owner: 10MusikAnimal) [15:16:55] (03CR) 10Hashar: [C:03+2] helm-linter: Bump version to update kubeconform-json-schema (k8s 1.31.2) [integration/config] - 10https://gerrit.wikimedia.org/r/1091734 (https://phabricator.wikimedia.org/T379919) (owner: 10Jelto) [15:17:40] ebernhardson: ready when you are, not sure whether you have seen my private message :b [15:17:42] (03Merged) 10jenkins-bot: Add User:Neriah to Gerrit Zuul allow list [integration/config] - 10https://gerrit.wikimedia.org/r/1091739 (owner: 10Amire80) [15:17:50] hashar: oh! i never notice those :P [15:17:54] aahah [15:18:12] (03Merged) 10jenkins-bot: helm-linter: Bump version to update kubeconform-json-schema (k8s 1.31.2) [integration/config] - 10https://gerrit.wikimedia.org/r/1091734 (https://phabricator.wikimedia.org/T379919) (owner: 10Jelto) [15:24:54] (03PS1) 10Ebernhardson: Add CI_RELEASE_TOKEN to {name}-maven-release [integration/config] - 10https://gerrit.wikimedia.org/r/1091746 [15:28:23] (03CR) 10Hashar: [C:03+2] "Deployed!!!!" [integration/config] - 10https://gerrit.wikimedia.org/r/1091746 (owner: 10Ebernhardson) [15:29:45] (03Merged) 10jenkins-bot: Add CI_RELEASE_TOKEN to {name}-maven-release [integration/config] - 10https://gerrit.wikimedia.org/r/1091746 (owner: 10Ebernhardson) [15:32:16] (03update) 10lwatson: web: Convert components to Composition API [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/570 (https://phabricator.wikimedia.org/T379832) [15:33:39] (03CR) 10Tchanders: [C:03+1] Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalBlocking dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1091655 (https://phabricator.wikimedia.org/T375869) (owner: 10Dreamy Jazz) [15:38:48] (03update) 10lwatson: web: Convert components to Composition API [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/570 (https://phabricator.wikimedia.org/T379832) [15:40:17] ebernhardson: so that should work β„’ I'll let you comment on the task! [15:41:45] (03CR) 10Hashar: [C:03+2] jjb: bump helm-linter image to newest version (0.6.1) [integration/config] - 10https://gerrit.wikimedia.org/r/1091737 (https://phabricator.wikimedia.org/T379919) (owner: 10Jelto) [15:42:52] (03CR) 10Hashar: [C:03+2] Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalBlocking dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1091655 (https://phabricator.wikimedia.org/T375869) (owner: 10Dreamy Jazz) [15:43:25] (03Merged) 10jenkins-bot: jjb: bump helm-linter image to newest version (0.6.1) [integration/config] - 10https://gerrit.wikimedia.org/r/1091737 (https://phabricator.wikimedia.org/T379919) (owner: 10Jelto) [15:44:09] (03Merged) 10jenkins-bot: Zuul: [mediawiki/extensions/WikimediaEvents] Add GlobalBlocking dependency [integration/config] - 10https://gerrit.wikimedia.org/r/1091655 (https://phabricator.wikimedia.org/T375869) (owner: 10Dreamy Jazz) [15:46:20] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Buster Deprecation): Migrate deployment-prep away from Debian Buster to Bullseye/Bookworm - https://phabricator.wikimedia.org/T327742#10327165 (10Andrew) 05Openβ†’03Resolved a:03Andrew I believe this to be done; there are no more Buster VMs in deployme... [15:46:42] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 06Content-Transform-Team-WIP, 10Cloud-VPS (Debian Buster Deprecation): Rebuild or delete deployment-docker-proton01 - https://phabricator.wikimedia.org/T369916#10327185 (10Andrew) 05Openβ†’03Resolved [15:48:57] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Buster Deprecation): Replace deployment-maps-master01 with a Bullseye or Bookworm instance - https://phabricator.wikimedia.org/T361381#10327198 (10Andrew) 05Openβ†’03Resolved [15:49:03] 10Beta-Cluster-Infrastructure, 10Cloud-VPS (Debian Buster Deprecation): Replace or remove deployment-echostore02.deployment-prep.eqiad1.wikimedia.cloud - https://phabricator.wikimedia.org/T361383#10327200 (10Andrew) 05Openβ†’03Resolved [15:49:13] 10Beta-Cluster-Infrastructure, 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation): Remove or replace poolcounter06.deployment-prep.eqiad1.wikimedia.cloud (Buster deprecation) - https://phabricator.wikimedia.org/T370458#10327203 (10Andrew) 05Openβ†’03Resolved [15:51:05] Caused by: java.lang.reflect.InaccessibleObjectException: Unable to make field private final java.util.Comparator java.util.TreeMap.comparator accessible: module java.base does not "opens java.util" to unnamed module @4f72cce0 [15:51:11] La la la Laaaa laal la [15:51:23] sometime I feel like java is picky :b [15:51:35] if it knows about the issue, why can't it magically fix it? :b [16:02:26] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10327305 (10ssingh) This should now be fixed. Thanks for filing the task and sorry about the change; I didn't expect beta to be updated (and I guess we just got lucky in the past)... [16:02:59] 10Beta-Cluster-Infrastructure, 06Traffic: Beta cluster is down, 2024-11-15 edition - https://phabricator.wikimedia.org/T380056#10327307 (10ssingh) 05Openβ†’03Resolved a:03ssingh [16:29:58] (03merge) 10dancy: web: Convert components to Composition API [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/570 (https://phabricator.wikimedia.org/T379832) (owner: 10lwatson) [16:36:38] (03update) 10dancy: tests/scap/test_log.py: Add tests for log.Timer() with name=None [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/571 [16:36:42] (03update) 10dancy: tests/scap/test_log.py: Add tests for log.Timer() with name=None [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/571 [17:55:33] (03approved) 10thcipriani: tests/scap/test_log.py: Add tests for log.Timer() with name=None [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/571 (owner: 10dancy) [17:55:35] (03merge) 10thcipriani: tests/scap/test_log.py: Add tests for log.Timer() with name=None [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/571 (owner: 10dancy) [17:55:56] (03update) 10thcipriani: Reduce the cardinality of scap timers/statsd metrics (phase 2) [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/572 (owner: 10dancy) [18:14:16] (03PS1) 10Subramanya Sastry: Tweaks for ruwikivoyage & jawikivoyage to suppress noise [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1091788 [18:14:16] (03PS1) 10Subramanya Sastry: Change some default paths & settings [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1091789 [18:14:16] (03PS1) 10Subramanya Sastry: Add url config for incubator wiki - lets us run tests for that wiki [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1091790 [18:17:52] (03PS2) 10Subramanya Sastry: Tweaks for ruwikivoyage & jawikivoyage to suppress noise [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1091788 [18:17:53] (03PS2) 10Subramanya Sastry: Change some default paths & settings [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1091789 [18:17:53] (03PS2) 10Subramanya Sastry: Add url config for incubator wiki - lets us run tests for that wiki [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1091790 [18:25:20] (03merge) 10thcipriani: Reduce the cardinality of scap timers/statsd metrics (phase 2) [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/572 (owner: 10dancy) [18:33:10] (03open) 10dancy: Release 4.124.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/573 [18:35:08] (03merge) 10dancy: Release 4.124.0 [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/573 [18:50:57] (03PS1) 10Subramanya Sastry: Add ruwikivoyage CSS workarounds to suppress some noise [integration/visualdiff] - 10https://gerrit.wikimedia.org/r/1091800 [19:37:59] 06Project-Admins: Convert Codex Special:Block to milestone of Multiblocks - https://phabricator.wikimedia.org/T378066#10328116 (10Pppery) 05Openβ†’03Resolved [19:53:49] (03update) 10dancy: Reduce the cardinality of scap timers/statsd metrics (phase 2) [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/572 (https://phabricator.wikimedia.org/T377883) [20:04:22] 10Release-Engineering-Team (Priority Backlog πŸ“₯), 10Scap, 06SRE Observability: Scap prometheus migration: Reduce the cardinality of scap timers/statsd metrics - https://phabricator.wikimedia.org/T377883#10328206 (10dancy) >>! In T377883#10313775, @colewhite wrote: >>>! In T377883#10313476, @dancy wrote: >> If... [20:12:27] Project beta-scap-sync-world build #180794: 04FAILURE in 1 min 46 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/180794/ [20:16:55] Project beta-scap-sync-world build #180795: 04STILL FAILING in 1 min 10 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/180795/ [20:17:15] 10Beta-Cluster-Infrastructure: Increase RAM on deployment-deploy04.deployment-prep - https://phabricator.wikimedia.org/T380093 (10dancy) 03NEW [20:19:58] (03PS1) 10Ahmon Dancy: jjb/beta.yaml: deployment-deploy03 -> deployment-deploy04 [integration/config] - 10https://gerrit.wikimedia.org/r/1091814 [20:20:53] beta-scap-sync-world problems are caused by me. I'm working on it. [20:33:40] !log Resizing deployment-deploy04.deployment-prep to g4.cores4.ram8.disk20 (T380093) [20:33:42] Logged the message at https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL [20:33:42] T380093: Increase RAM on deployment-deploy04.deployment-prep - https://phabricator.wikimedia.org/T380093 [20:39:18] (03CR) 10Ahmon Dancy: [C:03+2] jjb/beta.yaml: deployment-deploy03 -> deployment-deploy04 [integration/config] - 10https://gerrit.wikimedia.org/r/1091814 (owner: 10Ahmon Dancy) [20:40:39] (03Merged) 10jenkins-bot: jjb/beta.yaml: deployment-deploy03 -> deployment-deploy04 [integration/config] - 10https://gerrit.wikimedia.org/r/1091814 (owner: 10Ahmon Dancy) [20:41:38] Project beta-scap-sync-world build #180796: 04STILL FAILING in 1 min 19 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/180796/ [20:45:45] Project beta-scap-sync-world build #180797: 04STILL FAILING in 55 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/180797/ [20:56:10] Yippee, build fixed! [20:56:11] Project beta-scap-sync-world build #180798: 09FIXED in 1 min 18 sec: https://integration.wikimedia.org/ci/job/beta-scap-sync-world/180798/ [20:56:55] 10Beta-Cluster-Infrastructure: Increase RAM on deployment-deploy04.deployment-prep - https://phabricator.wikimedia.org/T380093#10328347 (10dancy) 05Openβ†’03Resolved `g4.cores4.ram8.disk20` is working out well. [22:27:35] (03open) 10dancy: mwscript: Set WMF_DATACENTER to cfg["wmf_realm"] [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/574 [22:27:38] (03update) 10dancy: mwscript: Set WMF_DATACENTER to cfg["wmf_realm"] [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/574 [22:28:10] (03update) 10dancy: mwscript: Set WMF_DATACENTER to cfg["wmf_realm"] [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/574 [22:30:07] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-HTTP-Cache, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Platform-Team: Caching on beta.metawiki playing up - https://phabricator.wikimedia.org/T379841#10328532 (10matmarex) FWIW, I could see the issue when this task was filed, about 7 hours after the r... [22:30:58] 10Beta-Cluster-Infrastructure, 10MediaWiki-Core-HTTP-Cache, 10MediaWiki-Core-Revision-backend, 06MediaWiki-Platform-Team: Caching on beta.metawiki playing up - https://phabricator.wikimedia.org/T379841#10328538 (10matmarex) 05Openβ†’03Declined Declining per Krinkle. I guess we can hope that this was... [22:34:25] (03update) 10dancy: mwscript: Set WMF_DATACENTER to cfg["wmf_realm"] [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/574 [22:44:14] (03open) 10lwatson: Draft: web: improve main page UI [repos/releng/scap] - 10https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/575 (https://phabricator.wikimedia.org/T379412)