[02:13:22] 06serviceops, 10MediaWiki-Platform-Team (Radar): Please review MediaWiki Apache config changes adding new docroot for the auth domain - https://phabricator.wikimedia.org/T385228#10523827 (10RLazarus) We rolled this back because, on deploying to Kubernetes, we didn't see a diff associated with flipping `public_... [07:37:37] 06serviceops, 10MediaWiki-Platform-Team (Radar): Please review MediaWiki Apache config changes adding new docroot for the auth domain - https://phabricator.wikimedia.org/T385228#10524025 (10Joe) The solution is indeed to use `mergeOverwrite` instead: `{{ mergeOverwrite (dict "a" true) (dict "a" false) }}` yie... [08:21:57] 06serviceops, 06Infrastructure-Foundations: Image publishing via docker-pkg on build2001 repeatedly failing - https://phabricator.wikimedia.org/T385531#10524071 (10elukey) I think that the issue wasn't only concurrent docker layers being pushed to the registry (it is a concern though), but probably just one of... [12:05:53] 06serviceops, 13Patch-For-Review: Migrate production Shellbox variants to PHP 8.1 - https://phabricator.wikimedia.org/T377038#10525015 (10jijiki) [12:06:10] 06serviceops, 13Patch-For-Review: Migrate production Shellbox variants to PHP 8.1 - https://phabricator.wikimedia.org/T377038#10525020 (10jijiki) [12:07:16] 06serviceops, 06SRE, 10Wikidata, 10Wikidata Integration in Wikimedia projects, 10Wikimedia-Site-requests: Increase entityAccessLimit for WikibaseClient wikis - https://phabricator.wikimedia.org/T384455#10525034 (10Marostegui) I am tagging #serviceops here to see if this is something they can help with. [12:30:34] 06serviceops, 06Commons: Add metrics for Commons file uploads - https://phabricator.wikimedia.org/T385707 (10hnowlan) 03NEW [12:42:22] 06serviceops, 10MW-on-K8s, 13Patch-For-Review: Allow defining kubernetes cronjobs through puppet - https://phabricator.wikimedia.org/T385596#10525164 (10Clement_Goubert) 05In progress→03Resolved [12:49:18] 06serviceops, 10MW-on-K8s: Periodic job alerting - https://phabricator.wikimedia.org/T385709 (10Clement_Goubert) 03NEW [12:49:28] 06serviceops, 10MW-on-K8s: Periodic job alerting - https://phabricator.wikimedia.org/T385709#10525206 (10Clement_Goubert) p:05Triage→03Medium [15:27:14] 06serviceops, 10Page Content Service, 07Code-Health-Objective: testwiki: Add changeprop rule to send requests to PCS on resource change - https://phabricator.wikimedia.org/T385719 (10Jgiannelos) 03NEW [15:28:01] 06serviceops, 06Content-Transform-Team-WIP, 10Page Content Service: testwiki: Add changeprop rule to send requests to PCS on resource change - https://phabricator.wikimedia.org/T385719#10525801 (10Jgiannelos) [16:18:47] 06serviceops, 06Content-Transform-Team, 10Page Content Service, 10RESTBase Sunsetting, 13Patch-For-Review: Update mobileapps k8s deployment chart for Cassandra credentials - https://phabricator.wikimedia.org/T350507#10525997 (10Jgiannelos) 05Stalled→03Resolved This is already enabled in prod. Clo... [16:34:44] 06serviceops, 10MW-on-K8s: Periodic job alerting - https://phabricator.wikimedia.org/T385709#10526044 (10kamila) > @kamila do you think you could help with that? Sure, I'll prepare a patch that adds those labels. For the comment, it looks like I can also export an annotation as a Prometheus annotation, I can i... [16:38:02] 06serviceops, 10MW-on-K8s: Periodic job alerting - https://phabricator.wikimedia.org/T385709#10526046 (10Clement_Goubert) >>! In T385709#10526044, @kamila wrote: >> @kamila do you think you could help with that? > For the comment, it looks like I can also export an annotation as a Prometheus annotation, I can... [16:39:49] o/ [16:40:28] The Kartotherian pods running on Wikikube have passed basic tests (latency + tile correctnes compared to bare-metal-maps) [16:40:51] so my idea now would be to shift some traffic to Wikikube, more or less how we did it with Thumbor [16:40:56] I filed https://gerrit.wikimedia.org/r/c/operations/puppet/+/1117568 [16:41:08] lemme know if it makes sense or not [16:41:14] eventually we'll likely use Istio ingress [16:41:27] but for the migration it would be nice to just pool/depool in case something is off [16:42:12] lgtm! [16:42:21] thankssss