[09:03:51] 06serviceops, 10MW-on-K8s, 06Trust and Safety Product Team, 10MediaModeration (MediaModeration 2.1), 13Patch-For-Review: Migrate MediaModeration jobs to mw-cron - https://phabricator.wikimedia.org/T385799#10771786 (10hnowlan) [09:18:31] 06serviceops, 10envoy, 10Observability-Metrics, 13Patch-For-Review, 10SRE Observability (FY2024/2025-Q4): Revisit default envoy histogram buckets - https://phabricator.wikimedia.org/T391333#10771828 (10fgiunchedi) >>! In T391333#10751268, @fgiunchedi wrote: >>>! In T391333#10744276, @akosiaris wrote: >>... [09:25:21] 06serviceops, 06Language and Product Localization, 13Patch-For-Review: Migrate language_and_product_localization jobs to mw-cron - https://phabricator.wikimedia.org/T388539#10771848 (10hnowlan) [09:51:20] 06serviceops, 10Image-Suggestions, 10Structured Data Engineering, 06Structured-Data-Backlog: Migrate data-engineering jobs to mw-cron - https://phabricator.wikimedia.org/T388537#10771925 (10hnowlan) Just checking back in - would it be possible to get these jobs evaluated using the matrix in the ticket body... [10:01:36] 06serviceops, 13Patch-For-Review: docker-registry.wikimedia.org keeps serving bad blobs - https://phabricator.wikimedia.org/T390251#10771962 (10elukey) I quickly checked the patches and the refactoring work is really nice, and I like the two new options. Really good job :) I am a bit on the fence about how to... [11:47:24] 06serviceops, 06Growth-Team, 10GrowthExperiments, 10MW-on-K8s, 13Patch-For-Review: Migrate GrowthExperiments maintenance jobs to mw-cron - https://phabricator.wikimedia.org/T385782#10772198 (10hnowlan) [11:58:30] 06serviceops, 06cloud-services-team, 10Horizon, 06SRE, 10Striker: Move cloudweb to Ganeti VMs and repurpose the servers as wikikube nodes - https://phabricator.wikimedia.org/T392478#10772235 (10taavi) /cc @Andrew Main thing to note here is that Horizon needs to be able to talk to cloud-realm services.... [12:43:47] 06serviceops, 06MediaWiki-Platform-Team: Migrate "startupregistrystats" maintenance script to k8s-mw-cron (mediawiki-platform-team) - https://phabricator.wikimedia.org/T388540#10772387 (10hnowlan) The main blameStartupRegistry.php is currently doing its first run on k8s - logs make it look okay so far (it can... [13:13:11] 06serviceops, 06MediaWiki-Platform-Team: Migrate "startupregistrystats" maintenance script to k8s-mw-cron (mediawiki-platform-team) - https://phabricator.wikimedia.org/T388540#10772532 (10hnowlan) [13:13:38] 06serviceops, 06MediaWiki-Platform-Team: Migrate "startupregistrystats" maintenance script to k8s-mw-cron (mediawiki-platform-team) - https://phabricator.wikimedia.org/T388540#10772533 (10hnowlan) 05In progress→03Resolved a:03hnowlan Last run appears to have been successful - closing this ticket for... [13:18:35] hi serviceops, I just merged this: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1133995 It really shouldn't cause any issues but if you see anything, please let me know [13:20:42] ack, thanks for letting us know [13:45:54] 06serviceops, 06Language and Product Localization, 13Patch-For-Review: Migrate language_and_product_localization jobs to mw-cron - https://phabricator.wikimedia.org/T388539#10772662 (10hnowlan) [13:59:16] 06serviceops, 06Community-Tech, 13Patch-For-Review: Migrate community-tech jobs to mw-cron - https://phabricator.wikimedia.org/T388536#10772749 (10hnowlan) [14:03:39] 06serviceops, 10CampaignEvents, 06Campaigns-Product-Team, 10MW-on-K8s, 13Patch-For-Review: Migrate CampaignEvents jobs to mw-cron - https://phabricator.wikimedia.org/T385867#10772786 (10hnowlan) [14:32:54] 06serviceops, 06Infrastructure-Foundations, 06Traffic: Ownership of the sre.deploy.hiddenparma cookbook - https://phabricator.wikimedia.org/T383809#10772847 (10CDanis) p:05Triage→03Medium [16:29:10] 06serviceops, 10MediaWiki-Core-AuthManager, 10MediaWiki-extensions-CentralAuth, 06MediaWiki-Platform-Team, and 4 others: Gradually isolate mediawiki authentication code and infrastructure - https://phabricator.wikimedia.org/T391784#10773454 (10sbassett) [16:39:17] 06serviceops, 06Data-Engineering, 06Data-Engineering-Radar, 10Dumps-Generation, 06MediaWiki-Platform-Team: Migrate WMF production from PHP 7.4 to PHP 8.1 - https://phabricator.wikimedia.org/T319432#10773517 (10Krinkle) [19:31:30] 06serviceops, 06Content-Transform-Team, 06Traffic: Purging edge caches doesn't work for articles with ":" in their title - https://phabricator.wikimedia.org/T392849 (10Jgiannelos) 03NEW [19:32:24] 06serviceops, 06Content-Transform-Team, 06Traffic: Purging edge caches doesn't work for articles with ":" in their title - https://phabricator.wikimedia.org/T392849#10774111 (10Jgiannelos) [19:39:33] 06serviceops, 06Content-Transform-Team, 06Traffic: Purging edge caches doesn't work for articles with ":" in their title - https://phabricator.wikimedia.org/T392849#10774120 (10Jgiannelos) [19:41:37] 06serviceops, 06Content-Transform-Team, 06Traffic: Purging edge caches doesn't work for articles with ":" in their title - https://phabricator.wikimedia.org/T392849#10774133 (10Jgiannelos) [19:44:55] 06serviceops, 06Content-Transform-Team, 06Traffic: Purging edge caches doesn't work for articles with ":" in their title - https://phabricator.wikimedia.org/T392849#10774139 (10Jgiannelos) [20:42:36] 06serviceops, 06MediaWiki-Platform-Team: Migrate "startupregistrystats" maintenance script to k8s-mw-cron (mediawiki-platform-team) - https://phabricator.wikimedia.org/T388540#10774451 (10Krinkle) While Prometheys counters are pretty straight-forward to aggregate, I'm not sure what to do with gauges. http... [21:09:56] 06serviceops, 06Content-Transform-Team, 06Traffic: Purging edge caches doesn't work for articles with ":" in their title - https://phabricator.wikimedia.org/T392849#10774560 (10Jgiannelos) [22:07:39] 06serviceops, 06Content-Transform-Team, 06Traffic: Purging edge caches doesn't work for articles with ":" in their title - https://phabricator.wikimedia.org/T392849#10774819 (10cscott) I bet this is the problem: https://wikitech.wikimedia.org/wiki/URL_path_normalization