[01:14:10] 06serviceops, 06MediaWiki-Engineering, 13Patch-For-Review: Clean up UcfirstOverrides.php following PHP 7.4 -> 8.1 transition - https://phabricator.wikimedia.org/T394556#10907193 (10Pppery) Scanning the paste: ` commonswiki Would rename Category:ʂ → Category:Ʂ (technical rename) ` can just be deleted - both a... [04:59:36] 06serviceops, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10907489 (10Joe) @Scott_French the procedure you outline seems good to me, but I would add, after merging the first patch, a deployment for shellbox. That s... [09:14:41] 06serviceops, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10908279 (10Clement_Goubert) Procedure and images lgtm, let's go! [09:18:13] 06serviceops, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10908289 (10MoritzMuehlenhoff) This won't work as moving to Bookworm would require an ICU transition first? We're currently on ICU 67 and Bookworm comes wit... [09:51:56] 06serviceops, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10908469 (10Joe) >>! In T378128#10908289, @MoritzMuehlenhoff wrote: > This won't work as moving to Bookworm would require an ICU transition first? We're cur... [09:53:37] 06serviceops, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10908471 (10MoritzMuehlenhoff) >>! In T378128#10908469, @Joe wrote: >>>! In T378128#10908289, @MoritzMuehlenhoff wrote: >> This won't work as moving to Book... [10:56:31] 06serviceops, 10Wikidata, 10Wikidata-Query-Service, 10Data-Platform-SRE (2025.05.24 - 2025.06.13), 13Patch-For-Review: wikidata-updatequeryservicelag cron job failing - https://phabricator.wikimedia.org/T395814#10908631 (10Clement_Goubert) 05Open→03In progress [10:56:38] 06serviceops, 10Wikidata, 10Wikidata-Query-Service, 10Data-Platform-SRE (2025.05.24 - 2025.06.13), 13Patch-For-Review: wikidata-updatequeryservicelag cron job failing - https://phabricator.wikimedia.org/T395814#10908632 (10Clement_Goubert) p:05Triage→03Medium [12:45:58] Hi, hypothetically speaking, how terrible it would be if I make a file in puppet dumped into mw images so it could be served in noc.wikimedia.org? [12:46:22] (the file in question: https://github.com/wikimedia/operations-puppet/blob/production/modules/mediawiki/files/mariadb/tables-catalog.yaml) [12:48:01] wdym dumped into mw images? [12:50:35] I actually dont' know :D is it even possible? [12:51:05] Not really, and not advisable imo [12:51:27] I think it'd be better to make it a configmap and mount it [12:51:50] like what I did for the fancycaptcha config in mwcron [12:52:15] I hope it doesn't hit the limit of configmap [12:52:24] Is it less than 1MB? [12:52:35] 44KB, yeah you're fine :D [12:53:02] yup [12:53:43] do you have a ticket how it was done for fancycaptcha config so I can get inspiration (copy) from [12:53:59] Hey akosiaris hnowlan can i go ahead and merge this one to test it on staging? https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1156290 [12:54:05] Amir1: puppet side https://github.com/wikimedia/operations-puppet/blob/9baa8fdfbb5ae759bb7f98cb8408a236e5d71d56/modules/profile/manifests/mediawiki/maintenance/generatecaptcha.pp#L14 [12:57:50] thanks [13:00:08] Amir1: On the charts side it's a little more involved, I think we need to add a feature flag for noc so we can differentiate from the other deployments, and if-guard the configmap/volumemount def, but the basic idea is that your file is dumped as the content of a (for example) mw.noc.tablescatalog key of a yaml file, then that is included in noc's helmfile.yaml, used to populate a configmap like [13:00:10] https://github.com/wikimedia/operations-deployment-charts/blob/master/charts/mediawiki/templates/mwcron/configmap.yaml.tpl, that gets put in a volume like https://github.com/wikimedia/operations-deployment-charts/blob/eee3304b06d2a6ee3886f7137bca050cca7da2ea/charts/mediawiki/templates/_volumes.tpl#L86 , and volumemounted like [13:00:12] https://github.com/wikimedia/operations-deployment-charts/blob/eee3304b06d2a6ee3886f7137bca050cca7da2ea/charts/mediawiki/templates/lamp/deployment.yaml.tpl#L337 [13:02:34] thanks. It shouldn't be too hard [13:03:14] Or we can just if-guard it on the existence of the mw.noc key [13:03:25] (instead of adding a feature flag) [13:04:11] Amir1: it's a bit convoluted but it's more or less the only way to mount a single file to a predictable path without doing disgusting hostMount stuff [13:07:34] 06serviceops, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10909027 (10Scott_French) Thanks, all! Inverting the order and piloting on shellbox early on sounds good. The only downside to that is the necessary change... [13:35:52] 06serviceops, 10Wikidata: Improve alerting for flaky mw-cron jobs - https://phabricator.wikimedia.org/T395885#10909165 (10Clement_Goubert) 05In progress→03Resolved [13:36:42] 06serviceops, 10Wikidata, 10Wikidata-Query-Service, 10Data-Platform-SRE (2025.05.24 - 2025.06.13): wikidata-updatequeryservicelag cron job failing - https://phabricator.wikimedia.org/T395814#10909168 (10Clement_Goubert) New alert deployed, it should only trigger if 5 of the last 10 runs have failed (sl... [13:36:50] 06serviceops, 10Wikidata, 10Wikidata-Query-Service, 10Data-Platform-SRE (2025.05.24 - 2025.06.13): wikidata-updatequeryservicelag cron job failing - https://phabricator.wikimedia.org/T395814#10909171 (10Clement_Goubert) 05In progress→03Resolved a:03Clement_Goubert [13:48:10] nemo-yiannis: I see you did, sorry for not replying earlier. Did it work? [13:48:20] yes [13:48:40] i am waiting for backport to finish so i deploy wikifeeds prod [13:49:10] super [14:19:17] 06serviceops, 10Wikidata, 10Wikidata-Query-Service, 10Data-Platform-SRE (2025.05.24 - 2025.06.13): wikidata-updatequeryservicelag cron job failing - https://phabricator.wikimedia.org/T395814#10909325 (10Lucas_Werkmeister_WMDE) Thanks a lot! [15:29:02] 06serviceops, 10MW-on-K8s: Create ValidatingAdmissionPolicy to permit hostPath mounts for mediawiki - https://phabricator.wikimedia.org/T395225#10909780 (10jijiki) 05In progress→03Resolved [15:31:10] 06serviceops, 10MW-on-K8s, 13Patch-For-Review, 10Release-Engineering-Team (Priority Backlog 📥): Provide an mwdebug functionality on kubernetes (mw-experimental) - https://phabricator.wikimedia.org/T276994#10909804 (10jijiki) Current status: * POC working on wikikube-worker2100.codfw.wmnet, tested with h... [15:31:54] 06serviceops, 10API Platform, 10MediaWiki-extensions-ReadingLists, 06MW-Interfaces-Team, and 2 others: Reading List REST Interface: reroute calls - https://phabricator.wikimedia.org/T348493#10909814 (10HCoplin-WMF) 05Open→03Resolved [15:33:36] 06serviceops, 10MediaWiki-extensions-ReadingLists, 06MW-Interfaces-Team, 10RESTBase Sunsetting, and 2 others: Switchover plan from RESTbase to REST Gateway for Reading Lists endpoints - https://phabricator.wikimedia.org/T384891#10909822 (10HCoplin-WMF) 05Open→03Resolved a:03HCoplin-WMF Marking as... [15:35:22] 06serviceops, 10MW-on-K8s, 10Release-Engineering-Team (Priority Backlog 📥): Make mw-experimental production ready - https://phabricator.wikimedia.org/T396767 (10jijiki) 03NEW [15:37:22] 06serviceops, 10MW-on-K8s, 10Release-Engineering-Team (Priority Backlog 📥): Make mw-experimental production ready - https://phabricator.wikimedia.org/T396767#10909858 (10jijiki) 05Open→03In progress p:05Triage→03Medium [18:33:44] 06serviceops, 10DNS, 06SRE, 06Traffic: Create redirect from tj.*.org to tg.*.org - https://phabricator.wikimedia.org/T393803#10910716 (10Dzahn) works for me now. thanks @jasmine_ for deploying my patches!:) ` curl -vv https://tj.wikipedia.org ..

The document has moved