[00:50:57] <wikibugs>	 06serviceops: Prepare WMF PHP 8.3 packages for bullseye - https://phabricator.wikimedia.org/T398245#10970535 (10Scott_French) Status update before I disappear for a bit:  I was able to run through //nearly// the full set of necessary packages today, including extensions listed in T398245#10965108 at the indicate...
[01:16:38] <wikibugs>	 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10970566 (10Scott_French) FYI, I will be out next week and intend to pick this back up when I return. Assuming all goes smoothly...
[07:59:46] <wikibugs>	 06serviceops, 06collaboration-services, 06Infrastructure-Foundations, 13Patch-For-Review: Upgrade httpd images to bullseye or bookworm - https://phabricator.wikimedia.org/T378128#10971356 (10Jelto) All miscweb images are running `httpd-bookworm` now. From our side the `httpd` image can be bumped to bookworm.
[09:54:53] <wikibugs>	 06serviceops, 10MW-on-K8s: Review the behaviour of foreachwikiindblist in mw-cron - https://phabricator.wikimedia.org/T398592#10971722 (10Michael) >>! In T398592#10971502, @Urbanecm_WMF wrote: > @Michael, this follows the conversation on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+...
[10:33:23] <wikibugs>	 06serviceops, 10MW-on-K8s: Review the behaviour of foreachwikiindblist in mw-cron - https://phabricator.wikimedia.org/T398592#10971912 (10Clement_Goubert) For now I'd recommend using `FOREACHWIKI_IGNORE_ERRORS` to restore previous behaviour. The issue with that is you won't get an alert unless the last wiki fa...
[10:37:25] <wikibugs>	 06serviceops, 06Growth-Team, 10GrowthExperiments-Mentorship, 07Wikimedia-production-error: growthexperiments-updatementeedata-s1 errors out on DB timeout - https://phabricator.wikimedia.org/T395299#10971929 (10Urbanecm_WMF) FWIW, we recently also encountered an etcd failure with a different job (T398592),...
[10:42:19] <wikibugs>	 06serviceops: Migrate all memcached* clusters to nftables - https://phabricator.wikimedia.org/T398611 (10jijiki) 03NEW
[10:42:37] <wikibugs>	 06serviceops: Migrate all memcached* clusters to nftables - https://phabricator.wikimedia.org/T398611#10971950 (10jijiki) 05Open→03In progress p:05Triage→03Low
[10:56:32] <wikibugs>	 06serviceops: Prepare WMF PHP 8.3 packages for bullseye - https://phabricator.wikimedia.org/T398245#10971978 (10MoritzMuehlenhoff) Since it wasn't mentioned on task; do the packages include the backported mail patches Jesse made?
[12:07:44] <wikibugs>	 06serviceops: Upgrade Excimer to 1.2.5 in production - https://phabricator.wikimedia.org/T397907#10972252 (10jijiki) 05Open→03Resolved a:03jijiki Excimer 1.2.5 is in production, please reopen if something is not right
[13:30:19] <wikibugs>	 06serviceops, 06DBA, 06SRE, 05MW-1.44-notes, and 2 others: HTTP 503 errors trying to reach Wikipedia: 2025-07-02 s4 overload - https://phabricator.wikimedia.org/T398448#10972588 (10Clement_Goubert)
[16:45:51] <andrewbogott>	 jayme: I'm still hoping for some more info about your chartmuseum setup. Is this the wrong place to ask? 
[18:22:38] <wikibugs>	 06serviceops: Prepare WMF PHP 8.3 packages for bullseye - https://phabricator.wikimedia.org/T398245#10973479 (10Scott_French) Thanks for the heads-up, @MoritzMuehlenhoff - I'd not seen those!  I need to rebuild PHP core anyway upon my return due to today's release of 8.3.23, so when I do so, I'll also add patche...
[22:04:07] <wikibugs>	 06serviceops: Upgrade Excimer to 1.2.5 in production - https://phabricator.wikimedia.org/T397907#10973744 (10tstarling) >>! In T397907#10961100, @Scott_French wrote: > My understanding is that your RequestTimeout change is a performance mitigation for the now-more-expensive manipulation of Excimer timers. Is...