[08:39:01] 06serviceops, 10Parsoid: PHP Fatal error: Uncaught MediaWiki\Config\ConfigException: Failed to load configuration from etcd: lost lock - https://phabricator.wikimedia.org/T392197 (10Jgiannelos) 03NEW [08:40:41] 06serviceops, 10Parsoid: PHP Fatal error: Uncaught MediaWiki\Config\ConfigException: Failed to load configuration from etcd: lost lock - https://phabricator.wikimedia.org/T392197#10751184 (10Jgiannelos) This looks like it has other references in the past: https://logstash.wikimedia.org/goto/454459f5a0d1462edd... [08:47:47] 06serviceops, 10envoy, 10Observability-Metrics, 10SRE Observability (FY2024/2025-Q4): Revisit default envoy histogram buckets - https://phabricator.wikimedia.org/T391333#10751208 (10fgiunchedi) [08:51:16] 06serviceops, 13Patch-For-Review: docker-registry.wikimedia.org keeps serving bad blobs - https://phabricator.wikimedia.org/T390251#10751229 (10elukey) >>! In T390251#10747420, @akosiaris wrote: > * `max-concurrent-uploads`, which was tested and reverted in https://gerrit.wikimedia.org/r/c/operations/puppet/+... [09:02:33] 06serviceops, 10envoy, 10Observability-Metrics, 10SRE Observability (FY2024/2025-Q4): Revisit default envoy histogram buckets - https://phabricator.wikimedia.org/T391333#10751268 (10fgiunchedi) >>! In T391333#10744276, @akosiaris wrote: > which indeed is very optimistic for our use cases. It's very improb... [09:03:11] 06serviceops, 10envoy, 10Observability-Metrics, 10SRE Observability (FY2024/2025-Q4): Revisit default envoy histogram buckets - https://phabricator.wikimedia.org/T391333#10751269 (10fgiunchedi) [10:59:35] 06serviceops, 10Wikimedia-Site-requests, 07Performance Issue: Choose a sensible set of thumbnail sizes for Special:Preferences - https://phabricator.wikimedia.org/T106640#10751509 (10Ladsgroup) Oh that's a nice trick. I hate this way that php handles arrays but it's useful sometimes. I'll do a query to see... [12:58:47] 06serviceops, 10MediaWiki-extensions-ReadingLists, 06MW-Interfaces-Team, 10RESTBase Sunsetting: Switchover plan from RESTbase to REST Gateway for Reading Lists endpoints - https://phabricator.wikimedia.org/T384891#10751776 (10HCoplin-WMF) Following up on this -- can we get an updated timeline from SRE (@a... [13:20:06] Hi, do people in serviceops know whether the performance cost of extra dblists has gone down after mw-on-k8s or it's still not recommended to add dblists for minor things. Context: https://phabricator.wikimedia.org/T392142#10751874 [13:29:17] Amir1: Nothing's changed in the way the php is executed [13:29:20] afaik [13:33:56] 06serviceops, 10MediaWiki-extensions-ReadingLists, 06MW-Interfaces-Team, 10RESTBase Sunsetting: Switchover plan from RESTbase to REST Gateway for Reading Lists endpoints - https://phabricator.wikimedia.org/T384891#10751979 (10MSantos) Adding @hnowlan to give some input as well. [13:41:10] makes sense [13:42:01] it may change a bit with single version but that's a long-ish way off [14:36:30] 06serviceops, 10MW-on-K8s, 13Patch-For-Review, 10Release-Engineering-Team (Priority Backlog 📥): Migrate mwdebug* hosts to PHP8.1 - https://phabricator.wikimedia.org/T391452#10752257 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage was started by jiji@cumin1002 for host mwdebug2001.codfw.wmnet wi... [14:42:17] 06serviceops, 10MediaWiki-Special-pages, 13Patch-For-Review: Migrate updatequerypages/update_special_pages/initsitestats jobs to mw-cron - https://phabricator.wikimedia.org/T388534#10752268 (10Clement_Goubert) 05Open→03In progress p:05Triage→03Medium [15:02:36] 06serviceops, 06DC-Ops, 10ops-eqiad, 06SRE: relocate (3) service-ops hosts out of eqiad D6 - https://phabricator.wikimedia.org/T391599#10752329 (10RobH) a:05RobH→03None Please do not take any actions on this task as the fundraising destination rack will likely now shift from D6 to row B. We'll have mor... [15:34:29] 06serviceops, 10MW-on-K8s, 13Patch-For-Review, 10Release-Engineering-Team (Priority Backlog 📥): Migrate mwdebug* hosts to PHP8.1 - https://phabricator.wikimedia.org/T391452#10752549 (10ops-monitoring-bot) Cookbook cookbooks.sre.hosts.reimage started by jiji@cumin1002 for host mwdebug2001.codfw.wmnet with O... [15:38:47] 06serviceops, 10MW-on-K8s, 13Patch-For-Review, 10Release-Engineering-Team (Priority Backlog 📥): Migrate mwdebug* hosts to PHP8.1 - https://phabricator.wikimedia.org/T391452#10752568 (10jijiki) [17:24:14] 06serviceops, 06Content-Transform-Team, 06MediaWiki-Engineering, 07OKR-Work, 03Web Team Essential Work 2025: Transition parsoidtest1001 to PHP 8.1 - https://phabricator.wikimedia.org/T380485#10753113 (10Scott_French) I am cautiously optimistic that we've shaken out the remaining issues discovered after t... [17:25:26] 06serviceops, 06Community-Tech: Migrate community-tech jobs to mw-cron - https://phabricator.wikimedia.org/T388536#10753121 (10Scott_French) [17:27:29] 06serviceops, 06Community-Tech: Migrate community-tech jobs to mw-cron - https://phabricator.wikimedia.org/T388536#10753152 (10Scott_French) Alright, `mediawiki_job_pagetriage_cleanup_test2wiki` has been migrated to mw-cron on k8s as a pilot. The next run will happen at 8:55 UTC tomorrow (Friday, April 18th),...