[07:36:04] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Install new line card in cr2-eqiad slot 0, move card from slot 1 to cr1-eqiad slot 0 and configure - https://phabricator.wikimedia.org/T426343#11929433 (10ayounsi) We have 2 new linecards coming, one for each router, so afaik we don't... [07:49:16] 10netops, 06Infrastructure-Foundations: POPs - free up 2xQSFP ports - https://phabricator.wikimedia.org/T424611#11929465 (10ayounsi) My suggestions here would be to open the decom tasks and leave it to DCops on how they want to tackle them. For esams that finally cleared the high power alarm, and we're going... [08:19:03] 06Traffic, 10Pywikibot, 06SRE, 10Wikidata, and 3 others: Pywikibot reports maxlag retry error - https://phabricator.wikimedia.org/T421642#11929560 (10Xqt) >>! In T421642#11928938, @Arcstur wrote: > @Xqt is it possible to check maxlag PER user-agent? I guess that coul help us sort thing out. I found this i... [08:38:04] Hey all, I'm back from a week of leave and resuming on the work we are doing to expose a grpc port in addition to http(s) for ML services on ML k8s clusters. I prepared a series of 3 changes. If someone could chime in and give a stamp of approval it would be appreciated :) [08:38:04] https://gerrit.wikimedia.org/r/c/operations/puppet/+/1283745 [08:38:04] https://gerrit.wikimedia.org/r/c/operations/puppet/+/1283746/2 [08:38:04] https://gerrit.wikimedia.org/r/c/operations/puppet/+/1283747/2 [09:07:56] 06Traffic, 06SRE: ASW single-point of failure for LVS VIPs at POPs - https://phabricator.wikimedia.org/T362772#11930012 (10ayounsi) 05Resolved→03Open a:05cmooney→03None Reopening as I think that should still be on Traffic's radar and up to traffic to close the task. I agree that the best long term fix... [09:25:10] 10netops, 06Infrastructure-Foundations, 06Data-Platform-SRE (2026-04-24 - 2026-05-15): Create depool hiera keys for cirrussearch hosts - https://phabricator.wikimedia.org/T426228#11930088 (10ayounsi) Thanks a lot for that ! [09:33:12] 10netops, 06Infrastructure-Foundations, 06ServiceOps new: codfw: rack A2 maintenance - https://phabricator.wikimedia.org/T426199#11930126 (10ayounsi) [10:12:22] 10netops, 06DC-Ops, 06Infrastructure-Foundations, 10ops-eqiad, 06SRE: Install new line card in cr2-eqiad slot 0, move card from slot 1 to cr1-eqiad slot 0 and configure - https://phabricator.wikimedia.org/T426343#11930298 (10cmooney) >>! In T426343#11929433, @ayounsi wrote: > We have 2 new linecards comi... [11:03:50] 10netops, 06Infrastructure-Foundations, 06SRE: InboundInterfaceErrors alerts firing for Nokia switches on v25.10.1 - https://phabricator.wikimedia.org/T412733#11930466 (10ayounsi) @Papaul did they provide a ETA for the fix? If not is it possible to ask them for any update ? [11:14:51] 10netops, 06Infrastructure-Foundations, 06ServiceOps new: codfw: rack A2 maintenance - https://phabricator.wikimedia.org/T426199#11930504 (10ayounsi) [12:58:33] 10netops, 06Infrastructure-Foundations, 06SRE: InboundInterfaceErrors alerts firing for Nokia switches on v25.10.1 - https://phabricator.wikimedia.org/T412733#11930998 (10Papaul) @ayounsi no ETA was given to me but yes i can can follow up with them. [13:41:02] 10netops, 06Infrastructure-Foundations, 06ServiceOps new: codfw: rack A2 maintenance - https://phabricator.wikimedia.org/T426199#11931215 (10ayounsi) [13:48:15] 10netops, 06Infrastructure-Foundations, 06ServiceOps new: codfw: rack A2 maintenance - https://phabricator.wikimedia.org/T426199#11931288 (10ayounsi) [13:53:10] anyone? :) [16:32:04] 06Traffic, 10ContentTranslation, 06LPL Hypothesis, 06Security-Team, and 4 others: CX dashboard can't load page collections on some wikis (blocked by CORS) - https://phabricator.wikimedia.org/T426323#11932396 (10Catrope) [17:28:28] yahoo mail is being rejected as spam, anyone have a moment to review https://gerrit.wikimedia.org/r/c/operations/dns/+/1288909 [17:28:43] which would add the wikimedia.org domain to yahoo's spam monitoring tool [18:36:37] jhathaway: +1, best of luck handling yahoo :/ [18:45:57] thanks [19:50:34] 06Traffic, 06Commons, 06DC-Ops, 10MediaWiki-Core-Revision-backend, and 3 others: ESAMS and others serving older revisions of overwritten files - https://phabricator.wikimedia.org/T425216#11933315 (10AlexisJazz) https://commons.wikimedia.org/w/index.php?title=Commons:Help_desk&diff=prev&oldid=1216270150 was... [21:24:24] 06Traffic, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Revert lvs1017 Mellanox NIC to Broadcom - https://phabricator.wikimedia.org/T421421#11933539 (10VRiley-WMF) @BCornwall is this okay to assign to you? [21:27:45] 06Traffic, 06DC-Ops, 10ops-eqiad, 06SRE, 13Patch-For-Review: Revert lvs1017 Mellanox NIC to Broadcom - https://phabricator.wikimedia.org/T421421#11933547 (10BCornwall) a:05VRiley-WMF→03BCornwall Sure thing!