[05:45:40] Gerrit needs a short maintenance in 15 minutes [07:22:17] <_joe_> regarding the recent "we blocked chrome on phabricator" issue, I've cooked up a patch that introduces traffic classes to cache-misc, https://gerrit.wikimedia.org/r/c/operations/puppet/+/1276403 [07:22:42] <_joe_> if we roll this out, such blocks won't affect (ideally at least) already logged in users in phabricator [07:22:47] <_joe_> and / or gerrit [07:23:07] <_joe_> and it will allow us to only apply limits safely to non-logged-in users. [07:23:39] <_joe_> anyways, I'll be off starting tomorrow until may 4th, between a few days of PTO and the hackathon, so I won't roll this out myself [07:23:44] <_joe_> cc jelto fabfur [07:38:32] I'm ooo today and tomorrow for oncall comp [08:38:43] Emperor: o/ re: sretest2010, sadly the BMC firmware that should have fixed the issue is not working, waiting for SM to fix it. I'll keep things updated in https://phabricator.wikimedia.org/T394357 [08:42:37] elukey: thanks for the update, and sorry it's such a pain [08:54:18] Emperor: all good, I meant to test it during the next days, your ping gave me the right push to do it :) [10:05:58] I'm quite surprised that CSV is not in the list of "languages" in the Wikitech "code block" window. There is YAML, json, INI, but no CSV.. [10:09:20] maybe 'cos there is no single CSV syntax? ;p [10:11:45] I think the immediate reason is that Pygments doesn’t have a CSV language (https://pygments.org/languages/); the reason for *that* is probably what Emperor said :P [10:12:42] “All in all I'm skeptical that a CSV lexer is worth it.” https://github.com/pygments/pygments/issues/1952#issuecomment-967251145 [10:17:50] haha, thanks for the pointers :) [10:18:29] <-- definitely doesn't have scars from having to deal with "CSV" in a past life [10:45:40] who could help to investigate jobqueue/eventbus issue. context https://phabricator.wikimedia.org/T423779#11850764 [18:41:51] I asked this in #operations already but it got drowned out by alerts. Is the new discovery intermediate ready for use? My reading of T420993 suggests that it **is** ready, but Puppet support needs https://gerrit.wikimedia.org/r/c/operations/puppet/+/1275956 . If anyone knows how to one-off test a single host LMK, my team has about 50 active cert alerts [18:41:52] T420993: Rotate discovery intermediate certificate (expires 2026-05-03) - https://phabricator.wikimedia.org/T420993 [18:46:53] hi folks, anyone is netops still around? could use a hand looking at an `Idle BGP Error: Bad peer AS` while adding new control plane nodes) [18:51:28] jasmine_: not netops but I can try. where do you get this error? [18:51:35] after enabling BGP on netbox and running homer? [18:53:23] ah sorry actually after BGP but before homer) - was running calicoctl trying to figure out why homer wasn't picking up the netbox diffs after enabling BGP - I see now that that's expected until the homer run [18:59:06] ok :) [19:01:01] yeah the session won't be established until homer has run, so that's perhaps what calicoctl was complaining about [19:07:14] herron: about https://gerrit.wikimedia.org/r/c/operations/puppet/+/1276745, I take it all brokers have been rolled out, and we're now "committing" the upgrade by switching the inter broker protocol? [19:07:29] sukhe: ah fixed, BGP established now - thanks! [19:07:59] nice! [19:26:15] brouberol: yes! rolled out the rest of the package upgrades to logging-codfw this morning, and targeting early next week for the protocol update if everything looks good [19:32:17] Nice! Let me +1 the patch then [19:32:59] {{done}} [19:56:22] thanks!