[11:10:58] \o I am about to push the changes from https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1275832 (dropping a Liftwing service from the changeprop config). If I shouldn't, please ping me :) I'll wait a bit before I proceed [11:16:15] klausman: I am runung a deployment [11:16:29] impacting mediawiki atm, shall we hold off a bit? [11:16:51] unless you are certain this will not have any impact [11:17:07] Whatever works better for you. The change I have only removes a LW service, and will thus reduce some logspam on the Logstash side. [11:17:50] So it's not super urgent, but also shouldn't really impact anything [11:18:09] cool, as long as we do not accidentally break changeprop atm [11:18:56] No guarantees in our profession etc. :) [11:19:55] Will proceed and let you know when I'm done (and keep an eye on chageprop). [11:20:02] no guarantees in our lives either [11:20:06] cheers [11:22:06] codfw done, will watch it for 5m for anything exploding [11:28:11] eqiad also doen, watching it for 5m again. so far no trouble [11:32:22] grand tx [11:32:31] All good, no issues. [11:32:42] best of luck with the deployment! [11:33:43] cheers [12:15:06] hello serviceops! just commenting about this here as a 'for your information, you can decide what/any action to take & when to take it' rather than a 'please do this right away' :p -- i don't know how much of an issue this would/wouldn't be (given that... it's restbase); [12:15:16] but just with https://wikitech.wikimedia.org/wiki/How_to_deploy_code#Problem:_undeployed_code in mind, i thought i should just give y'all an FYI that (FWICS) the most recently-merged commit to restbase/deploy may not currently be deployed -- https://phabricator.wikimedia.org/T415975#11798449 has context [12:16:10] (tldr; FWICS, the commit before the most recent commit may have been inadvertendly deployed, rather than the most recent commit) [12:25:05] claime: for the liftwing endpoints, i see a new "inference" cluster configured for prod, but not for staging. is that an oversight? I was planning to test against an inference endpoint... [12:55:06] duesen: hmm yeh I may have forgotten that the endpoints aren't automatically added, let met check [14:01:28] duesen: i see it in the envoy config dump, it should work, i'll take a look after meetings [14:22:49] claime: it would be inherited from the live config... I'm wondering if it should be different on staging. [14:24:25] it could hit inference-staging potentially [14:35:08] but it's not required for testing i don't think [14:39:26] duesen: basically I don't know if every model has an actual staging etc. so I'd rather use the prod endpoint [14:57:36] ok, thanks for checking