[08:08:53] greetings [08:11:40] andrewbogott: ack, thank you I'll check the review [09:29:34] anyone had this error from the wmcs.vps.create_project cookbook? [09:29:34] gitlab.exceptions.GitlabCreateError: 403: 403 Forbidden - You are not allowed to push into this branch [09:30:03] the token on disk seems to not have changed since december and the cookbook was used recently to create a new project (2 weeks ago) [09:44:19] mmhh maybe the token expired? just spitballing [09:45:20] already checked is valid and doesn't have an expiration [09:45:34] tested also via cli and that the cookbook reads the one on disk that I tested [09:46:42] :( [09:48:07] found the issue (thanks dhinus for the hint), it's picking the wrong repo [09:50:07] due to https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/wmcs-cookbooks/+/refs/heads/main/wmcs_libs/wm_gitlab.py#116 [09:50:44] sending patch [10:43:54] a bit more comoplex than expectd, with CI complications that was not running due to an old pin and reported tons of iossues when the pin was removed. result are [10:44:03] CI: https://gerrit.wikimedia.org/r/c/cloud/wmcs-cookbooks/+/1280282 [10:44:08] gitlab: https://gerrit.wikimedia.org/r/c/cloud/wmcs-cookbooks/+/1280283 [10:44:18] problem is I will have to step out very soon to catch the train [10:48:06] but I could run it with test-cookbook to see if I at least can unblock the wise prohect [10:54:47] I'm afk, +1 for using test-cookbook, but if you're in a rush I can run it later today [10:59:40] thx, testing, if it works at least we're donw with that :) [11:10:10] do you know why we pint python-gitlab to 2.5.0 from 2020? they are at 8.3.0 :/ [11:15:16] adapting the patch to the old APIs but we should update that dependency [11:23:28] no idea, I don't know of any reason for that pin [11:23:32] ok MR generated, it seems to work but before merging we should review carefylly all the CI linting things I've fixed in the first commit [11:23:41] and evaluate to get a more recent gitlab library :D [11:30:52] ok project created. [14:36:19] I'm about to rollout pdns security updates on cloudservices, anything to consider for them? just one at time with a little delay in between [14:41:46] moritzm: not as far as I'm aware [14:45:40] k, I'll start with 1006 and then 1005 [14:48:25] FWIW in case there are issues I'm on a train with this ping situation and may drop [14:48:30] 64 bytes from 8.8.8.8: icmp_seq=494 ttl=114 time=2629 ms [14:50:19] updated and all seems fine [14:50:59] ack thank you [15:26:27] godog: volans: safe travels [15:42:03] obligatory <3 to volans for the clinic duty rotation script [16:11:27] lol will I get those every week in perpetuity? :-D [16:13:28] maybe :D [16:13:48] I created T425011 to have some tail of the paws outage this week [16:13:48] T425011: Deployment failed causing a PAWS outage - https://phabricator.wikimedia.org/T425011 [16:14:34] s/tail/trail/