[13:37:45] godog: not 100% sure this is related to you but I saw `Info: Applying configuration version '(cae1e72ca4) Filippo Giunchedi - dumps: add nfs_client for dumps-nfs.w.o'` when running puppet on the deployment host, and then [13:37:45] ... [13:37:45] Notice: /Stage[main]/Rsync::Server/Service[rsync]: Triggered 'refresh' from 1 event [13:37:45] Error: Systemd start for stunnel4 failed! [13:38:56] brouberol: that's https://phabricator.wikimedia.org/T418262#12102130 I think [13:39:07] which deployment host is that? [13:39:15] 2003 [13:40:27] hah, mhh, more-grunting-noises [13:42:04] brouberol: yeah it's that, I'll kill and restart the process cleanly, and we'll investigate on monday [13:42:19] cool cool [13:42:41] yeah indeed, looks like puppet and stunnel haven't been happy with each other [13:43:11] godog: https://www.youtube.com/watch?v=RBmoQSHfO2U [13:43:17] godog: Not just puppet tbh, a manual systemctl restart fails the same way [13:46:55] cdanis: lol very fun, thank you [13:47:12] claime: hah! that explains, that's the new deploy host isn't it ? [13:48:06] godog: yes [13:48:10] and the current prod one [13:48:42] * godog nods [13:48:43] My brain's broken today so I can't productively look unfortunately [13:49:09] that's okay I think, doesn't look it is on fire [13:51:17] o/, I'm looking into the puppetserver woes [13:51:27] jhathaway: <3 [13:51:28] cdanis: somehow that video reminded me of https://www.youtube.com/watch?v=JXD-jvHage8 [18:07:44] FYI, per discussion in #wikimedia-traffic, I'll be restarting one pybal instance (high-traffic2 in codfw) shortly, in order to clear some lingering config diffs / alerts before the weekend. cc: jhathaway (and t.opranks) FYI [18:10:22] swfrench-wmf: thanks! [18:16:56] {{done}} [20:32:59] jhathaway: Bitu-account-managers is the ldap group you need to disable/enable people. Not sure about how to reset a password. [20:33:43] https://ldap.toolforge.org/group/bitu-account-managers [20:34:45] https://wikitech.wikimedia.org/wiki/SRE/LDAP#Changing_the_password_of_a_user [20:40:15] RhinosF1: I think that information is out of date, https://wikitech.wikimedia.org/wiki/IDM/Account_Blocking [20:40:46] the log, https://idm.wikimedia.org/wikimedia/log/#, shows slyngs blocking the account via Bitu [20:41:28] jhathaway: that guide links to the exact same list of people in who can access the block feature in Bitu [20:41:36] ah! [20:41:41] The very last paragraph [20:43:33] thanks, your reading comprehension was better than mine! [20:43:42] looks like I am in neither list at present