[05:34:15] a classic [05:51:50] the cr2-codfw/cr2-eqord icinga alerts are due to Telia scheduled maintenance afaics [05:52:09] the link/circuit between them is not working, so all good [09:24:14] hi all i plan to disable puppet fleet wide for a period of about 5 minutes at 10:30 while we restarte the puppetdb service [09:24:24] sorry 9:30 UTC [09:29:21] so almost now :) [09:30:17] yep :) [09:37:58] fyi all i failed to disable puppet while i restarted the puppetdb so there where a few failed puppet runs as seen https://grafana.wikimedia.org/d/yOxVDGvWk/puppet?orgId=1 [12:23:58] is it possible/desirable to delete LDAP accounts? [12:24:05] https://phabricator.wikimedia.org/T230126 [12:46:25] _joe_: happy for me to merge your change [12:46:45] <_joe_> jbond42: oh sigh sorry I was waiting for a +1 on the following one [12:46:48] <_joe_> go on! [12:47:11] i can check the other if you want (first has been pushed) [12:47:23] <_joe_> jbond42: no need, ema is on it [12:47:26] ack [12:48:18] _joe_: I think I've +1ed everything and the kitchen sink [12:48:30] <_joe_> you did indeed [12:48:41] <_joe_> now it's jenkins who's being mean [12:49:01] jenkins come on man [13:36:25] cdanis: I am curious, how are the sections ordered by on eqiad.json? [13:36:36] marostegui: however they get hashed in Python [13:36:41] I am trying to find a logical pattenr [13:36:43] we can change to sorted order [13:36:43] Ah, right XD [13:36:50] we do this in the config diff output [13:36:55] cdanis: yeah, that'd be nice [13:36:59] s1, s2... [13:37:00] but had deemed it unnecessary for writing to etcd [13:37:16] since we assumed humans wouldn't be looking at that :D [13:37:19] hahaha [13:37:40] And you realised that DBA aren't human and we do look at it! [13:37:53] oh hey [13:37:59] there might be a very simple solution, one sec [13:38:06] Get human DBAs? [13:38:13] 😂 [13:41:23] marostegui: https://gerrit.wikimedia.org/r/#/c/529100/ is there anything jq can't do? [13:41:29] haha [13:41:49] s3 aka DEFAULT will still sort first, ofc [13:41:55] yeah, that's ok [13:49:05] marostegui: ok should be live in a minute or so [13:50:21] yaaay [13:50:56] also I have a change to make https://noc.wikimedia.org/db.php read these files but it is waiting on finding a reviewer who isn't in transit to wikimania [13:51:39] and once that is merged, I will probably remove the now very stale data from db-eqiad/db-codfw.php [13:52:58] bye bye db-eqiad :( [13:56:58] cdanis: I just refreshed, looks good now, easier to read. Thank you so much [13:57:05] np! [14:51:44] We're going to start cr1-codfw routing engine replacement. No impact expected.