[04:50:34] In 10 minutes we'll start the s3 switchover [12:15:52] Threembb is that three.co.uk? [15:02:12] do you know if node exporter knows anything about server uptime? or otherwise how to integrate that into grafana? [15:04:25] `node_boot_time_seconds` is probably what I was looking for [15:06:44] <_joe_> yes [15:07:09] do you have any usage examples at hand? [15:07:47] <_joe_> you mean a prometheus query? [15:08:16] I'm thinking on any fancy grafana panel showing a server uptime [15:08:43] <_joe_> that's not neccessarily fancy given it should be a pretty monotone graph :P [15:08:47] https://grafana.wikimedia.org/d/GWvEXWDZk/prometheus-server?refresh=1m&panelId=42&fullscreen&orgId=1 [15:08:50] this is process uptime [15:08:52] but a similar metric [15:08:58] * arturo looking [15:18:04] thanks! [15:18:26] result in the top right panel: https://grafana.wikimedia.org/d/aJgffPPmz/wmcs-openstack-eqiad1-hypervisor?orgId=1&var-hypervisor=cloudvirt1025&refresh=30s [16:02:54] mmm, I think I need breakfast (or maybe lunch by now) before I can write up a reasonable debian/changelog entry for conftool [18:44:40] <_joe_> cdanis: I was thinking we should probably test the release on a dump of the current etcd data, esp syncing and how to remove the services objects [18:45:25] mmmmm [18:45:29] I had forgotten about that change [18:45:34] yeah okay, that's a good thought [18:45:43] does your etcd dumper still work _joe_? [18:48:05] <_joe_> cdanis: uh that shitty thing I patched up pre-wmf? [18:48:12] <_joe_> I was tinking of restoring a prod backup :D [18:48:56] shrug, I've never used either ;) [18:56:14] _joe_: how exactly were you thinking of doing that? getting a dump made by etcdctl and restoring it locally? [18:57:32] <_joe_> cdanis: we take a snapshot every day on each etcd server, we can just copy it to labs [18:57:37] <_joe_> given there is no private data [18:58:34] this is starting to sound like a job for tomorrow morning [18:59:43] <_joe_> yeah, probably mine tomorrow morning to set it up [19:00:08] <_joe_> if I'm able to get confd to build how I want to [20:01:05] _joe_: I have debs for conftool 1.2.0 for all our Debian versions, we can do the rest together in my morning