[00:32:58] <springle>	 do you think db1022 deserves a pt checksum or sync? we havn't recently checked dbstore1001, and it seems like a good opportunity for sanity check
[00:33:13] <springle>	 jynus_: (just $0.02)
[02:26:27] <springle>	 jynus_: nm, my mistake. i see what you did
[05:17:49] <springle>	 db1034 is me. normal upgrade. possibly also reload and/or switch it to logpager
[06:58:44] <jynus>	 I will profile db1018 as I did last week for 24 hours to assess the impact of P_S
[09:49:14] <jynus>	 the lag on 1069:3 is cause by a pt-table-checksum - many tables do not exist there from testwiki
[17:52:53] <mutante>	 jynus: do you need tendril right now, maybe 2 minuts downtime
[17:53:06] <mutante>	 i want to make sure it gets cloned right from WMF rpo
[17:53:26] <mutante>	 by removing the existing files and letting puppet add them again
[17:53:35] <jynus>	 not a good time now
[17:53:57] <jynus>	 it is the only place where I can monitor access failures for non-production
[17:54:14] <jynus>	 can you wait some minutes, maybe 1 hour
[17:54:25] <mutante>	 ok, i won't touch anything else
[17:54:39] <mutante>	 i did merge a puppet change but that was no-op
[17:54:48] <mutante>	 of course, it can wait
[18:23:14] <jynus>	 mutante, I think I can survive now without it, if you promise to put it up again :-)
[18:23:24] <jynus>	 please make a backup
[18:23:45] <jynus>	 I am not 100% sure that the repo and the files there would be the same
[18:24:07] <jynus>	 (I tried to deploy it on my pc and I lacked of some files)
[18:25:08] <mutante>	 jynus: which repo did you clone from? github or gerrit?
[18:25:17] <jynus>	 github
[18:25:36] <mutante>	 so yea, i did make a local backup
[18:25:51] <mutante>	 but if github repo is not complete.. then sigh
[18:25:58] <mutante>	 i should delay this then
[18:26:15] <jynus>	 not sure if because of the files, though
[18:26:24] <jynus>	 it may be because the lack of sql scripts
[18:26:45] <mutante>	 hrmm.. i'll try it. and if it fails then rsync back from backup
[18:26:50] <jynus>	 I didn't answer the gerrit because I wanted to check for differences first
[18:27:07] <jynus>	 but too many pending things
[18:33:06] <mutante>	 trying it now
[18:38:21] <jynus>	 it seems back
[18:38:34] <mutante>	 jynus: restored from local backup
[18:38:41] <mutante>	 because.. i did not clone it .. at all
[18:38:46] <jynus>	 oh
[18:38:55] <mutante>	 even though we use the same for other tools
[18:38:58] <jynus>	 maybe I can help tomorrow
[18:39:03] <jynus>	 or to be fair
[18:39:06] <mutante>	 so something is broken with puppet git clone in general :/
[18:39:12] <jynus>	 springle is your guy for this
[18:39:15] <mutante>	 or i made a mistake
[18:39:27] <mutante>	 yea, so.. i will hold back on this for now
[18:39:33] <mutante>	 and first test the cloning somehow
[18:39:38] <mutante>	 and probably continue tomorrow
[18:40:01] <mutante>	 sorry for this, that's not what i expected at all
[18:40:14] <mutante>	 maybe some permission issues or something.. but not nothing happening at all
[18:41:00] <jynus>	 do not worry, I do not know about sean, but I havn't touched that code yet
[18:41:14] <jynus>	 we plan to do it soon
[18:41:31] <mutante>	 alright, so it worked in the past for dbtree
[18:41:34] <mutante>	 we did the same thing
[18:41:40] <mutante>	 something must have changed in between
[18:41:46] <mutante>	 will figure it out, but not right now
[18:41:59] <mutante>	 so you can go ahead