[00:12:49] <TParis>	 StevenW: Draft doesnt show up on search page
[00:13:06] <TParis>	 nevermind
[00:13:09] <TParis>	 suddenly popped up
[00:25:02] <StevenW>	 TParis: Yeah it's only the Advanced options
[00:25:14] <StevenW>	 we should consider adding it as a selection option other than Advanced.
[00:32:56] <TParis>	 StevenW: I checked the advanced options and it wasnt there, I looked carefully.  After my message above, I hit refresh and everything moved over one and it was suddenly there.
[00:40:14] <StevenW>	 TParis: are you looking on enwiki?
[00:40:23] <StevenW>	 The namespace is not deployed, so you can't search for it. 
[00:40:32] <StevenW>	 It's hard to search for something that doesn't exist.
[00:40:59] <StevenW>	 Check it out on http://en.wikipedia.beta.wmflabs.org/wiki/Main_Page instead
[00:48:13] <TParis>	 StevenW: I was looking at the beta, but I might have crossed over to live somehow.  It doesnt appear to be hard to jump into enwp unknowingly from beta-enwp
[00:48:29] <StevenW>	 TParis: yeah, true that
[01:00:03] <bd808>	 !log wikimania-support Updated scholarship-alpha to 008a93f
[01:00:05] <labs-morebots>	 Logged the message, Master
[01:08:25] <bd808>	 !log wikimania-support Updated scholarship-alpha to 8fd1634
[01:08:27] <labs-morebots>	 Logged the message, Master
[10:50:54] <hashar>	 !log depoyment-prep apt upgrade of deployment-staging-cache-mobile02
[10:50:55] <labs-morebots>	 depoyment-prep is not a valid project.
[10:51:09] <hashar>	 !log deployment-prep apt upgrade of deployment-staging-cache-mobile02
[10:51:10] <labs-morebots>	 Logged the message, Master
[10:51:50] <hashar>	 !log deployment-prep update operations/puppet repository on deployment-staging-cache-mobile02
[10:51:51] <labs-morebots>	 Logged the message, Master
[12:49:29] <dan-nl>	 hey hashar, when you have a moment. i need some help regarding the puppet config for production https://gerrit.wikimedia.org/r/#/c/101058/
[12:50:31] <dan-nl>	 we want to make sure a runner picks up those 3 gwtoolset jobs … aaron helped me out with that config and i just want to verify that it's okay plus ...
[12:50:43] <dan-nl>	 how do i do the same for the beta cluster?
[13:31:33] <zhuyifei1999>	 !coffee T13|needsCoffee
[13:32:10] <T13|needsCoffee>	 ...
[14:38:05] <hashar>	 !log deployment-prep applied role::beta::natfixup to several instances, that is meant to rewrite IP packet trying to access the public IP of beta instances. See {{bug|45868}}
[14:38:06] <labs-morebots>	 Logged the message, Master
[14:39:05] <hashar>	 so hm
[14:39:10] <hashar>	 friday deploys are definitely bad :-D
[15:15:39] <hashar>	 !log deployment-prep Beta apaches port 80 were firewalled out.  Got fixed up :-}
[15:15:40] <labs-morebots>	 Logged the message, Master
[16:19:02] <MaxSem>	 Coren or andrewbogott, when I'm attempting to ssh into a particular instance (staging) it hangs forever - what could be wrong?
[16:19:13] <andrewbogott>	 MaxSem: what project is that?
[16:19:31] <MaxSem>	 mobile
[16:21:00] <andrewbogott>	 MaxSem: are other homedirs in that project working ok?
[16:21:50] <MaxSem>	 same stuff for zero-test
[16:22:13] <MaxSem>	 ...and mobile-b2g
[16:22:28] <MaxSem>	 yeah, and yesterday my home on staging was read-only
[16:23:45] <andrewbogott>	 MaxSem, try now?
[16:24:05] <MaxSem>	 andrewbogott, works - thank you:)
[16:53:17] <hedonil>	 Coren: andrewbogott: I'm deelpy concerend about the ongoing user locks on S6 (ru-,ja-,frwiki). Saw some heavy db maintenance some hours ago. How long will that last?
[16:56:11] <andrewbogott>	 hedonil: I know nothing, best to wait for Coren to appear
[16:57:01] <hedonil>	 andrewbogott: when will he be back again?
[16:57:22] <andrewbogott>	 I don't know.  Soon I'd expect.
[19:18:58] <hedonil>	 Coren: ping
[19:33:59] <hedonil>	 apper: ping
[19:34:21] <apper>	 hedonil: pong
[19:34:43] <hedonil>	 apper: can you do me a favor and try to connect to ruwiki.labsdb?
[19:35:10] <apper>	 hedonil: Access denied
[19:35:21] <hedonil>	 apper: same to me f***
[19:35:37] <apper>	 :/
[19:35:52] <hedonil>	 apper: yes, indeed.
[19:39:07] <hedonil>	 apper: thx.
[19:39:17] <apper>	 np
[19:52:54] <hedonil>	 Ryan_Lane: Can you help explain / solve the issue with s6.labsdb?
[19:53:53] <milimetric>	 Ryan_Lane / Coren / anyone: How can I give Nuria (new analytics member) loginviashell rights?
[19:53:56] <milimetric>	 RT ticket?
[19:55:23] <milimetric>	 so, the context is that she has an account on wikitech and it fails when I try to add her to our projects
[19:55:34] <milimetric>	 it says that she needs "loginviashell" rights
[20:33:17] <andrewbogott>	 milimetric: I can do loginviashell
[20:33:35] <andrewbogott>	 hedonil:  toollabs is pretty distinct from 'labs'.  Ryan and I know about Labs but Coren is the only toollabs staff.
[20:33:41] <andrewbogott>	 Of course there are many volunteers who might know things.
[20:35:48] <andrewbogott>	 hedonil: I just checked the calendar… several people (including Coren) are doing datacenter visits today.  I'd expect Coren back this evening or tomorrow.
[20:36:00] <andrewbogott>	 milimetric: Nuria should be all set now.
[20:43:06] <hedonil>	 andrewbogott: yeah community, contribution, knwoledge - This is what it's all about.;-)
[20:43:22] <hedonil>	 andrewbogott: but thanks.
[21:06:39] <Ryan_Lane>	 hedonil: I'll be honest that I have no idea about any of the db stuff
[21:08:52] <hedonil>	 Ryan_Lane: ok. was asking, just incase:)
[21:11:20] * hedonil  drinks some vodka lemon in the meantime

[21:13:25] * hedonil  can't do any useful coding stuff at the moment, so he's working on some pink gurl's css scheme

[22:23:16] <Betacommand>	 Coren: someone broke the databasees
[22:23:35] <greg-g>	 has he been online today (C-oren, that is)?
[22:23:58] <Betacommand>	 Nope
[22:24:11] <Betacommand>	 anyone around with root access?
[22:24:21] <greg-g>	 he's probably out visiting potential datacenters with some other ops
[22:24:27] <greg-g>	 not me :/
[22:25:11] <Betacommand>	 local-betacommand-dev@tools-login:~/$ sql frwiki_p
[22:25:13] <Betacommand>	 ERROR 1045 (28000): Access denied for user 'p50380g50402'@'10.4.0.220' (using password: YES)
[22:25:28] <apper>	 Betacommand: you're not the first reporting this
[22:25:30] <Betacommand>	 why is the french wiki forbidden?
[22:26:19] <apper>	 noone around to fix this
[22:27:01] <apper>	 cluster s6 is broken: frwiki, jawiki and ruwiki
[22:36:53] <greg-g>	 apper: has someone emailed the labs-l mailing list?
[22:37:06] <greg-g>	 Coren will probably see that and respond when he can
[22:37:10] <apper>	 greg-g: don't think so
[22:37:18] <greg-g>	 someone should :)
[22:37:53] <andrewbogott>	 If you email, cc sean pringle
[22:37:58] <andrewbogott>	 he may also know something… maybe
[22:38:09] <andrewbogott>	 And is in Australia, so, better TZ coverage
[23:00:24] <grrrit-wm>	 (03PS1) 10Jforrester: Add new Parsoid repos to be pinged about [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/101449 
[23:01:20] <grrrit-wm>	 (03CR) 10GWicke: [C: 032] Add new Parsoid repos to be pinged about [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/101449 (owner: 10Jforrester)
[23:03:55] <grrrit-wm>	 (03CR) 10Legoktm: [C: 032 V: 032] "jenkins can't merge here for some reason." [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/101449 (owner: 10Jforrester)
[23:16:42] <grrrit-wm>	 (03CR) 10Jforrester: "Needs rebasing on latest config.yaml file." [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/98141 (owner: 10MarkTraceur)
[23:17:38] <grrrit-wm>	 (03CR) 10MarkTraceur: "I believe it. Last time I tried testing this it crashed on every patchset, so I'll rebase it when I have time to fix the issues." [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/98141 (owner: 10MarkTraceur)
[23:27:44] <grrrit-wm>	 (03PS1) 10Jforrester: Don't need to specify the sub-repo for Parsoid [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/101452