[00:31:28] <Betacommand>	 anomie: see PM
[05:10:10] <scfc_de>	 Ryan_Lane: https://wikitech.wikimedia.org/wiki/Special:UserRights/Santhosh has "shell" right, but is not listed as a member of the Bastion project.  Could you add him to it, please?
[05:10:28] <Ryan_Lane>	 one sec
[05:11:15] <Ryan_Lane>	 done
[05:12:09] <scfc_de>	 Thanks.  Some old account?
[05:13:35] <Ryan_Lane>	 likely
[05:13:43] <Ryan_Lane>	 man, updating that group is slow as shit
[05:14:40] <scfc_de>	 I think all LDAP updates are.  I asked andrewbogott_afk recently, but he didn't have any obvious idea what could be wrong.
[05:14:56] <scfc_de>	 (Or "optimizable" :-).)
[05:14:57] <Ryan_Lane>	 nah. that group in particular has been for a while
[05:15:07] <Ryan_Lane>	 it's due to its size
[05:15:17] <Ryan_Lane>	 I wonder if I still have virtual groups referencing it
[05:16:26] <scfc_de>	 So you mean it's related to group size?  Because Tools isn't fast either.  Giving either shell access or Tools membership takes about half a minute.
[05:17:27] <Ryan_Lane>	 yep
[05:17:28] <Ryan_Lane>	 same issue
[05:18:08] <Ryan_Lane>	 hm. I really should check to see if any virtual static groups still exist
[05:18:14] <Ryan_Lane>	 it could be causing the issue
[05:18:32] <scfc_de>	 Well, I have no idea what you're talking about, but any speed-up will be appreciated :-).
[05:18:43] <Ryan_Lane>	 http://opendj.forgerock.org/opendj-server/doc/admin-guide/index/chap-groups.html#virtual-static-groups
[05:19:17] <Ryan_Lane>	 we used to use them and don't anymore
[05:19:30] <Ryan_Lane>	 I'll check in a bit. food time
[05:19:54] <scfc_de>	 Bon appetit!
[05:25:29] <wm-bot>	 Change on 12mediawiki a page Wikimedia Labs/status was modified, changed by Vinod modgill link https://www.mediawiki.org/w/index.php?diff=888696 edit summary: vinod modgill
[05:29:50] <wm-bot>	 Change on 12mediawiki a page Wikimedia Labs/status was modified, changed by Tim.landscheidt link https://www.mediawiki.org/w/index.php?diff=888697 edit summary: Undo revision 888696 by [[Special:Contributions/Vinod modgill|Vinod modgill]] ([[User talk:Vinod modgill|talk]])
[08:35:32] <bd808>	 !log logstash Checking to see if irc input is still working
[10:09:42] <matanya>	 mutante: please add me as a member on etherpad project
[10:09:54] <mutante>	 matanya: lol, ok
[10:10:03] <matanya>	 I had to :)
[10:10:13] <mutante>	 I had to as well:)
[10:10:37] <mutante>	 gimme a minute
[10:12:43] <mutante>	 !log etherpad added project member matanya
[10:12:53] <mutante>	 Successfully added matanya to etherpad. 
[10:13:00] <matanya>	 thank you
[10:13:04] <mutante>	 matanya: you know what, adding as member is no problem
[10:13:10] <mutante>	 but before you ask for projectadmin next
[10:13:12] <yuvipanda>	 matanya: and mutante is hard to differentiate on ICR :P
[10:13:19] <mutante>	 for that please request via wiki
[10:13:21] <yuvipanda>	 so many ms, ts, and voweles
[10:13:33] <mutante>	 to make sure there is no NDA issue
[10:13:37] <mutante>	 (i know you have one)
[10:13:51] <mutante>	 for data on that existing instances others have been using
[10:13:52] <matanya>	 i don't need project admin there atm, but thanks
[10:14:03] <mutante>	 what i can do though is create a fresh new instance
[10:14:07] <mutante>	 for now
[10:14:13] <mutante>	 but in that same project
[10:15:29] <matanya>	 etherpad-matanya works for me
[10:16:28] <mutante>	 Created instance i-00000a2f with image "ubuntu-12.04-precise" and hostname i-00000a2f.pmtpa.wmflabs. 
[10:16:42] <mutante>	 https://wikitech.wikimedia.org/wiki/Nova_Resource:I-00000a2f.pmtpa.wmflabs
[10:17:01] <mutante>	 !log etherpad added new instance for etherpad module testing by matanya
[10:17:24] <mutante>	      etherpad-matanya.pmtpa.wmflabs 
[10:17:56] <mutante>	 matanya: remember the pmtpa part will change soonish, you know right
[10:20:42] <andrewbogott>	 hm, morebots broken?
[10:20:47] <mutante>	 yes
[10:20:56] <mutante>	 it was already before today
[10:21:16] <mutante>	 i'm showing my will to log:)
[10:21:48] <mutante>	 because it also nicely ends up on the wikitech project page
[10:22:03] <mutante>	 SAL per project 
[10:24:17] <mutante>	 yea, but also don't know anything about root cause and when it broke exactly
[10:24:44] * andrewbogott  kicks the bot

[11:19:03] <andrewbogott>	 !labs-morebots, feeling ok?
[11:19:03] <labs-morebots>	 I am a logbot running on tools-exec-04.
[11:19:03] <labs-morebots>	 Messages are logged to wikitech.wikimedia.org/wiki/Server_Admin_Log.
[11:19:03] <labs-morebots>	 To log a message, type !log <msg>.
[11:19:14] <andrewbogott>	 !log etherpad added new instance for etherpad module testing by matanya
[11:19:15] <labs-morebots>	 Logged the message, dummy
[11:20:48] <mutante>	 yay, thanks andrewbogott 
[11:20:58] <andrewbogott>	 It won't last :(
[11:21:04] <mutante>	 oops, ok
[11:21:19] <mutante>	 i'll be patient
[11:31:15] * andrewbogott  is out for the day

[11:31:38] <andrewbogott>	 mutante: I didn't mean that I'm still working on morebots, only that it seems to croak every couple of days.
[11:35:56] <mutante>	 andrewbogott_afk: aaah :) ok, thanks and have a nice day
[11:36:40] <mutante>	 !log etherpad added project member matanya
[11:36:41] <labs-morebots>	 Logged the message, Master
[11:37:03] <mutante>	 (hrm, i don't even wanna be Master and have custom name too:)
[12:16:14] <Zuzak>	 I'm getting a bad cert on https://wikitech.wikimedia.org -- is that an issue on my end?
[12:19:30] <Zuzak>	 Companies Lorraine Wants Me To Apply For But I Shan't Because Sam Will Disown Me include but are not limited to: http://www.blurrt.co.uk/
[12:20:53] <Zuzak>	 what the shit is a "bespoke UK English dictionary"
[12:20:58] <Zuzak>	 surely words are words
[12:21:16] <Zuzak>	 WE GOT RID OF AARDVARK BECAUSE IT'S TOO COMPLICATED FOR TWITTER
[16:56:21] <mutante>	  [ERROR] Nagios config validation failed but i'll take it to labs
[16:56:43] <mutante>	 Cron <root@i-0000030d> test -d /root/labsnagiosbuilder/ &&  ...
[16:56:57] <mutante>	 something started failing and mailing there a little while ago
[17:39:15] <Zuzak>	 er, apologies for earlier
[17:50:35] <pancakes9>	 Coren: you there?
[17:50:58] <pancakes9>	 or yuvipanda ?
[17:57:07] <Coren>	 pancakes9: I am, just back from lunch.  What's up?
[18:06:48] <pancakes9>	 Coren: wanted to help out with wikimedia-labs
[18:07:18] <Coren>	 I'm in a meeting in #wikimedia-office atm, but we can talk in a bit if you want.
[18:07:28] <pancakes9>	 Coren: yes!
[18:10:33] <quentinv57>	 Coren, did you have the time to look at my request for a node ? https://bugzilla.wikimedia.org/show_bug.cgi?id=59697
[18:11:05] <Coren>	 quentinv57: I have; it's allocated and installed, only tying it into gridengine remains.
[18:11:55] <quentinv57>	 Coren, okay, thank you :)
[18:13:12] <Coren>	 quentinv57: I'll try to do it today or tomorrow so that you'll have it for the weekend.
[18:13:57] <paravoid>	 can someone give a few details (or point me to docs :)) about the nginx proxy yuvipanda was writing?
[18:15:54] <Coren>	 paravoid: Is, I think, not was.  I think there's something on wikitech about it but I'll need to hunt it down after the -office hours.
[18:56:07] <grrrit-wm>	 (03PS1) 10John F. Lewis: Have WMT repo changes post to the WMT channel [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/109116 
[19:20:25] <grrrit-wm>	 (03CR) 10Legoktm: [C: 032] Have WMT repo changes post to the WMT channel [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/109116 (owner: 10John F. Lewis)
[19:23:12] <legoktm>	 !log tools re-committed password to local repo, not sure why that wasn't committed already
[19:23:14] <labs-morebots>	 Logged the message, Master
[19:23:21] <legoktm>	 !log tools ^ was for grrrit-wm
[19:23:23] <labs-morebots>	 Logged the message, Master
[19:24:59] <legoktm>	 !log tools restarting grrrit-wm now https://gerrit.wikimedia.org/r/#/c/109116/
[19:25:00] <labs-morebots>	 Logged the message, Master
[19:38:10] <hashar>	 !log deployment-prep VisualEditor was not being updated properly because some files belonged to root instead of mwdeploy.  Ran chown -R mwdeploy:mwdeploy /data/project/apache/common-local/php-master/extensions/VisualEditor
[19:38:12] <labs-morebots>	 Logged the message, Master
[19:38:15] <hashar>	 ryasmeen: ^^^
[19:38:42] <ryasmeen>	 okay, thanks hashar
[19:42:08] * pancakes9  waits

[20:09:11] <grrrit-wm>	 (03PS1) 10John F. Lewis: Add initial WMT bot files [labs/tools/WMT] - 10https://gerrit.wikimedia.org/r/109126 
[20:12:39] <grrrit-wm>	 (03CR) 10John F. Lewis: [C: 032 V: 032] "Seems fine as-is. Self merging as this is the just adding all the code." [labs/tools/WMT] - 10https://gerrit.wikimedia.org/r/109126 (owner: 10John F. Lewis)
[22:05:19] <pancakes9>	 Coren: hey are you free now?
[22:05:48] <Coren>	 For a little while; you left just before I returned earlier.  What can I do for you?
[22:07:09] <pancakes9>	 how can I start helping out
[22:08:45] <Coren>	 With labs in general?  There are lots of ways; one of the easiest is to skim through the bugzilla reports and see if there are things you feel comfortable doing -- many are easy and require just a small patch to do.
[22:08:56] <Coren>	 It depends greatly on where your skills like, really.  What do you do?
[22:11:44] <Coren>	 https://bugzilla.wikimedia.org/buglist.cgi?list_id=270182&resolution=---&resolution=LATER&resolution=DUPLICATE&query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=PATCH_TO_REVIEW&bug_status=REOPENED&component=General&component=Infrastructure&component=tools&component=wikitech-interface&product=Wikimedia%20Labs
[22:11:52] <Coren>	 Ugly long link, but right place.  :-)
[22:13:59] <pancakes9>	 Coren: okay, I will check that out, thanks!
[22:14:33] <Coren>	 Sharing your expertise on IRC is also very useful, especially to the newer devs.
[22:28:35] <scfc_de>	 wm-bot: ping
[22:28:35] <wm-bot>	 Hi scfc_de, there is some error, I am a stupid bot and I am not intelligent enough to hold a conversation with you :-)
[22:28:39] <scfc_de>	 @seen ldavis
[22:28:39] <wm-bot>	 scfc_de: Last time I saw ldavis they were quitting the network with reason: Quit: ldavis N/A at 1/23/2014 7:56:31 PM (2h32m8s ago)
[23:04:08] <Technical_13>	 @seen anomie
[23:04:08] <wm-bot>	 Technical_13: Last time I saw anomie they were quitting the network with reason: Quit: ... N/A at 1/23/2014 10:57:14 PM (6m53s ago)
[23:04:15] <Technical_13>	 ...
[23:04:35] <Technical_13>	 Hopefully he comes back shortly...
[23:04:58] <Technical_13>	 AnomieBOT quite updating the XPERTable's about 4.5 hours ago.
[23:28:40] <grrrit-wm>	 (03PS1) 10John F. Lewis: Fix rcreader.php format [labs/tools/WMT] - 10https://gerrit.wikimedia.org/r/109254 
[23:29:53] <grrrit-wm>	 (03CR) 10John F. Lewis: [C: 032 V: 032] "Exactly as it says. Fixes the format." [labs/tools/WMT] - 10https://gerrit.wikimedia.org/r/109254 (owner: 10John F. Lewis)
[23:29:56] <grrrit-wm>	 (03CR) 10PiRSquared17: "Fine. Thx." [labs/tools/WMT] - 10https://gerrit.wikimedia.org/r/109254 (owner: 10John F. Lewis)
[23:47:33] <Krinkle>	 Any known issues with 'tools-db'?
[23:48:07] <Krinkle>	 https://tools.wmflabs.org/cropbot/cropbot.php?img=Viliami%20Uasike%20Latu.jpg is showing a MySQL connectivity problem with 'tools-db'
[23:49:54] <scfc_de>	 bgwhite reported earlier https://bugzilla.wikimedia.org/show_bug.cgi?id=60382, but didn't specify which server he meant.
[23:51:14] <scfc_de>	 "/mnt" seems to be full on tools-db
[23:51:55] <scfc_de>	 Coren: How do you solve that usually?
[23:52:57] <scfc_de>	 "/dev/vdb       165139820 156751812         0 100% /mnt"
[23:55:37] <scfc_de>	 Coren: There's 6 GByte free on /.  Shutdown mysql, move some directories to /var/lib/mysql2, replace with symlinks, restart mysql?
[23:56:51] <scfc_de>	 Doing so now ...
[23:58:39] <scfc_de>	 "service mysql stop" is hanging.