[08:54:13] <dan-nl>	 anyone happen to know how to add a mediawiki template to the mw instance that runs with the jenkins tests?
[10:43:23] <quentinv57>	 Hi. Could somebody please tell me if we still should use tools-login.wmflabs.org, or if it has changed ?
[10:43:28] <quentinv57>	 Thanks by advance
[12:00:40] <a930913>	 quentinv57: Yes, it's still a bastion.
[12:47:09] <quentinv57>	 thanks a930913... I was confused because the fingerprint changed
[13:03:07] <a930913>	 quentinv57: Moved from pmtpa to eqiad a while back.
[13:03:44] <quentinv57>	 a930913, yes, I noticed, but I hadn't the time to connect via SSH before now
[13:42:18] * Coren  returns from vacation with ~1200 email to catch up to. Yeay.

[13:44:01] <andrewbogott>	 welcome back!
[13:44:13] * andrewbogott  has caught up on most email thanks to jet-lag insomnia

[13:44:30] * a930913  bets that over half of Coren's emails are from various people here rage asking where he is.

[13:44:58] <sumanah>	 hi Coren  and welcome back
[13:45:07] <Coren>	 andrewbogott: You get jet lag insomnia?  I get jet lag coma instead.  :-)
[13:45:39] <andrewbogott>	 Coren:  both!  alternating
[13:47:32] <a930913>	 Bah, you guys have it lucky. You try keeping American times in the UK.
[14:03:55] <phe>	 I'm submitting a job, a python script, with a $ jsub -N  .... it works fine, but if I do $ jsub -once -continuous -N ... I get a : ImportError: No module named pywikibot. In the tools ~/.profile I've export PYTHONPATH=/shared/....
[14:03:55] <phe>	 is it normal the job env look like different with -once -continous ?
[14:05:41] <wikibugs>	 3Wikimedia Labs / 3tools: Expose revision.rev_content_format on replicated wikidatawiki - 10https://bugzilla.wikimedia.org/54164#c5 (10Marc A. Pelletier) 5REO>3ASS Ah, hm.  It fails to apply because my view management system right now does not properly deal with the concept that the same schema doesn't a...
[14:08:12] <Coren>	 phe: Not specifically, but there is an extra level of indirection that might confuse things is your .bashrc is different from your .profile (one often wants to source the former from the latter to be certain)
[14:08:51] <Coren>	 phe: That is, you probably want to set your environment in .bashrc, and source that with ". ~/.bashrc" in .profile
[14:09:00] <phe>	 Coren, ok
[14:09:38] <Coren>	 Yes, IMO, that's silly behaviour -- but it's bash's normal behaviour.
[14:29:13] <wikibugs>	 3Wikimedia Labs / 3deployment-prep (beta): beta labs mysteriously goes read-only overnight - 10https://bugzilla.wikimedia.org/65486 (10Chris McMahon) 3NEW p:3Unprio s:3normal a:3None I've been seeing this in the overnight runs of the browser tests in recent times. The build for VisualEditor will fail...
[14:32:41] <wikibugs>	 3Wikimedia Labs / 3tools: root's crontab on tools-submit produces daily error - 10https://bugzilla.wikimedia.org/65027#c1 (10Marc A. Pelletier) 5NEW>3RES/FIX Indeed it was.  Fix't.
[14:34:17] <bd808>	 !log deployment-prep Restarted logstash service on deployment-logstash1; it stopped logging new events at 10:37:13Z
[14:34:19] <labs-morebots>	 Logged the message, Master
[14:35:58] <wikibugs>	 3Wikimedia Labs / 3tools: Create views for user_daily_contribs table - 10https://bugzilla.wikimedia.org/61300#c6 (10Marc A. Pelletier) 5NEW>3ASS a:5Marc A. Pelletier>3Sean Pringle Dumping in Sean's capable hands; once the actual data has been replicated I'll add a view to it.
[14:47:12] <wikibugs>	 3Wikimedia Labs / 3Infrastructure: filearchive table not available on labs - 10https://bugzilla.wikimedia.org/61813#c9 (10Marc A. Pelletier) There is, IMO, a plausible issue with the SHA but I don't know whether it is relevant for legal: its primary use case is (of course) to note files which have been previ...
[14:48:33] <JohannesK_WMDE>	 hi all :)
[14:49:54] <JohannesK_WMDE>	 i've created a new instance, and 15 minutes after booting, in Special:NovaInstance it says 'Puppet status: failed'. in 'get console output', i see lots of messages like 'May 19 14:40:18 cgtest nslcd[1120]: [6d8d3c] <group=50062> error writing to client: Broken pipe'
[14:49:59] <JohannesK_WMDE>	 anybody seen this before?
[14:51:02] <Steinsplitter>	 mabye you need to wait for the next puppet run?
[14:52:13] <wikibugs>	 3Wikimedia Labs / 3tools: create a node for dexbot service group which runs the user:dexbot - 10https://bugzilla.wikimedia.org/65199#c1 (10Marc A. Pelletier) 5NEW>3ASS Sounds legit.  :-)
[14:53:48] <bd808>	 JohannesK_WMDE: nscld is the ldap lookup service. I have seen it flake out on occasion. My first attempt to fix would be to reboot the instance. Crude, but often effective.
[15:02:10] <matanya>	 JohannesK_WMDE: try to force a puppet run before the reboot
[15:14:54] <JohannesK_WMDE>	 puppet was also disabled for some reason... ran puppet agent --enable, puppetd -tv, then rebooted... things look ok now. thanks for the tips matanya, bd808
[15:15:19] <matanya>	 :)
[15:24:33] <Coren>	 Down to ~400 email
[15:41:03] <phe>	 Coren, I can't make it working, even a simple $ jsub -once -continuous -l h_vmem=512M -N test_env /bin/bash -c "env" 
[15:41:03] <phe>	 doesn't show in test_env.out anything coming from .profile or .bashrc
[15:41:03] <phe>	 w/o -once -continuous it works, the environment seems altered by -once -continuous after .profile is read, SHELL and SGE_O_SHELL seems ok == "/bin/bash"
[15:42:16] <Coren>	 phe: ... that's really odd.  Please open a bugzilla for it, I'll need to look deeper into it.
[15:42:37] <Coren>	 I'll try to take a look at it in a few hours after I caught up on mail and urgent stuff.
[15:43:13] <a930913>	 Coren: phe: I gave up trying to use shared pywikibot and just installed it locally.
[15:44:32] <phe>	 a930913, it works for me, it even works with jsub, the only pb come from jsub -once -continuous, the env doesn't contains the needed PYTHONPATH=
[15:45:42] <Coren>	 phe: And, just as a silly check, you do /export/ that variable and not just set it, right?
[15:46:05] <phe>	 Coren, yeps export PYTHONPATH=/shared/pywikipedia/core:/shared/pywikipedia/core/externals/h\
[15:46:05] <phe>	 ttplib2:/shared/pywikipedia/core/scripts
[15:46:19] <Coren>	 Yeah, that should work.
[16:00:44] <a930913>	 Anybody know how to parse wikitext for image captions?
[16:04:37] <a930913>	 @notify Earwig|away 
[16:04:37] <wm-bot>	 This user is now online in #wikimedia-labs. I'll let you know when they show some activity (talk, etc.)
[16:14:29] <wikibugs>	 3Wikimedia Labs / 3tools: running job with SGE doesn't get the right environment when using -once -continuous - 10https://bugzilla.wikimedia.org/65491 (10Philippe Elie) 3NEW p:3Unprio s:3major a:3Marc A. Pelletier When I run a python job using pywikibot it works with a simple jsub but fails to import...
[16:15:16] <a930913>	 Coren: How many mails now? :)
[16:22:45] <grrrit-wm>	 (03Abandoned) 10Incola: Add .gitignore [labs/tools/maintgraph] - 10https://gerrit.wikimedia.org/r/133770 (owner: 10Incola)
[16:31:56] <dschwen>	 Hi all. How can I access a tools webservice from tools-logon?
[16:32:20] <dschwen>	 curl -m 5 'http://tools.wmflabs.org/zoomviewer/index.php' > /dev/null 2>&1     always times out
[16:33:14] <a930913>	 dschwen: Use tools-webproxy I think.
[16:33:52] <a930913>	 dschwen: So, curl -m 5 'http://tools-webproxy/zoomviewer/index.php' > /dev/null 2>&1
[16:38:48] <dschwen>	 thx, that works
[16:39:07] <dschwen>	 but why in god's name is curl on tools-login pestering me to "Supply a filename!" ?
[16:39:16] <dschwen>	 that is not curl's standard behavior
[16:39:26] <dschwen>	 I cannot even specify "-o -"
[16:40:01] <dschwen>	 Is somebody trying to "protect" me from "accidentally" spilling data to my termonal?
[16:54:25] <jem->	 Hi, Tool-Labs question, does anyone know about the connectivity tool, or Lvova? (or an alternate tool to show most linked disambiguations not just for enwiki)
[17:00:14] <a930913>	 petan: Poke?
[17:38:41] <wikibugs>	 3Wikimedia Labs / 3tools: running job with SGE doesn't get the right environment when using -once -continuous - 10https://bugzilla.wikimedia.org/65491#c1 (10Philippe Elie) typo, I meant /data/project/phetools/test_env.out.good and /data/project/phetools/test_env.out.bad
[17:52:57] <grrrit-wm>	 (03PS1) 10Yuvipanda: Move multimedia related bugs to #wikimedia-multimedia [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134140 
[17:55:53] <grrrit-wm>	 (03PS2) 10Yuvipanda: Move multimedia related bugs to #wikimedia-multimedia [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134140 
[18:05:30] <grrrit-wm>	 (03CR) 10MarkTraceur: [C: 031] Move multimedia related bugs to #wikimedia-multimedia [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134140 (owner: 10Yuvipanda)
[18:06:39] <YuviPanda>	 valhallasw: ^ +2? I don't have rights :'(
[18:07:17] <valhallasw>	 YuviPanda: let me fix that for you
[18:07:37] <valhallasw>	 YuviPanda: you should have +2?
[18:07:42] <YuviPanda>	 valhallasw: yeah
[18:07:44] <YuviPanda>	 i hope? :)
[18:07:46] <YuviPanda>	 oh
[18:07:46] <valhallasw>	 according to group labs-tools-pywikibugs
[18:07:47] <YuviPanda>	 now
[18:08:03] <grrrit-wm>	 (03CR) 10Yuvipanda: [C: 032 V: 032] Move multimedia related bugs to #wikimedia-multimedia [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134140 (owner: 10Yuvipanda)
[18:08:04] <YuviPanda>	 valhallasw: hmm, I do
[18:08:06] <valhallasw>	 I think qchris added you somewhere today
[18:08:09] <YuviPanda>	 valhallasw: dunno why it didn't show up the last time
[18:08:59] <valhallasw>	 also added you and legoktm as group admins
[18:09:09] <YuviPanda>	 valhallasw: cool! :D
[18:09:20] <YuviPanda>	 valhallasw: I'm hopping around talking to the different teams moving things off -dev
[18:09:37] <valhallasw>	 Sure. Maybe we should also move stuff back, as legoktm suggested?
[18:09:46] <valhallasw>	 should be as easy as adding it explicitly to the -dev channel
[18:10:10] <YuviPanda>	 valhallasw: which stuff? and where was it suggested?
[18:10:10] * YuviPanda  looks at list archives

[18:10:25] <valhallasw>	 coreextensions stuff
[18:10:27] <valhallasw>	 iir
[18:10:28] <valhallasw>	 c
[18:11:00] <YuviPanda>	 valhallasw: ah, in that case I think it makes sense to change grrrit-wm's behavior
[18:11:07] <YuviPanda>	 less spam on -dev the better
[18:11:21] <valhallasw>	 sure
[18:11:27] <YuviPanda>	 legoktm: ^
[18:13:27] <grrrit-wm>	 (03PS1) 10Yuvipanda: Add GWToolset to #wikimedia-multimedia [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134147 
[18:14:42] <YuviPanda>	 marktraceur: quick review? https://gerrit.wikimedia.org/r/#/c/134147/
[18:15:56] <grrrit-wm>	 (03CR) 10MarkTraceur: [C: 031] Add GWToolset to #wikimedia-multimedia [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134147 (owner: 10Yuvipanda)
[18:16:10] <grrrit-wm>	 (03CR) 10Yuvipanda: [C: 032 V: 032] Add GWToolset to #wikimedia-multimedia [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134147 (owner: 10Yuvipanda)
[18:21:05] <palerdot>	 hi this is palerdot. new to both wikitech and this channel. I recently signed up for wikitech developer access and got a message that I can log into bastion
[18:21:13] <palerdot>	 i need some help on how to proceed further
[18:21:54] <apper>	 I tried to join a commons table with a table from dewiki, but had no success (on Tool Labs). I connected to dewiki ("sql dewiki") and tried a simple query ("SELECT * FROM page LIMIT 0,1;"). This worked fine. Now I wanted to test the same with the foreign table, but this gives no result ("SELECT * FROM commonswiki_f_p.page LIMIT 0,1;"). The syntax seems to work, because I get an error message, if I write something different, but this query
[18:21:54] <apper>	 gives no result (at least for some minutes now...)
[18:22:25] <palerdot>	 i ssh ed into palerdot@bastion.wmflabs.org and i'm clueless on what to do next.
[18:25:15] <grrrit-wm>	 (03PS1) 10Yuvipanda: Move Growth related extensions to #wikimedia-growth [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134150 
[18:26:19] <grrrit-wm>	 (03CR) 10Swalling: [C: 031] "Please do." [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134150 (owner: 10Yuvipanda)
[18:26:59] <andrewbogott>	 palerdot: I'm in a meeting at the moment but can help in ~30 mins.
[18:27:12] <grrrit-wm>	 (03CR) 10Mattflaschen: [C: 031] "Channels are correct." [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134150 (owner: 10Yuvipanda)
[18:27:33] <grrrit-wm>	 (03CR) 10Yuvipanda: [C: 032 V: 032] "Thanks!" [labs/tools/pywikibugs] - 10https://gerrit.wikimedia.org/r/134150 (owner: 10Yuvipanda)
[18:28:06] <palerdot>	 andrewbogott: thank you for the help. I will wait till you are available. thanks again
[18:28:50] <grrrit-wm>	 (03PS1) 10Yuvipanda: Move growth things to #wikimedia-growth [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/134153 
[18:30:33] <grrrit-wm>	 (03CR) 10Swalling: [C: 031] "LGTM" [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/134153 (owner: 10Yuvipanda)
[18:31:01] <grrrit-wm>	 (03CR) 10Yuvipanda: [C: 032 V: 032] Move growth things to #wikimedia-growth [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/134153 (owner: 10Yuvipanda)
[18:31:47] <apper>	 I got a result... But shouldn't a query like "SELECT * FROM commonswiki_f_p.page LIMIT 0,1;" be faster than 2 minutes from dewiki?
[18:35:16] <grrrit-wm>	 (03PS1) 10Yuvipanda: Remove duplication of -multimedia extensions from -dev [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/134154 
[18:38:57] <wikibugs>	 3Wikimedia Labs / 3tools: running job with SGE doesn't get the right environment when using -once -continuous - 10https://bugzilla.wikimedia.org/65491#c2 (10Philippe Elie) Looking the man page http://cf.ccmr.cornell.edu/cgi-bin/w3mman2html.cgi?qsub%281B%29 environment var are not exported to the job, it's th...
[18:56:26] <andrewbogott>	 palerdot: ok, I have a few minutes now… can you tell me what you're hoping to do?
[19:03:26] <palerdot>	 andrewbogott: i just want to get to know about developer access and how one can use it for contributing
[19:03:51] <andrewbogott>	 palerdot: OK… labs is divided into projects, each of which has its own access policy.
[19:04:04] <andrewbogott>	 So until you know what you want to do/who you're doing it with… I'm not sure where to start :)
[19:04:21] <andrewbogott>	 If you want shell access to write a tool or a bot, that would be the 'tools' project.
[19:04:29] <palerdot>	 oh ok. i signed up to clone the mediawiki repository from git
[19:05:17] <palerdot>	 so that i can browse around the code and get to know the wikipedia development stack. 
[19:05:53] <andrewbogott>	 ok!  That you can do locally without logging into labs.  Or you can set up 'vagrant' and get a mediawiki dev environment set up locally.
[19:06:12] <andrewbogott>	 (or we can set you up with a mw dev environment on labs, but that's probably the most trouble and I don't know that that helps you.)
[19:06:18] <andrewbogott>	 Lemme find some vagrant docs
[19:07:00] <andrewbogott>	 palerdot: what are you running on your local machine?  windows/linux/mac/???
[19:07:06] <palerdot>	 linux ubuntu
[19:07:43] <palerdot>	 let us say if i set up a local environment what should i do to push some code to the project ?
[19:08:12] <andrewbogott>	 If you want a local checkout of the source (without a running server or anything) just do this:
[19:08:13] <andrewbogott>	 git clone https://gerrit.wikimedia.org/r/p/mediawiki/core.git
[19:08:38] <andrewbogott>	 The account that you just now created will provide you with 'gerrit' access, which is the system we use to submit and review patches.
[19:09:07] <andrewbogott>	 So in order to submit a patch, you'd want to log into gerrit.wikimedia.org (using the same credentials as on wikitech) and upload an ssh public key there.
[19:09:21] <palerdot>	 ok! i just now did that
[19:09:35] <andrewbogott>	 Then you can submit patches with just 'git review'
[19:09:54] <andrewbogott>	 presuming everything goes well with auth on gerrit, patches will appear publicly for others to view, review, merge on gerrit.wikimedia.org
[19:10:11] <palerdot>	 ok! i believe i still need to know a lot more things before i could contribute anything meaningful to mediawiki
[19:10:16] <andrewbogott>	 palerdot: to set up a local test/dev box, try this:  https://www.mediawiki.org/wiki/MediaWiki-Vagrant#Quick_start
[19:10:35] <andrewbogott>	 It's really slick, gets you a local VM running a mediawiki web server on your local machine.
[19:10:52] <andrewbogott>	 So you can muck around with the MW source and break things :)
[19:10:58] <palerdot>	 ok! thanks! will definitely try that. 
[19:11:04] <palerdot>	 and by the way thanks for the help
[19:11:07] <andrewbogott>	 sure thing.
[19:11:09] <palerdot>	 this is my first irc chat
[19:11:14] <andrewbogott>	 :)
[19:11:25] <palerdot>	 i cannot believe people here took their time to help me out
[19:11:34] <andrewbogott>	 Labs comes into play if you have a project that you want to host in a public place so other people can see your work.
[19:11:51] <andrewbogott>	 So for instance if you write a custom extension or something like that (rather than just a minor bugfix) and want to demonstrate it
[19:11:54] <palerdot>	 oh ok ! i will set up a local environment and see how it goes
[19:11:59] <andrewbogott>	 you'd set up a labs server so that other people can visit.
[19:12:09] <andrewbogott>	 Yep, local env will be easier in the meantime.
[19:12:32] <palerdot>	 is it something like a google appspot 
[19:13:00] <andrewbogott>	 hm, maybe?  I don't know what that is :)
[19:13:22] <palerdot>	 ok! thanks! will start with setting up a local environment
[19:13:47] <palerdot>	 is php knowledge enough to get to know mediawiki ?
[19:15:13] <andrewbogott>	 yep, should be.
[19:15:27] <andrewbogott>	 There's some javascript in there but I'm always able to ignore it
[19:16:37] <palerdot>	 ok! great! thanks again for the help! i'm going off for a while now. Hope we will have more great conversations here in future
[19:16:41] <palerdot>	 bye !
[19:16:45] <andrewbogott>	 good luck!
[19:16:51] <palerdot>	 thanks !
[19:44:41] <wikibugs>	 3Tool Labs tools / 3Matthewrbowker's tools: MATTHEWRBOWKER-8 On-IRC help system for WikiWelcomer - 10https://bugzilla.wikimedia.org/59067 (10Andre Klapper) s:5critic>3enhanc
[20:19:12] <andrewbogott>	 YuviPanda: if you're still awake, should we try to upgrade nginx again?
[20:19:19] <andrewbogott>	 (And, I guess by 'we' I mean 'you')
[20:19:27] <YuviPanda>	 andrewbogott: sure
[20:20:29] <YuviPanda>	 andrewbogott: tools first?
[20:20:36] <andrewbogott>	 Either way.
[20:20:41] <YuviPanda>	 ok tools first
[20:20:50] <YuviPanda>	 sshing in now
[20:20:58] <andrewbogott>	 http://tools.wmflabs.org/ uses the tools proxy?
[20:21:21] <YuviPanda>	 yup
[20:21:23] <valhallasw>	 YuviPanda: please tests if the pywikibot nightlies work afterwards ;-)
[20:21:33] <valhallasw>	 or poke me to do that
[20:22:50] <YuviPanda>	 valhallasw: sure
[20:24:26] <YuviPanda>	 valhallasw: test now?
[20:24:48] <valhallasw>	 seems to work
[20:24:53] <YuviPanda>	 andrewbogott: ^
[20:24:58] <YuviPanda>	 everything seems alright
[20:25:00] <valhallasw>	 not very fast though
[20:25:02] <YuviPanda>	 scfc_de: just upgraded nginx on tools
[20:25:06] <andrewbogott>	 yep, looks ok to me.
[20:25:07] <YuviPanda>	 valhallasw: slower than before?
[20:25:07] <valhallasw>	 ~ 130 KB/s
[20:25:10] <valhallasw>	 instead of 2MB/s
[20:25:27] <YuviPanda>	 I'm on terrible internet so would be a terrible person to test, can someone else check?
[20:25:31] <YuviPanda>	 valhallasw: can you paste a link?
[20:25:48] <valhallasw>	 http://tools.wmflabs.org/pywikibot/core.tar.gz
[20:26:11] <YuviPanda>	 andrewbogott: do you have a fast enough connection to check speed on ^?
[20:26:27] <valhallasw>	 basically, gzipping gzipped content makes no sense, and makes the proxy unhappy, I think :-p
[20:26:35] <YuviPanda>	 I don't think we're doing that
[20:26:41] <YuviPanda>	 mime types are explicitly whitelisted
[20:26:43] <YuviPanda>	 for gzipping
[20:26:46] <andrewbogott>	 I'm getting around 1.5 M/s
[20:27:31] <andrewbogott>	 valhallasw: is it still slower if you try again?  Maybe restarting nginx invalidated a cache someplace?
[20:28:06] <valhallasw>	 ~600KB/s now. Maybe it's actually my connection that's crappy :/
[20:28:11] <YuviPanda>	 andrewbogott: while you are here, care to merge https://gerrit.wikimedia.org/r/#/c/133265/
[20:28:11] <YuviPanda>	 ?
[20:28:17] <YuviPanda>	 andrewbogott: and https://gerrit.wikimedia.org/r/#/c/133266/
[20:31:32] <andrewbogott>	 YuviPanda: you upgraded nginx on the labs proxy as well?
[20:31:49] <YuviPanda>	 andrewbogott: nope, thinking of letting it simmer in tools for a while
[20:31:55] <andrewbogott>	 ok
[20:32:10] <YuviPanda>	 andrewbogott: tomorrow perhaps?
[20:32:13] <andrewbogott>	 sure
[20:32:43] <YuviPanda>	 !log tools upgraded nginx on tools-webproxy... again.
[20:39:51] <scfc_de>	 I get about 1.5 MByte/s for core.tar.gz.
[20:40:14] <scfc_de>	 YuviPanda: What would be the downgrade procedure (just in case)?
[20:40:58] <YuviPanda>	 scfc_de: 1. rm 1.7 nginx from /data/project/.system/debs/all and amd64 2. run update-repos.sh in debs, 3. do apt-get update 4. apt-get install nginx-extras 5. run puppetd -tv
[20:42:08] <scfc_de>	 Does that downgrade the nginx package?
[20:42:17] <YuviPanda>	 yup, since that'll leave the 1.5 packages there
[20:42:43] <scfc_de>	 But if 1.7 is already installed, wouldn't it just keep that installed (and running)?
[20:43:34] <scfc_de>	 (Never tried if Puppet => latest downgrades if that would be the conclusion.)
[20:43:34] <YuviPanda>	 scfc_de: I think the install downgrades it? if not you can always just do a dpkg -i of both common (in all) and extras (in amd64)
[20:44:05] <scfc_de>	 For the moment, let's hope it works :-).  What were the symptoms last time?
[20:45:27] <YuviPanda>	 scfc_de: :) 503s
[20:45:33] <YuviPanda>	 scfc_de: but those were from redis, as we later discovered
[20:50:14] <grrrit-wm>	 (03Abandoned) 10Adamw: Reformat using a slightly more yaml-y style [labs/tools/grrrit] - 10https://gerrit.wikimedia.org/r/112311 (owner: 10Adamw)
[21:07:19] <se4598>	 bits.beta.wmflabs.org is bitchy :(
[21:44:51] <mwalker>	 andrewbogott, with regards to the trusty image; have you done any further testing in order to remove the provisional status of that image? paravoid and I brokered a deal with greg-g that I would either release PDF into betalabs on a non testing image or as a beta feature using the real hardware I already have
[21:45:00] <mwalker>	 but that relies on a non provisional image
[21:45:15] <mwalker>	 alternatively; if you think it's stable enough to work with I can just use it
[21:45:32] <andrewbogott>	 mwalker: Should be relatively close to release; ask me again tomorrow :)
[21:45:37] <mwalker>	 kk
[21:45:44] <andrewbogott>	 Best not to create anything based on the 'testing' image though, as I'm hoping to replace it.
[21:45:52] <andrewbogott>	 And VMs die if their parent image is removed.
[21:45:56] <mwalker>	 makes sense
[22:11:08] <andrewbogott>	 Coren: is wikitech treating you ok just now?
[22:12:14] <mutante>	 andrewbogott: 15:11 <+icinga-wm> PROBLEM - LDAP on virt1000 is CRITICAL: Connection refused  
[22:12:16] <andrewbogott>	 Ah, that'd be it
[22:12:19] <Coren>	 andrewbogott: It logged me out and won't log me back in.
[22:12:23] <Coren>	 Ah, clearly.
[22:12:28] <Coren>	 andrewbogott: Want me to go look?
[22:13:04] <andrewbogott>	 Coren: Sure… I'm looking too.
[22:13:24] <Coren>	 Hm.  It's running.
[22:13:49] <Coren>	 But apparently not listening.
[22:15:04] * andrewbogott  wonders for the 10th time why having a backup on virt0 does not help

[22:15:24] <andrewbogott>	 Coren:  Shall I restart opendj or do you think there are other interesting things to look for first?
[22:15:36] <Coren>	 I'm not sure the openldap auth extension to mediawiki actually uses a backup.
[22:15:38] <Coren>	 Though most other things will.
[22:16:07] <Coren>	 andrewbogott: I had already scoured the logs to no avail and I just restarted it.
[22:16:19] <andrewbogott>	 ok
[22:16:33] <Coren>	 andrewbogott: Hoping to see something interesting during its startup -- or more precisely hoping to /not/ see anything.  :-)
[22:16:47] <andrewbogott>	 I guess it can't be a firewall issue since it's the same host
[22:16:57] <Coren>	 aaand... that worked.
[22:17:07] * Coren  growls at opendj.

[22:18:32] <andrewbogott>	 ok, I'm going to restart pdns since it usually freaks out when opendj restarts
[22:47:23] <twentyafterfour>	 so I supposedly have bastion shell access but the bastion host seems to be expecting a key that I don't have. do I need to submit my ssh public key somewhere to have it added to authorized_keys on labs hosts? 
[22:55:08] <Krenair>	 twentyafterfour, you need to add it to your public keys list in wikitech preferences
[22:55:20] <Krenair>	 (iirc)
[23:00:59] <twentyafterfour>	 Krenair: I see, thanks! I'm in