[00:43:55] <grrrit-wm>	 (PS1) Jdlrobson: Story 1630: Add a graph counting thanks [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110112
[00:52:47] <grrrit-wm>	 (PS1) Edenhill: Fixes for Ottomata's gerrit review comments [analytics/kafkatee] - https://gerrit.wikimedia.org/r/110115
[00:53:19] <grrrit-wm>	 (CR) Edenhill: "Fixed in latest commit." (2 comments) [analytics/kafkatee] - https://gerrit.wikimedia.org/r/109505 (owner: Edenhill)
[01:40:46] <Ironholds>	 hmn, so, that's interesting
[01:40:59] <Ironholds>	 hive queries executed through the terminal without going into hive seem to, ah.
[01:41:05] <Ironholds>	 not particularly enjoy finishing
[01:41:57] * Ironholds  resists the urge to file a bug titled 'hadoop client on stat2 has anorgasmia'

[03:16:39] <grrrit-wm>	 (PS3) Edenhill: Initial kafkatee [analytics/kafkatee] - https://gerrit.wikimedia.org/r/109505
[03:18:02] <grrrit-wm>	 (Abandoned) Edenhill: OSX compilation fixes [analytics/kafkatee] - https://gerrit.wikimedia.org/r/109683 (owner: Edenhill)
[03:18:35] <grrrit-wm>	 (Abandoned) Edenhill: Fixes for Ottomata's gerrit review comments [analytics/kafkatee] - https://gerrit.wikimedia.org/r/110115 (owner: Edenhill)
[15:50:05] <grrrit-wm>	 (CR) Milimetric: [C: 2 V: 2] "Ran the new generate in prod and it looked good. You'll have to "fab mobile_reportcard deploy.only_data" to get the graph up." [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110112 (owner: Jdlrobson)
[15:52:20] <grrrit-wm>	 (CR) Milimetric: "(I deployed the graph as well)" [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110112 (owner: Jdlrobson)
[15:58:20] <grrrit-wm>	 (PS1) Milimetric: Fix flake8 errors [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/110196
[16:00:11] <milimetric>	 ottomata: so I  totally hosed myself by running scripts/install
[16:00:22] <milimetric>	 so here's my proposal
[16:01:13] <milimetric>	 someone helped me figure out how to link to the pywikibot httplib2 right from setup.py
[16:01:35] <milimetric>	 so when I fix my environment, I'm gonna try turning scripts/install into a two liner:
[16:01:41] <milimetric>	 sudo pip uninstall httplib2
[16:01:44] <milimetric>	 sudo pip install -e .
[16:02:04] <ottomata>	 hmmmm ok, but
[16:02:04] <ottomata>	 we need to upgrade pip
[16:02:20] <ottomata>	 and, running scripts in stall repeatedly seems to not hurt me
[16:02:59] <milimetric>	 worksforme is not gonna work here though :)
[16:03:22] <milimetric>	 because apparently one of those upgrade lines hits some bug that requires pip==1.5
[16:03:25] <milimetric>	 and I have 1.5.2
[16:03:43] <milimetric>	 so now my pip 100% doesn't work
[16:08:10] <ottomata>	 hm
[16:12:44] <grrrit-wm>	 (CR) Ottomata: Initial kafkatee (2 comments) [analytics/kafkatee] - https://gerrit.wikimedia.org/r/109505 (owner: Edenhill)
[16:19:14] <milimetric>	 ok ottomata: fixed my pip, had to rm -r a bunch of directories, install easy_install again, then use easy_install to upgrade pip
[16:19:51] <milimetric>	 so can I try simplifying the install script and can you test it in puppet world?
[16:21:26] <ottomata>	 hm, ok
[16:30:08] <grrrit-wm>	 (PS1) Milimetric: Fix Bug: 60095 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/110200
[16:31:13] <milimetric>	 ottomata: it didn't work in the simplified way :(
[16:31:55] <drdee>	 have you guys considered virtualenv?
[16:32:54] <ottomata>	 milimetric: should you have also removed the custom httplib2 install code from scripts/install, if pip does it now?
[16:33:08] <ottomata>	 drdee, oof, virtualenv + vagrant + puppet sounds nasstaayyy
[16:33:12] <milimetric>	 :)
[16:33:24] <milimetric>	 people seem to get it working in virtualenv drdee
[16:33:27] <milimetric>	 same as local
[16:33:36] <milimetric>	 so I think it works fine
[16:33:43] <milimetric>	 but I don't want to require virtualenv
[16:33:49] <milimetric>	 ottomata: I didn't change the script
[16:33:50] <drdee>	 uninstalling libs that people have installed also sounds nasty ;)
[16:34:06] <milimetric>	 I just added some echoing at the bottom to link to the problems it can cause
[16:34:15] <milimetric>	 nah, this is benign
[16:35:10] <ottomata>	 right, but you added to requirements, rigth?
[16:35:17] <ottomata>	 which means pip should be able to take care of it?  or i guess i'm wrong?
[16:43:13] <milimetric>	 nope, didn't change requirements ottomata
[17:33:55] <grrrit-wm>	 (CR) Ottomata: [C: 2] "Looks great to me!" [analytics/kafkatee] - https://gerrit.wikimedia.org/r/109505 (owner: Edenhill)
[17:35:09] <grrrit-wm>	 (CR) Ottomata: "Faidon, as far as I can tell, as is this depends on libyajl2, which has only recently been uploaded to debian unstable. Magnus says that " [analytics/kafkatee] - https://gerrit.wikimedia.org/r/109505 (owner: Edenhill)
[18:04:24] <grrrit-wm>	 (CR) Milimetric: [C: 2 V: 2] Fix Bug: 60095 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/110200 (owner: Milimetric)
[18:21:15] <ottomata>	 milimetric: seems good
[18:21:24] <milimetric>	 cool
[18:21:38] <milimetric>	 yeah, i tried various ways of grabbing the right httplib automatically
[18:21:45] <milimetric>	 and I think I'm just not as cool as Merlijn
[18:21:46] <milimetric>	 :)
[21:54:11] <DarTar>	 hey halfak|Lunch, running a bit late, I'll be there around 2.10 pt
[21:55:15] <halfak|Lunch>	 ok
[21:55:19] <halfak|Lunch>	 no worries/
[21:55:27] * halfak  finished lunch a long time ago 

[21:59:39] <Ironholds>	 hey tnegrin, poke me when you get in from whenever you are? (Assuming you haven't gone home). I have something cool to show you.
[21:59:52] <tnegrin>	 5 mins
[22:01:30] <Ironholds>	 kk
[22:13:17] <sayhar>	 Hello hello
[22:18:18] <milimetric>	 hi sayhar
[22:18:26] <milimetric>	 <-- Dan Andreescu
[22:18:58] <sayhar>	 Hi dan
[22:19:20] <sayhar>	 millimetric: I have a hopefully simple and definitely non-urgent question
[22:19:55] <sayhar>	 On the official site: http://www.mediawiki.org/wiki/Analytics , it mentions Kracken and Kafka. But doesn't do a good job explaining it. Could you please explain what they are? I am just curious.
[22:22:19] <milimetric>	 Kraken is sort of an outdated name for some of the architecture and ETL logic we're building on top of Hadoop
[22:22:23] <milimetric>	 have you clicked through? https://www.mediawiki.org/wiki/Analytics/Kraken
[22:22:40] <milimetric>	 and Kafka is a key part of our logging infrastructure: https://www.mediawiki.org/wiki/Analytics/Logging_infrastructure
[22:23:28] <ottomata>	 milimetric: the mediawiki pages are actually out of date
[22:23:29] <milimetric>	 Kafka's basically a system built by Linked In to manage reliable scalable ingestion of large amounts of data
[22:23:33] <ottomata>	 wikitech is the link
[22:23:37] <ottomata>	 https://wikitech.wikimedia.org/wiki/Analytics/Kraken
[22:23:39] <milimetric>	 k, gotcha
[22:23:43] <ottomata>	 sayhar: ^
[22:24:00] <milimetric>	 we should have a cleanup party and get all that stuff in order
[22:24:15] <sayhar>	 thanks everyone
[22:24:25] <ottomata>	 well, that's sorta what I did when I moved it to Kraken, i'd be fine with deleteing the mediawiki pages
[22:24:53] <sayhar>	 why are there mediawiki pages at all? Shouldn't they all be wikimedia foundation pages?
[22:30:24] <milimetric>	 I've been here over a year and it's still pretty hard to know which docs go where
[22:34:20] <Ironholds>	 we document things?
[22:34:22] <Ironholds>	 ...crap.
[22:38:44] <average>	 sayhar: https://github.com/wikimedia/analytics-kraken
[22:38:45] <milimetric>	 lol
[22:38:58] <ottomata>	 nawwww
[22:38:58] <ottomata>	 https://github.com/wikimedia/kraken
[22:39:01] <ottomata>	 hehe
[22:39:03] <average>	 omg omg
[22:39:21] <average>	 sayhar: use ottomata 's link
[22:40:16] <ottomata>	 same same though
[22:42:23] <qchris>	 Meh. sayhar left ... I just wanted to add the gerrit link :-)
[22:55:52] <average>	 sayhar: you have come back :)
[22:57:44] <sayhar>	 average: what?
[23:12:49] <milimetric>	 sayhar: average was talking about this from earlier:
[23:12:51] <milimetric>	 <qchris> Meh. sayhar left ... I just wanted to add the gerrit link :-)
[23:13:13] <milimetric>	 note to sayhar: if you ask questions here people shall answer them in perpetuity :)
[23:18:14] <milimetric>	 fun link of the day: http://www.youtube.com/watch?v=DYu_bGbZiiQ
[23:18:20] <milimetric>	 tnegrin: you might find that funny ^
[23:18:29] <milimetric>	 nite everyone
[23:30:38] <ottomata>	 niihaatas
[23:30:39] <ottomata>	 i'm out too
[23:30:41] <ottomata>	 byoeo