[09:18:28] <wikibugs>	 Analytics / Quarry: Replace spaces with underscores for wiki usernames in URL - https://bugzilla.wikimedia.org/70166 (Aaron Halfaker) NEW p:Unprio s:normal a:None http://quarry.wmflabs.org/Halfak%20(WMF)  should be   http://quarry.wmflabs.org/Halfak_(WMF)
[11:48:54] <grrrit-wm>	 (Abandoned) Gilles: Add graphs for opt-outs [analytics/multimedia/config] - https://gerrit.wikimedia.org/r/145599 (owner: MarkTraceur)
[13:48:17] <grrrit-wm>	 (Abandoned) Nuria: Setup packages and basic html layout [analytics/dashiki] - https://gerrit.wikimedia.org/r/154787 (owner: Nuria)
[15:36:26] <grrrit-wm>	 (PS1) BearND: Add edit funnel reports to config [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157161
[15:37:46] <grrrit-wm>	 (CR) Milimetric: [C: 2] Add edit funnel reports to config [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157161 (owner: BearND)
[15:38:07] <bearND>	 milimetric: thank you!
[15:38:18] <milimetric>	 np
[15:40:28] <wikibugs>	 Analytics / Quarry: Replace spaces with underscores for wiki usernames in URL - https://bugzilla.wikimedia.org/70166#c1 (Yuvi Panda) The latter link works as well, but perhaps I should also output 'nicer' URLs.
[16:33:53] <grrrit-wm>	 (PS1) Milimetric: [WIP] Add metric selector [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170
[16:34:21] <milimetric>	 nuria_: i'm gonna grab lunch but I think I've got the hang of these weird bindings and semantic ui
[16:34:28] <milimetric>	 wanna talk in a bit?
[16:34:45] <nuria_>	 ok, I am changing the code
[16:34:47] <milimetric>	 check out that patch ^ and then we'll talk
[16:34:51] <nuria_>	 after all your comments
[16:35:25] <nuria_>	 and I think i am mostly done moving stuff to wikimetricsapi, there was one not obvious (to me ) issue
[17:20:38] <grrrit-wm>	 (PS8) Nuria: Project and language choices component [analytics/dashiki] - https://gerrit.wikimedia.org/r/156741
[17:23:44] <grrrit-wm>	 (CR) Nuria: Project and language choices component (8 comments) [analytics/dashiki] - https://gerrit.wikimedia.org/r/156741 (owner: Nuria)
[17:51:32] <grrrit-wm>	 (PS9) Nuria: Project and language choices component [analytics/dashiki] - https://gerrit.wikimedia.org/r/156741
[18:37:04] <tnegrin>	 hey Ironholds
[18:37:09] <tnegrin>	 how do I kill a hadoop job?
[18:37:20] <tnegrin>	 otto told me but I can't find the email
[18:37:57] <Ironholds>	 tnegrin, hangon, I know this
[18:37:59] <Ironholds>	 *thinks*
[18:38:28] <Ironholds>	 try yarn application -kill [applicationID]
[18:42:25] <tnegrin>	 yep
[18:43:30] <Ironholds>	 grand!
[18:43:59] <Ironholds>	 also, I should do a writeup of 'how to eke speed improvements out of R'
[18:43:59] <Ironholds>	 Because, this stuff is important.
[18:44:07] <Ironholds>	 and we are dealing with bigger and bigger datasets.
[18:44:48] <Ironholds>	 some long writeup on vectorisation and primitive data types and BCC and parallelisation == my weekend. What a thrilling life I lead.
[18:46:24] <Ironholds>	 yo DarTar
[18:46:27] <tnegrin>	 hey -- I met the RSci guy last night
[18:46:34] <DarTar>	 howdy
[18:46:51] <DarTar>	 Karthik
[18:47:23] <DarTar>	 he is now formally with the Berkeley Data Science program
[18:47:54] <DarTar>	 which is great (he’s been traveling without a clear affiliation as an R advocate for the last 1-2 years)
[18:47:57] <Ironholds>	 cool!
[18:48:14] <Ironholds>	 Appropriately I was just talking about R
[18:48:20] <DarTar>	 Ironholds: I also told him about your frustration with the lack of R meetups in Boston
[18:48:22] <Ironholds>	 doing some kind of writeup on eking out speed improvements
[18:48:29] <Ironholds>	 because, woo big data *ducks*
[18:48:37] <DarTar>	 :)
[18:49:29] <DarTar>	 he also told me the author of rhadoop is based in the Bay Area
[18:50:02] <DarTar>	 which I didn’t know
[18:50:50] <Ironholds>	 huh
[18:50:55] <Ironholds>	 it's not what we need but it's a nice tool.
[18:51:09] <Ironholds>	 Unless you fancy writing mapreduce jobs in R, and opsen fancies supporting that ;p
[18:58:16] <DarTar>	 yeah, it might turn out to be useful down the line, but not an immediate need
[19:07:23] <grrrit-wm>	 (PS10) Nuria: Project and language choices component [analytics/dashiki] - https://gerrit.wikimedia.org/r/156741
[19:07:57] <grrrit-wm>	 (PS2) Milimetric: [WIP] Add metric selector [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170
[19:41:42] <bearND>	 milimetric: you've merged my config.yaml changes in limn-mobile-data almost three hours ago and I still don't see the app-edit-funnel-*.csv files.
[19:42:18] <milimetric>	 bearND: I'll take a look at the logs in a bit, I'm in the middle of some weird CSS work :)
[19:42:43] <bearND>	 milimetric: :)
[20:30:22] <grrrit-wm>	 (PS11) Milimetric: Project and language choices component [analytics/dashiki] - https://gerrit.wikimedia.org/r/156741 (owner: Nuria)
[20:31:56] <milimetric>	 bearND: looking at your stuff
[20:32:27] <bearND>	 yeah :)
[20:34:36] <milimetric>	 https://www.irccloud.com/pastebin/PYug9iQX
[20:34:42] <milimetric>	 bearND: ^ that's the trace
[20:34:55] <milimetric>	 so it's not your stuff, I think it looks like your query isn't returning any rows so it broke the generator
[20:37:47] <bearND>	 milimetric: ok, i see the iOS app was published later
[20:38:02] <bearND>	 milimetric: I probably should change the start date then
[20:38:25] <milimetric>	 that would fix it
[20:38:39] <milimetric>	 I was just looking at the code to try and fix it for good, but anything I can think of is risky and this repo isn't tested
[20:40:11] <milimetric>	 bearND: ^
[20:40:42] <bearND>	 milimetric: ok, let's hope from now one that were will be at least one edit click for each app per day ;)
[20:41:28] <milimetric>	 bearND: that's so crappy, you're right!
[20:41:28] <milimetric>	 ugh
[20:41:38] <bearND>	 milimetric: or is there a way to default to 0 in SQL?
[20:41:45] <grrrit-wm>	 (CR) Nuria: [WIP] Add metric selector (7 comments) [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170 (owner: Milimetric)
[20:41:56] <milimetric>	 bearND: coalesce(something, 0)
[20:42:20] <bearND>	 milimetric: ah, that's what the coalesce is for. I'll add that as well
[20:42:25] <milimetric>	 bearND: I guess that's a good idea in general, summing to 0 if there are no values
[20:45:50] <bearND>	 milimetric: it makes the SQL a bit less readable, but I'll do it for correctness sake
[20:46:28] <milimetric>	 bearND: SQL readable? what? :)
[20:46:59] <bearND>	 :)
[20:48:50] <bearND>	 milimetric: IMO, sum should return 0 when there is nothing to sum up. Also the if expression has a 0 for the else case
[20:49:42] <milimetric>	 bearND: ah, but sum will return null if it's summing "null" and "3", because it doesn't know what exactly you want
[20:50:44] <milimetric>	 but count will return 0 as it doesn't consider values
[20:50:57] <bearND>	 milimetric: need a pythoic SQL
[20:51:05] <bearND>	 pythonic
[20:52:16] <milimetric>	 bearND: sqlalchemy!
[20:52:45] <milimetric>	 totally why we used it in wikimetrics, and why we've been trying to replace ad-hoc tools like this repo with wikimetrics
[20:52:53] <milimetric>	 but - as always - not enough time!
[20:54:41] <grrrit-wm>	 (PS1) BearND: Coalesce the edit funnel SQL queries [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157288
[20:57:23] <grrrit-wm>	 (CR) Milimetric: "you might want to still increase the date, as I'm not 100% confident about why that error is happening there. I'm switching between too m" [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157288 (owner: BearND)
[21:00:09] <grrrit-wm>	 (CR) Milimetric: [WIP] Add metric selector (7 comments) [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170 (owner: Milimetric)
[21:08:23] <bearND>	 milimetric: would it be enough to change the date in the datasource file?
[21:10:13] <bearND>	 milimetric: oh well, I'll just change both: that and the config.yaml
[21:11:00] <milimetric>	 bearND: the config is what affects it
[21:11:16] <milimetric>	 the datasource file just operates as a transform on the datafile, so it's after all the sql stuff
[21:12:16] <bearND>	 milimetric: ok, good to change both then
[21:13:14] <grrrit-wm>	 (PS2) BearND: Coalesce the edit funnel SQL queries [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157288
[21:19:47] <grrrit-wm>	 (CR) Milimetric: [C: 2] Coalesce the edit funnel SQL queries [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157288 (owner: BearND)
[21:21:07] <grrrit-wm>	 (PS3) Milimetric: Add metric selector [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170
[21:21:22] <milimetric>	 nuria_: I pushed updates, simplified a bit, now I'm adding tests
[21:28:31] <nuria_>	 ok milimetric, i will add tests too and we should be pretty ready
[21:46:33] <grrrit-wm>	 (PS4) Milimetric: Add metric selector [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170
[22:22:58] <grrrit-wm>	 (CR) Nuria: "Looks good, I still need to fully understand the chidContext binding." (1 comment) [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170 (owner: Milimetric)
[22:23:38] <grrrit-wm>	 (PS5) Milimetric: Add metric selector [analytics/dashiki] - https://gerrit.wikimedia.org/r/157170
[22:23:55] <milimetric>	 nuria_: I just removed the child context binding :)
[22:24:28] <nuria_>	 k i was saying as homework to myself.
[22:24:30] <milimetric>	 basically, it was simpler and easier to just make the binding invoke the $(element).dropdown() thing
[22:24:48] <milimetric>	 take a look at the latest patch, it's ready and  tested really well
[22:24:53] <milimetric>	 I LOVE karma
[22:25:20] <milimetric>	 I actually like writing tests more than code now
[22:25:34] <milimetric>	 check out https://gerrit.wikimedia.org/r/#/c/157170/5/test/components/metric-selector.js
[22:25:47] <milimetric>	 also, <3 knockout - so testable
[22:26:19] <milimetric>	 ok everyone!  have a lovely holiday weekend!
[22:26:40] <Ironholds>	 I won't.
[22:26:44] <tnegrin>	 yeah -- you too!
[22:26:56] <Ironholds>	 "we'd like session identification in the apps" "okay, cool, and it's got a unique ID, too, so this'll be really easy"
[22:27:05] <Ironholds>	 *looks in requestlogs, find ton of requests without IDs* ah.
[22:27:43] <nuria_>	 milimetric: NICE!
[22:28:32] <nuria_>	 ironholds: from new apps? or older installs?
[22:29:20] <Ironholds>	 nuria_, that's the genius; the new apps simultaneously are providing it, and are not providing it.
[22:29:34] <Ironholds>	 I am going to operate under the assumption that it's only passed through with some types of requests.
[22:30:37] <Ironholds>	 alright, bearND has been as helpful as their username is giggle-inducing, so I have enough to go to mobile-tech. In the meantime, booze and food!
[22:35:49] <bearND>	 milimetric: hmm, still no csv files :(
[22:37:25] <bearND>	 milimetric: has it tried to run the queries since you merged my changes?
[23:13:23] <bearND>	 milimetric: yeah! i see the new csv files now. :)
[23:21:16] <grrrit-wm>	 (PS3) BearND: Add edit funnel and user block reports to dashboards [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/156736
[23:30:02] <grrrit-wm>	 (CR) BearND: [C: 2] Add edit funnel and user block reports to dashboards [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/156736 (owner: BearND)
[23:30:07] <grrrit-wm>	 (Merged) jenkins-bot: Add edit funnel and user block reports to dashboards [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/156736 (owner: BearND)
[23:30:19] <grrrit-wm>	 (PS1) BearND: Fix app user block report [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157304
[23:30:43] <grrrit-wm>	 (CR) BearND: [C: 2] Fix app user block report [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157304 (owner: BearND)
[23:30:48] <grrrit-wm>	 (Merged) jenkins-bot: Fix app user block report [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/157304 (owner: BearND)
[23:56:17] <grrrit-wm>	 (PS12) Nuria: Project and language choices component [analytics/dashiki] - https://gerrit.wikimedia.org/r/156741