[07:19:01] Analytics / Wikimetrics: Story: User creates cohort with CentralAuth insertions - https://bugzilla.wikimedia.org/66843 (Kevin Leduc) [07:19:17] Analytics / Wikimetrics: Story: User creates cohort with CentralAuth insertions - https://bugzilla.wikimedia.org/66843#c1 (Kevin Leduc) 74 hours (8 hours working days for Teresa) * (10 hours) puppet would need to be updated to create central auth testing database in vagrant (check central-auth role in... [10:50:31] Analytics / Wikimetrics: Max recursion limit hit - https://bugzilla.wikimedia.org/67823#c4 (Dan Andreescu) #hornetsnest [12:37:02] Analytics / Refinery: Story: Admin has versioned and sync'ed files in HDFS - https://bugzilla.wikimedia.org/67129 (christian) PATC>RESO/FIX [12:57:17] (CR) QChris: [C: -1] "Nits only." (3 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/146143 (owner: Ottomata) [13:11:26] (CR) QChris: [C: 1] "Not yet verified, hence only CR+1." (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/146297 (https://bugzilla.wikimedia.org/67823) (owner: Milimetric) [13:16:59] (PS2) Ottomata: Add camus infrastructure to handle webrequests [analytics/refinery] - https://gerrit.wikimedia.org/r/146143 [13:17:13] (PS2) Milimetric: Avoid pickle max recursion while serializing chain [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/146297 (https://bugzilla.wikimedia.org/67823) [13:18:05] (CR) Ottomata: Add camus infrastructure to handle webrequests (2 comments) [analytics/refinery] - https://gerrit.wikimedia.org/r/146143 (owner: Ottomata) [13:18:23] (CR) Milimetric: "The code in either of the comments was not so valuable, it was mostly the experience that was of value. I removed it." (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/146297 (https://bugzilla.wikimedia.org/67823) (owner: Milimetric) [13:18:32] -thanks for the review qchris [13:19:18] milimetric: :-/ Sorry for not yet testing it. I'll test it after the meetings. But I thought I'd at least submit what I have up to now. [13:19:51] oh not a problem. The manual test can be run with scripts/test tests/manual/parallel_reports.py [13:20:06] have to give the full path because nosetests doesn't recurse into "manual" [13:21:56] qchris: hiiiiiii! [13:21:57] :) [13:22:31] qchris I am itchin to merge that camus change! [13:22:39] hmm, actually [13:22:44] Go ahead. [13:22:48] I'll CR+2 right away. [13:22:51] hah [13:23:01] i passed my non prefixed bin/camus by you? :D [13:23:07] i can't remember if that camus-wmf artifact is the one that is compiled against cdh5 [13:23:19] i should probably recompile and upload a new artifact, I bet it isn't [13:23:41] Oh. I see you commented on the change already. [13:23:48] yup :) [13:24:03] So you prefer to merge (as it comes more or less straight from Kra^W...) and we fixup later? [13:24:12] i think its fixed up! [13:24:26] the only thing I'm not sure about is camus/ directory, but that we can figure out later [13:24:38] no idea what is good for that, and we didnt' really figure that out in kr--en either [13:24:38] I'll go through the comments then. [13:24:40] k [13:24:53] yeah, i'm itchin, only enough to want to IRC review with you rather than slower gerrit :) [13:25:02] the hadoop cluster is back online [13:25:09] really want to get the data flowin back in this week [13:25:16] Just gimme a sec to read. than we can CR in IRC. [13:25:23] would be AMAZING if I could get somethign queryable in time for tech talk today [13:25:24] ok cool [13:27:27] (CR) QChris: Add camus infrastructure to handle webrequests (1 comment) [analytics/refinery] - https://gerrit.wikimedia.org/r/146143 (owner: Ottomata) [13:27:38] (CR) QChris: [C: 2] Add camus infrastructure to handle webrequests [analytics/refinery] - https://gerrit.wikimedia.org/r/146143 (owner: Ottomata) [13:27:49] (CR) QChris: [V: 2] Add camus infrastructure to handle webrequests [analytics/refinery] - https://gerrit.wikimedia.org/r/146143 (owner: Ottomata) [13:28:28] ottomata: anything else you need me to +2 for the tech talk today? [13:30:34] thank you!, no don't think so, want to proof the talk? [13:30:55] oh, qchris, i will be building a new camus artifact, so I will change the hadoop versiona and wmf revision in the poms there [13:30:58] and then commit a new artifact [13:31:03] but if you are ok with that, i can self merge those [13:31:17] Either way is fine by me. [13:32:11] k [13:34:42] (PS1) Ottomata: Update to compile against cdh5.0.2 and bump wmf revision up to 5 [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/146453 [13:35:19] (CR) Ottomata: [C: 2 V: 2] Update to compile against cdh5.0.2 and bump wmf revision up to 5 [analytics/camus] (wmf) - https://gerrit.wikimedia.org/r/146453 (owner: Ottomata) [13:40:35] (PS1) Ottomata: Add camus-wmf-0.1.0-wmf5.jar artifact and update camus-wmf.jar symlink [analytics/refinery] - https://gerrit.wikimedia.org/r/146454 [13:41:10] (CR) Ottomata: [C: 2 V: 2] Add camus-wmf-0.1.0-wmf5.jar artifact and update camus-wmf.jar symlink [analytics/refinery] - https://gerrit.wikimedia.org/r/146454 (owner: Ottomata) [13:53:47] Analytics / Tech community metrics: Code review metrics should not include [WIP] changesets - https://bugzilla.wikimedia.org/66283#c2 (Quim Gil) PATC>RESO/FIX Looks good. Thank you! [13:55:48] Analytics / Tech community metrics: Identifying open changesets submitted by each organization - https://bugzilla.wikimedia.org/63530#c2 (Quim Gil) PATC>RESO/FIX This is good enough for now. Thank you! [13:58:01] Analytics / Tech community metrics: Regression: popup windows go beyond right margin, hiding most recent data - https://bugzilla.wikimedia.org/66258#c4 (Quim Gil) RESO/FIX>REOP We have this problem again at http://korma.wmflabs.org/browser/gerrit_review_queue.html The problem is not the length o... [14:03:48] Analytics / Tech community metrics: Key performance indicator: Gerrit review queue - https://bugzilla.wikimedia.org/37463#c43 (Quim Gil) Finally, I have started providing better strings in the form of pull requests: https://github.com/Bitergia/mediawiki-dashboard/pulls In the meantime http://korma.wm... [14:29:32] Analytics / Wikimetrics: Max recursion limit hit - https://bugzilla.wikimedia.org/67823 (Dan Andreescu) [14:29:32] Analytics / Wikimetrics: Optimize JSON format of recurrent report output - https://bugzilla.wikimedia.org/67822 (Dan Andreescu) [14:37:37] ottomata: he has arrived [15:01:24] nuria now my hangout chats aren't going through! [15:01:25] i feel good about presentation [15:01:30] trying real hard to get some data in the cluster before the talk [15:01:46] ok, it's in 2 hours right? [15:02:01] yup [15:02:19] ok, will off for the next half an hour but online after that [15:04:30] milimetric: another keeper as a library: https://twitter.github.io/typeahead.js/ [15:04:46] qchris! I just your hdfs deploys script for the first time [15:04:47] works great! [15:04:48] thank you! [15:13:16] nuria: that looks good, but I don't think bootstrap and knockout are conflicting [15:13:19] let me know if you look at that [15:13:44] bootstrap's autocomplete has a JS initialization [15:13:54] the other thing we could do is upgrade to the next bootstrap - looks a lot better anyway [15:24:59] ottomata: Wohooo! Great to hear. Thanks. [15:28:29] huh, ya'll use scrumbugz, how do you like? [15:30:30] greg-g: I HATE IT! (And if our phabricator overlords are not listening ... I like it) [15:31:08] It does not get in the way. And I know how to deal with bugzilla. [15:31:20] * greg-g nods [15:31:21] It has shiny graphics and grouping by sprint works fine. [15:31:40] It's simple overall ... and I like simple. [15:38:59] ! [15:39:01] qchris_meeting: [15:39:06] if your sequence file tool says this [15:39:12] CompressionType: BLOCK [15:39:12] CompressionCodec: org.apache.hadoop.io.compress.SnappyCodec (.snappy) [15:39:13] Key: org.apache.hadoop.io.LongWritable [15:39:13] Value: org.apache.hadoop.io.Text [15:39:13] Metadata: (0 metadata entries) [15:39:17] the file is not a sequence file, correct? [15:39:27] hm, or is it? [15:46:11] pretty sure its a sequence file gah [15:46:37] yup [15:46:41] HMM what the crap Hive!? [16:31:42] ottmata: Just cat the file. Sequence files are easy to read and identify on the terminal. [16:31:54] Darn. ottomata left :-/ [17:01:16] ottomata, you should have the link in your email [17:01:37] lemme know if you can't find it. [17:01:45] can't! [17:01:49] humm [17:01:55] i only have link to the live hangout [17:02:07] can you check the alert (bell shape ) on the top right of your Google mail page? [17:02:23] yes [17:02:25] only have live link [17:02:30] that should be it [17:03:03] nuria [17:03:05] did you find it? [17:05:10] have y'all started yet? the stream is not yet running for me [17:05:17] just started [17:05:36] do you see it mwalker? [17:05:39] yep [17:05:41] :) [17:05:46] great! [17:41:16] analytics tech talk now live at: https://plus.google.com/u/0/events/c53ho5esd0luccd09a1c30rlrmg [19:10:51] (PS1) Milimetric: Refactor Aggregation constants [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/146520 [19:15:27] (PS1) Milimetric: Make coalesced report format more efficient [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/146521 (https://bugzilla.wikimedia.org/67822) [19:18:37] (PS2) Milimetric: [WIP] Make coalesced report format more efficient [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/146521 (https://bugzilla.wikimedia.org/67822) [19:18:54] milimetric: will look at your CRs tomorrow, want to work a bit more on js today [19:19:06] no prob nuria, they're not really ready anyway [20:29:34] (PS3) Milimetric: Make coalesced report format more efficient [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/146521 (https://bugzilla.wikimedia.org/67822) [20:38:46] Analytics / Wikimetrics: Performance of Recurrent Reports - https://bugzilla.wikimedia.org/67543#c3 (Dan Andreescu) PATC>RESO/FIX All the research and fixing has been done or split up into these two related issues: https://bugzilla.wikimedia.org/show_bug.cgi?id=67823 https://bugzilla.wikimedia.o... [20:47:16] Analytics / Wikistats: ipv6 addresses are mistaken for registered users - https://bugzilla.wikimedia.org/66079#c1 (Erik Zachte) ASSI>RESO/FIX oops, this bug was fixed a while ago [20:56:32] Analytics / Refinery: Story: Admin has duplicate monitoring in Icinga - https://bugzilla.wikimedia.org/67128#c9 (christian) Discussing the solution to this item a bit more with ottomata last week, it turned out that it might be better to incorporate the duplicate checking into partition adding, and tur...