[11:47:48] (PS1) Nemo bis: Fix typo [analytics/wikistats] - https://gerrit.wikimedia.org/r/118257 [11:48:28] (CR) jenkins-bot: [V: -1] Fix typo [analytics/wikistats] - https://gerrit.wikimedia.org/r/118257 (owner: Nemo bis) [11:58:19] (PS1) Nemo bis: Comment some path tests overriding standard ones [analytics/wikistats] - https://gerrit.wikimedia.org/r/118261 [11:58:52] (CR) jenkins-bot: [V: -1] Comment some path tests overriding standard ones [analytics/wikistats] - https://gerrit.wikimedia.org/r/118261 (owner: Nemo bis) [12:30:47] (PS1) Nemo bis: Remove trailing whitespace [analytics/wikistats] - https://gerrit.wikimedia.org/r/118266 [12:31:02] (CR) jenkins-bot: [V: -1] Remove trailing whitespace [analytics/wikistats] - https://gerrit.wikimedia.org/r/118266 (owner: Nemo bis) [12:34:12] (CR) Nemo bis: Remove trailing whitespace (1 comment) [analytics/wikistats] - https://gerrit.wikimedia.org/r/118266 (owner: Nemo bis) [12:40:24] (PS2) Milimetric: Move test to allow it to run by itself [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118208 (owner: Nuria) [12:43:15] (CR) Milimetric: Move test to allow it to run by itself (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118208 (owner: Nuria) [12:44:08] (CR) Milimetric: [C: 1] "I left a comment on patchset one and improved it in this patchset. This is good to merge in my opinion, if you agree, just +2 it and subm" [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118208 (owner: Nuria) [12:49:33] hey Dan, good morning [12:51:10] morning! [13:57:54] (PS18) Stefan.petrea: [WIP] kraken-hive UDFs [analytics/kraken] - https://gerrit.wikimedia.org/r/96738 (owner: QChris) [13:59:48] Mapred Local Task Succeeded . Convert the Join into MapJoin [13:59:48] FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask [14:00:02] my way of saying hi [14:07:03] (CR) Nuria: "Let's see if this publish my comments." (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 (owner: Milimetric) [14:07:57] (CR) Csalvia: Implement security for public reports (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118068 (owner: Milimetric) [14:08:55] (CR) Csalvia: Add scheduler mode to wikimetrics (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 (owner: Milimetric) [14:09:01] (PS19) Stefan.petrea: [WIP] kraken-hive UDFs [analytics/kraken] - https://gerrit.wikimedia.org/r/96738 (owner: QChris) [14:47:32] (CR) Nuria: [C: 2] Move test to allow it to run by itself [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118208 (owner: Nuria) [14:50:10] ottomata: have you experienced problems with hcatalog jsonserde choking on UTF-8 ? [14:50:34] ottomata: I see it choking on it in the logs on some portuguese user-agent [14:50:36] no, but I have not used it very much either, just enough to test that it works [14:50:59] hm, ok, I'll try to pull a new version of it, if there is one [14:51:40] btw, the error I talked about in standup is most likely caused by switching from hive-json-serde to hcatalog jsonserde [15:00:21] ottomata: http://hive.apache.org/hcatalog_downloads.html [15:00:28] Following HCatalog's merge with Hive (in March of 2013) HCatalog is now released as part of Hive. Older versions of HCatalog can still be separately downloaded. [15:00:40] we do have the latest one it seems, 0.5.0 [15:00:48] that's the one that's choking on portuguese [15:00:54] aye hm [15:01:10] well there are a couple of ways here: [15:01:14] average: sorry, I probably won't be able to look at this today [15:01:20] 1) we fallback to the hive jsonserde [15:01:31] i think hive-json serde doesn't work with snappy compressed sequence files [15:01:31] or [15:01:33] 2) I go and fix the bug in hcatalog jsonserde and add UTF-8 support [15:01:37] it will, but we'd have to add coding to make it work [15:01:55] i dunno, maybe it did? [15:01:59] ah i don't remember [15:02:14] anyway, yeah, i am taking tomorrow and friday off, and have to get three important thigns done before I go [15:02:21] so i'm focusing on those things [15:02:27] could you send an email or make a bug about this? [15:02:37] a bug on their issue tracker ? [15:02:47] on hcatalog's issue tracker (if there is one) ? [15:04:40] ottomata: ^^ [15:04:59] on ours? or theirs sure [15:05:04] i was thinking ours to track it [15:05:16] but if you know the bug well enough to report it to them, go right ahead [15:06:12] ok [15:06:31] I'll report it on their issue tracker and link it back to a card in our mingle [15:06:36] milimetric: do we still use mingle ? [15:07:33] milimetric: so there's a bug in some 3rd party, I'd like to report it on their side and from what I understand, we have to track it on our side too [15:25:44] (CR) Milimetric: Add scheduler mode to wikimetrics (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 (owner: Milimetric) [15:25:50] (CR) Milimetric: Add scheduler mode to wikimetrics (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 (owner: Milimetric) [15:30:09] ottomata: you wanna look at labs after lunch-ish? Like 1-2pm our time? [15:30:14] average: sorry for the late reply [15:30:21] we are using mingle still, sadly [15:30:38] can we do after my 1on1 with toby? [15:30:40] after 3pm? [15:30:43] ok, perfect [15:30:48] i'll try to build up questions by then [15:30:57] average: you don't need to track other projects' bugs [15:31:25] but if it becomes a major blocker, let's talk about it, and we may need to track work that you do to interact with other teams to solve the bug [15:31:34] milimetric: it is a blocker, let's talk abou tit [15:31:35] or we may just decide to work around the bug [15:31:35] *it [15:31:40] ok [15:31:52] dude, btw, I made mucenici Sunday for the first time [15:31:54] :) [15:31:58] haha :) nice [15:32:03] sooo friggin good [15:32:09] my wife said she never tasted anything like it [15:32:27] I hope you got to have some [15:32:33] if not, I'll make some in Zurich [15:32:35] better late than never [15:32:44] hehe :) [15:33:01] ok, so what's the bug [15:33:04] and how's it blocking us [15:34:08] average: If it is UTf-8 related should be present in any of your changes right? not just on the last one [15:35:28] nuria: switched jsonserde between yesterday and today, so it's new [15:36:09] sorry, i just read up average, my bad [15:36:41] yeah, average, it looks like this is a hard blocker for us [15:36:43] ok, look for "Invalid UTF-8 middle" [15:36:47] https://gist.github.com/wsdookadr/f6673e8b11f44b9e362e [15:36:50] in this gist [15:36:54] because the old json thing we were using didn't work with snappy like andrew said [15:37:06] yes [15:37:17] ok, so I think - file a bug with them and look a little bit into what it would take to fix it [15:37:39] and tell us tomorrow what you find. If you're still stuck, you can find something new to do while we figure out how to unblock [15:37:52] ok [16:01:09] (PS15) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165 [16:01:15] (PS16) Milimetric: [WIP] Run recurring reports using the scheduler [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/112165 [16:01:17] (PS9) Milimetric: Add scheduler mode to wikimetrics [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111623 [16:01:19] (PS8) Milimetric: Allow reports to be rerun [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/111914 [16:01:26] nuria: I uploaded my latest work ^ [16:01:33] and rebased on latest master [16:01:57] csalvia: let me know when you've got your stuff in so I can rebase on that too [16:02:11] #gonelunching [16:02:28] ok, will look a bit into how the celery recurrent scheduler works to truly be able to review your changes and get your patch [17:23:17] hey [17:23:31] I am so sorry -- I have to move our 1:1 again [17:24:53] tnegrin, who are you talking to? [17:25:01] (PS1) Jdlrobson: Add settings to Menu clicks [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/118305 [17:25:14] * halfak is wondering if his IRC client is having issues.  [17:25:22] nuria -- thought I was private messaging -- I can't use computers [17:25:28] :) [17:25:30] keep me off the cluster [17:31:20] noted - ottomata revoke tnegrin's access to the cluser [17:31:22] :P [17:31:34] wfm ;) [17:31:53] <- grandpa [17:32:05] tnegrin: scrum of scrums today? [17:32:14] we don't see people from the office yet [17:32:23] nvm :) [17:32:36] not for me -- have another meeting [18:18:37] Hi milimetric, did you just ping springle too? [18:18:59] n/m just saw the email [18:30:48] (CR) Milimetric: [C: 2 V: 2] Add settings to Menu clicks [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/118305 (owner: Jdlrobson) [18:37:05] yeah, sorry halfak, today was scrum of scrums and I almost forgot to, but managed to bring it up [18:37:53] Gotcha. Thanks for doing that. My ping originated from starting a new analysis that would be 100 times faster with that index. [18:43:29] :) yeah, hopefully the multiple pings convey importance and not annoying buzzing to Sean [18:44:08] Indeed. [19:35:16] [travis-ci] develop/3d12a31 (#166 by milimetric): The build passed. http://travis-ci.org/wikimedia/limn/builds/20633674 [19:37:33] [travis-ci] master/3d12a31 (#167 by milimetric): The build passed. http://travis-ci.org/wikimedia/limn/builds/20633685 [19:42:48] (Abandoned) Terrrydactyl: Bug 58609 - Date and time revert creating a report [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/109725 (owner: Terrrydactyl) [19:50:00] just curious, is there a reason why the list on the wikimetrics front page unstyled? i keep thinking it's a paragraph with weird line breaks, but it's actually a list without bullet points. [19:52:40] no reason terrrydactyl, just what happens when developers do design :) [19:52:49] that particular oddity is my fault [19:53:05] feel free to patch it to something more semantic if you want [19:53:09] okay [19:53:17] it's driving me ever so slightly nuts [19:53:18] :) [19:53:39] though i'm not a designer either so i have no idea how it can be made to look better [19:56:54] ooh, found a bug [21:24:41] (PS1) Terrrydactyl: Fixed some broken links. Was missing contacts page [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118355 [21:26:15] (CR) Milimetric: Fixed some broken links. Was missing contacts page (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118355 (owner: Terrrydactyl) [21:38:54] (PS2) Terrrydactyl: Fixed some broken links. Was missing contacts page [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118355 [21:41:49] (PS3) Terrrydactyl: Fixed some broken links. Was missing contacts page [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118355 [21:43:09] (CR) Milimetric: [C: 2] Fixed some broken links. Was missing contacts page [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/118355 (owner: Terrrydactyl) [21:53:24] nitey nite everyone [22:08:00] (PS1) Nemo bis: Typofix in comment [analytics/wikistats] - https://gerrit.wikimedia.org/r/118366 [22:08:20] (CR) jenkins-bot: [V: -1] Typofix in comment [analytics/wikistats] - https://gerrit.wikimedia.org/r/118366 (owner: Nemo bis) [22:13:50] (PS2) Nemo bis: Typofix in comment [analytics/wikistats] - https://gerrit.wikimedia.org/r/118366 [22:14:28] (CR) jenkins-bot: [V: -1] Typofix in comment [analytics/wikistats] - https://gerrit.wikimedia.org/r/118366 (owner: Nemo bis)