[10:59:39] <grrrit-wm>	 (CR) Nuria: Fix Bug 66483 (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/139566 (owner: Terrrydactyl)
[12:17:26] <grrrit-wm>	 (PS3) Nuria: Make tests in wikimetrics more deterministic. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/139852
[12:18:10] <grrrit-wm>	 (CR) Nuria: Make tests in wikimetrics more deterministic. (8 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/139852 (owner: Nuria)
[12:18:24] <grrrit-wm>	 (PS5) Nuria: 1st run of recurrent report is scheduled right away [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/138109 (https://bugzilla.wikimedia.org/66280)
[12:18:36] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] 1st run of recurrent report is scheduled right away [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/138109 (https://bugzilla.wikimedia.org/66280) (owner: Nuria)
[15:31:22] <ori>	 qchris_meeting: updated eventlogging to latest
[15:34:36] <qchris_meeting>	 ori: you're me hero. Thanks!
[15:35:00] <qchris_meeting>	 s/me/my/
[18:21:53] <milimetric>	 ottomata: ping me when you're back
[18:22:40] <ottomata>	 ghiya
[18:22:42] <ottomata>	 am here
[18:22:45] <ottomata>	 milimetric:
[18:22:50] <milimetric>	 hi
[18:23:05] <milimetric>	 ok, so the redis config problem on wikimetrics bit us in the butt today
[18:23:13] <milimetric>	 someone's report got deleted before they could check it
[18:23:22] <milimetric>	 nuria sent you an email with the bug
[18:23:38] <milimetric>	 https://bugzilla.wikimedia.org/show_bug.cgi?id=63664
[18:23:50] <ottomata>	 ahh, yeah, saw, sorry, haven't responded
[18:23:51] <ottomata>	 eeeegh
[18:23:54] <ottomata>	 that is a very annoying problem
[18:23:57] <milimetric>	 no prob, that's why I pinged you :)
[18:23:57] <ottomata>	 the redis module is crappy for that
[18:23:59] <milimetric>	 yeah, I know
[18:24:01] <ottomata>	 ori: might know more
[18:24:06] <ottomata>	 i think there was some ticket about the redis module recently
[18:24:26] <milimetric>	 ok, but in the immediate future, what's the best hack?
[18:24:34] <ottomata>	 milimetric: easy fix:  don't use redis module.  Maybe just package { 'redis': ensure => installed }
[18:24:39] <ottomata>	 and then do your own manual configuration
[18:24:43] <milimetric>	 ok
[18:24:45] <ottomata>	 that way it doesn't manage any config
[18:25:02] <milimetric>	 i'll submit that patch, one moment
[18:42:27] <milimetric>	 ottomata: I tried to make that patch and it fails with really strange errors about apache...
[18:42:45] <ottomata>	 ah
[18:42:47] <ottomata>	 ori ^
[18:42:48] <ottomata>	 :/
[18:42:53] <ottomata>	 ori is messing witih apache module
[18:42:58] <milimetric>	 oh in vagrant?
[18:43:03] <milimetric>	 that might be it
[18:43:04] <ottomata>	 oh
[18:43:07] <ottomata>	 hmmm
[18:43:08] <ottomata>	 no
[18:43:14] <ottomata>	 thoguht you meant in labs
[18:43:20] <milimetric>	 no, i'm trying it in vagrant
[18:43:25] <milimetric>	 it seemed fine before my patch
[18:43:28] <ottomata>	 what's the error / patch?
[18:43:51] <milimetric>	 oh, no... never mind, that error is there before my patch
[18:43:56] <milimetric>	 i'll just submit the patch
[18:45:49] <milimetric>	 oh wait a minute, ottomata, isn't that "redis-server" instead of "redis"?
[18:46:26] <milimetric>	 should that name match the apt-get package?
[18:46:37] <ottomata>	 yeah it should
[18:46:41] <ottomata>	 that was pseudo code...
[18:46:42] <ottomata>	 :)
[18:49:01] <milimetric>	 ottomata: https://gerrit.wikimedia.org/r/#/c/140173/
[18:50:15] <ottomata>	 cool that will work, you might want to add a dependency on Package['redis-server'] for the services
[18:50:27] <ottomata>	 and maybe also add a service resource to start the redis server
[18:50:28] <ottomata>	 up to you
[18:50:30] <ottomata>	 :)
[19:01:49] <grrrit-wm>	 (PS4) Milimetric: Make tests in wikimetrics more deterministic. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/139852 (owner: Nuria)
[19:02:04] <grrrit-wm>	 (CR) Milimetric: [C: 2] Make tests in wikimetrics more deterministic. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/139852 (owner: Nuria)
[19:02:14] <grrrit-wm>	 (Merged) jenkins-bot: Make tests in wikimetrics more deterministic. [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/139852 (owner: Nuria)
[19:02:31] <grrrit-wm>	 (PS6) Milimetric: 1st run of recurrent report is scheduled right away [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/138109 (https://bugzilla.wikimedia.org/66280) (owner: Nuria)
[19:02:34] <ottomata>	 milimetric: merged in prod puppet
[19:02:38] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] 1st run of recurrent report is scheduled right away [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/138109 (https://bugzilla.wikimedia.org/66280) (owner: Nuria)
[19:02:52] <ottomata>	 you should be able to fetch and rebase on your labs instances puppet checkout now
[19:05:09] <milimetric>	 ok, i'll give it a shot
[19:10:56] <milimetric>	 ottomata:
[19:11:00] <milimetric>	 so this error:
[19:11:01] <milimetric>	 err: Could not retrieve catalog from remote server: Error 400 on SERVER: Puppet::Parser::AST::Resource failed with error ArgumentError: Invalid resource type apache::mod at /etc/puppet/modules/wikimetrics/manifests/web/apache.pp:21 on node wikimetrics-dev1.eqiad.wmflabs
[19:11:10] <milimetric>	 is the same one I get in vagrant
[19:11:19] <milimetric>	 but it looks unrelated (happens regardless of the patch)
[19:11:31] <ottomata>	 yeah, i betcha ori has been changing apache things in both places
[19:11:37] <milimetric>	 gotcha
[19:12:05] <milimetric>	 seems like a pretty big deal - doesn't that mean puppet is basically broken everywhere?
[19:13:34] <ori>	 ottomata: hey, I'll fix
[19:16:01] <grrrit-wm>	 (PS10) AndyRussG: WIP Create a cohort from campaign participations [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight)
[19:16:03] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] WIP Create a cohort from campaign participations [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight)
[19:17:10] <ottomata>	 k, thanks Ori
[19:18:01] <ori>	 ottomata: i'm going to have a series of rapid-fire fix-ups for the apache stuff.. i don't want to make any single patch large for obvious reasons, but i feel self-conscious about harassing you. what does the next 45 mins look like for you? if i could have this interval to nag you periodically i would hugely appreciate it
[19:18:16] <ori>	 keep in mind that a +1 doesn't mean you sanction everything, it's still on me to make sure it's correct
[19:19:14] <ottomata>	 i'm here and can do it
[19:19:24] <ottomata>	 i'm just trying to figure out newer kafka version build systems
[19:19:29] <ottomata>	 which is gonna be crazyyyy
[19:19:29] <ori>	 ok, hugely appreciate it! i know it's annoying and distracting
[19:19:48] <grrrit-wm>	 (CR) Milimetric: [C: -1] "The test_run_report file fails flake. I tried to fix that but then it gets a pickle error." [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/138109 (https://bugzilla.wikimedia.org/66280) (owner: Nuria)
[19:21:11] <grrrit-wm>	 (CR) Milimetric: [C: -1] Upgrade used MobileWebEditing schema to current one (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/139889 (owner: QChris)
[19:22:24] <grrrit-wm>	 (CR) JGonera: [C: -1] Upgrade used MobileWebEditing schema to current one (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/139889 (owner: QChris)
[19:24:54] <grrrit-wm>	 (PS11) AndyRussG: WIP Create a cohort from campaign participations [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight)
[19:24:56] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] WIP Create a cohort from campaign participations [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight)
[19:26:29] <grrrit-wm>	 (CR) Milimetric: Upgrade used MobileWebEditing schema to current one (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/139889 (owner: QChris)
[19:28:12] <grrrit-wm>	 (PS12) AndyRussG: WIP Create a cohort from campaign participations [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight)
[19:28:14] <grrrit-wm>	 (CR) jenkins-bot: [V: -1] WIP Create a cohort from campaign participations [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight)
[19:29:41] <grrrit-wm>	 (CR) AndyRussG: "That _was_ a rebase. Not sure what's up with jenkins..." [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/126927 (owner: Awight)
[21:12:06] <ottomata>	 qchris: around?
[21:12:14] <qchris>	 just arrived.
[21:12:17] <qchris>	 What's up?
[21:12:35] <ottomata>	 trying to remember, what did we find out we needed to do with the hcatalog jar once...we had to put it in hdfs, ja?
[21:12:37] <ottomata>	 for something?
[21:13:08] <qchris>	 You mean the one we depend on for SerDe?
[21:14:00] <ottomata>	 yes
[21:14:06] <ottomata>	 usually we grab it from the local path
[21:14:15] <qchris>	 Yes, that's sufficient now.
[21:14:17] <ottomata>	 but i can't remember, i thought there was something where it wouldn't work unless we put it into hdfs
[21:14:23] <qchris>	 Local path is fine.
[21:14:33] <ottomata>	 most of the time, ja, but i thought there was something...
[21:14:36] <ottomata>	 dunno,
[21:14:40] <ottomata>	 if you don't remember, and I don't remember
[21:14:41] <ottomata>	 then I guess not!
[21:14:55] <qchris>	 We tested it in hdfs, as hive for some queries picked it from local path and for some from hdfs, when the auxpath came without protocol.
[21:15:03] <ottomata>	 hm
[21:15:09] <ottomata>	 oh, had to prepend with file:///?
[21:15:14] <qchris>	 Yes.
[21:15:20] <ottomata>	 ahhh, ok, i'll do that in the puppetization then
[21:15:20] <ottomata>	 cool
[21:15:31] <qchris>	 We did!
[21:15:37] <qchris>	 (for cdh4)
[21:15:40] <ottomata>	 ah, and we did!
[21:15:43] <ottomata>	 i'm looking at my vagrant stuff for cdh5
[21:15:44] <ottomata>	 perfect
[21:15:45] <ottomata>	 thanks
[21:15:55] <qchris>	 Want me to dig up the commit?
[21:15:57] <ottomata>	 naw, i see it
[21:15:59] <ottomata>	 no worries
[21:16:00] <qchris>	 Ok.
[21:16:10] <qchris>	 So no need to put the jar into hdfs.
[21:19:26] <grrrit-wm>	 (PS1) Milimetric: Always display time zone [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/140222 (https://bugzilla.wikimedia.org/63923)
[21:23:19] <ottomata>	 yup, danke
[22:01:11] <grrrit-wm>	 (CR) QChris: Upgrade used MobileWebEditing schema to current one (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/139889 (owner: QChris)
[22:02:12] <grrrit-wm>	 (Abandoned) QChris: Upgrade used MobileWebEditing schema to current one [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/139889 (owner: QChris)