[13:31:02] hey ottomata [13:33:18] yo morning! [13:33:20] well [13:33:21] mornign for me! [13:33:22] :( [13:33:23] :) [13:33:29] afternoon here :D [13:36:08] yo otto! how are we doing on the msg drops? [13:48:40] hey qchris [13:48:41] hey Snaps [13:48:49] Hi average [13:56:25] hey average! [13:57:03] yoo Snaps, still plenty of KAFKADR: Kafka message delivery error: Broker: Request timed out happen in esams [13:57:07] but as far as i know no messages are dropped [13:57:10] they are duplicated [13:57:47] huhm [13:59:25] even though you upped request.timeout.ms to 60s? [13:59:54] yeah [14:00:33] here's what i'm currently using [14:00:33] https://gist.github.com/ottomata/7302875 [14:05:36] we could try and increase them some more and see if the problem goes away; if not, something is fishy. [14:05:44] 5 minutes or so [14:05:45] yeah, ok [14:05:47] ok [14:05:53] i'll will be back in a few mins [14:32:32] hey milimetric , did you get my e-mail ? [14:40:27] Snaps: [14:40:28] varnishpipe [14:40:45] varnishicle (varnish-cronicle) [14:41:02] varnishplex [14:41:12] varnishdocket [14:41:22] varnishledger [14:41:30] (i'm looking at a thesaurus, obviously :p) [14:41:46] i kinda like varnishicle [14:41:47] haha [14:42:12] you want a serious descriptive name of just a unique name? [14:42:17] we could do varnish-anything really? [14:43:12] milimetric: want to set up your own labs hadoop cluster? [14:43:21] yes, totally [14:43:35] but... give me like 10 min. for emails? [14:43:45] have all the time you want [14:44:27] I'm out to get something, bb in ~20m [14:44:56] sure [14:45:21] milimetric: maybe go ahead and spawn up 2 nodes [14:45:22] before you do emails [14:45:25] so they'll be up [14:45:30] k [14:45:33] i'd do 2, you could probably get away witih 1 [14:45:37] but 2 would be better [14:45:38] any settings ok? [14:45:57] yeah dunno, give yourself something bigger than the tiniest one, but yeah anything will probably work for just testing stuff [14:47:34] test-kraken-node1 and test-kraken-node2 or should they have more specific names [14:47:37] like namenode, etc. [14:47:55] whatever, don't put kraken in the name though :p [14:48:24] hadoop-test1, hadoop-test2 if you like [14:48:39] well, this would hopefully be part of kraken etl at some point [14:49:12] i'm trying to write code to sqoop mediawiki dbs into hadoop [14:53:39] ok whatever, but i think we're trying to make kraken be just the repo name, for code and stuff, if you are building a cluster, why name it after the code you are going to run there? [14:53:40] I must have been stress testing our production server [14:53:46] buuut, whatever you want, i don't care so much :) [15:08:27] ottomata: varnishicle sounds pretty cool :) [15:08:49] haha [15:08:52] like popsicle? [15:09:00] haha, yeah, also varnish-chronicle [15:14:29] varnishpad [15:14:50] varishpost [15:15:13] varnishpostal [15:15:47] oo maybe you could make a pun on 'log' [15:15:54] stump [15:15:57] varnishstump [15:16:09] varnishplank [15:16:21] varnishtimber [15:16:29] varnishmill [15:17:36] finkelhose [15:17:47] haha [15:17:52] no hits on google! [15:17:54] haha [15:24:49] gosh writing emails is so much fuN! :( [15:25:08] ok, I'm done ottomata, wanna deploy some puppets! [15:25:36] hadoop-test1 and hadoop-test2 are ACTIVE [15:26:09] ok awesome [15:26:55] ok, so go to configure hadoop-test1 [15:26:56] hey drdee [15:27:12] yep [15:27:19] morning guys [15:27:36] morning [15:27:41] morning drdee [15:27:41] (hi drdee) [15:27:43] ottomata batcave? [15:27:46] no! [15:27:48] he's mine [15:28:02] :) jk, you can have him :( [15:29:39] you can both have me in batcave yes no? [15:30:02] Leave some ottomata for me as well :-D [15:30:13] or none of us right [15:30:18] *right now [15:31:21] dan come back! [17:15:50] milimetric: dunno what happened, but it looks l;ike the hdfs namenode format worked [17:17:13] :) weird [17:17:28] ja, looks like everything is good to go [17:17:34] the kraken grain thing should be fixed [17:17:39] but won't hurt anything with what you are doing [17:17:59] you're right, I can -ls stuff [17:18:07] awesome [17:18:29] and I can just make myself a home directory under milimetric and all that? [17:18:47] sorry, I mean I can just use sudo to make a milimetric home directory? [17:19:11] yup [17:19:12] ah - no I can not [17:19:16] sudo -u hdfs [17:19:19] ah [17:21:44] mkdir: Permission denied: user=root, access=WRITE, inode="/user":hdfs:hadoop:drwxrwxr-x [17:29:28] sudo -u hdfs [17:29:51] sudo -u hdfs hadoop fs -mkdir /user/milimetric && sudo -u hdfs hadoop fs -chown milimetric:milmetric /user/milimetric [17:29:54] milimetric: ^ [17:36:47] (PS16) Stefan.petrea: [not ready for review] A step towards 818 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/91207 [18:01:19] ottomata: scrum :-) [18:01:23] lost link somehow [20:00:58] (PS1) Milimetric: November Meeting [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/93561 [20:01:14] (CR) Milimetric: [C: 2 V: 2] November Meeting [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/93561 (owner: Milimetric)