[04:39:24] dschoon, are you guys currently storing unsampled traffic data for wikimedia.org ? [04:39:34] hm! [04:39:36] good question. [04:39:48] i'll ask tomorrow. [04:39:54] we're probably storing 1:100 [04:40:01] I'd really like to have this data as part of a big experiment that is going live soon [04:40:04] as that's the default for non-special-cased traffic [04:40:12] yeah, that's what I figured [04:40:14] yeah, it's surely tiny. [04:40:29] (footnote: i want everything unsampled :P) [04:40:51] (but udp2log falls over) [04:40:57] I know [04:41:24] so yeah. i'll check with otto tomorrow. [04:41:28] wmf.org is a low hanging fruit (or will be in a few hours or days), if you're looking for one [04:41:38] cool thx [04:41:46] aiight. i'm sure we'll be able to make that happen tomorrow. [04:42:02] i doubt it's more than a one-box config change. [14:48:33] !log rebooting hadoop datanodes with hyperthreading (logical processing) enabled [14:48:35] Logged the message, Master [17:34:56] mornin gentlemen [17:35:31] HALLlooooo [18:00:15] https://plus.google.com/hangouts/_/calendar/ZHNjaG9vbm92ZXJAd2lraW1lZGlhLm9yZw.9nskdejqsjnt1p1bqdp70geu68 [18:00:24] oh you boys are already there [20:09:56] btw, back, but looking at stuff with ryan [21:02:18] oh, dschoon, hmm, maybe this is bad timing if we are trying to get stuff done real fast (before the end of next week) [21:02:27] but at the last ops meeting, I volunteered to be on ops rotation next week [21:02:34] oh wait, maybe its the week after [21:02:35] hmmm [21:38:29] dschoon, whaaaat's doin, can I help you with anything atm? [21:38:29] if not, I'll see about running the consumers more often [21:43:23] back. [21:43:37] i was engaged in meetings. [21:43:54] ottomata: i'm going to write the zerobytes script now [22:18:08] dschoon, if you haven't already done it, I did too: [22:18:09] https://gist.github.com/4392585 [22:18:20] awesome [22:18:42] oh, i didn't know you could glob. [22:19:40] we kinda want the sizes for every job though [22:19:57] because we want to know if the ones that come after the zero-byte jobs are bigger [22:24:40] can do [22:30:16] https://gist.github.com/4392686 [22:34:48] ok, dschoon, this is the most useful i think [22:34:49] https://gist.github.com/4392722 [22:35:15] peacing out real soon, i'll start more frequent imports tomorrow [22:42:05] laatas! [22:46:29] bye otto [22:46:42] happy new year! [22:53:48] ottomata: can you make sure DarTar is in the right LDAP groups for hue? [23:44:16] finishing out from home. back online in 30 or so. [23:49:44] nite everyone, you can now add remote data-sources to limn :)