[15:11:15] hashar: hey Antoine [15:11:29] hashar: can you help me get access on stat1001 please ? [15:11:40] I have no way to do that [15:11:48] hashar: who should I talk to ? [15:11:49] you want to ask in #wikimedia-operations :-D [15:12:03] mark paravoid and apergos would be the one to talk to [15:12:58] hashar: I wrote to them [15:13:29] nice :-] [15:15:15] morning average_drifter, milimetric, ottomata [15:15:24] morning drdee [15:15:33] aight [15:15:44] a little bit behind schedule but hey it's my first attempt [15:15:45] hey drdee ! :) [15:15:49] how's the tiny one [15:15:50] :) [15:16:06] a happy pumpkin as she was just fed [15:16:37] average_drifter: did you and ottomata deploy webstatscollector? [15:16:59] drdee: ottomata informed me yesterday that webstatscollector had not crashed and it produced data properly [15:17:12] drdee: but I'm not sure as if he deployed it into production [15:17:22] k [15:17:30] sounds like a good start [15:19:30] :) [15:19:43] I'm looking for ottomata for access on stat1001 to deploy editor wikistats [15:19:58] I contacted #wikimedia-operations in the meantime [15:20:17] why not run that on stat1 just like wikistats? [15:21:09] drdee: that is possible, but the page itself stats.wikimedia.org sits on stat1001 ( as I was informed by Erik ) [15:22:16] drdee: Erik says there's an rsync taking data from stat1 => stat1001 [15:22:32] yes so it should be hosted on stat1001 [15:22:38] but the crunching needs to happen on stat1 [15:22:49] so ottomata can just add the editors content to that rsync [15:23:11] drdee: Erik says he's gonna show me an example of the rsync [15:23:15] k [15:23:33] is ottomata joining us today or is he already enjoying his long weekend? [15:23:43] drdee: I'm not yet 100% whether the flow is stat1 => stat1001 or viceverse (if the latter, I will need access to stat1001 which I'm talking about right now with mark on #wikimedia-operations ) [15:24:02] the flow is stat01 --> stat1001 [15:33:37] drdee: ok [15:33:53] drdee: I talked more with Erik and it seems I will need access to stat1001 to be able to run the scripts that do rsync [15:34:06] drdee: mark on #wikimedia-operations asked me to create ticket [15:34:13] drdee: I sent an e-mail which creates the ticket [15:34:19] drdee: I will need your approval please for this [15:34:20] let's talk with ottomata first [15:34:29] got your email [15:34:31] thx [15:55:46] average_drifter: ping [16:04:09] drdee: here [16:04:37] talking with Erik on skype [16:04:40] okay, have there been any pushes to wikistats [16:04:41] ? [16:04:43] oh okay [16:04:45] shall i join? [16:05:14] drdee: there's a review in progress with some things that need corrected [16:06:04] k [16:50:17] brb 30m [16:54:42] k [17:58:43] https://plus.google.com/hangouts/_/2e8127ccf7baae1df74153f25553c443bd351e90 [18:00:38] drdee, erosen, average_drifter, ^^ [18:00:50] still talking to robla, coming soon [18:03:01] coming [18:32:51] folks, I have to skip today's analyst scrum - (hopefully final) follow-up doctors appointment for my wrist in 20 mins [19:12:37] yawn. [19:12:47] don't we have days off this week at some point? [19:15:45] tomorrow and friday [19:15:52] we have friday off? [19:15:53] huh [19:15:55] cool. [19:16:02] so you can shop [19:16:11] oh! good point. [19:16:37] i definitely need some senseless consumerism to fill this hollow void in my life where my heart should be [19:16:45] maybe i could get some shoes~ [19:16:46] or in your case struggle with comcast :D [19:27:32] sigh. [19:38:43] yo, has andrew otto been around at all today? [19:55:28] no, he is taking a day off, can i help? [19:55:32] binasher ^^ [19:57:44] drdee: hey, i wanted to ask him about if he'd like having the /event udplog traffic sent directly to analytics1001 [19:58:04] but i should probably wait til monday to make any changes with that anyways [19:58:29] i think that's okay, dschoon what's your opinion? [20:27:56] my opinion is that lunch was great. [20:27:59] (reading) [20:33:33] i think the answer is that we should wait to answer until otto is back [20:34:29] our public IP points at a cisco, and they have ~3.6T in storage [20:35:00] we want to run the kafka brokers on dells because they have ~24T [20:35:15] that gives us enough headroom to keep a sliding window of a week or so in logs [20:35:56] so pointing the whole stream at a cisco would either mean routing it internally afterward, which hurts throughput overall [20:36:18] or moving the public ip [20:37:10] though i'm not all THAT worried about net, it would really, really suck to have to upgrade [20:37:21] (switches, interfaces, routers) [20:37:36] so i lean toward moving the ip, and that means we should wait for otto [20:37:40] ^^ binasher [20:49:56] dschoon: there would still be internal routing of all the traffic though, wouldn't there? or a significant portion [20:50:15] of course. [20:50:28] but hadoop is notorious for gobbling up net [20:50:37] just trying to be conservative about a known-scarce resource