[00:03:55] i added 10.x.x.x to the CIDR filter, drdee [01:37:49] New review: coren; "Congratulations, you manage to be /more/ paranoid than I am! :-)" [analytics/log2udp2] (master) - https://gerrit.wikimedia.org/r/58449 [01:50:00] New review: coren; "Yeah, so ignore the storage quip above, I misread the direction of the overflow in the scenario you ..." [analytics/log2udp2] (master) - https://gerrit.wikimedia.org/r/58449 [04:15:16] New review: Tim Starling; "> I generally don't guard as well against command-line arguments presuming that if you get to pick a..." [analytics/log2udp2] (master) - https://gerrit.wikimedia.org/r/58449 [10:28:46] Change abandoned: Hashar; "(no reason)" [analytics/asana-stats] (master) - https://gerrit.wikimedia.org/r/60459 [10:28:50] Change abandoned: Hashar; "(no reason)" [analytics/check-stats] (master) - https://gerrit.wikimedia.org/r/60460 [10:28:55] Change abandoned: Hashar; "(no reason)" [analytics/editor-geocoding] (master) - https://gerrit.wikimedia.org/r/60461 [10:29:00] Change abandoned: Hashar; "(no reason)" [analytics/glass] (master) - https://gerrit.wikimedia.org/r/60462 [10:29:08] Change abandoned: Hashar; "(no reason)" [analytics/gerrit-stats] (master) - https://gerrit.wikimedia.org/r/60463 [10:29:13] Change abandoned: Hashar; "(no reason)" [analytics/reportcard] (master) - https://gerrit.wikimedia.org/r/60464 [10:29:32] ^^^ they were merely Jenkins tests to add python linting [13:59:13] mooooorning [14:04:32] hey average, are you around? [14:05:31] milimetric, morning [14:05:33] ottomata, morning [14:05:36] average, morning [14:05:40] morning [14:08:13] so i think dschoon was probably right, I somehow blew out my home directories [14:08:22] :( [14:08:26] I can ssh into analytics1001.wikimedia.org [14:08:40] would you mind copying that over my other home directories? [14:08:46] on 02 at least? [14:09:19] prefer to ask ottomata, don't want to make this problem worse [14:09:26] rsync -Cavz analytics1001.wikimedia.org:/home/milimetric analytics1002.eqiad.wmnet:/home/milimetric [14:09:30] ok [14:09:35] i don't think it can get much worse [14:09:38] hi drdee, yes I'm around [14:09:49] hey, you did an amazing job with 353! [14:09:55] thank you so much! [14:10:14] okay a couple of questions: [14:10:24] 1) what is needed to enable jenkins for wikistats? [14:10:40] 1) jenkins is running for wikistats [14:11:09] for all the reports? [14:11:16] (that have unit-tests)? [14:11:24] for the available unit-tests yes [14:11:35] so is this finished: https://mingle.corp.wikimedia.org/projects/analytics/cards/581 [14:12:03] that one is for Travis [14:12:11] we can still do without Travis and only with Jenkins.. [14:12:39] but Travis would have been easier since we can tweak package installs and all sorts of settings [14:12:45] k [14:12:48] hangout? [14:12:51] interaction with Ops delays us by around 7-8h [14:13:04] drdee: in 25m please ? [14:13:33] sure, btw ottomata can merge Jenkins related changes [14:13:39] no 7-8 hour delay ;) [14:13:58] ok [14:19:03] milimetric, shall we do the final iOS pig check for #92? [14:19:36] sure, i can change the regex to the one you thought of last night, though I disagree that it's a useful test [14:19:43] even if the numbers look perfect it could be totally wrong [14:20:15] why do you disagree it's a useful test? [14:20:24] requirements should be gathered not guessed [14:21:00] the reason I gave - how do we know we've had success? [14:26:55] ok drdee, I've pushed the new regex [14:27:20] they have been gathered, see wiki page :) [14:27:25] btw, it'd be cool if we could rename dr0ptp4kt to like _dr0ptp4kt or something :) [14:28:02] the wiki page we've been referencing? well, no, those are incomplete [14:28:46] that might be true, but that's what we have been given [14:28:50] i understand it's frustrating, but in some cases we need black and white. So I'm going to start reading the mobile code [14:31:25] let's wait for brion to show up and ask him, he knows this stuff [14:31:51] where do they keep their code, github? [14:32:28] gerrit, and mirrored on github [14:32:37] ask #wikimedia-mobile [14:39:55] k, thanks, i'll get to the bottom of this [14:40:39] so drdee, i pushed the regex you mentioned yesterday (just pull, sync the jars and try again if you want) [14:40:57] ok doing now [16:01:55] drdee: so gerrit crashes my browser every time I try to access your seed.sql file [16:02:07] ACES! [16:02:08] is there a way to get that with git review? [16:02:16] 1 sec [16:02:31] git fetch https://gerrit.wikimedia.org/r/analytics/E3Analysis refs/changes/47/61147/1 && git cherry-pick FETCH_HEAD [16:02:52] oh duh, sorry, i could've gotten that [16:03:01] curious - can you access the sql file through the gerrit web? [16:03:12] let me try [16:04:07] it crashes my tab as well :D [16:04:11] nice [16:05:21] New patchset: Milimetric; "moving diederik's seed file from the old repo" [analytics/E3Analysis] (master) - https://gerrit.wikimedia.org/r/61584 [16:06:11] sonofa [16:06:31] the new repo is submitting stuff to the old repo's gerrit [16:08:39] ah balls, well, I basically just ended up pushing the seed file drdee, you can change it later [16:09:03] ;) [16:09:49] Change abandoned: Milimetric; "oops, bad .gitreview setup" [analytics/E3Analysis] (master) - https://gerrit.wikimedia.org/r/61584 [16:10:09] drdee, rounce123: could we swarm together on the April engineering report? [16:10:49] i'll be there in a couple of minutes [16:11:04] for sure [16:11:25] thanks. :) [16:15:45] re: engineering report, let's use the scrum hangout. [16:15:48] https://plus.google.com/hangouts/_/2da993a9acec7936399e9d78d13bf7ec0c0afdbc [16:48:31] New review: Yuvipanda; "(1 comment)" [analytics/limn-mobile-data] (master) C: -1; - https://gerrit.wikimedia.org/r/60608 [17:01:05] milimetric, average, erosen: scrum [17:18:15] Mobile Site HTTP Status (March): https://docs.google.com/a/wikimedia.org/spreadsheet/ccc?key=0Ai_u2wTiMldddEpsN19tQkNiOHhZWkZtaVlESk9jZlE#gid=0 [17:18:49] Reminder, please review https://www.mediawiki.org/wiki/Analytics/Infrastructure/Hadoop_Tools [17:18:58] questions welcome :) [17:31:40] milimetric, just saw your message. do i get an underscore so that i'm more l33t as a private variable? lemme know if you need any quick pointers on the zero (ZeroRatedMobileAccess) and mobile web (MobileFrontEnd) hooks. i'm pretty comfortable in the zero code, and have gone through the mobile web code once plus as required as part of my work on the zero team. [17:31:51] oh what?! [17:31:53] you're a real person? [17:31:56] lol, i'm so sorry! [17:32:08] i thought you were something generated to report on dropped packets [17:32:33] hi, I'm Dan Andreescu, who are you dr0ptp4kt? [17:32:40] milimetric, that depends on who you ask. one time my friend broke off a piece of a motherboard, put it in an envelope and left a note in the envelope that said, "Dear Adam, I found a missing part of your brain." [17:32:48] milimetric, i'm adam baso [17:32:57] and i heart analytics [17:32:59] nice, you have good friends then [17:33:04] ok, well nice to meet you [17:33:18] and I will now type three letters every time I gotta ping diederik :) [17:40:11] to those who are interested [17:40:13] https://docs.google.com/a/wikimedia.org/spreadsheet/ccc?key=0Ai_u2wTiMldddHVYLWQ4WGpQalhfMnVhREZFc1o4NlE#gid=0 [17:40:18] Mobile IPv6 Traffic [17:43:50] drdee, kraigparkinson: grooming not happening this week? I'm helping with a big deployment this morning (echo going live on enwiki) but hanging out in case you guys are meeting [17:44:15] dario we are here! [17:44:16] https://plus.google.com/hangouts/_/2da993a9acec7936399e9d78d13bf7ec0c0afdbc [17:44:17] DarTar: https://plus.google.com/hangouts/_/2da993a9acec7936399e9d78d13bf7ec0c0afdbc [17:44:20] sorry, we didn't change hangouts [17:44:26] since we were already all in our stand up one [17:44:57] ic [17:45:02] I'll join in stealth mode [17:45:07] :p [18:00:47] maybe we can use some Kalman filters to estimate stuff (I have no clue about those, but they sound cool) [18:00:52] :D [18:01:00] jk [18:02:38] YuviPanda: shouldn't you be studying ? [18:29:41] ottomata: you see those ipv6 numbers? [18:29:47] faidon was pleased :) [18:30:09] http://www.google.com/intl/en/ipv6/statistics.html [18:30:10] drdee, rounce123: are we going to defer our leadership scrum a little longer today while drdee gets brekkie? [18:31:06] I can push it out by 30min [18:31:32] is that good for you both? [18:31:59] i am good in 15 minutes [18:32:18] I'll go grab lunch quickly now, and be ready in 15. [18:32:41] dschoon, barely, cool! [18:51:02] drdee, wo bist du? [18:51:13] donde estas? [18:55:24] milimetric, could you remind me what I should do to deploy https://gerrit.wikimedia.org/r/#/c/60614/ ? should I use limn-deploy? [18:56:28] the sql should already be running thanks to puppet jgonera [18:56:28] ok, i neeeed foood [18:56:32] i will be back in an hour [18:56:51] and to deploy the new graph/datasource you use limn-deploy and go: [18:56:54] milimetric, but the graph's not showing up, I guess because of the JSON files [18:57:02] fab mobile_dev deploy.only_data [18:57:09] where mobile_dev is whatever you're deploying to [18:57:18] i think the other one of yours is "mobile" [18:58:06] ok, I just deployed to mobile_dev and it works, so I'll deploy to mobile too [18:58:27] k, cool [18:58:47] all that really does is git pull in the data directory, over ssh [18:58:56] and then fixes the permissions [18:59:18] New review: JGonera; "(1 comment)" [analytics/limn-mobile-data] (master) - https://gerrit.wikimedia.org/r/60608 [19:11:14] New patchset: JGonera; "Generate JSON files in datasources using templates" [analytics/limn-mobile-data] (master) - https://gerrit.wikimedia.org/r/60608 [19:43:57] brb lunch [22:20:11] hey dschoon, are you working on the X-CS stuff using Hive? [22:20:17] erosen: did you work on https://mingle.corp.wikimedia.org/projects/analytics/cards/582 by any chance? [22:20:38] (csv output for umapi) [22:20:38] nope [22:20:54] did we take it on for this sprint? [22:21:36] no, but i got an email from jessie saying that csv support was finished [22:21:50] so i guess she was referring to userstats [22:22:06] hmm [22:22:12] i suspect she meant the csv upload feature [22:22:17] which dan and I just finished testing [22:22:21] and seems good to go [22:22:28] k [22:26:37] drdee: i hadn't started yet [22:26:51] i could, though [22:27:00] pleeeeeze :) [22:34:44] yeehawwww drdee [22:34:44] https://gerrit.wikimedia.org/r/#/c/61710/ [22:34:54] YOU ARE THE MAN! [22:36:45] aand, i'm out, tty tomorrow [22:36:46] laters [23:06:46] hey erosen [23:06:49] got a sec? [23:07:17] I was pinging csteipp re: security of UMAPI [23:07:36] and he asked me if you or dan could test something against a local test instance [23:07:54] Is there a labs instance? Or can I get some help setting a dev environment up? [23:08:03] csteipp: not yet [23:08:07] drdee: ^^ [23:08:47] csteipp: if erosen and milimetric are not around maybe drop a line to usermetrics@wikimedia.org ? [23:32:55] csteipp send me instructions on what to do, i have a local dev instance running