[15:33:31] hi [15:34:21] * average just had coffee+energy drink to get him through the day [16:32:46] (PS1) QChris: Add skeleton for script to monitor geowiki-data files [analytics/geowiki] - https://gerrit.wikimedia.org/r/83809 [16:32:47] (PS1) QChris: Add monitoring of dashboards [analytics/geowiki] - https://gerrit.wikimedia.org/r/83810 [16:32:48] (PS1) QChris: Add monitoring of graphs [analytics/geowiki] - https://gerrit.wikimedia.org/r/83811 [16:32:49] (PS1) QChris: Add monitoring of datasources [analytics/geowiki] - https://gerrit.wikimedia.org/r/83812 [16:32:50] (PS1) QChris: Add monitoring of datafiles [analytics/geowiki] - https://gerrit.wikimedia.org/r/83813 [16:32:51] (PS1) QChris: Update monitoring for data up to 2013-09-10 [analytics/geowiki] - https://gerrit.wikimedia.org/r/83814 [16:50:15] hey average [16:50:18] yo qchris [16:53:46] Hi drdee :-) [17:03:00] drdee, ottomata: scrum [17:03:21] you can run it i am in a workshop [17:03:23] milimetric as well [17:03:34] but if the three of you run it that would be great! [17:03:40] Ok :-) [17:03:46] oh scrum!? [17:03:52] where do I go?! [17:03:58] oh qchris and I are good at 2 person scrum [17:04:14] We're in the Batcave now. [17:10:50] drdee: hi [17:10:56] drdee: is milimetric around ? [17:11:00] yes [17:11:55] hey average [17:11:59] what's up [17:12:20] hey milimetric [17:12:43] drdee: qchris is asking if there's a calendar with hangouts going on at the meetings [17:13:18] milimetric: is it ok to go raw sql and try to conver to sql alchemy afterwards ? [17:15:03] or maybe not [17:15:43] I will need to extend stuff from func.tools I think [17:15:46] to some extent [17:16:11] I mean from func.* [17:16:44] oh qchris [17:16:49] 10.4.1.118 is zero-bdd.pmtpa.wmflabs. [17:16:52] it is a labs instance [17:16:59] labs? Oh :-/ [17:17:03] ha, right? [17:17:04] i think we should discard labs traffic by default [17:17:32] yeah but uhhh how is that traffic getting into the udp2log stream? [17:17:52] Yes, we discard 10.0.0.0/8 traffic. But it should never get set there. I thought it indicates that something goes wrong somewhere. [17:18:00] Yes. That's just my point. [17:18:13] oh i see yuri [17:18:14] gonna ask him [17:18:54] average, yeah, totally, if there's no danger of sql injection from user inputs, using the sql expression stuff from sqlalchemy is totally fine [17:18:59] or do you mean totally raw SQL? [17:19:51] milimetric: raw SQL with placeholders [17:20:06] yeah, I don't think we should do that average [17:20:24] why don't you write the raw sql and let's see what we'd need to do to make it into SQLAlchemy [17:20:25] We should have updated our software years ago [17:20:55] oh! average! [17:20:58] let's try floobits [17:20:58] ? [17:21:02] what's floobits ? [17:21:10] https://floobits.com/ [17:21:16] we can write this in real time together [17:21:39] we can get the 30 day trial and we have support to continue afterwards if it's useful [17:21:43] but this is a perfect use case [17:21:51] it integrates with VIM [17:22:07] yeah, except it doesn't integrate with an actual environment where you get to run things [17:22:25] it's not just about writing the code.. we also need to run it to see if it works or not [17:22:39] but let's give it a shot, we can experiment with it for today [17:23:12] sharing terminals ? [17:23:14] how does that work [17:23:15] ? [17:23:23] is it secure in any way [17:23:23] ? [17:23:58] ok qchris, zero-bdd is adam baso's test labs instance [17:24:07] it is making periodic requests to prod varnish [17:24:12] Ok. [17:24:18] we have no idea why it would not have zero= set though [17:24:19] Our hardware is too slow to cope with demand [17:24:28] average, I've gotta run to a meeting now [17:24:49] but do the SQL and we'll mess with it in about an hour [17:24:50] sooo buuudunnoooo [17:24:53] ottomata: If it's just his test machine, that's fine with me. [17:24:56] anyway, let's look at those geowiki changes [17:25:05] Sure. [17:25:14] milimetric: ok [17:25:37] ottomata: I added a comment to https://gerrit.wikimedia.org/r/#/c/82410/2/manifests/misc/statistics.pp [17:26:12] oh i see [17:26:20] yes, we can drop it, if you like, hmm. [17:26:35] Would you prefer to keep it? [17:26:46] I do not mind. [17:26:51] hmm [17:27:05] i got back and forth on this sometimes [17:27:38] up to you, these statistics class aren't organized or consistent enough for me to make a decision [17:27:40] and it doesn't really matter [17:27:54] Ok. [17:28:37] Do the other two changes make sense to you? [17:34:53] ja i think its cool [17:35:06] i guess just submit whatever patchset you want to 82410 and I will merge them all :) [17:35:10] also, adam baso is here with me [17:35:21] he wants to troubleshoot the IP/X-CS mismatch issue [17:35:29] want to hangout with us and think about that after I merge these? [17:36:33] qchris: ^ [17:36:58] ottomata: Awesome! [17:37:21] I am in the Batcave. [19:03:09] (PS1) Erik Zachte: Hebrew speakers 10M -> 5.3M [analytics/wikistats] - https://gerrit.wikimedia.org/r/83847 [21:05:16] average: qchris: https://office.wikimedia.org/wiki/HR_All_Hands_Event_Details_2013 [21:06:46] Thanks! [22:22:08] ottomata: are you free to figure out my login issue ? [22:22:18] on https://stat1001.wikimedia.org/public-datasets/analytics/mobile/ [22:22:28] tfinc: use http [22:22:33] it's httpseverywhere bug [22:22:54] yup. thats works just fine [22:22:57] thanks YuviPanda [22:23:00] yw :) [22:23:05] ottomata: are you aware of that bug ? [22:23:24] oh yeah i remember something about t hat [22:23:29] yeah i'm free(ish) was about to start something but i'm here [22:23:31] does http work for you? http://stat1001.wikimedia.org/public-datasets/analytics/mobile/ [22:23:43] tfinc: ^ [22:24:02] yeah, it did [22:24:12] oh sorry [22:24:13] saw that [22:24:14] ottomata: read the backscrollYuviPanda pointed that out [22:24:18] all good now [22:24:24] ok cool, great [22:44:29] qchris, around? [23:32:05] (PS1) Diederik: Add test data for unit-tests [analytics/kraken] - https://gerrit.wikimedia.org/r/83962 [23:32:21] (CR) Diederik: [C: 2 V: 2] Add test data for unit-tests [analytics/kraken] - https://gerrit.wikimedia.org/r/83962 (owner: Diederik) [23:37:01] why [23:37:02] In the interest of efficiency I only check my email for that on a Friday