[01:24:59] (PS4) Jdlrobson: [WIP] Use NewEditorEdit schema for new graph [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/105869 [01:33:38] (PS5) Jdlrobson: [WIP] Use NewEditorEdit schema for new graph [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/105869 [01:34:16] (CR) Jdlrobson: "My Limn instance seems to have broken and I haven't got a clue why.... so I can't test this :(" [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/105869 (owner: Jdlrobson) [14:46:40] (CR) Nuria: [C: 1] "Added 1 comment." (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/105869 (owner: Jdlrobson) [14:53:15] Same procedure as everyday ... I cannot join the batcave :-( [14:53:38] ottomata: Could you please invite me again? *very friendly smile* [14:53:39] (CR) Milimetric: [C: 2 V: 2] "Wiki Metrics" -> "Wikimetrics" consistently [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/107486 (owner: Sharihareswara) [14:59:39] milimetric: I cannot join the hangout again. Could you please invite me? [14:59:48] yes [14:59:49] sorry! [14:59:59] what's your email again [15:00:03] stupid auto complete [15:00:05] qchris: ^ [15:00:14] stupid brain of mine too :( [15:00:25] pm-ed the email address. Thanks. [15:07:58] ... [15:08:56] charles-mobile! [15:10:27] Are we having standup today? [15:10:31] https://plus.google.com/hangouts/_/calendar/d2lraW1lZGlhLm9yZ19jYjM3bXU0OGNuaHRkN2hybmE4czI3b25hb0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t.c6j7qidqs491nhi7ovk9pi4h14?authuser=1 [15:10:43] https://plus.google.com/hangouts/_/calendar/d2lraW1lZGlhLm9yZ19jYjM3bXU0OGNuaHRkN2hybmE4czI3b25hb0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t.c6j7qidqs491nhi7ovk9pi4h14?authuser=1 [15:11:14] https://plus.google.com/hangouts/_/calendar/d2lraW1lZGlhLm9yZ19jYjM3bXU0OGNuaHRkN2hybmE4czI3b25hb0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t.c6j7qidqs491nhi7ovk9pi4h14?authuser=1 [15:11:15] ga [15:11:21] https://plus.google.com/hangouts/_/calendar/d2lraW1lZGlhLm9yZ19jYjM3bXU0OGNuaHRkN2hybmE4czI3b25hb0Bncm91cC5jYWxlbmRhci5nb29nbGUuY29t.c6j7qidqs491nhi7ovk9pi4h14 [15:11:21] there [15:11:35] oh [15:11:39] i need to add your gmail [15:11:41] what is your gmail again? [15:11:45] charles-mobile: ^? [15:12:06] charles.a.salvia [15:12:34] ok try now [15:28:07] average, should we keep chatting? [17:13:02] (PS1) Nuria: Making models compatible with SQLAlchemy > 0.8.1 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/107602 [17:14:56] (PS2) Milimetric: Making models compatible with SQLAlchemy > 0.8.1 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/107602 (owner: Nuria) [17:17:53] (CR) Milimetric: [C: 2 V: 2] Making models compatible with SQLAlchemy > 0.8.1 [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/107602 (owner: Nuria) [18:10:02] hey halfak [18:10:15] hey ori. [18:10:30] what's the veredict? :) [18:10:33] *verdict [18:11:25] Sorry for the delay, but I haven't been able to get to the analysis yet. I can have an answer for you by end of day. [18:12:16] cool, no problem [18:13:21] How often do we update https://metrics.wmflabs.org to git master? [19:22:21] wow, just deployed limn over limn-deploy to reportcard.wmflabs.org [19:22:25] 0 problems, first try [19:22:26] :) [19:22:32] fabric ftw [19:22:42] fabric ftw indeed [19:24:21] is the analytics showcase going to be broadcast? [19:29:02] I cannot find a hangout in the showcase invite ... does anyone of you see one? [19:29:33] hmm i don't have showcase on my cal? [19:29:58] It's on DarTars calendar. [19:30:04] oh research showcase? [19:30:06] or analytics? [19:30:15] research's [19:30:17] ahhahah [19:30:18] ah [19:30:19] ok [19:30:36] we still have a week of work ahead of us :-) [19:33:17] (PS1) Milimetric: enabling Wikidata by default [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/107619 [19:33:32] (CR) Milimetric: [C: 2 V: 2] enabling Wikidata by default [analytics/reportcard/data] - https://gerrit.wikimedia.org/r/107619 (owner: Milimetric) [19:41:34] Ironholds: yt? [19:41:35] can you join the hangout? [19:41:47] DarTar, lemme test [19:43:29] * Ironholds pokes halfak [19:43:34] we have a link in your inbox :D [19:43:36] kk [20:31:41] milimetric: do you have a moment to talk? I have 2 questions, one about an OAuth error I'm getting, and one about https://bugzilla.wikimedia.org/show_bug.cgi?id=58208#c4 [20:32:05] yes, but analytics research showcase [20:32:08] 10 minutes-ish? [20:32:44] milimetric: sure, no prob [20:39:23] (sorry, I thought it was over) milimetric: https://bugzilla.wikimedia.org/show_bug.cgi?id=60095 is the first. I only get this particular OAuth error in my dev environment, not when I log in at metrics.wmflabs.org, and it only affects Wikimedia login, not the Google login. Is there something I need to fix to get the SSL handshake to work, or was this never intended to work on other sites? (or maybe there is a third option) [20:39:48] k sumanah, shoot (or if you prefer hangouts, come to the batcave) [20:40:05] I replied to the bug, did you see? [20:40:18] * sumanah checks mail. not yet [20:40:20] * sumanah checks bug [20:40:24] or... i did not.... [20:40:25] wtf [20:40:49] i definitely wrote that answer down somewhere [20:40:50] hm.... [20:40:56] weird! [20:41:07] now i'm scared some random person got that and is totally confused [20:41:14] HA [20:41:27] ah, I see [20:41:35] like, you wrote it in a blog comment or on HN ;-) [20:41:35] the bugzilla daemon is being lazy [20:41:36] oh! So this is the last silly gotcha in setting up your development environment. I'd love it if anyone came up with some sort of automated way to do this. Basically the standard httplib2 library does not have the appropriate certificates to do SSL handshakes with MediaWiki. So in production and locally we just remove the httplib2 from our systems and install this instead: https://github.com/wikimedia/pywikibot-externals-httplib2. [20:41:36] It's a version that has the proper certificates baked in. [20:41:37] I'm happy to keep this as a bug and change it to: find a way to automatically install a version of httplib2 that works with MediaWiki. [20:41:58] i wrote that in response but the daemon hasn't put it on the bug yet [20:42:19] (I reply via email is what I mean) [20:42:42] milimetric: oh, hmm, I should try replying via email sometime [20:43:07] so yeah, that's the weird thing I forgot in the setup instructions [20:43:12] thanks for finding it [20:43:15] Sure [20:43:24] milimetric: I'm happy to add that to the README [20:43:28] I guess in the readme we could just mention installing that pywikibot version yea [20:43:33] cool, that'd be great [20:43:48] phew, done [20:43:53] halfak, was that okay? vaguely interesting? [20:46:14] milimetric: to remove httplib2 I was gonna just do a pip uninstall - any reason I should remove it in a different way? [20:46:54] Ironholds: interesting [20:47:12] and I would forward evan's similar work but I'm not sure it's relevant [20:47:24] bug me if you're interested - he dug into how the GeoIP databases change over time [20:47:36] I'm not sure if pip uninstall works [20:47:39] but if it works for you sumanah, then do it [20:47:53] * sumanah ventures forth on a voyage of discovery :-) [20:47:54] otherwise you may have to rm -rf the httplib2 related directories from dist-packages [20:47:57] heh [20:48:02] if you get in trouble, definitely ping [20:48:09] milimetric, cool! Just diffing it? [20:48:19] right now: [20:48:20] what I'm interested in is not so much the database changes as the database changes as they hit us. [20:48:22] (in my venv) [20:48:22] $ pip freeze | grep http [20:48:22] httplib2==0.8 [20:48:24] no, I believe he was after the same rough thing you're after Ironholds [20:48:29] cool! [20:48:31] okay, lunchtime [20:48:48] cool sumanah, yeah, that's the bad one I'd think [20:48:57] oh, venv... hm, that might be easier yea [20:49:06] <-- python noob [20:49:20] yeah, this is a big reason venvs are nice :) [20:59:36] * sumanah does a bunch of wording [21:01:18] halfak, we should talk geolocation and independent variables when you get into town. I have a plan ;p [21:02:18] sumanah: re: https://bugzilla.wikimedia.org/show_bug.cgi?id=58208#c4, I also replied to that [21:02:23] lazy bugzilla :) [21:02:30] basically, I said "YES!" [21:02:39] totally go ahead and make a new template [21:02:44] cool! [21:02:47] thanks milimetric [21:02:52] milimetric: you can also use the requests library instead of httplib2 and disable SSL certificate checking [21:02:57] did you find where to change the route in the controller? [21:03:13] thanks drdee, I don't use httplib2 directly [21:03:16] it's flask-oauth that does [21:03:20] and I totally hate that module now [21:03:30] I'll switch it to rauth whenever I have time [21:03:37] (which uses requests) [21:03:45] kool [21:04:50] sumanah: https://git.wikimedia.org/blob/analytics%2Fwikimetrics.git/d0dfce8c314b2d4f3f08bd4db458e231665b8f7e/wikimetrics%2Fcontrollers%2Fcohorts.py#L54 [21:05:22] so instead of json_response you can return render_template and pass the model to your template [21:05:46] and then instead of using jquery to click that link, you can just make it a normal link [21:06:20] sumanah, that link is here: https://git.wikimedia.org/blob/analytics%2Fwikimetrics.git/d0dfce8c314b2d4f3f08bd4db458e231665b8f7e/wikimetrics%2Ftemplates%2Fcohorts.html#L61 [21:06:52] uh, duh, never mind, you don't have to change the link [21:06:56] :) [21:06:58] (PS1) Sharihareswara: README improvements - httplib2, suggesting using a venv [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/107710 [21:07:35] milimetric: reading backscroll now, thanks. Sorry, was fighting Git [21:09:40] np at all, just fyi I don't expect IRC conversations to be real-time [21:09:58] if I absolutely need to tell someone something I email it [21:10:01] milimetric: cool! [21:11:06] (I love the requests library!) [21:11:37] should we really disable SSL cert checking? Do we just not care about that particular threat vector? (cc drdee) [21:14:30] hm, not sure [21:14:39] i think the oauth identify protocol is pretty damn secure [21:14:55] but what do i know [21:14:57] (PS1) Sharihareswara: capitalization in README [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/107715 [21:15:32] sumanah: only for dev work you should disable it, obviously not in prod [21:15:41] should, i mean could [21:15:51] drdee: ah, got it, thanks [21:16:09] that reminds me - we've turned Flask debug mode off for the real site, right? [21:23:24] yes sumanah, definitely [21:24:00] ok, phew :) [22:58:30] ok, this is weird. "from .controllers import *" is crashing my wikimetrics installation now, and wasn't a few hours ago [22:58:39] "ImportError: No module named controllers" [23:03:59] matanya: if you want to puppetize the wikimetrics setup, talk to average who has already started [23:05:34] average, if you have a moment to look at a crash: at some point within the last few hours, my Flask and Celery processes stopped being willing to start :/ http://tools.wmflabs.org/paste/view/385b0c7b is what happens when I try to do wikimetrics --mode web or queue [23:08:53] matanya: Stefan ("average") is a good person to liaise with [23:08:58] re the puppet thing [23:09:53] ok, i see [23:39:58] anyone here able to help me troubleshoot why my limn graph doesn't work locally?