[12:37:54] halfak: https://phabricator.wikimedia.org/T91062 [12:37:59] halfak: what do you think? [13:34:45] YuviPanda, Good idea :) [13:36:12] halfak: :D wanna help co-run it? [13:36:21] Yes. :) [13:36:25] or rather, you’d run it and I’d help, because you know a lot more about research than I do [13:42:00] Meh. I think that a lot of what we're going to want to talk about is infrastructure for research work and support for running new experiments. [13:42:24] So, we're going to be two equal sides of the coin :) [13:42:50] halfak: :D [13:50:38] * halfak extends task description. [13:52:20] halfak: wheee [13:54:14] halfak: btw, way more than 2000 queries now on quarry :D [13:54:19] and people actually complain when it goes down! [13:54:25] and it hasn’t gone down when labs has bene up [13:55:05] :) I've been finding uses for quarry everywhere. Any time someone wants to know how to get something out of the DB, quarry is my communication tool. [13:55:10] halfak: I’m going to increase default quarry time to 20min [13:55:16] not today, but monday [13:55:23] Cool! [13:55:32] Oh say, did you ever hear from Taha? [13:55:36] halfak: not today [13:55:46] halfak: didn’t he ping earlier about doing a workshop today? [13:55:55] yeah. [13:56:05] it was supposed to be a couple hours ago. [13:56:10] I guess they didn't need help. [13:56:33] there was a labs outage earlier during the day [13:56:47] Uhoh. Do you think that would have affected them? [13:56:54] ... then again, they would have asked, right? [13:57:22] halfak: yup. and it was also around noon my time, so earlier in the day, I guess? [13:57:52] halfak: yup, didn’t overlap with their times [13:58:01] GOod. [13:58:02] Oh say! I'm supposed to bug you about puppet. We have an API for revision scoring live now and it would be nice to manage that instance well. [13:58:13] oooh, sure [13:58:15] See http://ores.wmflabs.org/scores/enwiki?models=reverted&revids=4567890 [13:58:23] omg [13:58:25] niceee [13:58:32] is it just a flask app? [13:58:36] Yup [13:58:36] or is there more complexities? [13:58:48] is it computationally intensive? [13:59:09] Not very computationally intensive. [13:59:12] halfak: http://quarry.wmflabs.org/query/runs/all definitely has a lot of queries [13:59:23] But it will rely on the API a lot. [13:59:30] And it will need to be fast there. [13:59:43] I've been doing some optimizations to help that be faster recently. [13:59:47] halfak: right. is the API stateless? where’s the state from? [13:59:57] Fast == fewer queries and more data sharing between models. [14:00:05] It is stateless. [14:00:27] There will be another part of the system that will need to maintain state and oauth. [14:00:36] See https://meta.wikimedia.org/wiki/Research:Revision_scoring_as_a_service/Coder [14:01:20] That coder will require few resources. [14:01:33] I'd like to use postgres as the backend so I can take advantage of the JSON datatype. [14:01:39] I won't need much space. [14:01:46] Not for this project. [14:02:31] halfak: don’t be scared, but *if* toollabs was rock solid reliable, would you use it for this? if not, why not? [14:05:16] YuviPanda, not sure. I guess I'd want to go down the list of current needs and short term plans to make sure that they'll work OK in toollabs. [14:05:35] halfak: right. [14:05:35] E.g. if we have a live updater that requests and caches scores for revisions as they happen. [14:05:40] right [14:05:57] With an instance, I don't really need to worry about affecting other tools. [14:06:12] So long as I play with shared resources in a reasonable way. [14:06:17] in an ideal world, with tools you wouldn’t have to either :) [14:06:20] In toollabs, everything is shared (so I thought) [14:06:26] it is, yeah. [14:07:12] anyway, let’s just start off with our own instances and see if we wanna move to toollabs later. [14:07:25] halfak: I probably won’t be able to do anything until the end of the coming week tho [14:09:30] No worries. We'll keep hacking things together in the meantime. We'll have a better idea of what will need puppet to manage for us when we get there. [14:10:08] YuviPanda, what's your preferred method for hosting a flask app? [14:10:14] uwsgi & nginx? [14:10:18] halfak: yup. [14:10:35] halfak: toollabs has ‘native’ support for uwsgi and nodejs now, btw. no need to fiddle with lighttpd, etc [14:10:52] just put your flask app in ~/www/python/src, your venv in ~/www/python/venv, and do ‘webservice2 uwsgi-python start’ and bam, done [14:11:11] same with nodejs. just put your code in ~/www/nodejs, do webservice2 nodejs start, and bam done [14:11:57] Nice. Will that make sure the app restarts if the who server gets rebooted? [14:13:28] halfak: after putting a ‘webservice2 uwsgi-python’ in ~/.bigbrotherrc [14:13:28] yeah [14:13:33] I’m getting rid of that requirement too soon [14:14:48] lol @ bigbrotherrc [14:15:28] Gotta shower and get ready for the day. Back in a bit. [14:50:03] * halfak smells better now [14:54:56] halfak: overrated!1 [16:21:59] o/ Ironholds [16:22:03] morning. [16:22:11] Is it OK if I comment on your transition doc? [16:24:04] Ironholds, ^ [16:24:20] I assume so; I don't know if toby will have a problem with it [16:24:29] but right now there are so few craps I give about that ;p [16:25:08] kk [17:16:59] milimetric, halfak, LMK when you're available for a GettingStarted walkthrough [17:17:34] Ironholds: i have *just* kicked off a huge query - so anytime [17:17:43] kk. Aaron? [17:18:05] o/ [17:18:08] we should wait for him for sure though, as he has data and I just have some simple funnel advice [17:18:09] batcave? [17:18:19] batcave [17:18:33] I'd like to keep on irc so that I can keep hacking on session paper formatting. [17:18:46] But don't let me stop you :) [17:19:01] Bah. I'm coming to the batcave. [17:19:43] "Trying to join call. Please wait..." [17:46:34] milimetric, halfak wants you back! [17:52:14] okay, we worked it out [17:59:29] hey, is anyone in the standup? I see people filling out notes but I'm alone in the hangout, so I'm wondering if I've got the wrong hangout [18:00:40] sorry I missed your ping! :( [18:00:51] but Ironholds: take a look at Erik's reply if you haven't [18:01:03] yep, I did :) [18:37:05] I strongly feel WMF staffers should get a bereavement day for Nimoy. [18:39:24] lzia: coming back? [19:03:25] Ironholds: I have watched so much media content in my day that if I got bereavement for every celebrity I'd probably be on permanent holiday. [19:03:46] milimetric, so you see why my plan is genius [19:04:18] DarTar, leila, ewulczyn, collaboration requests meeting? [19:04:50] halfak: nothing new on my end, I need to ping Shilad and Mark but I think Mark is still on vacation [19:05:00] so I am skipping unless we have new requests to review [19:05:08] I've got the CMU one. [19:05:19] Not sure if you guys want to talk about that or wait for my next update. [19:05:42] If I actually get them working with the flow team, we'll need to do the MOU/OA policy dance. [19:05:47] I’d go for the latter if that’s ok [19:05:49] right [19:06:42] Sure. [19:06:43] No problem. [19:08:25] thanks [22:57:36] yar