[13:17:39] hey phuedx! [13:17:42] I'm in Glasgow!!!1 [13:17:48] \o/ [13:17:52] \o/ [13:17:52] hey yuvipanda [13:17:56] phuedx: it's cooold [13:17:59] hah! [13:18:05] it's pretty dern cold here too [13:19:22] phuedx: heh, yeah. and raining as well [13:19:28] alright, you win [13:19:33] you workin'? [13:19:52] phuedx: yeah :) but will do Quarry stuff for a bit as well. sqlite on NFS! [13:19:59] \o/ [13:20:00] awesome [13:20:08] i've got a lot of review to catch up with [13:20:13] i suspect that's me for the day ;) [13:21:29] phuedx: :D [13:21:54] phuedx: halfak is also in the UK still, btw. Unsure if I told you, but he'll be at Oxford for a bit [13:22:12] yeah, he told me [13:22:29] i don't know how long he's around for though [13:22:36] meetup in oxford! [13:23:23] :D [13:23:24] yeah [13:23:29] although I guess Glasgow is a bit too far [13:24:02] maybe… [13:24:13] how long did it take you to get there? [13:24:21] many, many hours? [13:24:59] phuedx: 6h [13:25:26] yowza [13:37:43] lzia! [13:38:03] yes, Ironholds. [13:38:35] * yuvipanda waves at leila and Ironholds [13:38:41] hey yuvipanda. [13:38:51] hey yuvipanda :) [13:39:14] * yuvipanda has gone back to a layering to combat cold [13:41:40] I need a haircut [13:42:51] haha! I got one yesterday [13:43:00] leila, https://scontent-a-lhr.xx.fbcdn.net/hphotos-xaf1/t1.0-9/p403x403/10603690_10152670575361255_2618172432494744226_n.jpg [13:43:04] it just did that WHILE I SLEPT. [13:43:20] yeah, so either shower or haircut [13:43:21] :D [13:43:26] maybe I should just very gingerly put it in a lawnmower [13:43:34] it does that after the shower too, as soon as it dries :( [13:43:36] haircut it is [13:43:43] plus, there is a rule that everyone in R&D has to have the same hair [13:43:48] and if you already got a haircut, well. [13:44:34] :D [13:46:02] wait wait wait [13:46:08] Ironholds: why would you want to get rid of that? [13:46:27] a little putty and you could spike it proper! [13:46:29] phuedx, because it looks ridiculous? [13:46:31] indeed [13:46:35] yeah, that's not really my scene [13:46:41] I was a rivethead as a teenager, not a punk [13:46:53] gimme some Assemblage 23 and death metal any day. [13:46:55] as someone without enough hair to do anything with it, you should do something with it [13:47:17] ^ that [13:47:25] you both have lovely albeit short hair! [13:47:27] your hair is for our satisfaction, not yours! [13:47:34] indeed [13:47:41] I feel objectified and a newfound appreciation for the anti-kyriarchy. [13:47:45] in order [13:47:51] it's like parents going 'I could not be a Doctor, so you should be!' [13:47:56] I'm Jewish [13:48:02] even if my parents WERE doctors they'd do that. [13:48:10] pick a better example [13:48:25] I'm not, and you're the closest male Jew around, so don't cut it. [13:48:55] ...mate, male jews are TYPIFIED by cutting it. [13:48:58] the only variance is in "it" [13:49:05] * yuvipanda gives Ironholds a phamplet [13:49:30] guys, I need to sign off and hit the road. see you in 1.5 hour or so. [13:49:40] have fun! [13:49:46] yuvipanda: fair ;p [13:49:53] :P [13:54:20] coffee time! [13:54:38] yuvipanda: so i have to get you hooked to coffee when you come back down to london, right? [13:54:47] phuedx: indeed [13:54:50] you can try [14:20:17] Hey guys. Just finished OII stuff. It went well. I got a lot of questions about view logs and geo-coding. [14:20:24] \o/ [14:20:33] you've had a busy week, halfak [14:21:08] hey yuvipanda. Taha Yasseri (oxford prof) was very excited about Quarry. [14:21:14] w000t :D [14:21:19] Looking forward to us it to introduce people to the data. [14:21:28] \o/ yeah, am redoing the results storage bits [14:55:13] halfak, cool! [14:55:21] I'm actually working on a project with han-teng around just those things :D [14:55:49] the OII has some awesome people. [14:56:05] Mwhahahaha MOAR COLLABORATION [14:56:23] what's OII [14:56:28] and yeah, Collaboration [14:56:49] I did some simple calculations with space and other requirements for pageview data, don't think it's doable much on labs instances, sadly [14:57:24] yuvipanda, but we can probably store the crunched results [14:57:46] true, depends on what you crunch. even daily ones for all wikis all pages would be untenable [14:57:49] N hits to A URL-that-we-care-about in B time period from C country. [14:57:56] really? wow. [14:58:03] ah, but is that including requests or pageviews? [14:58:11] pageviews, from the raw dumps [14:58:17] which is the only publicly available data I have [14:58:18] because I'm pretty sure the webstats dumps are proof it's workable ;p [14:58:21] huh [14:58:35] Ironholds: ah, because they're on NFS, and not easily queryable :) [14:58:47] Ironholds: the raw pageview data is also on NFS, and not easily queryable. I want them to be queryable :) [14:59:09] which would mean some kind of database [14:59:40] halfak: btw, in a month or so, you should be able to use Quarry to query OSM dat as well :) once our OSM labs stuff settles down [15:00:04] Ironholds: and MySQL on NFS is just asking for slooooowwwwwneeeeessss [15:00:13] WAT. YUS! [15:00:29] In a month!?! [15:00:36] We can use this. OMG. :D [15:00:38] halfak: probably lesser, but I wanted to pad it out a bit :) [15:00:43] Good [15:00:46] halfak: you can't join between them, since OSM is postgres [15:01:14] Even so. [15:01:16] Still OK [15:01:19] indeed :) [15:01:20] And amazing [15:01:27] :) [15:01:46] halfak: we could make other data sources quite easily available as well, in mysql or postgres. so if you think any other such thing would be useful, hit me up [15:27:45] I'd like to look into ways to get EventLogging into Quarry/LabsDB. Is that just a political issue or can we make technical progress? [15:27:57] yuvipanda, ^ [15:35:07] so, Ironholds, are you in Boston or what? :D [15:35:18] kevinator has heard some rumors. ;p [15:35:32] leila, hah. No, I do not hit Boston for another week or so :D [15:35:38] I am in London working opposite my dad [15:35:49] that's comforting to hear. ;-) [15:35:49] who is affectionately known in his industry as Comedy Jon, a fact that amuses me endlessly. [15:36:09] what industry? [15:36:10] please send our best regards from the sf office. [15:36:10] because they have the pattern of [name] [company] or [company] [name] because it's a largely word-of-mouth field. [15:36:19] this results in "Comedy Jon" or, my favourite, "Dave Banana" [15:36:28] oh, and "Dave Hah Bloody Hah" [15:36:34] kevinator, standup comedy! [15:37:02] is he on youtube? [15:37:06] does he have a website, Ironholds? [15:37:11] probably not, he's an agent not a comedian ;p [15:37:18] I've heard everyone should have internet presence. [15:37:27] the one legacy he has left me of this is that I scream "ARSEHOLES" at the TV whenever the Avalon logo comes on [15:37:29] leila, pshhh ;p [15:37:41] I don't think that internet thing is going to catch on [15:37:45] http://www.ukcomedy.com/2k2/home.html [15:38:40] hey halfak. you're not comping today? [15:38:50] I should comp tomorrow [15:38:57] Na. I've gotta start getting caught up. [15:38:58] I'll be in standup. [15:39:24] halfak, things you missed [15:39:26] cool. :-) I came to office with so much excitement and turns out no one will show up today [15:39:27] :D [15:39:33] we declared Leila to officially as well as unofficially be Director of Analytics [15:39:40] Makes sense. [15:39:48] Toby is moving on to the role of Chief Keeping It Real Officer. [15:39:49] Also Toby owes you at least $2. [15:39:54] I owe you $5 :/ [15:39:56] hahahahaha! [15:40:02] (look, you came up a lot in conversation) [15:40:03] did anyone mess it up in the presentations? [15:40:17] I don't think so. But we can review the videos >:) [15:40:17] I messed it up *explaining why I had a jar on my desk full of money*. [15:40:21] If that's not perfect timing... [15:40:25] lol [15:40:25] hahahahaha! [15:40:27] it should be pounds when done in the UK [15:40:38] but then how do we handle conversion? [15:40:42] payday rate or offence day rate? [15:40:59] speaking of which, I've noticed ErikM has a full control over the two names. It's impressive [15:41:08] halfak: hey! was in meetings [15:41:21] halfak: it's political, technical and ethical/legal [15:41:30] halfak: data sanitization is the *biggest* issue. [15:41:37] halfak: technically it's not hard at all [15:41:46] Yeah. I can work on that bit. [15:42:04] I'd like to extend schemas with some annotations though. [15:42:09] Or annotate something else. [15:42:27] halfak: what kind of annotations? [15:42:28] Basically, I want structured annotations and I can be convinced about where they should live. [15:42:39] "This field can appear in public view" [15:42:47] aha! [15:43:25] yes, indeed. putting them in Schema: pages right now even should be ok, and we can extend our redaction scripts to work with that [15:43:27] oh god [15:43:35] so, I just read the C code that R src uses for dt handling. [15:43:42] We already do a lot of negotiating which fields we capture for privacy/ethics reasons anyway. We can include these concerns in the same conversation. [15:43:51] halfak: :) indeed [15:43:58] http://www.desktopwallpaper2.com/desktop-wallpaper-home/0f14c735f16e5a558125bedb798620fb-6-1920x1080.jpg [15:44:29] halfak: I think way forward is to pick the most useful EL table, and then work towards making a version of that public [15:45:02] Sounds good. I have a set of them that correspond to public events and contain public data, but are more sanely structured. [15:45:11] halfak: right. [15:45:21] https://meta.wikimedia.org/wiki/Schema:PageMove [15:45:47] halfak: yeah, that should be all public, I fancy [15:46:05] brb [16:20:28] researchers: are we doing the standup today? [16:20:29] I'm down [16:20:41] that is, a fan of it [16:20:44] halfak, leila [16:20:57] yes. [16:20:59] Plz [16:21:10] Still in Growth standup. [16:21:29] yes, Ironholds. [16:21:36] yay! [16:21:37] but we still have 9 mins, right? [16:21:43] * Ironholds goes to fill it out with a happy feeling in his heart [16:21:43] yep! [16:32:46] Ironholds, fyi, I'm in the hangout. ;p [16:32:51] leila, yep! [17:15:21] Off to dinner. I'll be back online tonight. [17:15:23] o/ [18:34:13] phuedx: I'm going to get rid of the *Repository classes, actually. I realize I've to use .session since .add and .commit need to be distinct sometimes, and putting that into Repository feels too much like a passthrough [18:34:19] phuedx: this does commit us to SQLAlchemy, but that might be ok... [18:34:22] phuedx: objections? [18:35:19] yuvipanda: as i said before, those classes were introduced to transition between the existing model classes and sqlalchemy [18:35:33] they don't do a good job of codifying the operations we perform on the database [18:36:03] ideally, we'd have something like an action class, which describes "how to do a foo" [18:36:13] hmm, right [18:36:15] so, i don't have any objections, things could be cleaner [18:36:27] yeah, I think so. [18:36:37] but if you don't do what i say, then i won't speak to you again, ever [18:36:39] alright? [18:36:58] there's also the tradeoff between 'this code is useless now but could be more useful later' vs 'I wish I had done this differently before' [18:37:00] but YAGNI, etc [18:37:07] phuedx: yeah, and no coffee addiction attempt [18:37:37] yuvipanda: if it costs to much to delete 'em, i messed up [18:37:43] i don't foresee that being an issue [18:37:51] phuedx: yeah, it's trivial to delete :) [18:37:53] coool [18:37:55] * yuvipanda hacks away [18:37:58] \o/ [18:39:19] phuedx: I have to do an SQL column rename, apparently those take forever. sigh [18:40:04] boo [20:30:36] Ironholds, on a scale of 0-1, what is the probability that we have a staff meeting now? [20:30:53] 1! But it had no hangout attached and it's 8pm or so. [20:30:57] so I have no idea what's going on. [20:31:03] also, is Toby even in? [20:31:10] mm, I'm in a hangout [20:31:18] I guess we could make up what we had liked the management news to be [20:31:22] He has attended some meetings in the morning [20:31:25] but not sure about now [20:31:31] "Everyone got a raise and we fired product so now you can just do whatever research you want" [20:31:41] "also, erik has to give you a hug every day now" [20:31:57] that's weird; mine did not have a hangout [20:32:04] so, it seems you and I should talk, given that I didn't get either of those [20:32:04] maybe google is being strange. I'll check the calendar directly [20:32:04] :D [20:32:09] haha [20:34:06] anyway [20:34:12] I am totally fine with meeting now iff we have something to discuss [20:34:17] but if Dario and Toby have not shown up... [20:34:54] Dario won't show up, that we know [20:35:02] what about halfak? [20:35:34] I do not see him :/ [20:35:34] so, you and Aaron have not responded to the event [20:35:44] Toby has probably said Yes to all of them be default. ;p [20:35:49] Dario has said no [20:36:07] guyses, we need a session on proper use of calendar. :D [20:36:44] what's the session length? [20:36:48] can I calculate it? pleasepleaseplease? [20:36:56] "D [20:36:58] :D [20:37:06] what's that? [20:37:09] you have a request? [20:38:00] haha [20:38:10] anyway. So I guess the meeting is not on. And, I apologise for wasting your time :/ [20:38:19] was was. you didn't. [20:39:17] was was? [20:40:06] ;p [20:53:39] does the Erik hugs edict apply only to the WMF research team? [20:53:52] if so, are there any openings? [20:57:31] ragesoss, we do have an opening for a traffic analyst [20:57:50] but the subtext is I get to tell you what to do. Or not, and then watch you cry at unquoted, unescaped TSVs while I laugh uproariously. [20:58:04] I feel really sorry for our traffic analyst [20:58:18] :) [20:58:31] I'll see if I can find an easier way to get Erik hugs. [20:58:43] walk up to him, hold your arms out and go "hug?" [20:59:00] that's my usual method, yeah. [20:59:23] but I assume he delivers, if you're on the research team. [21:00:57] absolutely [22:15:38] Ironholds, re: BigInJapan, Did you use http://colorbrewer2.org ? (You were commenting on something to do with being restricted to a single hue, but I don't recall why?) [22:16:23] If not: That's the go-to site, for picking out cartography color schemes. :) [23:30:59] Ironholds, are you around? [23:58:31]