[07:37:30] evening fhocutt :) [07:37:35] or morning, I guess? I mean, by my TZ. [07:38:33] o/ Ironholds [07:38:36] how's it going? [07:39:20] I have headphones full o'J-pop, dbs full of data, a schedule full of vacation, and a reading shelf full of interesting sci-fi. Pretty good! [07:39:22] yourself? [07:39:54] that sounds pretty sweet [07:40:13] 12 days of continuous vacation! It's going to be glorious. [07:40:19] oooo. [07:40:24] And I've worked out a way to make sure I don't spend it coding: physically unplugging my machine. [07:40:33] heh, whatever it takes [07:40:40] (this also gives me an excuse to give it a de-dusting, install some new cable runs, and generally make it look pretty) [07:41:04] nice. [07:41:41] am doing decently. Had helpful comments on my code to work off of today, so that's nice [07:42:12] sweet! :) [07:42:15] Helpful comments are the best [07:42:27] Nuria proved once and for all why I adore the engineers I work with, in some CR this morning. [07:42:34] " Can we look at the exception together maybe? That would be the best way to troubleshoot, I think." [07:43:13] nice. :) [07:43:44] yeah, halfak took a look at my stuff [07:46:03] what are you working on? (This is what every engineer loves, I know. Questions about work after work) [07:46:31] heh [07:46:35] that matching bot [07:46:53] here's the dev branch https://github.com/fhocutt/matchbot/tree/dev [07:48:26] oh awesome! :) [07:50:10] woah, that's a thorough readme. +1! [07:50:18] thanks! [07:50:23] I didn't know the JSON-double-quotes thing. [07:51:43] Ah well. It's still better than XML! ;P [07:51:54] true [07:52:07] I may go for yaml in the future, not sure [07:52:29] part of the reason it's so long is I couldn't put comments in the config [07:53:41] * Ironholds nods [07:53:57] I've played around with YAML a bit for the UA parser I maintain; it seems sane enough. Certainly much more human-readable, which is nicew. [07:54:41] the good bit is it tends to be mutually compatible with JSON, so if you wanted to be really lazy (read: if you wanted to be as tremendously lazy as I tend to be. I am not a very motivated person) you could store it as YAML but have it converted to JSON at runtime. [07:55:03] That way you wouldn't have to mess around changing all the calls to the existing JSON-based config [07:55:43] JSON is a strict subset [07:56:16] Cool! Ignore my commentary, then: I probably shouldn't be waxing lyrical sleep-deprived anyway ;p [07:59:19] enjoy your vacation! [07:59:34] I will! As soon as I can finish this project off. Hrn. [07:59:41] Signs of tiredness: inability to remember how rounding works. [15:32:22] Hey YuviPanda. I'm considering using celery for one of the WikiCredit projects. I'm wondering if you'd give me a tour of how you use celery with Quarry. [15:32:59] Specifically, I'm wondering how you manage the worker server and a result-backend along-side the WSGI and other python stuff. [15:52:02] morning halfak :). How goes? [15:52:26] hey dude. Not bad. Yourself? [15:54:00] dealing with WSC :/. [15:54:15] It looks like if neither UDF is broken we've actually been overreporting traffic by closer to 25% than 15%. [15:54:39] I'm hoping the UDF is broken ;p [15:56:55] Good to know either way. [15:57:17] Ironholds, will you be producing a set difference? [15:57:33] halfak, yep! [15:57:51] Cool. I'm looking forward to hearing about what you find in that set. [15:57:55] the first step is just to produce a graph of "new UDF versus sampled logs, old UDF versus hive query, do they match" [15:58:06] if they match, we cool. If they don't, then I start with set differences. [16:01:37] (also, of COURSE our publicly-available datasets are only month-level. Because why would we want dataset transparency) [16:01:49] halfak, any thoughts on the geodata idea I threw at the list, btw? [16:02:29] Ironholds, sounds good, but I won't have time to dig into it any time soon. :\ [16:02:37] that's okay! [16:02:42] like I said I won't be around for two weeks anyway :D [16:02:56] Ahh. Good point. [16:05:38] morning J-Mo! :) [16:06:00] ohai there ol' Ironholds ol' buddy [16:06:11] how goes? :) [16:07:06] can't complain. Busy keeping the world safe for free knowledge. It's Friday. Got a good weekend coming up. [16:07:13] et tu, buddeh? [16:07:27] week and a half of holiday around the corner; s'gonna be good! [16:07:32] and in the meantime, interesting geo datasets :) [16:10:44] what are the big holiday plans, Ironholds? [16:11:50] I have a stack of.. [16:11:51] *counts* [16:12:09] 19. books. [16:12:16] along with a set of furniture to build [16:12:21] ooooh…. that's my favorite kind of holiday plans [16:12:39] btw, you should read the "Old Man's War" series by John Scalzi. Have I mentioned that? [16:12:44] I am going to disconnect from the internet and spend a week and a half bolted inside my apartment listening to aggressive feminist J-pop, reading and building shelves. [16:13:02] you should! Already did; you mentioned it when we visited Seattle. We were hanging out outside your collab space at the time having a smoke. [16:13:13] * Ironholds has a weird memory for things [16:13:13] "aggressive feminist J-pop" <— sauce plz? [16:13:27] https://www.youtube.com/watch?v=QNtuAvGvRo8 [16:13:31] via Keilana [16:13:47] ty [16:13:59] oh, J-Mo: any chance you recommended "The Green Book: Freedom under the Snow" or E.O. Wilson's "To The Finland Station: A Study in the Writing and Acting of History"? [16:14:07] because someone recommended a big pile of awesome books for me and I don't know who. [16:14:30] wasn't me. but Ima check em out now [16:16:09] haha [16:16:24] actually, J-Mo: E.O. Wilson's "Letters to a Young Scientist", a halfak recommendation, is great. [16:16:50] Admittedly I mostly like it because it's a soothing balm on my impostor syndrome, so it may not be as viable to someone more self-evidently awesome. [16:17:10] oh, and milimetric, guess what's at the top of my reading list for this vacation? [16:17:25] I know few awesome people who find their awesomeness to be self-evident. [16:17:39] Kozen, Automata and...Cupcakes? Cranberries? Collaborations? [16:17:46] Whatever; some dude I know and respect recommended it ;p [16:18:04] halfak, indeed; welcome to the world of Oliver Compliments: sentences that implicitly recognise someone's neatness just in case they don't ;p [16:18:16] :) [16:30:42] :) Ironholds I wish you much relaxation, but I offer no promises that Kozen's spartan style will lubricate said relaxation [16:37:01] milimetric, I have a week and a half and 18 other books; I'm sure I can recover ;p [16:43:15] o/ Nettrom [16:43:45] yay a nettrom! [16:44:01] Nettrom, we decided I should get a scandinavian name, since I don't fit in with all y'all awesome collaborators. JFYI. [16:44:51] now soliciting suggestions [16:45:59] Ironholds, ARNBJÖRG [16:46:18] that...doesn't relate to my actual name, though. [16:46:22] Oh [16:46:30] I mean, if we're just picking random names I'd go for Forseti [16:47:09] that doesn't sound terribly Scandinavian [16:47:21] I got it from http://www.behindthename.com/names/usage/scandinavian [16:47:26] Snorri Sturluson would disagree, Nettrom ;p [16:47:31] https://en.wikipedia.org/wiki/Forseti [16:47:49] http://ssb.no/en/befolkning/statistikker/navn [16:48:10] well, Iceland isn't in Scandinavia... [16:49:09] Naw, but see "Norse mythology" and "sacred island of Heligoland". [16:49:34] The vikings dismiss your attempts to apply modern cartography to their culture, and would like to counter by randomly showing up where you live and deciding it's theirs now! [16:50:18] mind you, they'd probably do that anyway. Particularly if you have a monastery with nice stuff in it. [16:50:22] Lindisfarne: Never Forget. [16:50:38] I guess I'll just have to accept Scandinavian names-lessons from a Brit [16:50:41] :P [16:51:05] touche ;p [16:51:11] hey, y'all invaded us enough times. [16:51:35] (trivia: one of my great-1e* uncles was the dude who drove y'all into the sea! [16:52:22] Sounds like he wasn't very good at staying on the road! Did they all drown? [16:52:33] ;P [16:52:33] * Ironholds groans [16:52:40] halfak, since when do you pun?! :P [16:52:45] Ironholds: yeah, it's only fair that you get payback, heh [16:53:17] you mean...PUNISHMENT? [16:53:20] I've still got it. [16:56:05] halfak, that thread on academics trying to insert self-cites into WP... [16:56:58] Would it be amusing or overkill to reply with, in part, "I for one have full confidence that attempts by an academic to force citations of their work will remain where they belong: in peer reviews of every paper I submit ;p" [16:58:42] lol [17:19:39] It's goddamn 850 Euro to register for WWW. [17:19:41] ARG! [17:19:54] what?! [17:19:56] urrrgh [17:20:02] can we get Toby to pay for it in advance? ;p [17:20:10] because I don't keep that kind of cash just lying around [17:20:30] Good Q [17:20:35] that reminds me - are we sending anyone to Wikiconference USA this year? [17:20:38] I was thinking of going. [17:21:23] GOod Q. I think we should. [17:21:24] When is it? [17:22:29] June/July, I think? I'll check [17:23:07] it'll be in DC :) [17:23:12] Oh wait. It looks like I can get a smaller pass and skip the Workshops. [17:23:20] 580 euro [17:23:23] still a lot of money. [17:23:32] And ACM membership gets you nothing, it seems. [17:23:40] goddamn europeans [17:23:41] * Ironholds spits [17:24:20] I hope you left your desk to do that. [17:24:41] Are you kidding? If I actually spat I think I'd do serious damage to my house. [17:24:57] The temperature is so low I'm worried it'd freeze in mid-air and drill a hole in the wall. [17:26:31] Why don't you turn up the heat? [17:26:47] I have a space heater running in my office so that I don't have to heat the whole house. [17:26:56] I live in this room anyway. [17:28:06] hahahah [17:28:10] spoken like a true wumph employee [17:28:37] wmf = wumph? [17:28:46] *== [18:02:21] Ironholds, STANDUP! [18:02:44] oop! [18:32:07] halfak: when should I block off 15 mins for you? later today? [18:32:18] GOod Q. Does now work? [18:32:25] yeah, I could do now [18:32:40] Can you call me via hangouts when you are ready? [18:33:12] whwnever someone says "block off" I have this image of something involving bricks and mortar and your calendar [18:49:09] Ironholds, The Calendar of Amontillado [18:49:34] https://en.wikipedia.org/wiki/The_Cask_of_Amontillado [18:49:52] hah! [18:50:46] halfak: are we good using the 3pm for reviewing the DOI data? [18:51:54] oh, wait - you’re not invited. halfak: I’ll block a slot from your calendar [18:51:56] Bah. I'm going to been to leave early at a reasonable time today, so I don't think I'll be able to meet after 3PM PST [18:52:04] ok [18:52:12] wanna touch base earlier? [18:52:19] Sure. Is now good? [18:52:26] I’m with grace until 11.30-ish [18:53:42] I just put something on our calendars for 12:30 [18:53:42] OK? [18:53:53] sounds good [18:53:57] Cool. [18:56:22] halfak: hey [18:56:24] I’m on vacation! [18:56:26] apparently [18:56:39] YuviPanda, me too! [18:56:40] high five! [18:56:49] I feel like this needs to go on bash. [18:56:51] :) [18:57:01] halfak: so I lost your celery question... [18:58:04] Hey. Not really a specific question so much as wanted to look at your code with you and talk about celery. [18:58:51] YuviPanda, ^ [18:59:54] halfak: ah, right. [19:02:22] halfak: after some deliberation I have decided to continue to be on vacation :) [19:02:41] But basically celery gives you a task id when you submit a task [19:02:55] And you can save that ID in a db [19:03:02] And then do operations on it [19:03:27] Gotcha. You should stay on vacation. :) When are you back again? [19:05:50] halfak: in 2 weeks [19:07:04] halfak: cat sample_doi.tsv | awk -F"\t" '{print "http://api.crossref.org/works/"$6"/agency"}' | xargs curl -s | jq '[.message][][]' — should give us all we need [19:07:23] running to see grace, bbl [19:08:03] halfak: I'll add two more campaigns to that handcoding sheet in the afternoon. [19:08:07] then I send the email to the list. [19:26:29] leila, sounds good. Are you guys just asking about quality assessment of the wikigrok data? [19:28:01] Dario, we can put HTML into datasets.wikimedia.org and it will load appropriately. [19:28:03] See http://datasets.wikimedia.org/public-datasets/enwiki/etc/html_test/ [19:29:26] halfak: yes, I was thinking also of a landing page at the docroot and maybe a standardized HTML template, but that’s the idea [19:30:15] +1 [19:47:11] halfak: no. we will do that ourselves. What we want is an answer to each of the questions in the spreadsheet. whether person a is a film actor or not? whether person b is a tv actor or not? The pages you see in the spreadsheet are those that don't have a response in Wikidata (either because the person is not an actor or because no one has attempted to fill up that item) [19:58:50] hi halfak [19:58:54] pull requests welcome! [20:26:11] okay, Grace and I broke the haiku singularity [20:26:26] email thread consisting of 11 haikus [20:26:42] did you know 10 is max.length for an object of class haiku? I didn't, and now my computer is full of bees. [20:28:34] o/ fhocutt. [20:29:04] re. pull requests, I'll be AFK this weekend so expect to hear from me mid next week. :) [20:31:13] ooh, going anywhere fun? [20:35:23] Ironholds, taking Jenny up to Duluth, MN to go skiing for her birthday :) [20:37:02] halfak, aww, happy birthday Jenny! [20:37:22] I hope she has an exskisuite time :) [20:37:38] * halfak groans [20:37:42] * Ironholds bows [20:38:51] Leila, do you see DarTar nearby? [20:39:01] no halfak. lunch maybe? [20:39:06] We really need to get a robot in the office so I can physically ping people [20:39:12] Thanks leila. [20:39:14] :D np [20:39:23] I can be your robot for now, halfak. ;-) [20:39:36] b.t.w., I found a really nice poster picture of you in the storage room [20:39:37] :D [20:39:45] I want to set it up somewhere around where we sit [20:39:52] Oh yeah! I forgot about that. I request that it is set up next to DarTar's desk [20:39:58] I'm sure Ironholds has one, too. I just have to dig the storage room one day [20:40:00] >:) [20:40:10] wait, what? [20:40:17] I want you to keep both your eyes on DarTar's screen. :D [20:40:24] okay, DarTar is here [20:41:03] DarTar, darling! [20:41:14] halfak: sorry dude [20:41:17] ...I don't actually have a followup to that but I thought I should give positive feedback for you jumping on IRC. [20:41:20] coming on a hangout [20:41:52] We're going to have to set up my cutout next to your desk as a deterent for future meeting time violations [20:42:49] hahahaha! [20:42:58] okay, I'm going to the storage to pull it out [20:43:02] keep Dario entertained [20:43:04] \o/ [20:44:20] why don't I have a cutout? :( [20:44:35] okay! why are you so tall, halfak? [20:44:35] :D [20:44:43] woo! I can see it! [20:44:44] good eatings [20:44:50] he's purebread minnesotan! [20:44:55] good weather, you mean, Ironholds. :D [20:45:00] that means a diet of 100% grass-fed, plains-raised Canadian citizen [20:45:13] well, that and mosquitos. That's what Minnesotans eat, you know. Canadians and mozzies. [20:45:28] leila, no, I've been to Minneapolis [20:45:32] it has two settings: Hell, and Hel. [20:46:00] yeah, I guess in that situation your body should store more energy for heating you up than extending the height [20:46:00] :D [20:46:09] anyhow, the halfak I see here is quite tall. :D [20:46:17] i met aaron. he didn't seem that minnesotan [20:46:29] yeah, that's the problem harej. [20:46:39] i knew someone from rochester, mn. oh boy oh boy [20:46:41] harej, oh geez [20:46:59] in fact, he called himself "sam from minnesota." that is how he introduced himself to people [20:48:14] say, you don't think halfak is particularly minnesotan? He acts Minnesotan alla time! Why, he wouldn't be more minnesotan if I'd gone up der crick to da minnesotan store and borrowed me a minnesotan to work with! [20:48:38] I will say that halfak is not a redneck and so is definitely not from SOME bits of Minneapolis I've been to. [20:48:53] I ran into a mall out there that sold t-shirts which read "mess with me and you mess with the whole trailer park" [20:49:04] I wanted to buy one and then have t-shirts printed for R&D that read "we're the trailer park". [20:49:11] everyone comes in wearing em, official staff photos for the team. [20:50:05] hmm. how soon do i have to leave my perch to board the train [20:50:12] train leaves in 20 minutes. but is train here yet? is it boarding? [20:50:15] i haven't been paying attention [20:50:27] harej, where are you going? [20:50:32] baltimore [20:50:37] it is a commuter train [20:50:53] why in god's name are you going to Baltimore? [20:50:55] Who did you piss off? [20:51:03] god, by being born [20:51:08] oh, you're from there? [20:51:10] i'm going to a hackathon. it is in a nice neighborhood [20:51:14] no i was born in new york city [20:51:26] ...who did you piss off? [20:51:28] ;p [20:51:35] god, by being born [20:51:36] * Ironholds hates, in sequence, NYC, Baltimore, Philly and Chicago [20:51:46] why baltimore? it's too irrelevant to hate [20:51:50] basically there's this triangle between Boston, Minneapolis and Raleigh [20:51:54] and if it's within that triangle it sucks [20:52:14] but the ArtBytes hackathon at the Walters Art Museum is this weekend. and, uh, wikimedia dc is sponsoring it [20:52:18] all the people I know from Baltimore are terrible. Conversely, all the Chicagoans and Philadelphians I know are lovely people who happen to live in miserable holes. [20:52:28] I mean, live in Chicago and Philly [20:52:43] Alright, time to go! [21:03:57] Freenode web chat is an extreme example of "not optimized for mobile" [21:04:17] DarTar, sent an email about the commons thing [21:20:17] halfak: great! Have a great time. [21:20:32] :) [21:20:40] alrighty, you know what time it is? [21:20:44] Iiiiit's HOLIDAY TIME! [21:20:59] * Ironholds bangs gong, triggers fireworks, drop-kicks surge protector [21:21:33] Catch you on the flip side, dudemeisters, NOT! [23:43:01] Is anyone able to sue hive right now? My queries are hanging. [23:43:13] Is anyone able to sue hive right now? My queries are hanging. [23:43:20] hadoop is having problems [23:43:25] christian is working on it [23:46:03] tnegrin: is this a quick fix or should I work on something that does not require hadoop for the rest of the day? [23:46:46] the latter [23:46:47] tnegrin: do we need to ping bob too? [23:46:58] I'll let him know [23:47:04] thx [23:47:06] ewulczyn: we could have our 1:1 [23:47:14] I object to that [23:47:19] * DarTar ducks [23:48:24] tnegrin: sure [23:48:32] I'm in the hangout [23:52:06] there