[00:01:05] tfinc: but it wasn't until September that it was handling all the traffic [00:01:19] k [00:16:10] awjr: hey Arthur [00:16:18] hi philinje [00:16:35] can you chat a little tomorrow? [00:16:41] i mean on a call [00:16:57] philinje sure [00:17:00] about what? [00:17:12] something related to WLM, a bit hard to explain briefly [00:17:18] tfinc: are we still doing 1:1 tomorrow? [00:17:45] philinje: ok no worries. i'm pretty open tomorrow, except for potentially having a mtg with tomasz at 4:30 [00:17:49] awjr: good question, i'm planning to be at the hackathon the whole day [00:17:56] so i can do it [00:18:01] up to you [00:18:45] tfinc: let's do it - i have just a few things to ask you about that probably shouldn't wait for you to get back on july 23 [00:19:08] tfinc as scheduled right now, it would be at 730 eastern [00:19:16] lets move it up sooner [00:19:26] heh i figured :) [00:19:26] do you mind playing it by ear tomorrow? [00:19:30] tfinc no [00:19:38] id prefer to do it soone rather then later [00:19:43] hackathons are really hard to predict [00:19:52] yeah sounds good [00:21:19] philinje: was there a particular time you wanted to talk? [00:26:44] ok, looks like the bytes sent figure we get does *not* include http headers [00:26:51] so this'll be easier on the js side [00:29:31] brion: in the WLM app, do you know how to get a message with HTML in it to appear with the HTML actually rendered when using the tag? [00:29:41] hmm [00:29:51] lemme check real quick if there's an option for it, but there might not be [00:30:13] yeah ive been digging a bit and nothing is jumping out at me [00:30:14] thanks [00:30:55] awjr: nope no option for it in jquery.localize.js that i can see [00:31:04] you can manually do it i guess [00:31:04] okidoke thanks for dbl checking [00:31:17] $('foo').html(mw.msg('blah')) [00:31:38] aye [00:43:12] * tfinc starts to think about dinner [00:44:03] btw, that en.WN bug is actually a MobileFrontend bug. Or two. [00:45:58] a [00:59:33] poop! the in-flight map on virgin america doesn't auto-refresh very well [00:59:41] i'm over colorado now, whee [01:00:53] brion: I think they have really weird tile caching. [01:04:28] im out, have fun in dc you guys! [01:09:00] filesystem access in phone gap blows [01:09:28] i'll do this on the java side [01:24:18] ah this might actually make sense on the js side now [01:24:46] brion: was that an in flight epiphany? [01:25:16] :) [01:43:06] nebraska. woo [01:51:11] merged awjr's create link [13:47:01] [13:55:54] hi Amgine [13:56:01] brion: is there a table of mobile folk? [13:56:11] Heyla pfhayes; are you here? [13:56:22] dunno, i'm sitting with roan & trevor & folks atm [13:56:31] Amgine: yup [13:56:40] i think the other mobiles are still asleep or getting breakfast ;) [13:57:02] pfhayes: I don't see you (which isn't saying much, barely conscious) [13:57:30] aaaaaaaaaaaaaaaaah this is the weirdest bug i can't type 9 or ( on android 4 [13:57:35] it's really, really annoying [13:57:54] Amgine: oh, you mean in DC [13:57:56] Amgine: nope [13:58:30] pfft. New York for pfhayes... [13:59:12] I have a bluetooth keyboard you can borrow, brion. [13:59:27] :) [14:00:51] trust me, it's at least as annoying to use. [14:47:28] brion: jrobson: https://bugzilla.wikimedia.org/show_bug.cgi?id=38068 [14:47:40] https://bugzilla.wikimedia.org/show_bug.cgi?id=37577 [15:01:19] Yuvi arrives. [15:13:13] yup, we were wondering when he woudl show [15:13:27] You took him out drinking? [15:22:22] http://www.kickstarter.com/projects/ouya/ouya-a-new-kind-of-video-game-console [15:24:10] I'm feeling left out now [15:24:11] * Reedy grumbles [15:26:56] awww [15:27:06] Reedy: you not coming to Wikimania? [15:27:14] Nope [15:27:23] 3 years running my parents have booked holidays that clashed [15:27:41] ... [15:28:16] Got to look after the house, and more importantly, the dogs [15:28:18] yuvipanda: http://www.kickstarter.com/projects/ouya/ouya-a-new-kind-of-video-game-console [15:29:41] Clearly we need to have wikimania in London. [15:29:58] Because we can all sleep at Reedy's parent's place. [15:29:58] trolololol? [15:30:10] If you want a 200 mile commute each way [15:30:17] Well, there is that. [15:34:09] Reedy: kickstarted isn't open outside the US. bad [15:34:23] whaa? [15:34:29] You can't create projects, but you can back them [15:40:10] Reedy: still lame [15:40:34] It's due to the Amazon payment system apparently [15:40:39] Coming to the UK soon [15:44:18] Reedy: we'll happily take your money here [15:44:19] :D [15:50:58] For what? ;) [15:52:10] MaxSem: online? [15:52:20] No, we blacked him out [15:54:04] Reedy: for our kickstarter projects :) [16:00:30] tfinc: https://github.com/wikimedia/WikipediaMobile/issues/265 [16:16:54] yuvipanda: i need you to run an md5sum on Wikipedia-v1.2.1.apk [16:17:07] yuvipanda: i have 5d2c5037ca6562bc18b0991a98bf82b1 which sadly is corrupt [16:19:37] tfinc: 206d4aa29c0d41c67b502d856260a500 [16:19:40] redownloaded [16:20:10] yuvipanda: paste me the drop box lnk [16:20:47] * yuvipanda pokes MaxSem again [16:22:55] tfinc: http://dl.dropbox.com/u/8768784/Wikipedia-v1.2.1.apk [16:36:08] Reedy: i'm shivering in here. [16:36:29] It's ~14C here atm [16:36:49] Reedy: the air conditioning is turned down too low here [16:37:10] i'm literally shivering visibly. [16:38:42] I was hoping that it'll hit 37-40C when we're here so I can watch other people squirm [16:38:46] but according to google not happening [16:39:18] you are an evil person, yuvipanda. [16:41:15] Amgine: lavalair [16:48:22] yuvipanda, I'm back [16:50:47] MaxSem: multichill was looking for you [16:50:56] he also is looking for you [16:50:58] but he also was [16:51:27] I'm online on a zillion of channels [16:51:49] Hi MaxSem [16:51:59] #wikilovesmonuments is just not in my autojoin list [16:52:07] We're talking about the adm0-4 stuff [16:52:09] hi multichill [16:52:20] MaxSem: no, he is sitting next to me, looking for you - so I was poking you :) [16:52:21] greetings awjr! [16:52:23] We want to make a table to navigate the tree structure [16:52:24] hello awjr [16:52:30] hello! [16:52:35] * tfinc waves with everyone from the wikimania hackathon [16:52:38] We wondered if you could help with that Max [16:52:51] :D [16:52:56] http://www.mediawiki.org/wiki/Mobile/Release_history#Apps is now up to date with md5s [16:53:04] how's the hackathon going so far? [16:53:08] so that we can verify any failed ips/apk's [16:53:12] awjr: productive [16:53:31] jdlrobson and brion have already added the file transfer progress bar [16:53:40] multichill, what exactly do you want, what use cases are there? [16:54:03] now were planning on what else we *have* to get done before the showcase tomorrow [16:54:19] righteous [16:54:50] that and comaparing our fourquare points [16:54:51] :D [16:54:59] comparing* [16:55:02] MaxSem: an api method for enumerating admin levels like a tree [16:55:05] lol [16:55:17] The use case is browsing the tree (more on that). We're thinking about implementing it like: id, level, name, parent [16:55:32] 1, 0, nl, NULL [16:55:45] 2, 1, nl-nh, 1 [16:55:48] Something like that [16:56:06] MaxSem: action=levelsquery & level=1 & name=us [16:56:25] so you like want to get all adm1's for a country, pick one, get adm2's for it and so on? [16:56:31] MaxSem: exactly [16:57:23] will think about it [16:57:55] how soon does it need to be done? [16:58:05] MaxSem: today :P [16:58:13] troll [16:59:27] MaxSem: no, really :D [16:59:32] MaxSem: First, table design [16:59:46] Pop up an etherpad? [16:59:59] let's see if this can be done with out present table [17:01:33] yuvipanda, regarding https://www.mediawiki.org/wiki/Wiki_Loves_Monuments_mobile_application/Queries - are you sure that you will not be requesting anything with a particulr language? [17:02:36] We talked about that and we would like to do it in another table. Just a cache table we fill every night [17:02:53] MaxSem: i18n is currently very fucked up. we'll have to figure out some other way. but srlang is not going to be it [17:06:10] yuvipanda: whats your md5sum for Wikipedia-v1.2.apk ? [17:06:22] tfinc: 206d4aa29c0d41c67b502d856260a500 [17:06:46] tfinc: 46961705c69c1f1e05132cc97b6a1526 [17:07:04] tfinc: http://dl.dropbox.com/u/8768784/Wikipedia-v1.2.apk [17:08:31] select distinct country, adm0, adm1, adm2, adm3, adm4 from monuments_all XD [17:08:50] MaxSem: let's do that on every request :P [17:11:47] multichill, is country always == adm0? [17:13:59] no [17:14:39] MaxSem: Look in /home/project/e/r/f/erfgoed/erfgoedbot/sql/create_table_admin_tree.sql [17:14:44] Just a quick mock up [17:15:29] Can you structure that into something workable? [17:15:50] MaxSem: Do "SELECT DISTINCT(CONCAT(adm0, ' - ', adm1)) FROM `monuments_all`;" [17:16:02] Gives you a good impression on what's in there [17:16:25] yuvipanda: http://upload.wikimedia.org/wikipedia/commons/8/89/Wlm_flows_draft4_2.png [17:17:57] `name` varchar(255) NOT NULL DEFAULT '', is wrong - there are NULL adm levels [17:21:08] Doesn't NULL always indicate the leaves of the tree? [17:22:40] MaxSem ^^ ? [17:24:01] * MaxSem feels that this thingie is gonna collapse under changing requirements pretty soon [17:25:43] we gotta figure out how ( 'foo', NULL, 'bar' ) will work [17:26:30] MaxSem: I'm not sure if requirements changed. We already talked about this in Berlin too [17:27:01] How many attending the hackthon? [17:27:15] * Debloper is missing wikimania! :-/ [17:27:23] multichill, unfortunately, I didn't participate in these discussions because nobody told me that I'm gonna participate in WLM [17:29:23] tfinc: what are you using (rather, do you use) to create android mock-ups? (as in: http://upload.wikimedia.org/wikipedia/commons/8/89/Wlm_flows_draft4_2.png) [17:29:55] or is it rather hand-crafted? [17:30:13] Debloper: thats the handiwork of our ui designer lindsey (linSmith) [17:30:53] oh, I see... neat :) [17:31:20] ask her when she signs on about what these were made in [17:31:48] Debloper: are you looking for software to do mockups ? [17:32:11] Debloper: http://www.fluidui.com/ is quick, web based, and easy [17:32:16] tfinc: yeah, if it reduces time/headaches [17:32:35] awjr: while you were gone I did this - https://gerrit.wikimedia.org/r/#/c/12035/ - but then realized email was handled separately elsewhere :-( is there anyway we can handle e-mail here too? [17:32:46] oh, thanks - I'll give it a try! [17:35:01] jdlrobson i don't totally understand what you're trying to accomplish [17:36:37] MaxSem: Sorry about that. Let's get this going. Shouldn't be too complicated [17:38:17] jdlrobson there's no real email handling code for the feedback form, per se [17:38:36] instead in configuration, you can configure links for what should happen for each of the different actions [17:38:55] so we have some mailto: links configured, with some fancy query string params to prepopulate message body, etc [17:41:28] jdlrobson you can see how it's currently configured here: https://gerrit.wikimedia.org/r/gitweb?p=operations/mediawiki-config.git;a=blob;f=wmf-config/mobile.php;h=cb64119287ac4e1813974f94e76fdc1a04d6ad14;hb=HEAD [17:41:40] pertinent stuff starts at line 18 [17:44:06] hmm my laptop has just made some very weird crackling noises - seemingly coming from underneath the keyboard... [17:44:40] it's done it twice now - it sounds kind of like static, but a little more… crunchy. [17:45:38] crunchy static = FAIL [17:45:54] it hasn't happened again.. .yet [17:45:58] but it's a bit unnerving. [17:46:11] tfinc: I just got an email from kolossos about the OSM installation. How is it going? [17:50:42] hey apmon [17:50:49] Hi [17:50:54] we have all the hardware and were waiting on aude to get some free time to set it up [17:51:04] if you can get to it faster then even better [17:51:19] Do you have some details on the hardware? [17:51:19] i tried to find the rt tickets about it but failed :( [17:51:32] apmon: i would if i could find the tickets in rt [17:52:45] I a non puppetted way, setting things up should be fairly easy if it is an Ubuntu system [17:54:02] Reedy: this is why you should be here https://twitter.com/#!/flyingclimber/media/slideshow?url=pic.twitter.com%2FH1A0qyhE&utm_source=fb&utm_medium=fb&utm_campaign=flyingclimber&utm_content=222749215955222529 :) [17:54:16] apmon: it needs to be setup in puppet [17:54:22] non puppet is not an option [17:54:36] tfinc: feel free to go guilt trip robla for me ;) [17:54:42] Ryan_Lane will stab you if you don't do it [17:54:48] Ok. Then it is a little more complicated... ;-) [17:55:05] yes. stabby stabby stab stab [17:55:06] im not sure you guys have enough mobile devices there [17:55:29] I have started to try and create puppet scripts to set up postgresql, create dbs and users [17:56:11] awjr: there are at least 4 more devices that are now on the table [17:56:40] But I am still learning how to script things in puppet. Unfortunately a bunch of things aren't just simple config files that one can copy over [17:57:31] so one thing im having trouble figuring out is how to locally test other people's commits in github (specifically for the WLM app) [17:57:40] Do you know if aude has done any work in that direction? [17:57:55] gerrit makes it trivial, but im not quite grokking how to do it with github [17:58:25] tfinc: I presume compiled code will also have to be turned into ubuntu packages? [17:58:55] awjr: I prefer adding .patch to the github pull req url and piping to git am [17:59:25] yuvipanda: oh cool [17:59:29] yuvipanda like: https://github.com/jdlrobson/WLMMobile/commit/a20f34dd613155a3bea605c27ebad2fdcd37d50b.patch [17:59:30] ? [17:59:33] awjr: https://github.com/wikimedia/WikipediaMobile/pull/264 is pull req, so curl https://github.com/wikimedia/WikipediaMobile/pull/264.patch | git am [17:59:37] and then [17:59:39] yeah [17:59:42] sweet [17:59:44] thanks! [17:59:45] awjr: :) [18:00:28] awjr: i tend to add other folks repositories as remotes, then i can check out their branches at any time [18:00:39] git remote add yuvi https://github.com/yuvipanda/WikipediaMobile.git [18:00:42] git fetch yuvi [18:00:47] git checkout yuvi/blahblah [18:00:59] oo that makes sense too [18:01:01] brion_: yeah, I still chuckle at the 'fetch' part :) [18:01:07] git clone yuvi! [18:01:14] i suppose that's a little more elegant [18:02:28] apmon: i do not. she's been too busy with wikimania [18:02:38] i'm planning on catchign her once wikimania starts [18:02:42] to get a quick debrief [18:02:49] greetings preilly [18:03:18] brion_: thanks! that works very nicely [18:04:09] brion_: if only we could "git clone yuvipanda" in real life [18:04:20] we could make a 2dpanda [18:04:21] multichill, so what shall we do when adm0='foo', adm1=NULL, adm2='bar'? [18:04:46] Adm0 and adm1 are never null [18:05:02] (cleaning up the data right now) [18:05:31] brion_: i'm guessing the return value of git fetch yuvi == "stick" ? [18:05:39] :) [18:06:25] multichill, okay: adm1='foo', adm2=NULL, adm3='bar' [18:06:31] I'll continue to try and create some puppet classes then on the laps instance and then see what aude has done [18:06:42] k [18:08:10] MaxSem: I don't think that should happen. If it happens, it should be looked at. I think another thing that would happen is adm2==adm3 [18:08:29] that's not a problem [18:09:25] thedj: git fetch yuvi == expensive flight + possibly boring long visa process :P [18:09:29] git is the dog :P [18:09:34] yuvipanda: http://lists.wikimedia.org/pipermail/wikimedia-l/2012-April/119644.html [18:11:44] MaxSem: Ok. Can we build the table structure now? [18:12:19] I'm playing with it right now [18:15:16] Great. I'm not editing the file so you can put the result in there [18:15:35] ( create_table_admin_tree.sql ) [18:18:48] anyone seen phil ? [18:19:11] nope [18:20:39] multichill: https://test.wikipedia.org/wiki/File:The_Keystone_1341943637332.jpeg [18:20:58] jdlrobson and other WLM people: what would be a good thing for me to tackle on the app? i dont want to step on anyone's toes but am looking for something to do. [18:21:05] i need him to clarify a bug that he opened and we marked as invalid http://www.mediawiki.org/w/index.php?title=Wiki_Loves_Monuments_mobile_application/ToDo&diff=prev&oldid=560475 [18:21:07] i'll mail him [18:21:13] awjr: hmm [18:21:24] i'm coordinating the work right now so feel free to reach out to me as point [18:21:29] cool [18:22:34] * tfinc pulls up http://www.mediawiki.org/wiki/Wiki_Loves_Monuments_mobile_application/ToDo [18:23:27] before i give you anything. MaxSem do you need awjr for any part of the db, api, etc work ? [18:24:44] Maxsem is looking at the database design right now. Maybe awjr can look at the api part? [18:26:22] awjr: yuvipanda is about to cut a bug for templates in the wlm app. he'll assign it to you [18:26:43] max and i have chatted a bit about strategy for handling the database so i have some idea what's going on there but i don't know what the story is with the api. if someone could catch me up i'd be happy to work on it [18:26:47] tfinc ok cool [18:28:28] tfinc, api requires DB changes first [18:31:23] awjr: tfinc https://bugzilla.wikimedia.org/show_bug.cgi?id=38282 [18:32:56] ok. MaxSem: awjr is avaialble as an extra pair of hands. he has plenty of experience with our ops team and the general wmf arch [18:33:00] so let him know where he can help [18:33:07] otherwise i'll steal him for more dev work :D [18:34:00] jdlrobson: yuvipanda at 4pm local i want to cut the apk that we'll be using tomorrow [18:34:04] tfinc, okay - since I've switched to admin tree, awjr can look at my import script [18:35:08] MaxSem: api question [18:35:15] sure [18:35:29] MaxSem: do I'm trying to login via the file api in a web browser [18:35:30] MaxSem the import script for toolserver monuments_all -> cluster? i'm happy to take a look [18:35:34] the first request sends me a token [18:35:46] i login again with the token but i still get NeedToken [18:35:50] awjr, so far I got as far as https://gist.github.com/gists/3085394/edit [18:35:51] is there anyway to get round that? [18:36:16] do you encode the token? [18:37:56] jdlrobson, have you tried playing with https://en.wikipedia.org/wiki/Special:ApiSandbox#action=login&format=json ? [18:38:06] yes but that's on http://en.wikipedia.org [18:38:13] I'm talking about doing so from another page [18:38:16] awjr: are you picking up the template? [18:38:24] (on a different domain/protocol MaxSem ) [18:38:25] http/https doesn't matter [18:38:31] yuvipanda yeah sure - im gonna take a look at max's import script and then work on the template stuff [18:39:23] jdlrobson are you making a post request or get? i think i saw the same issue once when i wasn't explicitly posting the data [18:40:15] action=login via GET --> mustbeposted error, not TokenRequired [18:41:26] I'm doing post awjr as login has side effects [18:41:42] GET's should be idempotent [18:42:10] I do a post to http://en.wikipedia.org/w/api.php with action=login lgname, lgpass and format json [18:42:12] if we only did that always:P [18:42:22] I get a token and result: NeedToken [18:42:29] i post again with lgtoken [18:42:37] (and all the things from before) [18:42:37] a [18:42:44] and I still get the same response [18:42:50] (but different token this time obviously) [18:43:00] do you post with the username/password again? [18:43:08] MaxSem: never too late to fix things - http://www.w3.org/Protocols/rfc2616/rfc2616-sec9.html#sec9.1.2 [18:43:11] :P [18:43:14] I do MaxSem [18:43:17] should I not do that? [18:43:42] no, you're doing it right [18:43:53] mm [18:44:09] once again - have you tried it in the sandbox? [18:45:00] once again yes :) [18:45:53] I can run my code on en.wikipedia.org in the debugging console and it works fine [18:46:04] it just doesn't work off a different domain / file protocol [18:46:09] I guess the cookie is getting set for the wrong domain? [18:47:35] multichill: https://commons.wikimedia.org/wiki/Special:ApiSandbox#action=uploadcampaign&format=json&ucprop=config [18:48:44] awjr: Are you able to open https://commons.wikimedia.org/wiki/Special:UploadCampaign/wlm-nl ? [18:48:50] jdlrobson: possibly a safari bug :P [18:48:56] mmm, no cookie = token mismatch, which is `badtoken` or something, not needtoken [18:49:20] it also worked for me in chrome [18:50:21] may be a safari bug [18:50:33] WFM on chrome [18:50:35] Yuvi just showed me it working in Chrome [18:53:27] awjr: Updated the bug [18:57:13] do you url encode the token ? [18:57:45] startin' the uploads list -- empty stub https://github.com/brion/WLMMobile/commit/819f1672c54e0651f5b6029d5909b545342c382f [18:58:44] multichill: i get the following error "You do not have permission to configure upload campaigns, for the following reason [18:58:46] " [18:58:54] Accountname? [18:58:59] awjrichards [19:00:09] jdlrobson: ^ do you uri encode the token ? [19:01:01] awjr: Try now [19:01:31] multichill: yup works now [19:01:55] thedj: mm… [19:01:58] * jdlrobson looks [19:02:13] thedj: we send those off via jQuery, it takes care of it [19:02:14] MaxSem: i'm still feeling a bit uncertain about the db move. we need to define nexts steps, priortize, and do them. i'm having a hard time following where we are at which is causing me to have to bug you guys more [19:02:26] works on Chrome, works on Mobile, doesn't on Safari. Same code. [19:02:43] MaxSem: add it to http://www.mediawiki.org/wiki/Wiki_Loves_Monuments_mobile_application/ToDo [19:03:41] thedj: nope... [19:03:43] :( [19:03:48] it's not that [19:07:24] tfinc, http://www.mediawiki.org/wiki/Wiki_Loves_Monuments_mobile_application/ToDo#API_on_WMF [19:07:37] well you can always put wireshark in between :D [19:08:59] speaking about the WLM API extension - any suggestion regarding its name? [19:10:34] MaxSem: extension? [19:10:45] MaxSem: it should remain standalone, no? [19:11:35] if we're to host it on WMF, we might as well integrate it into the overall infrastructure [19:12:12] we're not going to host the current erfgoed anyway because it will make ops cry [19:12:29] jdlrobson: perhaps you are already logged in on en.wiki + centralauth and if you go to commons, the login there will do bad token because it clashes with your earlier centralauth cookie . [19:12:39] MaxSem: re: WLM Migration thread. We don't need anything to do with TS at all. We can just run the pywikipedia bot on our server. [19:12:41] could be something as weird as that. [19:12:52] thedj: how could I verify that? [19:13:09] thedj: nope, no enwiki logins done [19:13:15] thedj: also, this is login into testwiki, not commons :) [19:13:18] jdlrobson: ^ [19:13:30] yuvipanda, how many WMF engineers are experienced with pywikipedia? [19:13:53] well whatever. just go into the prefs and delete all our 'wiki' and central auth cookies and try from scratch. [19:14:01] and if all fails. Wireshark [19:14:32] it's not like we have a https requirement on login :D [19:14:34] MaxSem: still better than replicating from Toolserver [19:14:41] MaxSem: or involving the toolserver in any way [19:14:47] for those at wikimania. lets keep http://wikimania2012.wikimedia.org/wiki/Quotes up to date [19:15:05] * thedj has to go now. cu [19:15:17] yuvipanda, once again - we can't use the current erfgoed DB structure [19:15:26] ..on WMF [19:15:40] thedj: reset safari still same problem. very sad :( [19:15:50] MaxSem: why not? Put up a seperate mysql instance, put this in [19:17:44] 15:15 < yuvipanda> MaxSem: why not? Put up a seperate mysql instance, put this in [19:17:57] grrrrrr, my kvirc crashed [19:18:08] 15:15 < MaxSem> ..on WMF [19:18:10] was the last one i got [19:21:09] separate machine is not a reliable/scalable solution per tfinc [19:21:56] MaxSem: so if you want to integrate this into 'the cluster', you'll need to make this a mw extension and use solr/lucene for search? [19:22:05] and figure out a way to load data into it? [19:22:05] yes [19:22:13] yes [19:22:13] that does not use pywikipedia? [19:22:24] that's a *lot* of work [19:30:05] multichill, so far i've come up with the following clusterfuck: http://dpaste.org/7DIXf/ [19:30:16] but the next lavels are going to be harder [19:30:25] s/lavels/levels/ [19:31:21] Looking [19:32:53] MaxSem: country field has nothing to do with admin levels [19:33:37] MaxSem: admin levels is just a split up of the address. [19:33:44] MaxSem: forget that country field exists for this use case [19:34:30] at the end of the day we need a) control of the full stack that the app depends on b) a scalable solution for the wlm contest [19:34:52] if our solution/s plug into that then they can work [19:35:48] tfinc: I think redoing everything and integrating that into our cluster would be a lot of duplicate work [19:36:22] tfinc: we should just have a self contained system in the cluster - couple of machines as master/slave/web/cache serving the API [19:36:42] tfinc: fully self contained, no external dependencies [19:37:01] MaxSem: that looks *very* complicated sql. I think a script would be much better off :)) [19:37:05] MaxSem: also ^^ [19:38:05] Guys, please take a look at https://en.wikipedia.org/wiki/User:ErfgoedBot for the flow of info [19:39:08] yuvipanda, you haven't seen "complicated" then:) the next two levels will be much harder:) [19:39:28] MaxSem: complicated vs a script :)_ [19:40:10] I'm still unsure what to do with null though [19:40:31] it creates helluva lot of uncertainty [19:43:25] MaxSem: so yuvipanda and multichill are giving me the download here at the hackathon about not wanting to redo the architecture [19:43:43] MaxSem: and instead wanting to just setup the stack for the lifetime of this project [19:44:01] existing stack* [19:44:31] and only using what's required for the app [19:45:09] lets think about risk/rewards [19:45:18] multichill: https://commons.wikimedia.org/wiki/Commons:Monuments_database/Setup/In_labs [19:45:42] if we re-architect then we get a better bulilt stack at the cost of time and new hardware [19:46:05] if we don't re-architect we get a hacky system thats easier to setup that still needs new hardware [19:46:28] tfinc, can we discuss this on Skype cause IRC slows the discussion down? [19:46:44] yuvipanda, multichill ^^ [19:46:50] MaxSem: do you have a good enough connection for video ? [19:47:03] yep [19:47:31] excellent. i'll call you over gtalk video with yuvipanda and multichill [19:47:46] MaxSem: can you log into gtalk [19:48:17] done, as maxsem.wiki [19:49:21] MaxSem: sent you a video invite [19:50:05] lame Unable to start voice/video chat. [19:50:19] i'll just use skype [20:02:16] Yuvipanda: the wifi is a bit weak outside, but it is much nicer termperature. [20:02:24] temperature. [20:04:39] eww, connection lost [20:05:16] so demanding MaxSem. [20:11:02] MaxSem are you guys still meeting? [20:11:11] yup [20:37:14] phewww, 45 minutes of videoconferencing over LieFi:) [20:43:05] Amgine: are you here? [20:43:09] Amgine: at wikimania? [20:43:35] Yes, I am. [20:43:39] Amgine: where? [20:43:47] I've been amused... I'm in the main room. [20:43:55] SJ just arrived. [20:44:12] Amgine: i've no idea how you look [20:44:14] Amgine: wave? [20:44:29] Amgine: come to the table with hats [20:44:30] Behind you. Ducking. [20:44:53] Heee....\ [20:45:23] Told you I was OLD\ [20:48:27] awjr, around? [20:48:48] MaxSem yup [20:49:10] awjr, you wanted to discuss something? [20:49:39] yuvipanda im a little unclear on where the image description is supposed to go during the file upload process - is it supposed to go in the 'text' field in the upload api request? [20:50:12] MaxSem: i read some of the backscroll during your skype chat and was just curious what the outcome was [20:50:37] awjr: yup [20:50:52] awjr: 'text' field is the contents of the page. [20:51:18] yuvipanda and to follow up, what is startUpload vs finishUpload? [20:51:43] and does the text need to be present in both requests? [20:51:55] the outcome was that we'll have to work out the strategic direction this week - cluster vs. separate machine(s) Lucene or not [20:52:24] MaxSem ok cool. what did you find out from ops yesterday? [20:52:46] is geo tagging planned as well ? [20:53:11] I still need to play around with lsearchd to figure out whether we can use this [20:54:10] awjr: good question [20:54:24] :p [20:54:25] awjr: I just picked up what brion did, but reading https://www.mediawiki.org/wiki/API:Upload tells me no need to do both start and finish [20:54:39] oh right, documentation [20:55:06] aah! [20:55:33] that would make sense, if you populate the page with text on the first request, that's probably all you need. [20:55:34] thnx [20:56:37] MaxSem: is the goal then to have a decision made sometime this week on how to move forward? [20:56:46] yes [20:56:57] awjr, have you looked at my script? [20:57:12] if we can't build an end to end protoype by the end of the week then we will use the WLM architecture as is (pending ops approval) [20:57:29] MaxSem: i gave it a quick skim but have not looked closely yet [20:57:47] where as is .. is a copy of it on wmf hardware [20:57:51] tfinc: you mean leaving the db and the bot on the toolserver? [20:57:54] you read my mind. [20:58:41] i suspect that would be the most expedient option but probably more error-prone and difficult to maintain. [20:59:09] so friday is our drop date for moving forward with a new architecture [20:59:17] if we do it great. if not then we know what the next step is [20:59:24] cool. [20:59:32] thanks for catching me up tfinc and MaxSem [20:59:37] okay, the app launches on Sept 1st - but when the campaign officially ends? [20:59:46] MaxSem i wish i could add comments to gist [21:00:03] you can just shout them in my face:) [21:00:06] oh it looks like i can but not on anon gists [21:00:10] hehehe [21:00:11] ok [21:00:27] MaxSem alternatively if you post that gist using your account i can probably leave comments [21:00:31] paper trail and whatnot [21:02:06] awjr, I've just edited it [21:03:04] w00t! [21:03:06] MaxSem: officially the content ends 9/30 for most countries. some countries are starting late though so we'll have to support it through 10/31 [21:07:11] https://wikimania2012.wikimedia.org/w/index.php?title=Quotes&diff=35368&oldid=35291 <- well played. [21:07:54] Amgine: :D i should have noted who said it [21:07:59] will have to find them tomorrow [21:08:06] heh... [21:09:11] Off for dinner. [21:14:23] apmon: at the hackathon? [21:14:37] tfinc: i'll be there tomorrow afternoon to do osm / maps tutorial [21:15:04] aude: I won't be at wikimania unfortunately [21:24:45] apmon: we'll talk on chat then, but not now [21:25:15] Ok, have fun at wikimania [21:29:10] MaxSem im a little confused about the import script without seeing the data source - you've got $dbw->dropTable( 'monuments_all', __METHOD__ ); - is monuments_all a temp table in this case, or the actual table? [21:30:08] [WikipediaMobile] flyingclimber pushed 3 new commits to master: http://git.io/pffepg [21:30:08] [WikipediaMobile/master] Add EmailComposer plugin - Jan Christiansen [21:30:08] [WikipediaMobile/master] Add action sheet item to share via mail - Jan Christiansen [21:30:08] [WikipediaMobile/master] Merge pull request #264 from plancalculus/mail-share - Tomasz Finc [21:30:38] Project WikipediaMobile - Nightly builds build #358: SUCCESS in 15 sec: https://integration.mediawiki.org/ci/job/WikipediaMobile%20-%20Nightly%20builds/358/ [21:30:38] * jac: Add EmailComposer plugin [21:30:39] * jac: Add action sheet item to share via mail [21:33:40] awjr, it's a temp table [21:33:59] MaxSem ok cool - i just posted comments [21:34:57] MaxSem overall it looks good, i just have some minor gripes i mentioned in the comments [21:35:24] MaxSem so the next step to this i suppose is updating data in the real table from the temp table? [21:36:54] awjr, responses: 1) I use settings instead of args intentionally - to avoid relying on ops once this thing is run via crontab [21:37:44] MaxSem: i think you should use both. it will make testing and the times you inevitably need to manually run this a lot easier [21:37:52] 2) this is a WMF-only thing, and we don't support 5.2 anymore [21:37:58] just use the settings as fallback defaults [21:38:01] oo [21:38:03] 3) yes, for debugging [21:38:06] that pleases me. [21:38:13] the fact that we don't support 5.2 anymore [21:38:15] when did that happen? [21:39:07] 4) any alternatives to proc_open() - we need to intercept the stdout and feed it into sourceStream() [21:39:17] a onth ago, if I remeber it right [21:39:22] *month [21:39:22] w00t [21:40:45] awjr, my current problem with this script is that it hangs:P [21:42:45] MaxSem if all you're doing is populating a temp table here, i dont really see the benefit to stream the data into the db as opposed to just sourcing it. that would be less code/less error prone/etc. [21:42:46] awjr: Reedy snuck it in :P [21:42:54] gooooo Reedy! [21:43:08] I'm doing who what now? [21:43:15] Reedy: kicking ass. [21:43:23] and killing php 5.2 support. [21:43:39] awjr, well, I put it through gunzip and sed in process [21:43:40] heh [21:43:53] one step away from really no register_globals :D [21:44:27] MaxSem yeah but you could just sed in place and then just import the resulting sql file [21:44:50] yawn:) [21:44:53] hehehe [21:44:57] MaxSem where is it hanging? [21:45:20] somewhere around executing the first SQL statement [21:45:39] MaxSem a benefit to using sed in place is that it will be easier to debug any sed screw ups, as you'll have all the SQL statements after running sed in a file [21:45:53] okayyy [21:45:54] you mean it hangs around the drop table? [21:46:09] no, around create table [21:46:11] o [21:46:26] but you probably don't know what the statement looks like because you're piping it from stdout :p [21:46:59] well, I pit a lot of echos around) [21:47:03] s/pit/put/ [21:47:36] MaxSem don't get me wrong you get mad style points for your fancy usage of sed proc and pipes, but i think in the long run it will be more of a pita [21:47:49] just my two cents :) [21:47:56] thanks awjr, I'll use your advices [21:50:51] you could have great success with this on a day like today in tucson: http://verydemotivational.files.wordpress.com/2011/08/demotivational-posters-meanwhile2.jpg [22:15:58] yuvipand1: jdlrobson http://etherpad.wikimedia.org/WLMShowcase2 [22:25:24] yuvipand1, jdlrobson: is there a safe way for me to test uploads without like, entering the contest or saturating things with junk photos? [22:25:47] awjr: all uploads through the app go to test wiki [22:25:55] awjr: send away [22:26:01] oh neat [22:27:59] mmm, in lucene.php: // off due to intermittent breakage which hangs saves -- brion 2005-09-14 [22:28:37] that was about a feature I was going to use for search [22:29:30] owch [22:37:27] awjr: hi [22:37:34] philinje: hi [22:37:47] are you busy? [22:38:14] i mean at the moment [22:38:33] philinje a bit - were you hoping to talk now? [22:38:47] or when convenient [22:39:04] philinje i'll probably be at a good breaking in point in ~20 mins [22:39:09] can i ping you when im ready? [22:39:12] cool [23:20:01] awjr: how's it going? [23:20:18] hiya phil sorry just wrapping this up - one sec [23:20:30] np [23:24:34] philinje ok ready [23:24:45] sorry that took longer than expected - i was unravelling a long thread :p [23:25:48] awjr: free now? [23:26:20] philinje yeah [23:27:31] "... at a reasonable hourly rate, paid in singlemalt whiskey." [23:27:40] awjr: sorry, browser crashed [23:28:00] awjr: free now? [23:28:02] philinje yeah [23:28:04] Amgine: is that bottles/shots/? depending, it could be quite expensive... [23:28:15] philinje_ no worries, im ready when you are [23:28:18] reasonable from *your* pov. [23:28:26] hehehehe [23:28:39] awjr: is a phone call ok? [23:28:51] sure [23:28:53] im on skype