[12:42:58] CREATE (new line) LAST Scawiki A tornallom [12:43:13] why doesn't it work? [12:43:22] using quick_statements? [12:45:06] krls-ca: it should be [12:45:09] CREATE [12:45:24] LAST Lsca "a tornallom" [12:45:34] label with language code [12:45:42] and string between "" [12:46:03] and create on its own line [12:46:32] CREATE (new line) LAST Lsca "A tornallom" Scawiki A tornallom [12:47:28] https://www.wikidata.org/wiki/Q18692785 [12:47:36] but ca sitelink doesn't work [12:47:41] doesn't add* [12:48:06] krls-ca: All strings must be in "", even the sitelink, I think [12:48:14] try [12:48:18] i will try it* [12:48:40] it's "ca" the language code, not "sca" sorry [12:48:57] no? [12:49:22] Q18692785 Scawiki "A tornallom" [12:49:24] works [12:50:20] so sitelinks work like a string :) [12:51:02] CREATE (new line) LAST Lca "Cementiri de Sant Gervasi"(new line) LAST Scawiki "Cementiri de Sant Gervasi" [12:51:14] yes [12:51:17] yeps! [12:51:22] :) [12:51:38] Perfect, I will create 500 new items :D [12:51:41] soon* [12:52:51] only 500? :p [12:54:04] Now, it's a testing project :D [13:01:01] krls-ca, Harmonia_Amanda: FYI created https://bitbucket.org/magnusmanske/wikidata-todo/pull-request/2/site-link-sitelink-fixed-one-example/diff [13:01:38] matej_suchanek: thank you [13:02:55] ty [13:32:02] (03CR) 10Siebrand: [C: 04-1] "i18n/L10n reviewed." (035 comments) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/181902 (owner: 10Multichill) [15:17:51] (03CR) 10Siebrand: [C: 04-1] "i18n/L10n reviewed." (032 comments) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/179868 (owner: 10Aude) [15:25:50] [13Diff] 15JeroenDeDauw created 06split (+1 new commit): 02http://git.io/WlQJrQ [15:25:50] 13Diff/06split 14e7f84e8 15jeroendedauw: Split biggest and most complex method [15:27:36] wmde/Diff#91 (split - e7f84e8 : jeroendedauw): The build passed. [15:27:36] Change view : https://github.com/wmde/Diff/commit/e7f84e82fbd4 [15:27:36] Build details : http://travis-ci.org/wmde/Diff/builds/45361631 [15:28:52] JeroenDeDauw: Where iz u? :D [15:29:04] It's like you're not even here [15:37:08] (03CR) 10Siebrand: [C: 031] "i18n/L10n reviewed." [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/181555 (owner: 10Daniel Kinzler) [15:38:04] (03CR) 10Siebrand: Move data type code to separate directory. (031 comment) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/181555 (owner: 10Daniel Kinzler) [15:45:00] hoo: It's like you and Abraham and the other WMDE people are not here! [15:45:37] JeroenDeDauw: Clearly you're not here :'D [15:45:44] It's a Lucie [15:46:20] hoo: saal2, you? [15:46:59] Somewhere on ground floor sitting at a table... doing some stuffs and waiting for someon+e [15:50:36] someone in particular or just waiting for anyone to talk to you? :) [15:52:20] frimelle: Someone in particular [15:52:44] Probably going to get food [15:52:48] and I need more caffeine [15:52:50] hoo: who is blessed with being on the 'wait-list' for thee? :o [15:52:55] sitting over here in the dark makes me extra sleepy [15:53:24] JohnLewis: I could give you a user name, but he's barely active on Wikimedia, I think [15:53:37] And he might not like it [15:53:39] so someone ;) [15:53:41] give me a username or anything :p [15:53:58] give me GPS coordinates then ;) [15:54:43] Oh, that's easy... somewhere withing the CCH, Hamburg [15:54:51] don't even give a city... oh late [15:55:28] so far away from me :( [16:20:40] hoo found his friend :D [18:10:06] YuviPanda: You around? Did you look enough into the wdq code to know how to force an update of certain items? [18:10:36] Does a purge trigger wdq to update or maybe an edit? [18:10:46] multichill: hey! [18:11:02] multichill: nope, it’s multithreaded C++ and I doubt I’ll find my way around... [18:11:35] Some items are still showing up in the autolists. I wonder if I can trigger an update [18:11:58] hmm [18:12:26] The database dump is pretty old so a new dump should be around soonish [18:13:04] bbl [18:15:53] multichill: hmm, right. I know enough to update when new dump is around [18:34:12] Hi [18:56:35] How do I mass-add labels with Widar? [19:17:13] YuviPanda: Feel like having a quick look at the update code together? I wonder how it is supposed to keep itself in sync [19:17:38] multichill: I’ve so many alarm bells going off in my head, but why not, let’s look at it :D [19:18:13] Haha, it was that or debug some anoying network problem on which I already wasted half a day [19:18:33] https://bitbucket.org/magnusmanske/wikidataquery is the place, right? [19:19:34] multichill: yeah [19:20:15] Use ./download_and_process_incremental_dumps.php for incremental updates <- that must be it? [19:20:54] multichill: bool TWikidataDB::updateRecentChanges ( TItemSet &target ) { [19:21:03] wd_inmem.cpp [19:21:05] line 1564 [19:21:08] right [19:21:16] multichill: nope, that documentation is out of date :P [19:21:39] multichill: hmm, so it goes through RC table and then makes a call to Special:EntityData [19:21:47] and updates from there [19:22:25] So if I get something to appear in RC, it will updated. Good to know [19:22:33] yeah [19:22:40] theoretically, at least :) [19:23:01] So now I wonder where this updateRecentChanges is called [19:23:34] multichill: hahaha [19:23:37] multichill: it’s called in a loop [19:23:49] line 599 [19:23:52] wd_server.cpp [19:24:13] that’s some bizzare code [19:24:19] if ( 1 ) { // Use replica DB [19:24:26] While (1), ouch [19:24:32] heh [19:24:34] usleep ( 1000 ) ; // Not sure why, but why not? [19:24:47] multichill: ideally, this will listen to RCStream and update only those [19:24:51] that come in from there [19:26:18] Is config["update_wdq_file"] set to true? [19:26:22] yup [19:26:23] it is [19:26:25] let me verify [19:27:26] multichill: yup, it is [19:27:58] Is it timestamped? [19:28:32] Oh, did you copy these files before you fired up the second server? [19:28:46] multichill: hmm? [19:29:02] clog << "Importing binary file list from " << web.binary_fofn << " ..." << endl ; [19:29:24] oh yeah, I did. they run off their own copies [19:30:17] https://www.wikidata.org/wiki/Q115913 is a good one to debug [19:30:32] Last edit 21, but still showing up [19:31:35] YuviPanda: Can you find that id somewhere in the logs? [19:31:49] I don’t think the logs actually log individual ids. [19:31:51] let me look [19:32:33] multichill: not really, can’t see any QIDs there... [19:32:41] multichill: also, want me to add you to the project? :) [19:33:12] uh oh, with power comes responsibility [19:33:49] Just do it :P [19:35:01] multichill: ok! [19:35:51] multichill: done. wdq-mm-01 and wdq-mm-02 [19:36:05] multichill: also, don’t make any permanent changes without doing so on puppet? [19:36:18] And !log I guess? [19:36:36] multichill: yeah [19:37:05] multichill: the load balancing nginx is on wdq-mm-01 itself - I don’t think we have enough load to justify a separate machine :) [19:37:52] 16679475 pages in namespace 0, now running the query how many pages have been touched since 20141221000000 [19:37:57] Just to get an idea of change rate [19:38:03] ok [19:38:05] We need another lb project :P [19:38:12] hmm? :) [19:38:21] technically dynamicproxy itself can work as a lb [19:38:30] just hasn’t been written into the wikitech interface yet [19:38:46] 1184392 pages have been touched [19:39:03] So about 1/15 pages in a week [19:39:24] That's quite a few to play catch up with [19:40:03] you can maybe restart the service to see if that helps. probably won’t :D [19:40:08] (sudo service wdq-mm restart) [19:40:23] My assumption is that it just sometimes misses updates [19:40:41] So that we could graph the outdated items in time and see clusters [19:43:02] YuviPanda: Any idea how much load the import job is causing? [19:43:29] multichill: so there’s a deadlock that sometimes happens whne you restart, and wdq-mm sits at 800% CPU and does nothing [19:43:40] multichill: or, it stays at 100% CPU for a few mins and then settles down to 3-4% [19:43:49] so it’s really negligible load in wdq-mm itself [19:44:07] ok [19:46:55] YuviPanda: Did an edit on https://www.wikidata.org/wiki/Q115913 . So that should trigger an update [19:49:22] it almost looks like wdq doesn't like Sarah :-( [19:54:03] multichill: :( [19:55:17] We're working on the list of paintings not connected with a collection at http://tools.wmflabs.org/autolist/autolist1.html?start=350&q=CLAIM%5B31%3A3305213%5D%20AND%20NOCLAIM%5B195%5D [19:55:40] Difficult job when the lists aren't properly updating [19:58:03] yeah :( [19:58:20] multichill: do you know when a new json dump is due? [19:58:30] No, maybe Lydia_WMDE? [19:59:07] nope sorry. hoo would know [19:59:11] hopefully [20:11:23] (03CR) 10Multichill: "Thanks for the feedback Siebrand. Could you answer my answer about the special page name?" (034 comments) [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/181902 (owner: 10Multichill) [20:12:26] (03PS4) 10Multichill: Implement a special page to show items with the most sitelinks [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/181902 [20:17:50] YuviPanda: I don't think I'm going to play around a lot with it soon. Probably bit more botting, maybe getting some more special pages and of course, lot's of paintings ;-) [20:18:06] :) [20:18:14] I’m afraid I’m not of much use in the code itself [20:18:43] At least the editing trick works. The ones I updated all disappeared [20:25:53] multichill: wooo! [20:26:06] so that’s almost a purge trick [20:26:15] I wonder if you can get things onto RC by other meanss [20:40:11] YuviPanda: It's time my friend. I think you're now worthy enough to create a user page at https://www.wikidata.org/w/index.php?title=User:Yuvipanda&action=edit&redlink=1 and experience the babel magic [20:41:01] Be sure to include that nice curly language of you ;-) [20:41:01] I don’t see anything! https://www.wikidata.org/wiki/User:Yuvipanda [20:41:05] oh [20:41:09] those [20:41:09] hmm [20:41:12] I forgot how to add them [20:42:18] nic [20:42:28] WOW, edit conflict detection is broken! [20:42:42] We had a mid air collision and it just saved my edit [20:43:05] hmm, and then my edit on top of that [20:43:44] Not sure I like it. Now you'll see ta and on each item and property like for example https://www.wikidata.org/wiki/Q2 [20:44:03] You probably want to add some languages you understand a bit [20:56:10] Lydia_WMDE: https://www.wikidata.org/wiki/Wikidata:Article_placeholder_input#Things_we_definitely_need_to_avoid <- what's wrong with my input and signature? :P [20:56:53] lol [21:02:12] I'm wondering if maybe we should add an option to add "wanted" sitelinks. So sitelinks, but they link to a red page. Than you can use that info on wikipedia to add a special class to red links to grab stuff from Wikidata [21:03:44] We could require to have at least 1 (or n) incoming links before you can create such a link. [21:04:40] But I'm not sure if this scales. At least it scales better than the akward redlink templates. What do you think Lydia_WMDE? [21:05:16] yeah i have been thinking about how to make this work and so far i don't have a solution i like [21:05:37] I'm afraid that will become such a dumping ground [21:05:46] yeah [21:06:55] Better than https://en.wikipedia.org/wiki/Special:WantedPages [21:08:24] multichill: sadly, I do not actually understand anything other than those two [21:08:42] multichill: also yay! :) [21:09:12] hehe [21:45:02] [13Diff] 15JeroenDeDauw opened pull request #23: Split biggest and most complex method (06master...06split) 02http://git.io/TxGHsA