[05:20:38] http://ultimategerardm.blogspot.nl/2013/10/statistics-for-wikidata.html [05:31:12] the lack of labels has me really worried [05:32:16] it should be really easy to populate them by bot [05:32:57] it would be a matter of using the title of the Wikipedia article for the label [05:33:12] that is better I think than no label [08:42:59] anyone alive in Germany ? I will be upgrading Jenkins monday 21st at 8:00 UTC (10am CET). https://wikitech.wikimedia.org/w/index.php?title=Deployments&diff=86281&oldid=86280 [08:43:03] jobs will be LOST : / [08:43:15] will ping you over IRC when I start [09:02:36] hashar: ? :O [09:02:47] addshore: that is on monday [09:02:57] addshore: we are running Jenkins Long Term Support release [09:03:02] they got a new release out a few days ago [09:03:07] so will upgrade our installation [09:03:10] ~ 2 hours downtime [09:03:25] hehe, was going to talk about something else ;p [09:08:35] how does jenkins handle the extensions.git repo? :> [09:09:14] * Jasper_Deng wonders if addshore got his memo [09:09:36] I just did :P [09:09:46] addshore: what do you mean with extensions.git ? [09:09:49] it is manually maintained [09:10:09] whenever an extension is added in gerrit we have to add it to mediawiki/extensions.git by running sync-from-gerrit.py [09:10:10] really? :O [09:10:18] that ls-projects and git add the submodule for us [09:10:21] ahh, I mean the auto updating for each commit [09:10:25] ah [09:10:29] that is handled by Gerrit directly [09:10:34] no clue how that works exactly [09:10:35] how? :D [09:10:38] haha [09:11:01] basically, Gerrit mysteriously manage to find out that mediawiki/extensions/Foobar.git is registered in mediawiki/extensions.git and update submodule pointer [09:11:04] branch = . [09:11:10] that is the submodule config in mw/ext.git [09:11:19] a trick that instruct Gerrit to update automatically [09:11:29] ^demon / qchris would know the details probably [09:11:46] so in theroy if I adda .submodules with the branch pointing to '.' it might auto update? :P [09:16:56] Gerrit supports a custom git superproject feature for tracking submodules. [09:16:57] This feature is useful for automatic updates on superprojects whenever [09:16:57] a change is merged on tracked submodules hehe bingo [09:33:55] (03Draft3) 10Addshore: Start Wikidata Superproject [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/90512 [09:39:38] (03PS4) 10Addshore: Start Wikidata Superproject [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/90512 [09:40:21] (03Draft4) 10Addshore: Start Wikidata Superproject [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/90512 [09:40:25] (03Draft1) 10Addshore: Start Wikidata Superproject [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/90512 [09:40:29] (03Draft2) 10Addshore: Start Wikidata Superproject [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/90512 [09:40:35] superproject! [09:48:50] (03CR) 10Tobias Gritschacher: [C: 032] Start Wikidata Superproject [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/90512 (owner: 10Addshore) [09:49:52] rschen7754|away: superproject indeed ;p [09:50:36] :D [09:52:39] (03Merged) 10jenkins-bot: Start Wikidata Superproject [extensions/Wikidata] - 10https://gerrit.wikimedia.org/r/90512 (owner: 10Addshore) [09:52:58] (03CR) 10Tobias Gritschacher: [C: 032 V: 032] Updated Ruby gems [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/90321 (owner: 10Zfilipin) [09:53:33] https://git.wikimedia.org/summary/mediawiki%2Fextensions%2FWikidata [09:58:42] hashar: any idea if there is a way to make jenkins trigger tests for this fancy gerrit superproject thing? :P https://git.wikimedia.org/summary/mediawiki%2Fextensions%2FWikidata [10:00:02] addshore: ping [10:19:41] addshore: don't we have jobs for Wikidata already ? [10:19:50] https://integration.wikimedia.org/ci/job/mwext-Wikidata-testextensions-master/ [10:19:59] bah test is even passing hehe [10:20:01] yes, but they dont run when gerrit does its super secret updating of the submodules :P [10:20:18] No idea if there is any way to make them run as gerrit does everything internally [10:20:38] we might receives event whens oemthing happens in mediawiki/extensions.git [10:20:39] might just have to setup a set of travis tests for it instead so when github gets updated something will run [10:20:40] not sure though [11:42:36] is it not possible to change the language without being logged in? [11:51:10] Hoi lbenedix ... it is possible the tool to do this is on the left hand side [11:53:49] Hoi, is it possible to put all the identifiers of external resources in a group ? [12:08:01] its not done with the ULS-thing at the top of the site? [12:15:14] It is ULS ... [12:15:28] this has gone to the sidebar in many instances [12:15:45] Do not ask me I am not the usability expert :) [13:57:55] what is the query-namespace? [14:01:18] lbenedix: not implemented yet [14:01:26] ie not functional [16:28:11] [travis-ci] JeroenDeDauw/WikidataBuilder#71 (nosource - decb48a : jeroendedauw): The build passed. [16:28:11] [travis-ci] Change view : https://github.com/JeroenDeDauw/WikidataBuilder/commit/decb48a161de [16:28:11] [travis-ci] Build details : http://travis-ci.org/JeroenDeDauw/WikidataBuilder/builds/12725398 [17:19:03] I wonder whether this is some correct code, from both technical and logical views: http://pastebin.com/2w0EbQ2j [17:20:27] $claim->getMainSnak()->getPropertyId()->equals( $existingClaim->getMainSnak()->getPropertyId() ), of course [17:42:04] where can I find documentation about what exactly you are saving in the text table? [17:42:40] there is a difference between: https://www.wikidata.org/wiki/Special:EntityData/Q42.json and https://www.wikidata.org/wiki/Special:Export/Q42 [17:44:48] lbenedix: you mean what's actually in the database? [17:44:55] yepp [17:45:28] lbenedix: that's https://www.wikidata.org/wiki/Special:Export/Q42 [17:45:53] I want to understand this [17:46:24] what is this "g": "q42$39F4DE4F-C277-449C-9F99-512350971B5B", [17:46:50] that's a guid [17:47:10] lbenedix: [[:en:Globally_unique_identifier]] [17:47:13] 10[1] 10https://en.wikipedia.org/wiki/Globally_unique_identifier [17:47:19] what are this arrays like "m": ["value",21,"wikibase-entityid",{...}] [17:47:55] lbenedix: well that's the fromat used internally by software [17:48:06] what is your exact need? [17:48:14] and I'd like to know why this is there [17:48:28] I want to make some analysis on the dumps [17:48:43] lbenedix: ough, then use https://www.wikidata.org/wiki/Special:EntityData/Q42.json [17:48:48] that's an external serialization [17:48:53] which is stable [17:49:01] and how do I create this from the dumps? [17:49:04] the internal (what is in the db) can change [17:49:34] lbenedix: to be hones I haven't played with dumps yet [17:49:38] there is no datamodel? [17:49:40] lemme check [17:49:44] no documentation? [17:50:41] there are many "q": [], [17:50:48] empty arrays [17:50:48] Lydia_WMDE: ^ ? [17:51:17] lbenedix: that's in export [17:51:23] yes [17:51:39] I think that is what can be found in the text table in mysql [17:52:44] lbenedix: and dumps have plain db format? [17:52:59] yep [17:53:03] just plain dumps [17:53:17] !team [17:53:35] lazowik: Hm? [17:53:45] lbenedix asking about dumps [17:53:57] team pings administrators. [17:54:01] I'm asking about the datamodel and documentation [17:54:05] ough [17:54:06] really? [17:54:12] couterintuitive [17:54:16] sorry :p [17:54:33] 'Use !_admin or !_team to get the attention of an administrator' :p [17:54:37] yep [17:54:53] Why we have it there, I don't know. [17:58:29] JeroenDeDauw: around? [17:59:38] The most confuing things are the "refs" arrays... [18:00:00] "refs": [ [[foo,bar,{}]],[...] ] [18:00:01] Caracteres inválidos en el enlace «foo,bar,{}»; no están permitidos: <>[]{} [18:00:38] Okay... I'll be afk some time [18:09:06] Good evening :) [18:15:50] (03PS7) 10Jeroen De Dauw: Install and update the store when needed [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88753 [18:15:54] (03PS7) 10Jeroen De Dauw: Update docs and @since tags [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88739 [18:16:00] (03PS8) 10Jeroen De Dauw: Install and update the store when needed [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88753 [18:16:34] lazowik: reporting live from th little old country of Belgium! [18:16:41] addshore: if you consider it a bug and want to fix it: http://pastebin.com/TGzKALwR [18:16:51] JeroenDeDauw: whoa! [18:17:01] addshore: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaahhhhhhhhh! [18:17:19] dumps are avaible only in internal serialization? [18:17:22] (03CR) 10jenkins-bot: [V: 04-1] Update docs and @since tags [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88739 (owner: 10Jeroen De Dauw) [18:17:25] (03PS5) 10Jeroen De Dauw: Update gitignore. [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88966 [18:17:26] (03CR) 10jenkins-bot: [V: 04-1] Install and update the store when needed [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88753 (owner: 10Jeroen De Dauw) [18:17:32] (03CR) 10jenkins-bot: [V: 04-1] Update gitignore. [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88966 (owner: 10Jeroen De Dauw) [18:18:56] JeroenDeDauw: ^ [18:19:32] :) [18:19:50] !_delete team ? [18:20:06] nah, people might be used to that [18:20:19] !_build DREAM_Team [18:20:25] :D [18:21:51] rschen7754|away: Thanks :p [18:22:50] lazowik: We could use !WikidataLazyDevelopersWhoRarelyUseIRCExceptWhenDiscussingACodeUpdateOrGoing'Thatsnotme!' [18:22:51] :p [18:23:14] * lazowik puts that into evernote [18:23:36] :p [18:24:32] And replace !_admin with !LetsPingOnlyThreeAdminsBecauseTheRestAreAway,Don'tUseIRCOrBeingDesysop'dNextWeekForInactivity :D [18:25:03] rschen7754|away^ Make those changes ;) [18:25:28] JohnLewis: you seem to not undertsand that we are all very busy browsing the interwebs watching lolcats [18:25:57] JeroenDeDauw: Oh sorry :/ Add that into the stalk word too. [18:26:06] GerardM: ah, found it! (re dreamteam) http://lo3szopki.files.wordpress.com/2011/03/dreamteam.png [18:26:50] http://ioi.eduardische.com/people/1071 [18:34:35] addshore: you here? [18:35:15] JohnLewis: the stalk word? [18:36:54] JeroenDeDauw: Never mind that :p [18:36:56] lazowik: yeah, that is the current state AFAIK [18:37:04] lazowik: though I think someone is working on this [18:37:13] and no docs on it? [18:37:18] lazowik: at the last we have some item on providing dumps in the API format [18:37:18] (internal serialization) [18:37:25] lazowik: no docs [18:37:32] lbenedix: ^ [18:37:32] lazowik: people should just not use it ;p [18:37:36] hehe [18:37:45] lazowik: I think it is quite bad we are exosing it at all now [18:38:15] lazowik: the only supported way to interpret this internal representation is by using the deserialization code for it that we have [18:38:20] ie in the Entity object [18:38:28] then how to do stats et. al.? [18:38:58] dumps are the only way for now if I understand correctly [18:39:26] lazowik: either wait untill we have proper dumps or try to guess what the stuff in our current ones means? [18:39:34] mhm [18:40:00] JeroenDeDauw: actually it's lbenedix who's interested [18:46:23] (03PS1) 10Jeroen De Dauw: Fix path in MW test registration [extensions/WikibaseQueryEngine] - 10https://gerrit.wikimedia.org/r/90579 [18:46:44] (03CR) 10jenkins-bot: [V: 04-1] Fix path in MW test registration [extensions/WikibaseQueryEngine] - 10https://gerrit.wikimedia.org/r/90579 (owner: 10Jeroen De Dauw) [18:47:54] (03PS2) 10Jeroen De Dauw: Fix path in MW test registration [extensions/WikibaseQueryEngine] - 10https://gerrit.wikimedia.org/r/90579 [18:48:52] (03CR) 10Jeroen De Dauw: [C: 032] Fix path in MW test registration [extensions/WikibaseQueryEngine] - 10https://gerrit.wikimedia.org/r/90579 (owner: 10Jeroen De Dauw) [18:48:56] (03PS6) 10Jeroen De Dauw: Update gitignore. [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88966 [18:54:49] (03CR) 10jenkins-bot: [V: 04-1] Update gitignore [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88966 (owner: 10Jeroen De Dauw) [19:03:27] FYI: PHP Notice: Key 8:datatypes-type-quantity already belongs to ext-datatypes, conflict with ext-wikibase-lib [19:03:59] (03Abandoned) 10Jeroen De Dauw: Schema updating stub [DO NOT MERGE] [extensions/WikibaseQueryEngine] - 10https://gerrit.wikimedia.org/r/82630 (owner: 10Jeroen De Dauw) [19:04:57] (03PS1) 10Jeroen De Dauw: Optimized imports [extensions/WikibaseQueryEngine] - 10https://gerrit.wikimedia.org/r/90581 [19:12:36] (03CR) 10Jeroen De Dauw: [C: 032 V: 032] Update docs and @since tags [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88739 (owner: 10Jeroen De Dauw) [19:24:45] [travis-ci] wikimedia/mediawiki-extensions-WikibaseQuery#66 (master - 8f0af16 : jeroendedauw): The build is still failing. [19:24:45] [travis-ci] Change view : https://github.com/wikimedia/mediawiki-extensions-WikibaseQuery/compare/b83e37279093...8f0af16cbe92 [19:24:45] [travis-ci] Build details : http://travis-ci.org/wikimedia/mediawiki-extensions-WikibaseQuery/builds/12732324 [19:48:53] (03PS1) 10Liangent: Fix {{#property: }} calls for missing property on wikis with LanguageConverter [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/90636 [19:57:03] (03PS2) 10Liangent: Fix {{#property: }} calls for missing property on wikis with LanguageConverter [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/90636 [19:57:59] huh, looks like not a lot of dev stuff happened... https://meta.wikimedia.org/wiki/Wikidata/Status_updates/2013_10_18 [19:58:19] JeroenDeDauw: It's what Addshore said happened. [19:58:20] Perhaps due to Lydia_WMDE not being in the office and raging people into filling in the weekly? [20:01:23] (03PS9) 10Jeroen De Dauw: Install and update the store when needed [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88753 [20:02:33] you missed the new statistics by Magnus Manske [20:02:54] GerardM: Nope, last weeks. [20:03:10] Or did he update then? [20:03:26] Nope there is a new statistic since today [20:05:29] He now also looks at number of descriptions [20:05:43] (03CR) 10jenkins-bot: [V: 04-1] Install and update the store when needed [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88753 (owner: 10Jeroen De Dauw) [20:06:07] I even tweeted about it [20:06:23] have it on facebook :) [20:09:17] (03PS1) 10Liangent: Remove one hard-coded constant [extensions/Wikibase] - 10https://gerrit.wikimedia.org/r/90643 [20:15:06] (03PS10) 10Jeroen De Dauw: Install and update the store when needed [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88753 [20:18:46] (03CR) 10jenkins-bot: [V: 04-1] Install and update the store when needed [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88753 (owner: 10Jeroen De Dauw) [20:52:56] (03PS7) 10Jeroen De Dauw: Update gitignore [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88966 [20:56:22] (03CR) 10jenkins-bot: [V: 04-1] Update gitignore [extensions/WikibaseQuery] - 10https://gerrit.wikimedia.org/r/88966 (owner: 10Jeroen De Dauw) [21:05:18] can someone tell me how many labels there are at this moment (never mind in what language) [21:41:22] http://ultimategerardm.blogspot.nl/2013/10/wikdata-needs-3780000000-labels.html [22:12:40] GerardM: 40482128 labels [22:12:51] in all languages for both items + properties [22:19:58] Thanks :) [22:23:27] legoktm: that is 0.010709558 of what we want :) [22:27:14] a lot of labels are the same in allmost every lang [22:29:02] lbenedix true but we need them anyway [22:30:43] I suggested one way to get some of them on the mailinglist today... [22:31:27] using the existend fallback mechanism and let users check if it is right and save the label [23:35:26] oi [23:35:38] wut [23:35:47] td bem? [23:36:17] :O Reedy actually comments in here when not pinged 1000 times [23:36:41] If I'm about..