[04:22:59] hey [04:23:44] i see the current apache conf is in www.wikipedia.conf and uses DocumentRoot /usr/local/apache/common/docroot/www.wikidata.org [04:23:57] were you about to change that ? [04:24:37] and what is the change that is planned for tomorrow [04:25:03] we just added loadbalancer config and SSL cert [04:25:32] but i did not make the DNS switch yet to actually point it to the new wikidata-lb [04:26:06] and i am wondering if its a good idea to schedule that with somebody here [06:16:29] mutante: so our wiki is setup but not the DNS? [06:17:05] or what's the status? [06:46:09] aude: since today you have a) ssl cert / key added to puppet repos b) config added to Load balancer c) config added to SSL proxy [06:47:36] aude: pending is: DNS change to point to new load balancer (and maybe a service IP), missing is: IPv6 [06:49:03] wiki setup: i dont know, but afraid not yet [06:49:43] what is the plan for tomorrow? [06:49:58] i just heard you need the SSL proxy setup soon [06:53:28] aude: i need to go, its like midnight, but in case there is something urgent, i mailed the other (European) ops with a summary [07:22:28] ~back... [07:23:24] i don't know about any plan, except that Denny is at a conference and sure he'd like to have something new to show :) [07:50:56] mutante: please coordinate that with denny [08:20:38] New review: Henning Snater; ""languagesearch" and "opensearch" use "search" as parameter name for the search string. I guess wbse..." [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/29558 [08:32:25] New review: Henning Snater; "Probably, the API response should also contain the original search text for that slow API responses ..." [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/29558 [09:08:19] New review: John Erling Blad; "Not sure if Jens is extending this one or write his own changeset, I'll ask later today." [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/29558 [09:31:09] New review: John Erling Blad; "Change I6ea1f848: New function getFromTerm that searches over both aliases and labels." [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/29558 [09:31:53] New review: John Erling Blad; "Change I60d74f34: (Bug 40392) First commit of wbsearchentities" [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/25006 [09:37:04] New review: John Erling Blad; "The changeset misses the continuation and also does not work as it should with searches depending on..." [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/25006 [09:48:09] New patchset: Daniel Werner; "Change EditableValue constructor to take interfaces" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29612 [10:02:11] New review: John Erling Blad; "It seems like the search is casesensitive due to how the table is configured." [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/25006 [10:03:09] New review: John Erling Blad; "C.5.5.1. Case Sensitivity in String Searches" [mediawiki/extensions/Wikibase] (master); V: 0 C: 0; - https://gerrit.wikimedia.org/r/25006 [10:04:42] Change abandoned: John Erling Blad; "Manually copied to Change I6ea1f848: New function getFromTerm that searches over both aliases and la..." [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29558 [10:12:59] New review: Daniel Werner; "beautiful" [mediawiki/extensions/Wikibase] (master); V: 1 C: 2; - https://gerrit.wikimedia.org/r/29557 [10:12:59] Change merged: Daniel Werner; [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29557 [10:34:51] Hola. [10:34:51] aharoni: Hi [10:34:57] Oh hi. [10:35:36] Ciao, Sannita. If I recall correctly, you asked about how the bots work with Wikidata on the mailing list recently. [10:36:15] So, Amir1 committed some code to pywikipediabot to make it work with Wikidata. [10:36:29] (Amir1 and I are different people with the same first name.) [10:36:57] I almost never run bots, so I cannot test it easily, but everybody is very welcome to try it. [10:37:11] Lydia_WMDE ^ [10:40:13] aharoni: yes he emailed me - still need to take care of that [10:40:19] hi Amir1! [10:40:36] Hi [10:40:58] currently traveling and trying to catch up with things [10:41:16] http://www.mediawiki.org/wiki/Manual:Pywikipediabot/Wikidata [10:41:23] https://www.mediawiki.org/wiki/Special:Code/pywikipedia [10:42:08] Lydia_WMDE: now we can run bots on wikidata and change labels, descriptions, and sitelinks [10:43:07] Amir1: ok great - as you know someone already worked on that for pywikidata and I'd really love if you could coordinate this a bit so you're not wasting effort [10:43:45] i'll send an email to you both in a bit [10:43:50] pywikidata is not same as pywikidata [10:44:11] we must no rewrite the whole code [10:44:11] can you explain please? [10:44:30] Change merged: Henning Snater; [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29612 [10:44:59] pywikidata is rewriting pywikipedia except it's can work on wikidata [10:45:16] but i arrange both pwb [10:45:26] PWB:pywikipbot [10:45:40] there is no need of pywikidata [10:46:02] I'm not very good at talking and documentation [10:46:08] Lydia_WMDE: :( [10:46:44] hmmm [10:47:16] let me write that email and then see where we can go [10:47:45] OK [10:48:10] please consider reading this [10:48:13] http://www.mediawiki.org/wiki/Manual:Pywikipediabot/Wikidata [10:48:24] This is how we can run bots on codes [10:48:29] on wikidata [10:52:07] Lydia_WMDE: is it ok?http://meta.wikimedia.org/wiki/Wikidata/Bots#Frameworks_.2F_API [10:52:11] I changed a little [10:52:35] i'll have a look [10:55:44] Lydia_WMDE: OK and Thanks [11:28:39] New patchset: Jens Ohlig; "(Bug 40391, Bug 40392) New function getFromTerm that searches over both aliases and labels." [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/25006 [11:39:46] New patchset: Jens Ohlig; "(Bug 40391, Bug 40392) New function getFromTerm that searches over both aliases and labels." [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/25006 [12:02:23] aharoni: (cc Lydia_WMDE ) pywikidata will still require some changes (yesterday or two days ago i made some changes iirc, more to come) the claim system will have to be added, and the item save function rewritten not to use &clear. i'd wait for a more stable version, maybe? [12:03:51] hey joancreus [12:04:17] joancreus: fyi aharoni amir != other amir [12:04:28] i know the "release early, release often", but for a mature project like pywikipedia, i'd wait [12:04:32] ohh sorry aharoni [12:04:35] joancreus: more stable version of wikidata you mean? [12:04:45] or? [12:04:50] when the api has settled down ;) [12:04:59] yeah that makes sense in my opinion [12:05:25] i just want to make sure you're not wasting time (since your work is good and we want you to do more of it obviously :D) [12:05:39] :) [12:06:09] when i have time (probably this weekend) i'll change it so it only sends the changed properties [12:06:12] joancreus: so anyway - would be good if you could reply to the email so we can figure out the next steps with amir [12:06:14] joancreus, joancreus, it's going to be confusing :) [12:06:30] let's agree that I am "aharoni" and the other Amir is Amir. [12:06:37] aharoni: very! we need secret identity names for you two [12:06:41] like batman and robin [12:06:42] :P [12:06:42] aharoni: i knew who you were & that you were involved in the project, and in gmail only read amir so i guessed it must be you [12:07:24] So, I essentially got Amir interested in integrating pywikipediabot with Wikidata and pointed him to documentation, mailing list and IRC, and that's it. [12:07:41] Lydia_WMDE: oh dammit, *right now* the other Amir has posted to the list [12:07:47] i smell a conspiracy to turn me mad [12:07:56] joancreus: haha yeah [12:08:15] It got him excited and he committed some code. I'll be very curious to learn how useful it is, because I know almost nothing about bots' code. [12:08:48] And there's no conspiracy, except that we are both Middle-Eastern. [12:08:59] aharoni: see it must be a conspiracy then! [12:09:01] ;-) [12:09:25] cause all good conspiracies are concealed and say there is none! [12:09:30] aharoni: let me check my memory: you're the Apertium+Catalan Wiktionary+(insert other projects here) guy, right? [12:10:23] ack i don't like the pywikipedia+wikidata extension: page.put(u"",u"BOT SUMMARY",wikidata={'type':u'item', 'label':'fa', 'value':u'هلیم'}) it's like working with the api with no interface [12:16:04] New patchset: John Erling Blad; "(Bug 40391) Make the parameter names more like the rest of the api" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29770 [12:18:27] Lydia_WMDE: can you make sure that the two feature requests i also posted to the mailing list are live *before* wikidata goes live? I tihnk they are easy to implement. [12:18:52] Merlissimo: uh remind me what they were please? [12:19:22] New patchset: John Erling Blad; "(Bug 40391) Make the parameter names more like the rest of the api" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29770 [12:19:22] is there a live-blocker bug which depend on those bugs? [12:19:32] yes [12:19:36] i think so [12:19:37] one sec [12:19:50] * Lydia_WMDE looks for it [12:20:09] *sigh* @ meh hotel wifi [12:20:46] Merlissimo: https://bugzilla.wikimedia.org/show_bug.cgi?id=40000 [12:21:24] (should have remembered that it's the one with the nice number ;-)) [12:21:32] New patchset: John Erling Blad; "(Bug 40391) Make the parameter names more like the rest of the api" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29770 [12:26:16] Lydia_WMDE: is amir ladsgroup a pwb developer? [12:26:42] Merlissimo: i am not sure tbh [12:26:45] aharoni: ^ [12:27:13] Lydia_WMDE: got your e-mail about the monthly report; np, just add it before Monday :) [12:27:28] his response to my mail shows that he has not read it completely [12:27:34] guillom: will do :) [12:34:07] bye [12:43:08] New patchset: Henning Snater; "Refactoring of option handling" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29609 [12:50:17] Change merged: Daniel Werner; [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29609 [13:21:16] New patchset: Jens Ohlig; "(Bug 40391, Bug 40392) New function getFromTerm that searches over both aliases and labels." [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/25006 [13:32:32] New review: John Erling Blad; "Lets try this!" [mediawiki/extensions/Wikibase] (master); V: 1 C: 2; - https://gerrit.wikimedia.org/r/25006 [13:32:32] Change merged: John Erling Blad; [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/25006 [13:38:10] New patchset: John Erling Blad; "(Bug 41214) Make Autocomment more general and reusable" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29295 [13:52:14] it's a DanielK_WMDE :) [13:53:13] Change merged: Tobias Gritschacher; [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29295 [14:07:37] DanielK_WMDE: do you have any time to help look at edit conflict issues? [14:30:38] New patchset: John Erling Blad; "(Bug 40391) Make the parameter names more like the rest of the api" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29770 [14:31:28] Lydia_WMDE: ping [14:31:38] aude: hey! [14:33:07] wasup? [14:35:07] Lydia_WMDE: is DanielK_WMDE around? [14:35:20] i don't know [14:35:21] he's on bugzilla, etc. but seems not to be around in irc [14:35:29] i am sitting in a hotel loby in prague [14:35:29] ;-) [14:35:30] oh [14:35:31] * DanielK_WMDE wibbles [14:35:36] DanielK_WMDE! [14:35:37] aude: i'm on vacation, but online for a couple of hours [14:35:50] we are having issues with edit conflicts which is partially fixed [14:35:50] * Lydia_WMDE waves @ DanielK_WMDE [14:35:57] currently trying to clean up thje mess i meade in editpage [14:35:57] but people are still having issues apparently :( [14:36:17] * aude trying to troubleshoot but it's something that would be great to fix ASAP [14:36:35] i guess it would... what exactly is the problem? [14:36:39] git a bug ID? [14:36:46] http://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Apparent_bug_causing_massive_text_loss_when_saving [14:36:48] * DanielK_WMDE is looking through mal macklog and finding piles of stuff to do [14:37:55] New patchset: Daniel Werner; "Fixed bug which made it possible to enter site-links with same site ID" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29789 [14:38:05] http://commons.wikimedia.org/wiki/Commons:Village_pump#Edit_conflict_issues [14:38:46] New patchset: John Erling Blad; "(Bug 40391) Make the parameter names more like the rest of the api" [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29770 [14:38:51] will look into it, but i'm a bit confused about what is supposed to be going on there. [14:39:11] I *tried* not to touch the conflict resolution code, but had to move it around (it's text-specific, after all). [14:39:18] https://bugzilla.wikimedia.org/41280 [14:39:19] so it's possible that i screded it up somewhere [14:39:32] will look into it in a minute [14:39:42] there was an obvious error that i fixed, but seems to happen not just with edit conflicts :( [14:40:21] * aude sad there are virtually zero unit tests for edit page, difference engine, etc. [14:52:09] gah. i'm sorry this is causing so much trouble. [14:52:34] i really tried to get more early reviewes. it proved to be impossible. [14:53:00] the entire "we'll review it it as a whole, when it's done" thing was a bad mistake. [14:55:25] aude: i wish EditPage wasn't such an awfull mess. i wonder if it wouldn't be easier to just rewrite it. [14:55:31] debugging it is nearly impossible. [14:56:23] yeah :( [14:56:57] aude: this looks bad, but i don't really know where to start looking, or how... [14:57:12] for now, i think edit page could try to have as much the same functionality as before [14:57:33] it shouldn't be used at all for other types of content.... only wikitext [14:58:02] (and JS, CSS are being treated as wikitext in the WMF setup now) [14:58:03] aude: so, how will you edit MediaWiki:common.js then? [14:58:11] no, they are not treated as wikitext [14:58:19] they are, and should be, rendered idfferently. [14:58:21] hmm.... [14:58:22] they don't support sections [14:58:24] etc [14:58:29] right [14:58:33] so, they are text-based content [14:58:43] * aude nods [14:58:43] and they use the same conde as wikitext for conflict resulution etc [14:58:51] ok [15:00:12] There shouldn't be a terrible lot of logic changes in EditPage. for the most part, it's just laoding and saving as Content objects, and delegating stuff like creationg the difference engine to the content handler [15:00:17] or at least, that's how it should be [15:00:21] right [15:00:30] the thing i fixed was obvious once i found it [15:00:39] I'm having a hard time understanding how I could have broken it in this way, but apparently, I did [15:01:00] aude: yea, thanks for that. looks like i got confused there (and even noticed it), but failed to go back and check. [15:01:18] i suspect it's a similar issue somewhere else [15:01:18] there was no "TODO" on the line, so it didn't show up when grepping for markers [15:01:22] it's a matter of finding it [15:01:32] well, yea, some kind of stupid oversight :( [15:01:46] yea, bugs tend to be that way :) [15:01:46] * aude pokes more [15:02:00] is there a reliable way to reproduce the issue? [15:02:14] locally or on wikipedia... anything [15:03:12] the edit conflict one yes, this i can't find [15:04:02] and this happens without any conflict resolution being applied? [15:04:12] that's quite odd... [15:04:36] * Silke_WMDE flucht [15:04:43] apparently [15:04:44] Sorry, can I ask sth in german? [15:05:05] Silke_WMDE: ja :) [15:05:36] Wie kriegt Ihr es bloß hin, dass Euer ssh -A den ssh agent mitnimmt??? Ich hänge dauernd auf diesem Mistserver und kann von da nicht an gerrit. [15:06:17] hmmm [15:06:45] would it be possible to mark all translation pages to be TextContent in Translate extension? [15:07:47] that would skip all parsing and presave transformations, right? [15:09:10] Nikerabbit: yes, and yes. [15:09:27] Nikerabbit: $wgNamespaceContentModels( NS_MEDIAWEIKI ) = CONTENT_MODEL_TEXT; [15:09:35] Nikerabbit: (off the top of my head) [15:09:52] Nikerabbit: and don't blame me for any strange side-effects that may have ;) [15:10:03] this is not Intended Use (tm) [15:10:31] Silke_WMDE: ich versteh nicht ganz... du hängst wo, und kommst wo nicht hin? [15:10:38] Silke_WMDE: von bastion of labs, oder was? [15:12:09] Nikerabbit: err, square brackets of course: $wgNamespaceContentModels[ NS_MEDIAWIKI ] = CONTENT_MODEL_TEXT; [15:15:40] btw... [15:15:53] what's the holdup with the deployment of wikidata.org? is itall ops stuff? [15:16:16] DanielK_WMDE: no idea [15:16:35] * aude apparently not in the loop on that [15:16:42] DanielK_WMDE: von labs [15:16:50] DanielK_WMDE: is there hook too so I can do it more granularly? [15:17:05] 06:46 < mutante> aude: since today you have a) ssl cert / key added to puppet repos b) config added to Load balancer c) config added to SSL proxy [15:17:19] like, any namespace not NS_MEDIAWIKI where language code is not qqq [15:17:24] 06:47 < mutante> aude: pending is: DNS change to point to new load balancer (and maybe a service IP), missing is: IPv6 [15:17:39] 06:49 < mutante> what is the plan for tomorrow? [15:17:40] 06:49 < mutante> i just heard you need the SSL proxy setup soon [15:17:48] * aude doesn't know about any plan [15:18:04] DanielK_WMDE: Da hab ich jetzt diesen puppetmaster aus puppet. Und jemand hat was neues gemergt. Das hätte ich gerne. Und es gibt so einen Workaround, damit der Key stimmt, aber gerrit will meinen Key nicht haben. [15:18:34] Nikerabbit: ContentHandlerDefaultModelFor [15:18:42] DanielK_WMDE: Ich bekomme immer: [15:18:42] smeyer@wikidata-dev-4:/var/lib/git/operations/puppet$ sudo GIT_SSH=/var/lib/git/ssh git pull --rebase [15:18:42] Permission denied (publickey). [15:18:42] fatal: The remote end hung up unexpectedly [15:19:18] Silke_WMDE: ich rate mal, dass es nicht am key liegt, sondern am user name. [15:19:44] Silke_WMDE: ...oder noch besser... an der identity. [15:20:14] Silke_WMDE: evtl musst du auf labs in deine .ssh/config rein schreiben, welche identity für gerrit verwendet werden soll. genau so, wie das bei dir lokal auch schon steht. [15:20:55] das key file, das du da angbist, muss soweit ich weiß nicht lokal auf labs liegen (do sollte dein private key eh nicht hin), das agent forwardning übernimmt das [15:21:30] Silke_WMDE: ach ja, statt immer an das -A zu denken geht auch "ForwardAgent yes" im entsprechenden abschnitt von .ssh/config [15:21:54] DanielK_WMDE: OK, danke, das probiere ich mal. [15:22:27] Silke_WMDE: ansonstent: versuch dich mal von labs aus per ssh zu gerrit zu verbinden, ohne git. aber mit -vv [15:22:50] dann sieht man zumindest, welcher benutzername und welche identity versucht wird [15:23:33] Nikerabbit: btw, i think rtrim is applied to plain text content too. [15:23:41] could be made optional, file a bug if you need that [15:24:59] DanielK_WMDE: well, I don't really have a problem with that, mostly I'd like to speed up mass imports and avoid turning ~~~~ to anything [15:26:04] that should be easily done [15:38:20] https://webconf.vc.dfn.de/smwcon/ [15:38:54] aude: is there a ticket on bugzilla for the second problem, the larger and nasty one? [15:39:37] aude: i can't reproduce it either [15:39:55] the best thing i can think of is: put it on bugzilla and tell people to report incidents and look for patterns [15:40:30] i'll try to poke at it over the next couple of days, but currently, i don't see how to attack the issue. the behavior just seems... odd. [15:41:07] i'll go offline again in a few minutes [15:41:22] Abraham_WMDE, AnjaJ_WMDE ----^ [15:42:54] Change merged: Tobias Gritschacher; [mediawiki/extensions/Wikibase] (master) - https://gerrit.wikimedia.org/r/29770 [15:43:10] DanielK_WMDE: ok [15:46:41] Ähem DanielK_WMDE noch da? [15:47:50] DanielK_WMDE: https://bugzilla.wikimedia.org/41352 [15:47:53] i'll keep poking at this one [15:48:23] Silke_WMDE: gerade noch so [15:49:23] aude: thanks. let me know what turns up [15:49:33] DanielK_WMDE: Auf labs hab ich jetzt ne ssh config, aber der key wird nicht akzeptiert von gerrit [15:50:00] DanielK_WMDE: Und mir ist unklar, wie der Pfad aussehen muss [15:50:19] laptop /home/silke... vs. labs /home/smeyer... [15:50:42] wie hast Du das gemacht? [15:50:49] garnicht [15:51:01] ich habe noch nie von labs aus gerrit benutzt [15:51:05] oh ok [15:51:30] Silke_WMDE: sorry, weiß ich auch nicht so genau. versuch's mal mit ssh -vv, pack das log in 'ne pastebin, und frag in #wikimedia-labs [15:51:33] was besseres fällt mir gerade nicht ein, sorry [15:51:44] gut, danke [16:44:29] new commit @ pywikidata, now only changes are pushed (the way it should be according to jeblad, it makes more sense & is a hell faster) [16:44:50] feature requests? [16:44:58] i'll post to the mailing list maybe [16:45:03] things which would be useful in botsw [16:45:05] *bos [16:45:07] *bots [16:49:16] joancreus: thanks! :) [16:49:20] * Lydia_WMDE heads to the airport [23:08:06] German wikipedians, what is the invariant property of disambiguation pages on Deutsche Wikipedia [23:08:37] in English it the {{DAB}} {{Disambig}} and {{Disambiguation}} template. [23:08:38] 10[1] 10https://meta.wikimedia.org/wiki/Template:DAB13 => [23:08:40] 10[2] 10https://meta.wikimedia.org/wiki/Template:Disambig13 => [23:08:42] 10[3] 10https://meta.wikimedia.org/wiki/Template:Disambiguation [23:10:50] umm, isn't that for Meta and interwiki links don't exist for it? [23:11:29] It looks like {{Begriffskl�rung}} [23:11:29] 10[4] 10https://meta.wikimedia.org/wiki/Template:Begriffskl%E4rung [23:11:43] Is there an easy way to know those aliases? [23:17:31] notconfusing: http://en.wikipedia.org/wiki/Template:DAB [23:17:44] and look at the interwiki links [23:17:57] http://de.wikipedia.org/wiki/Vorlage:Begriffskl%C3%A4rung [23:18:40] not sure that helps? but doubt any german wikipedians here now [23:22:20] http://de.wikipedia.org/w/index.php?title=Spezial%3ALinkliste&target=Vorlage%3ABegriffskl%C3%A4rung&namespace=10 [23:22:26] don't see aliases