|
2018-05-09 13:35:21
|
<poe>
|
could anyone tell me what is the best way to get a full static HTML dump from the multiple wiktionaries? Can XML files be converted easily?
|
|
2018-05-09 13:36:56
|
<poe>
|
sorry, not sure if this is the right channel
|
|
2018-05-09 13:38:14
|
<Reedy>
|
We don't do html dumps, unfortunately
|
|
2018-05-09 13:40:00
|
<poe>
|
@Reedy I see you do it for wikipedia. Maybe I could use the same scripts to do it for wiktionary?
|
|
2018-05-09 13:40:03
|
<DanielK_WMDE>
|
poe: talk to the kiwix people, they do this for wikipedia. don't know if they have wiktionary
|
|
2018-05-09 13:40:20
|
<poe>
|
DanielK_WMDE thanks!
|
|
2018-05-09 13:44:35
|
<Reedy>
|
Yeah, "we" as in Wikimedia don't actually do it :(
|
|
2018-05-09 13:46:22
|
<poe>
|
I see, they are no up to date https://dumps.wikimedia.org/
|
|
2018-05-09 14:12:47
|
<kiwi_0x010C>
|
tgr: Hi
|
|
2018-05-09 14:12:52
|
<kiwi_0x010C>
|
We had asked last year an OAuth consumer for Lingua Libre, which we have hardly used because of a significant shift in the development of the project. https://meta.wikimedia.org/wiki/Special:OAuthListConsumers/view/1eee51d3553ee71cb165d77e14650421
|
|
2018-05-09 14:13:03
|
<kiwi_0x010C>
|
However, we would need it now, but with an other ''callback URL''. Is there a way to change it on an existing consumer, or do we need to register a new one?
|
|
2018-05-09 14:23:29
|
<Reedy>
|
kiwi_0x010C: You need to register a new one/new version
|
|
2018-05-09 14:24:23
|
<kiwi_0x010C>
|
Reedy: ok, will it automatically replace the old one?
|
|
2018-05-09 14:24:36
|
<Reedy>
|
No..
|
|
2018-05-09 14:28:26
|
<kiwi_0x010C>
|
So, how can we remove then the old one? 'cause https://www.mediawiki.org/wiki/OAuth/For_Developers#Registration tell us to visit https://meta.wikimedia.org/wiki/Special:OAuthConsumerRegistration/list to do it, but once there I see no delete/disable button... :/
|
|
2018-05-09 14:28:52
|
<Nudin_WMDE>
|
Technical Advice IRC meeting starting in 30 minutes in channel #wikimedia-tech, hosts: @CFisch_WMDE & @Tonina_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
|
|
2018-05-09 14:32:35
|
<Reedy>
|
kiwi_0x010C: I don't think you need to
|
|
2018-05-09 14:32:59
|
<kiwi_0x010C>
|
ok, thanks :)
|
|
2018-05-09 14:56:05
|
<Nudin_WMDE>
|
Technical Advice IRC meeting starting in 5 minutes in channel #wikimedia-tech, hosts: @CFisch_WMDE & @Tonina_WMDE - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
|
|
2018-05-09 15:01:30
|
<Tonina_WMDE>
|
Hello and welcome to this week's Technical Advice IRC meeting with me and CFisch_WMDE \o/
|
|
2018-05-09 15:01:34
|
<CFisch_WMDE>
|
\o/ Hello!
|
|
2018-05-09 15:02:06
|
<CFisch_WMDE>
|
So another Wednesday another IRC meeting!
|
|
2018-05-09 15:03:02
|
<CFisch_WMDE>
|
We have no prepared topics on the wiki page so...
|
|
2018-05-09 15:03:10
|
<CFisch_WMDE>
|
..fire away with your questions ;-)
|
|
2018-05-09 15:03:31
|
<CFisch_WMDE>
|
( if there are any )
|
|
2018-05-09 15:04:32
|
<poe>
|
what is the state of Wikidata in Wiktionary? How can we help?
|
|
2018-05-09 15:04:38
|
<Reedy>
|
How do we solve P=NP?
|
|
2018-05-09 15:05:07
|
<CFisch_WMDE>
|
phfff Reedy
|
|
2018-05-09 15:05:13
|
<CFisch_WMDE>
|
poe: whooo
|
|
2018-05-09 15:05:18
|
<CFisch_WMDE>
|
big questions
|
|
2018-05-09 15:05:22
|
<Tonina_WMDE>
|
:D
|
|
2018-05-09 15:06:01
|
<CFisch_WMDE>
|
SInce neither Tonina_WMDE nor me are part of the Wikidata team
|
|
2018-05-09 15:06:10
|
<CFisch_WMDE>
|
I am not sure about the state there
|
|
2018-05-09 15:06:21
|
<CFisch_WMDE>
|
and where help could go to
|
|
2018-05-09 15:06:53
|
<CFisch_WMDE>
|
maybe if Lydia_WMDE is available she can leave a note on that
|
|
2018-05-09 15:07:21
|
<CFisch_WMDE>
|
but I would assume at least the first question is hard to answer
|
|
2018-05-09 15:07:50
|
<poe>
|
ok thanks
|
|
2018-05-09 15:08:36
|
<CFisch_WMDE>
|
But I guess at least I can say that's appreciated that you want to help :-)
|
|
2018-05-09 15:08:39
|
<tgr>
|
kiwi_0x010C: there is no self-disable ATM, admins can disable it for you
|
|
2018-05-09 15:09:24
|
<tgr>
|
although it is indeed not needed (consumer versions are just UI sugar, every version is a separate, unrelated app basically)
|
|
2018-05-09 15:12:08
|
<Tonina_WMDE>
|
poe: that might be helpful https://www.wikidata.org/wiki/Wikidata:Lexicographical_data
|
|
2018-05-09 15:12:50
|
<poe>
|
I was looking at that, apparently they will deploy the first version this month
|
|
2018-05-09 15:14:06
|
<Tonina_WMDE>
|
yep, looks like it
|
|
2018-05-09 15:18:23
|
<CFisch_WMDE>
|
Sooo anyone else? :-)
|
|
2018-05-09 15:31:43
|
<TheDaveRoss>
|
CFisch_WMDE: we consistently run into issues regarding Lua memory on our project. Is there anything in the works to help diagnose or resolve such issues? Or to help module developers understand the impacts of their changes before making them live?
|
|
2018-05-09 15:32:32
|
<CFisch_WMDE>
|
Hi TheDaveRoss
|
|
2018-05-09 15:33:15
|
<CFisch_WMDE>
|
I am not sure about that ...
|
|
2018-05-09 15:33:35
|
<CFisch_WMDE>
|
...but let me dig around a bit to see what I can get.
|
|
2018-05-09 15:36:51
|
<CFisch_WMDE>
|
So I guess you're using https://www.mediawiki.org/wiki/Extension:Scribunto
|
|
2018-05-09 15:37:20
|
<CFisch_WMDE>
|
there is a setting for lua
|
|
2018-05-09 15:37:22
|
<TheDaveRoss>
|
yes, it is a WMF wiki (en.wiktionary.org)
|
|
2018-05-09 15:37:23
|
<CFisch_WMDE>
|
memoryLimit
|
|
2018-05-09 15:37:43
|
<TheDaveRoss>
|
i.e. we have limited control over such settins
|
|
2018-05-09 15:37:58
|
<CFisch_WMDE>
|
ah ok
|
|
2018-05-09 15:38:21
|
<CFisch_WMDE>
|
so I am not sure if that setting would apply for the WMF production servers
|
|
2018-05-09 15:38:41
|
<CFisch_WMDE>
|
but if so it could be changed by the operations people
|
|
2018-05-09 15:38:42
|
<legoktm>
|
there is a lua profiler that can help track down expensive modules, but I don't know where its functionality is documented
|
|
2018-05-09 15:39:15
|
<CFisch_WMDE>
|
TheDaveRoss: You could also start by creating a ticket stating the problem
|
|
2018-05-09 15:39:57
|
<TheDaveRoss>
|
We generally rely on inspecting the source to see where the memory is going, but it is hard to understand from a lay perspective how the memory usage is calculated and when modules can recycle memory etc
|
|
2018-05-09 15:40:01
|
<CFisch_WMDE>
|
and if increasing that limit might be a first solution, devs could start working on that
|
|
2018-05-09 15:44:40
|
<Tonina_WMDE>
|
TheDaveRoss: there's something on phabricator regarding the problem https://phabricator.wikimedia.org/T188492
|
|
2018-05-09 15:47:12
|
<TheDaveRoss>
|
Yeah, it has been a persistent issue for a couple of years, I mostly suspect it is how we use modules but we don't have a lot of guidance on how we should be using them
|
|
2018-05-09 15:57:16
|
<CFisch_WMDE>
|
Hmm I dug a bit but also could not find satisfying answers for LUA performance issues or profiling. ... So it seems you could profile things when testing them in the sandbox ...
|
|
2018-05-09 15:57:21
|
<CFisch_WMDE>
|
but I did not get how.
|
|
2018-05-09 15:57:52
|
<CFisch_WMDE>
|
I you might want to post something on https://discourse-mediawiki.wmflabs.org/
|
|
2018-05-09 15:58:17
|
<CFisch_WMDE>
|
for a broader audience
|
|
2018-05-09 15:59:59
|
<seth_unr>
|
is there any public page like https://tools.wmflabs.org/admin/oge/status where one can see if there is a replica lag?
|
|
2018-05-09 16:00:54
|
<seth_unr>
|
right now the lag seems to be >24h
|
|
2018-05-09 16:01:14
|
<CFisch_WMDE>
|
seth_unr: o.O
|
|
2018-05-09 16:01:30
|
<seth_unr>
|
(or I am just too dumb)
|
|
2018-05-09 16:02:19
|
<CFisch_WMDE>
|
you should probably ask in #wikimedia-operations ... I mean for the lag
|
|
2018-05-09 16:02:29
|
<CFisch_WMDE>
|
;-)
|
|
2018-05-09 16:02:54
|
<seth_unr>
|
ok
|
|
2018-05-09 16:04:31
|
<mutante>
|
CFisch_WMDE: i think that's more #wikimedia-databases and #wikimedia-cloud heh
|
|
2018-05-09 16:04:58
|
<mutante>
|
seth_unr: ^
|
|
2018-05-09 16:06:23
|
<CFisch_WMDE>
|
Hmm yeah right - so many channels ^^'
|
|
2018-05-09 16:06:48
|
<mutante>
|
i agree there are many channels
|
|
2018-05-09 16:06:53
|
<CFisch_WMDE>
|
but seems operations did work
|
|
2018-05-09 16:06:55
|
<CFisch_WMDE>
|
:-)
|
|
2018-05-09 16:07:07
|
<paravoid>
|
win 41
|
|
2018-05-09 16:08:11
|
<CFisch_WMDE>
|
So official time for the technical advice meeting is up. See you around and maybe next week!
|
|
2018-05-09 16:08:16
|
<CFisch_WMDE>
|
\o/
|
|
2018-05-09 16:08:29
|
<Tonina_WMDE>
|
Thanks everyone! See you! o/
|
|
2018-05-09 16:14:43
|
<seth_unr>
|
thanks, yesm -operations worked
|
|
2018-05-09 16:14:58
|
<seth_unr>
|
s/m/,/
|
|
2018-05-09 16:15:00
|
<seth_unr>
|
:-)
|
|
2018-05-09 18:27:52
|
<DanielK_WMDE>
|
hm, CI fails with 18:13:22 Error: your composer.lock file is not up to date. Run "composer update --no-dev" to install newer dependencies
|
|
2018-05-09 18:27:57
|
<DanielK_WMDE>
|
that shouldn't happen, right?...
|
|
2018-05-09 18:28:19
|
<Reedy>
|
Maybe
|
|
2018-05-09 18:28:30
|
<Reedy>
|
Depends if the vendor patch merged before core and stuff
|
|
2018-05-09 18:29:07
|
<Reedy>
|
Or a rebase might be needed
|
|
2018-05-09 18:29:09
|
<DanielK_WMDE>
|
well, the patch in question doesn't touch composer.json
|
|
2018-05-09 18:29:22
|
<Reedy>
|
Doesn't matter
|
|
2018-05-09 18:29:25
|
<DanielK_WMDE>
|
hitting rebase now
|
|
2018-05-09 18:29:37
|
<Reedy>
|
If your patches parent is an older composer.json... and the one in vendor has changed
|
|
2018-05-09 18:29:41
|
<Reedy>
|
There's potential for mismatch
|
|
2018-05-09 18:30:11
|
<DanielK_WMDE>
|
yea, i see
|
|
2018-05-09 18:30:18
|
<DanielK_WMDE>
|
could use a better error message
|
|
2018-05-09 18:30:59
|
<DanielK_WMDE>
|
any, ttfn
|