|
2019-04-10 14:00:21
|
<wm-bot>
|
Technical Advice IRC meeting starting in 60 minutes in channel #wikimedia-tech, hosts: @amir1 & @subbu - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
|
|
2019-04-10 14:01:40
|
<Zppix>
|
(for real this time) ^
|
|
2019-04-10 14:02:03
|
<RhinosF1>
|
Zppix, Yes it's today
|
|
2019-04-10 14:02:27
|
<Zppix>
|
RhinosF1: i know thats what i was saying
|
|
2019-04-10 14:03:00
|
<RhinosF1>
|
I didn't know whether it was a question or sarcasm
|
|
2019-04-10 14:03:23
|
<Zppix>
|
:P
|
|
2019-04-10 14:05:33
|
<Reedy>
|
Sarcasm is hard to detect on the internet
|
|
2019-04-10 14:05:56
|
<Zppix>
|
This is true
|
|
2019-04-10 14:50:20
|
<wm-bot>
|
Technical Advice IRC meeting starting in 10 minutes in channel #wikimedia-tech, hosts: @amir1 & @subbu - all questions welcome, more infos: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting
|
|
2019-04-10 15:02:10
|
<subbu>
|
Amir1, o/
|
|
2019-04-10 15:02:17
|
<Amir1>
|
o/
|
|
2019-04-10 15:02:34
|
<Amir1>
|
Hello and welcome to the technical advice irc meeting
|
|
2019-04-10 15:03:21
|
<Amir1>
|
subbu and I are your hosts today and wish a pleasant meeting. The weather is sunny and nice.
|
|
2019-04-10 15:04:39
|
<RhinosF1>
|
Hello, Amir1, Subbu, Do you have any idea when Wikitech Account Creation will be unlocked?
|
|
2019-04-10 15:05:35
|
<Amir1>
|
RhinosF1: Unfortunately not, Security and RelEng are working on it
|
|
2019-04-10 15:06:01
|
<Amir1>
|
on the time being, if it's a small case, you can make a task for certain cases
|
|
2019-04-10 15:07:13
|
<RhinosF1>
|
Amir1, Thanks, I don't really need it for now. Have a good meeting. :)
|
|
2019-04-10 15:07:17
|
<qq[IrcCity]>
|
hello. Are here JavaScript experts? I need an advice on mw.hook('wikipage.content')
|
|
2019-04-10 15:08:45
|
<Amir1>
|
I have basic knowledge of frontend but Krinkle knows the best
|
|
2019-04-10 15:09:55
|
<qq[IrcCity]>
|
I developed several scripts using the hook for operations which might be quite heavy; such as searching in all <img> elements, or <span>s having a specific class.
|
|
2019-04-10 15:10:03
|
<subbu>
|
same as Amir1 as well.
|
|
2019-04-10 15:11:39
|
<apergos>
|
can someone give an update on the status of the train this week? I tried to wade through the various backlogs but still don't have a clear picture
|
|
2019-04-10 15:12:16
|
<subbu>
|
qq[IrcCity], what is the question?
|
|
2019-04-10 15:12:42
|
<subbu>
|
apergos, i know there were some blocking tickets .. but, let me look around and see what i can find out.
|
|
2019-04-10 15:12:49
|
<qq[IrcCity]>
|
Now I suspect that mw.hook('wikipage.content') interfers with performance of some functions, such as hints in the search form.
|
|
2019-04-10 15:12:51
|
<apergos>
|
ty
|
|
2019-04-10 15:13:27
|
<qq[IrcCity]>
|
But I don’t know how often the hook is called, actually.
|
|
2019-04-10 15:13:54
|
<Amir1>
|
apergos: there's an issue with Score extension and VE
|
|
2019-04-10 15:14:44
|
<Amir1>
|
https://phabricator.wikimedia.org/T206679
|
|
2019-04-10 15:15:08
|
<subbu>
|
https://phabricator.wikimedia.org/T206679 .. ah Amir1 got ther ealready. :)
|
|
2019-04-10 15:15:30
|
<apergos>
|
huh
|
|
2019-04-10 15:16:00
|
<apergos>
|
ok, thanks (trying to decide if I should ask for a backport or just cross fingers and wait)
|
|
2019-04-10 15:18:39
|
<subbu>
|
qq[IrcCity], from what i can tell, that hook should be called once .. after the page content is ready ... /me looks for docs
|
|
2019-04-10 15:20:39
|
<qq[IrcCity]>
|
that is, I may deem that it isn’t called for such nonces as showing hints.
|
|
2019-04-10 15:21:07
|
<qq[IrcCity]>
|
But I expect it to be called, for example, on the smart preview.
|
|
2019-04-10 15:22:07
|
<subbu>
|
i am unable to find the docs for that hook .. let me ask in another channel unless Amir1 found it.
|
|
2019-04-10 15:22:48
|
<Amir1>
|
let me check
|
|
2019-04-10 15:23:24
|
<Krinkle>
|
qq[IrcCity]: https://doc.wikimedia.org/mediawiki-core/master/js/#!/api/mw.hook-event-wikipage_content
|
|
2019-04-10 15:23:37
|
<Krinkle>
|
qq[IrcCity]: Yes, it generally fires just one. It is effectively an improved version of $(function)
|
|
2019-04-10 15:23:59
|
<Krinkle>
|
the difference being that 1) it is limited to the page content area (not skin sidebar etc.), and 2) it will fire again during live preview and after VE edits.
|
|
2019-04-10 15:24:13
|
<Krinkle>
|
because that will replace the page without refreshing the browser
|
|
2019-04-10 15:25:15
|
<Krinkle>
|
qq[IrcCity]: If you are running expensive computations that don't require visual changes to be immediately visible, you can consider using mw.requestIdleCallback to defer the work in chunks so that it does not pause the browser when scrolling or when typing.
|
|
2019-04-10 15:26:13
|
<Krinkle>
|
Generally I recommend not to make code complicated or make performance improvements, unless you find a performance problem first :)
|
|
2019-04-10 15:26:57
|
<qq[IrcCity]>
|
interesting, thanks. Perhaps the performance problem in some situations is caused by something else than my hooks.
|
|
2019-04-10 15:28:20
|
<qq[IrcCity]>
|
A completely unrelated stuff: people who wrote Tech News: 2019-15 here?
|
|
2019-04-10 15:29:09
|
<subbu>
|
qq[IrcCity], any specific items in there? because many folks would have contributed to that.
|
|
2019-04-10 15:30:55
|
<qq[IrcCity]>
|
general: feedback on meta:Talk:Tech/News isn’t seemingly effective.
|
|
2019-04-10 15:33:07
|
<subbu>
|
qq[IrcCity], ok .. maybe ask a specific question and Amir1 and I can try to find out the answer?
|
|
2019-04-10 15:33:33
|
<Amir1>
|
YEs
|
|
2019-04-10 15:34:13
|
<Amir1>
|
qq[IrcCity]: In general you should look who's this tech news is targetiing
|
|
2019-04-10 15:35:00
|
<Amir1>
|
this is for non-technical users who want to know what's going to affect them (like "at 15-02-2019 you can't edit wikidata for 30 minutes because of technical reasons)
|
|
2019-04-10 15:35:21
|
<Amir1>
|
but if you need technical details, there are other ways (depending on what you want to know)
|
|
2019-04-10 15:42:41
|
<qq[IrcCity]>
|
No question. Just to remind that there are no dashes in ASCII.
|
|
2019-04-10 15:49:54
|
<isaac_>
|
Hello everyone, new to freenode. I was wondering if there was a way to check on which extensions are currently being worked on?
|
|
2019-04-10 15:52:27
|
<Amir1>
|
isaac_: good question https://github.com/wikimedia/ is sorted by repos that most recently got changed
|
|
2019-04-10 15:52:39
|
<Amir1>
|
that's one way to see it
|
|
2019-04-10 15:54:52
|
<isaac_>
|
thank you so much Amir1
|
|
2019-04-10 15:55:39
|
<Amir1>
|
https://www.irccloud.com/pastebin/aXHq0A9g/
|
|
2019-04-10 15:56:15
|
<Amir1>
|
isaac_: https://wikimedia.biterg.io/app/kibana#/dashboard/Gerrit this is a better matrix
|
|
2019-04-10 15:58:46
|
<isaac_>
|
thank you! appreciate it!!!
|
|
2019-04-10 15:59:31
|
<danilo>
|
sometimes I see some users complaing that "what links here" and category lists delay too much to update after someone edit a template to change some link or category that is added in many pages
|
|
2019-04-10 15:59:32
|
<basiclaser>
|
Hello, id like to extract data about countries - im not sure how to parse the "text" content here, im not sure what that templating language is either https://en.m.wikipedia.org/wiki/Special:Export/Kuwait. Is there a way to just get a clean JSON for a subject like the country kuwait without parsing XML text / html?
|
|
2019-04-10 16:00:04
|
<Nemo_bis>
|
basiclaser: you need to use Wikidata
|
|
2019-04-10 16:00:35
|
<Nemo_bis>
|
https://www.wikidata.org/wiki/Wikidata:Data_access
|
|
2019-04-10 16:00:49
|
<danilo>
|
I know that is because the job queue, but isn't there a way to make it work faster? sometimes it delays many hours to update a list
|
|
2019-04-10 16:03:53
|
<subbu>
|
danilo, yes it is because of the job queue .. and if the template that got edited is very popular, it takes a long time to process all the pages that reference that template.
|
|
2019-04-10 16:05:00
|
<subbu>
|
eventually, as improvements to templates are made in the coming years, we might be able to make edits to popular templates cheaper ... but for now, that is how it is without throwing a lot more hardware at the problem .. but, maybe Krinkle has a more specific answer than what i gave you.
|
|
2019-04-10 16:05:26
|
<subbu>
|
Amir1, alright .. i guess it is end of the office hour for today then.
|
|
2019-04-10 16:07:25
|
<Krinkle>
|
The new jobqueue does not have the kind of easy to check metrics as the old one, as such I do not know what the current residence time of of these jobs typically.
|
|
2019-04-10 16:08:06
|
<Krinkle>
|
It is indeed based on the job queue processing millions of work loads from a popular template. That can take a while.
|
|
2019-04-10 16:08:17
|
<Krinkle>
|
If the template is not used by millions of pages, it should only take a few minutes usually.
|
|
2019-04-10 16:08:47
|
<Krinkle>
|
subbu: hardware does not currently solve it, I've thought the same many times, but jobrunners aren't local CPU bound. They're DB-master bottlenecked for the most part.
|
|
2019-04-10 16:08:53
|
<basiclaser>
|
@Nemo_bis
|
|
2019-04-10 16:09:06
|
<Krinkle>
|
danilo: ^
|
|
2019-04-10 16:09:06
|
<basiclaser>
|
Nemo_bis: thanks a lot thats really helpful!
|
|
2019-04-10 16:09:07
|
<subbu>
|
Krinkle, ah, ok.
|
|
2019-04-10 16:09:30
|
<subbu>
|
i didn't know that.
|
|
2019-04-10 16:10:00
|
<Krinkle>
|
subbu: my hope is that the upcoming promised land of kubernetes would allow us to allocate our 90% idle time on web servers to job runners, which we may still do and try for some jobs, but for the most part they're not bottlenecked on that.
|
|
2019-04-10 16:10:06
|
<Krinkle>
|
is/was*
|
|
2019-04-10 16:10:22
|
<subbu>
|
:)
|
|
2019-04-10 16:12:46
|
<danilo>
|
Krinkle: sometimes that delay makes more difficult to check if the edit produced the expected effect in the links/category list, that is why some users complaing about that, but ok, I understand, I will explain that to the last user that asked about that in ptwiki...
|
|
2019-04-10 16:14:28
|
<basiclaser>
|
https://www.wikidata.org/wiki/Special:EntityData?id=Q817&format=json im much closer to getting the data. once i look up an entity like kuwait (Q817), how can i search for a field like "population"? it is not stored directly as plain text in there. look up all "property" ?
|
|
2019-04-10 16:15:02
|
<Nemo_bis>
|
basiclaser: yes, you need to find what property stores the info you need
|
|
2019-04-10 16:15:50
|
<Nemo_bis>
|
it might be easier with some API client so that you don't have to reinvent the JSON parsing and all that
|
|
2019-04-10 16:39:24
|
<basiclaser>
|
Nemo_bis: can you recommend any :3
|
|
2019-04-10 16:42:50
|
<basiclaser>
|
umm nm i think i got it
|
|
2019-04-10 18:18:52
|
<Nemo_bis>
|
https://joinup.ec.europa.eu/news/ready-challenge
|
|
2019-04-10 19:22:24
|
<RhinosF1>
|
When's best to be running quarry querys that pulls stats from currently active users (edited in last 30 days) to reduce time for it to run?
|
|
2019-04-10 19:24:57
|
<andre__>
|
always and never? How do you mean?
|
|
2019-04-10 19:26:39
|
<mutante>
|
there is kind of a gap when US has stopped working but Europe isn't up yet.. but probably there is never a good time
|
|
2019-04-10 19:27:41
|
<RhinosF1>
|
andre__, Pretty much, when will the quarry database have the least load so it runs faster and has less of an impact on people. The query is https://quarry.wmflabs.org/query/34268. Although, I'll be changing the edits and days old parameters
|
|
2019-04-10 19:47:47
|
<RhinosF1>
|
andre__, mutante, Is there no 'best' time then?
|
|
2019-04-10 19:49:43
|
<mutante>
|
RhinosF1: i don't think so, either it can finish or it's too much but don't think it depends on time of day much
|
|
2019-04-10 19:52:38
|
<RhinosF1>
|
Mutante, Thanks, wasn't sure whether certain times should be avoided.
|