[00:48:43] does someone know how I can beautify the plots I posted under each language at https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Behaviour/Robustness_across_languages#Results ? i want them to be bigger and more visible, but these look gigantic AND the quality doesn't look good, although the original file on Commons has a reasonable quality. [16:39:26] 10Quarry, 10Patch-For-Review: Quarry should refuse to save results that are way too large - https://phabricator.wikimedia.org/T188564#4053662 (10zhuyifei1999) 60 seconds is definitely not enough for the query. Switched to the unlimited version, then ran: https://quarry.wmflabs.org/query/25564 Browser reports a... [16:55:25] abartov: did we mess up the question mark direction for Hebrew at https://blog.wikimedia.org/2018/03/15/why-the-world-reads-wikipedia/ (under the first image)? :( [16:55:40] the first one in Arabic is correct, but ... [17:06:00] leila: yup, messed up. :) [17:06:13] should be to the left of the Hebrew text. [17:06:19] akhakh. right. [17:06:24] * leila goes to ask a fix. [17:06:27] abartov: thanks! [17:55:59] leila, what you want to change? fontsize of xlabels? [18:12:47] dsaez: no. the question mark direction under the image for Hebrew was incorrect. Ed fixed it now. [18:13:23] halfak: soooo. what do you think about submitting a proposal for a Wikimania panel discussion on Machines and the Movement? [18:14:54] halfak: miriam, dsaez, and I are considering it, and it would be good if you join if you have time/interest. [20:40:51] 10Quarry, 10Patch-For-Review: Quarry should refuse to save results that are way too large - https://phabricator.wikimedia.org/T188564#4054474 (10Halfak) For the record, the above is crazy. It's writing less than a megabyte and it take 5 minutes! :| This works for now, but getting off of NFS (T178520) seems... [20:42:57] 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520#3694676 (10Halfak) We've confirmed that there is a bigdisk instance available with 300GB of direct access disk space. We'll need a backup strategy. Here's a couple that seem sane-ish: **Two big di... [20:50:19] o/ leila Sorry was distracted [20:50:34] leila, I'm in :) [20:57:48] np halfak. Okay. We will start a first draft and will add you. [20:58:04] you should have this by morning PT tomorrow, halfak. [20:58:55] Cool. I plan to write up my proposal (about ML support for curation & the future of NPP) Saturday AM, so I'll likely review it then. [20:59:09] Thanks for taking the lead and thinking of me ^_^ [21:04:45] 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520#4054559 (10zhuyifei1999) Any suggestions on how to send results back from the query runners to the bigdisk? [21:20:57] 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520#4054672 (10Halfak) Good Q. Are there basic file services that we could utilize for this? Maybe something like this: https://medium.com/@keagileageek/paramiko-how-to-ssh-and-file-transfers-with-pyth... [21:34:59] 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520#4054721 (10zhuyifei1999) >>! In T178520#4054672, @Halfak wrote: > Good Q. Are there basic file services that we could utilize for this? > > Maybe something like this: > https://medium.com/@keagilea... [21:47:39] halfak: would love to hear more about it [21:53:09] harej, re. npp stuff? [21:53:25] your idea for your proposal in particular [21:53:48] Basically, I want to do the last research showcase talk I gave with some more data on how ORES has impacted some wikis [21:53:57] Did you see that showcase presentations? [21:54:22] http://youtube.com/watch?v=fpmRWCE7F_I#t=30m30s [21:54:33] Slides: https://commons.wikimedia.org/wiki/File:Backlogs!_Backlogs_everywhere..._(Research_Showcase,_Feb._2018).pdf [21:54:33] Single image overview: https://commons.wikimedia.org/wiki/File:New_article_routing.with_ORES.svg [22:02:13] Looks great. When are we going to ship it? :D [22:09:46] harej, we're in (what I hope) are the final blockers for doing a deployment. [22:10:15] Right now, we're working on getting a big asset (word2vec mapping) onto the deployment machines. [22:10:23] Releng is working on Git Large File Support. [22:10:43] So the ETA might be tomorrow or in a couple of weeks. :| [22:16:16] 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520#4054844 (10zhuyifei1999) Another thing: gotta make sure whatever method we use to store the results remotely is faster than NFS or we'll do a lot of work and end up worse... [22:36:29] A lot sooner than I thought. And is this just deploying the data system or has it been integrated into a product? [22:42:54] 10Quarry: Find somewhere else (not NFS) to store Quarry's resultsets - https://phabricator.wikimedia.org/T178520#4054966 (10Halfak) I think it'll be hard to beat NFS at that game ;)