[01:27:59] Quarry doesn't like me today. [01:30:07] Y U Q. [08:41:39] 10Quarry: SELECT command denied to user for table 'logging_userindex' - https://phabricator.wikimedia.org/T99414#1426333 (10Nemo_bis) Thanks. I got confused by the fact that the two names are equivalent when using `sql`. [12:04:01] basile: what's quarry doing? [14:12:52] YuviPanda: Sometimes it keeps saying "queued" even after I modify the query and run it again. [14:19:51] o/ guillom [14:19:58] hey halfak [14:20:53] How goes? [14:25:48] Yesterday night, I finally managed to fix enough of the license category tree on Commons to be able to parse it and extract all the license templates. [14:26:08] I now know that we have about 2200 different license templates on Commons. [14:26:20] "-_- [14:28:08] COol guillom! I'm just here this morning to work with the revscoring IEG grantees to plan next steps. [14:48:34] anyone wants to help me test some quarry stufF? :D [14:48:39] * YuviPanda looks at guillom too [14:50:40] YuviPanda: I'm going to have breakfast soon, but I'd be available after that. [14:50:47] cool! [15:42:06] 10Quarry: Quarry's indentation function is not completely functional - https://phabricator.wikimedia.org/T101424#1426532 (10yuvipanda) So this is using the sql mode of the codemirror code editor, and this seems to be that one's behavior. I guess possible options are: # Turn off autoindent for everyone # Make it... [15:43:11] 10Quarry: Suggested Feature: Put title of the query into the HTML title for page - https://phabricator.wikimedia.org/T99449#1426536 (10yuvipanda) 5Open>3Resolved a:3yuvipanda This was done a while ago :) [15:50:41] YuviPanda: I'm around if you need a guinea pig. [15:50:47] guillom: I do! [15:51:09] guillom: I just gave Quarry some love, and made it possible for anyone to run a local development instance of it with one command. [15:51:20] guillom: can you 1. git clone github.com/wikimedia/analytics-quarry-web and 2. run 'vagrant up'? [15:51:27] oh... assuming you have vagrant installed... do you? [15:51:39] Nope; I've always managed to avoid it before :p [15:51:43] so [15:51:49] this is Vagrant which is fairly simple [15:51:53] but I can install it easily, I presume. [15:51:58] everytime someone *else* in the wikimedia community says 'Vagrant' [15:52:07] they mean a specific bundle in Vagrant, called Mediawiki-Vagrant [15:52:12] Right. [15:52:14] that's fairly complex and used for MW stuff [15:52:24] this doesn't use any of that, is just a simple script. [15:52:37] guillom: yes, you should be able to get it from https://www.vagrantup.com/ [15:53:57] Downloading [15:54:59] No usable default provider could be found for your system. [15:55:17] I probably need to install something else. [15:55:33] "Vagrant relies on interactions with 3rd party systems, known as [15:55:34] "providers", to provide Vagrant with resources to run development [15:55:34] environments. Examples are VirtualBox, VMware, Hyper-V." [15:55:37] Any recommendation? [15:56:00] guillom: yes, virtualbox [15:56:26] Right, found it. [15:57:43] Bringing machine 'default' up with 'virtualbox' provider... [15:58:03] downloading jessie [16:00:40] YuviPanda: https://phabricator.wikimedia.org/P875 [16:00:42] 10Quarry, 7Easy, 5Patch-For-Review: String "Your query is currently executing" should be "This query..." - https://phabricator.wikimedia.org/T103275#1426547 (10yuvipanda) 5Open>3Resolved a:3yuvipanda Fixed! Thank you for reporting it! [16:01:24] guillom: are you on Windows? [16:01:32] nope; opensuse 13.2 [16:01:43] Windows: pff. :p [16:01:59] * guillom hasn't used Windows in over a decade. [16:02:00] hmm, did you use your system provided vagrant or is this vagrant from their website? [16:02:02] nice! [16:02:08] googling that error message led me to sme 'windows!' [16:02:28] There wasn't a vagrant package, I downloaded the RPM from their website. [16:03:03] guillom: virtualbox? [16:03:15] Ah, yes, virtualbox was packaged. [16:03:21] Want me to check the version? [16:03:24] yeah [16:03:35] http://docs.vagrantup.com/v2/virtualbox [16:04:26] 1:1.7.2-1 [16:04:49] ugh [16:05:09] guillom: oh that seems a bit... old [16:05:14] Ah no that's vagrant; sorry. [16:05:16] guillom: you're also the first person I nkow using opensuse! [16:05:40] 4.3.20-13.1 [16:05:45] That's virtualbox ^ [16:06:02] I've been using it for years now; I like it a lot :) [16:06:14] :D nice [16:06:19] I think I saw a gecko on csteipp's screen as well once. [16:06:20] right, so according to http://docs.vagrantup.com/v2/virtualbox [16:06:22] you should be supported [16:07:24] guillom: can you open virtualbox GUI? see if there's any VMs there? [16:07:50] I see a VboxGtk program. Opening now. [16:09:01] hmm, it's resisting. [16:09:39] oh? [16:09:53] Yeah, gtk stuff missing apparently. [16:10:02] that might be why vagrant is having problems as well... [16:10:07] if vbox isn't able to initizlie [16:10:38] https://phabricator.wikimedia.org/P875#4120 [16:11:38] guillom: aha! https://forums.opensuse.org/showthread.php/505252-VirtualBox-doesn-t-run [16:12:01] hah, ok [16:12:49] I won't even try to understand why it installed the gtk one instead. [16:13:31] heh [16:13:40] debian master race, etc? [16:13:45] says the person running os x shamefully [16:16:50] Now where did they hide the Qt one. [16:17:44] not in package list? [16:18:39] The package is installed, I just don't find the program. [16:18:49] oh.... [16:19:07] Oh, it somehow got removed. WTH. [16:19:13] ... [16:19:17] AH. [16:19:27] Because it wants dependencies I refused. [16:19:37] wth does it need firefox and kde games. [16:19:40] ... [16:19:40] * guillom shakes fist. [16:20:12] A certain packager shall burn in hell. [16:20:16] guillom: maybe https://www.virtualbox.org/wiki/Downloads? [16:20:30] https://www.virtualbox.org/wiki/Linux_Downloads has openSuse packages [16:20:31] nah I'm mostly done [16:20:34] ah ok :0 [16:20:35] :) [16:21:00] "You are not a member of the vboxusers group." [16:21:03] ... [16:21:06] I'll be right back. [16:22:14] 10Quarry: Raise query limits - https://phabricator.wikimedia.org/T74342#1426565 (10yuvipanda) Note that current limit is 20mins instead of 10 [16:22:17] ok! [16:24:01] 10Quarry: Allow published query titles to be searched or filtered by tag - https://phabricator.wikimedia.org/T90509#1426572 (10yuvipanda) [16:25:56] YuviPanda: https://phabricator.wikimedia.org/P875#4121 [16:26:18] If I'm being honest, I need to go back to 'real' work at some point :) [16:26:42] guillom: yeah, I think I'm goin to chalk this up to 'Yuvi does not know enough about VirtualBox / SuSE to help' :( [16:26:46] guillom: thanks for trying! [16:26:52] you're welcome [16:27:09] I just don't want to mess with this too much. [16:28:44] guillom: yeah, thanks for trying :) is ok, I found other guinea pigs :) [16:28:49] :) [16:29:46] I'm also going through the bugs filed against quarry and organizing them [16:31:11] * guillom goes back to being abused by the license templates on Commons. [17:09:02] 10Quarry, 5Patch-For-Review: JSON output should be one row per JSON blob - https://phabricator.wikimedia.org/T98492#1426586 (10yuvipanda) 5Open>3Resolved a:3yuvipanda This has been implemented as the 'json lines' output format. [17:10:29] 10Quarry: Make query URLs have a sluggified version of the title in them - https://phabricator.wikimedia.org/T75885#1426595 (10yuvipanda) Yeah, we totally should - don't think there's any other way to do this. [17:10:36] 10Quarry: Make query URLs have a sluggified version of the title in them - https://phabricator.wikimedia.org/T75885#1426596 (10yuvipanda) p:5Triage>3Normal [17:13:29] 10Quarry, 5Patch-For-Review: Remember filters: "All queries", "Published queries", etc. chosen by user in recent queries page - https://phabricator.wikimedia.org/T76084#1426599 (10yuvipanda) [17:14:13] 10Quarry: Build a vagrant box for Quarry dev - https://phabricator.wikimedia.org/T71193#1426605 (10yuvipanda) 5Open>3Resolved There's a Vagrantfile in the repo now :) [17:25:17] 10Quarry, 5Patch-For-Review: Quarry does not respect ORDER BY sort order in result set - https://phabricator.wikimedia.org/T87829#1426614 (10yuvipanda) 5Open>3Resolved a:3yuvipanda Just fixed it :) Thanks for reporting the issue, and apologies for such late resolution. [17:26:45] 10Quarry: Unicode in query results in strange behavior - https://phabricator.wikimedia.org/T71224#742694 (10yuvipanda) Is this still happening? [17:26:54] 10Quarry, 5Patch-For-Review: Excel does not recognize Quarry CSV output as UTF-8 - https://phabricator.wikimedia.org/T76126#1426626 (10valhallasw) UTF-8 with BOM also works fine, and should be easier to implement. [18:04:50] 10Quarry: Number of queries shown in profile is wrong - https://phabricator.wikimedia.org/T86512#1426673 (10yuvipanda) This seems to be a somewhat strange sqlalchemy issue... [18:06:14] gpaumier@carbon:~/code/licensing-dashboard> node --version [18:06:14] v0.12.5 [18:06:23] gpaumier@tools-bastion-01:~/archaeo$ node --version [18:06:23] v0.10.25 [18:07:06] Aaaaargh. [18:08:02] Me wants me new shiny toys. [18:08:28] guillom: you can use nvm [18:09:53] hmm. [18:10:47] I've never used that before. /me looks. [18:12:29] YuviPanda: is that available in tool labs? [18:18:42] installed, looks good. Thanks :) [18:19:08] guillom: yw :) [18:19:17] guillom: it's per-user tool that you can install yourself [18:19:23] yup [18:19:47] guillom: similar tools exist for other languages as well (pyenv for python, rbenv / rvm for ruby) [18:20:39] Good to know :) [20:25:04] 10Quarry: WMF employees use an internal Quarry instance to share data & sample queries - https://phabricator.wikimedia.org/T75142#1426761 (10Krenair) Why do we need an internal WMF-only instance of Quarry? [20:32:49] 10Quarry: WMF employees use an internal Quarry instance to share data & sample queries - https://phabricator.wikimedia.org/T75142#1426765 (10yuvipanda) Labsdb is redacted but internal analytics store isn't. [20:36:36] 10Quarry: WMF employees use an internal Quarry instance to share data & sample queries - https://phabricator.wikimedia.org/T75142#1426769 (10Krenair) So you're going to provide all WMF employees (and presumably contractors etc. as well?) with access to all the research data via some sort of corp Quarry instance? [20:39:10] 10Quarry: WMF employees use an internal Quarry instance to share data & sample queries - https://phabricator.wikimedia.org/T75142#1426770 (10yuvipanda) Such a thing has been proposed, primarily for eventlogging information. It would be for anyone with enough clearance to access it. Currently nobody is spending t... [20:44:03] 10Quarry: WMF employees use an internal Quarry instance to share data & sample queries - https://phabricator.wikimedia.org/T75142#1426778 (10Krenair) So actually it wouldn't be just for WMF employees, it would actually be something in production that some of the groups defined in puppet get access to (via SSH pr... [20:47:54] 10Quarry: WMF employees use an internal Quarry instance to share data & sample queries - https://phabricator.wikimedia.org/T75142#1426780 (10yuvipanda) There already exists such a group (researchers I think?) so this might piggy back off it. Or not - we don't know. Will be determined if / when someone starts wor... [20:50:21] 10Quarry: WMF employees use an internal Quarry instance to share data & sample queries - https://phabricator.wikimedia.org/T75142#1426783 (10Krenair) That was the group I had in mind, I know for a fact it's not 100% WMF employees. Will adjust the title. [20:52:18] 10Quarry: Build an internal Quarry instance to share data & sample queries between researchers (and other analytics users?) - https://phabricator.wikimedia.org/T75142#1426785 (10Krenair) [22:16:03] w00t [22:16:44] * guillom has now got a script that computes the distribution of Commons files with a given license over time.