[18:47:59] bd808, tgr|away: I need to do some API request analysis. Would it be easier for one of you to query the kafka/hadoop/whatever thing for me, or help me get access and then teach me how to use it, or for me to just grep 30 days of api.log? [18:49:16] * anomie wants to know if some annoying parameters are actually used [19:03:41] anomie: "it depends" :) I think you should get access to stat1002 so you can do this stuff, but I'd be glad to run some queries for you [19:05:20] bd808: The queries are basically "how often are parameters in a list used with action=query" (or with one of 4 query submodules if that's easier). One set is a prop parameter where I only care about one of the props. [19:06:03] First set: adrparse, arvparse, drvparse, rvparse (or 'parse' for list=alldeletedrevisions, list=allrevisions, prop=deletedrevisions, and prop=revisions) [19:06:24] Second set: adrgeneratexml, arvgeneratexml, drvgeneratexml, rvgeneratexml (or 'generatexml' for the same submodules) [19:06:34] Third set: adrexpandtemplates, arvexpandtemplates, drvexpandtemplates, rvexpandtemplates [19:06:42] Fourth set: adrdiffto, adrdifftotext, adrdifftotextpst, arvdiffto, arvdifftotext, arvdifftotextpst, drvdiffto, drvdifftotext, drvdifftotextpst, rvdiffto, rvdifftotext, rvdifftotextpst [19:07:05] Fifth set: adrprop, arvprop, drvprop, rvprop, but only containing parsetree [19:08:51] * bd808 looks for notes on fancy queries against the action_param_hourly table [19:20:29] anomie: what time range are you interested in? Month of October? [19:20:55] bd808: Sure, October would be good. [19:32:06] anomie: I'm running one query to see what happens. Looks like it's going to be crappy slow the first way I tried :( [20:36:10] uhm, just discovered I have the PHPSESSID cookie on enwiki - anyone else seeing this? [20:49:54] MaxSem: I don't have that cookie at the moment. [21:01:15] anomie: I got distracted in the middle of working on your question. Does it sound reasonable that I found 100,259,663 requests in Oct using 'rvparse' as a param? [21:01:36] and only 1 using arvparse [21:01:44] bd808: Yeah. Unfortunately. [21:02:11] I'll start a paste to track the queries and results [21:05:00] anomie: https://phabricator.wikimedia.org/P4355 [21:05:24] running a similar query for the generatexml params now [21:34:41] TimStarling: Looks like the "recent" change to the parser to require tag balancing has had some side-effects to open-ended use cases like starting a .js page with // . Previously instances of '~~~~' would be unaffected, but now they are expanded unless // is added to the end of the page. [21:35:08] Probably not a big issue, easily worked around, but noticed it a few times when doing minor edits to scripts where my edit unintentionally broke the script due to unexpected substitution. [21:35:21] (e.g. the content to be expanded was already there in a previous rev) [22:32:48] right [22:33:09] it was a decent design choice though