[17:36:42] bd808: Now that I have access to stat1002, what do I do to access the API stuff? [18:22:38] anomie: stand on your left foot, spill the blood of a small bird in a circle while turning windershins, and learn a bit about hadoop [18:23:48] anomie: the tables are described at https://wikitech.wikimedia.org/wiki/Analytics/Data/ApiAction [18:24:27] BUT... take note of the note that the data is really in bd808.action_* and not wmf.action_* today [18:27:16] anomie: on stat1002 there are some queries you can look at in /home/bd808/projects/action-api [18:27:49] most of them have header comments that give usage info [18:27:51] bd808: Ok, knowing it's "hadoop" and not "kafka" or "hive" sort of helps... Although eventually googling "run a query in hadoop from the command line" seems to tell me it really is the hive command that I need... [18:28:04] yeah [18:28:21] or ... there's another frontend now... what is is called [18:28:29] but hive still works [18:29:11] this page may be of some use -- https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Hive/Queries [18:29:28] ah. "beeline" is the new hotness [18:29:49] I think it's pretty much just "hive 2.0" [18:31:10] Hmm, "/home/bd808/projects/action-api/query-anomie-annoying.sql", was it the query that's annoying or me asking for it? ;) [18:32:11] I think you were being annoyed by not having the data :) [18:52:10] Hmm. Is there no Phab task for "use pageId not Title as principal accessor where possible" or something similar? Looking to tag it for the DevWishlist. [20:50:44] Warning: Compilation failed: PCRE does not support \L, \l, \N{name}, \U, or \u at offset 52 in /srv/mediawiki/php-1.29.0-wmf.7/extensions/AbuseFilter/includes/parser/AFPData.php on line 234 [20:50:46] Bo [20:50:48] *Boo [20:51:16] Relatedly: Warning: Compilation failed: nothing to repeat at offset 34 in /srv/mediawiki/php-1.29.0-wmf.7/extensions/AbuseFilter/includes/parser/AFPData.php on line 234 [20:52:52] Probably bad user input, but it's hhvm level so we don't have a wiki or a url [20:52:57] or stacktrace [20:53:02] Would be nice guard better [20:53:03] I guess [20:55:04] Could check preg_last_error() [20:56:10] Warning: Compilation failed: unknown property name after \P or \p at offset 3 in /srv/mediawiki/php-1.29.0-wmf.7/extensions/AbuseFilter/includes/parser/AFPData.php on line 234 [20:57:30] Unrelated: AbuseFilter is still calling User::loadFromSession() before the end of Setup.php [20:57:35] AbuseFilter makes lots-o-spam [21:04:05] https://gerrit.wikimedia.org/r/#/c/332570/ [22:21:44] ostriches: long ago I did some analysis of how to get useful data for HHVM fatals -- https://phabricator.wikimedia.org/T89169#1573731 [22:23:53] Well, yeah but at the same time the error's user level and probably shouldn't be logging :) [22:23:57] (in the AbuseFilter case)