[04:44:03] Engineering-Community, Analytics-Tech-community-metrics, Phabricator: Monthly report of total / active Phabricator users - https://phabricator.wikimedia.org/T1003#847260 (Springle) [04:44:04] Analytics-Tech-community-metrics, Phabricator: SQL user/grant for phabricator statistics script - https://phabricator.wikimedia.org/T78311#847258 (Springle) Open>Resolved Added to passwords::mysql::phabricator $metrics_user (phstats) and $metrics_pass. Granted SELECT on phabricator_maniphest.* to phsta... [07:59:10] Analytics-Refinery: Geo-coding UDF - https://phabricator.wikimedia.org/T77683#847313 (DarTar) I notified Reid of the existence of this thread. [08:09:54] (PS1) Gergő Tisza: Generate pageview stats [analytics/multimedia] - https://gerrit.wikimedia.org/r/179872 [08:58:12] Multimedia, MediaWiki-extensions-MultimediaViewer, MediaWiki-extensions-ImageMetrics, Analytics: Calculate the ratio of opted-out anonymous users of MediaViewer - https://phabricator.wikimedia.org/T78228#847374 (Gilles) p:Triage>Low [09:06:24] (CR) Gergő Tisza: [C: -1] "Way too slow." [analytics/multimedia] - https://gerrit.wikimedia.org/r/179872 (owner: Gergő Tisza) [09:07:16] (CR) Gilles: "Can creating some indexes help?" [analytics/multimedia] - https://gerrit.wikimedia.org/r/179872 (owner: Gergő Tisza) [09:10:42] (CR) Gilles: [C: 2] Calculate image cache miss ratio [analytics/multimedia] - https://gerrit.wikimedia.org/r/179771 (owner: Gergő Tisza) [09:10:49] (Merged) jenkins-bot: Calculate image cache miss ratio [analytics/multimedia] - https://gerrit.wikimedia.org/r/179771 (owner: Gergő Tisza) [12:17:37] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847755 (Amire80) NEW [12:34:48] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847782 (Ironholds) a:Ironholds MINE. [12:36:56] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847788 (Ironholds) Wait, misread. You're asking for an infrastructure project, here? I can't see this happening, alas, until after pageviews - which is what we are currently working on on the R&D side (I'm not... [12:37:02] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847789 (Ironholds) a:Ironholds>None [12:41:01] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847791 (Amire80) > What I could give you right now, if you wanted, is an ad-hoc report covering browsers used by people who try VEediting, browsers used by people who try Wikitext editing, and browsers used by p... [12:43:59] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847800 (Ironholds) Well, then that's fine. But if you want an automagically generated report that runs every N days...that one will have to wait :) [12:44:28] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847801 (Ironholds) I'll leave this open for the time being just so I can talk to Dario and Grace and see how they want to prioritise the request. It would be good to have more detail on what you'd use this for,... [12:47:04] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847804 (Amire80) >>! In T78539#847800, @Ironholds wrote: > Well, then that's fine. But if you want an automagically generated report that runs every N days...that one will have to wait :) A one-time thing is OK... [13:54:58] Analytics, VisualEditor: [gadsh] "VisualEditor: Latency" graphs look dead - https://phabricator.wikimedia.org/T78547#847905 (Nemo_bis) NEW [13:55:19] Analytics, VisualEditor: [gdash] "VisualEditor: Latency" graphs look dead - https://phabricator.wikimedia.org/T78547#847905 (Nemo_bis) a:Jdforrester-WMF [14:04:30] o/ milimetric [14:04:41] hi halfak [14:04:48] i'm in the hangout but have been having network issues here [14:04:55] is it not showing me in there? [14:04:57] Gotcha. [14:05:25] I see you there. [14:07:46] halfak: I can't even get appear.in to load now... [14:08:02] I can get it to load, but I don't see you. [14:08:09] IRC? [14:08:18] sure :) [14:16:27] Analytics-Tech-community-metrics, Phabricator: SQL user/grant for phabricator statistics script - https://phabricator.wikimedia.org/T78311#847967 (Dzahn) Thank you Sean. Patch amended using the new metrics user. [14:41:06] Quarry, Tool-Labs-tools-tsreports: Quarry-TSreports feature parity - https://phabricator.wikimedia.org/T78549#848037 (valhallasw) NEW [14:56:28] Multimedia, MediaWiki-extensions-MultimediaViewer, Analytics: Investigate if pre-rendering images is having an impact on performance - https://phabricator.wikimedia.org/T76035#848075 (Gilles) I'm going to backport this to get the results a couple of days earlier. It should be a good source of information abou... [15:23:08] Analytics-Refinery: Geo-coding UDF - https://phabricator.wikimedia.org/T77683#848102 (ggellerman) Should we add Reid to this ticket? [15:27:35] (PS1) Dr0ptp4kt: Getting mccmnc.py script in repo [analytics/zero-sms] - https://gerrit.wikimedia.org/r/179926 [15:27:55] (CR) Dr0ptp4kt: [C: 2] Getting mccmnc.py script in repo [analytics/zero-sms] - https://gerrit.wikimedia.org/r/179926 (owner: Dr0ptp4kt) [15:38:11] Analytics-Engineering: set up hackaton at MWDS - https://phabricator.wikimedia.org/T76800#848124 (ggellerman) Emailed Rachel Farrand about doing a 60 min EL workshop at MWDS. There is still time to get stuff scheduled. Added request at bottom of page here: https://www.mediawiki.org/w/index.php?title=MediaW... [16:27:08] Analytics-EventLogging: find a better way to identify events that fail validation as early as possible - https://phabricator.wikimedia.org/T78355#848182 (kevinator) The email thread is archived here: https://lists.wikimedia.org/pipermail/analytics/2014-December/002884.html [16:29:35] Analytics-EventLogging: find a better way to identify events that fail validation as early as possible - https://phabricator.wikimedia.org/T78355#848187 (kevinator) Per Christian in response to Nuria: Hi, On Thu, Dec 11, 2014 at 06:03:15PM -0800, Nuria Ruiz wrote: > Besides the ability of testing in beta lab... [16:32:35] Analytics-EventLogging: find a better way to identify events that fail validation as early as possible - https://phabricator.wikimedia.org/T78355#848198 (kevinator) Open>Resolved a:kevinator The better way is to do EventLogging testing on the Beta cluster: https://wikitech.wikimedia.org/wiki/EventLog... [17:08:42] Analytics, VisualEditor: [gdash] "VisualEditor: Latency" graphs look dead - https://phabricator.wikimedia.org/T78547#848245 (Jdforrester-WMF) [17:09:22] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#848250 (Nemo_bis) [17:11:01] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#847755 (Nemo_bis) I've updated the task the description to match discussion and summary (in particular, no additional report is requested for [[https://meta.wikimedia.org/wiki/Stupidity_of_the_reader|vague and c... [17:11:07] Analytics-Engineering: set up hackaton at MWDS - https://phabricator.wikimedia.org/T76800#848258 (kevinator) Updated the workshop request with a blurb: https://www.mediawiki.org/wiki/MediaWiki_Developer_Summit_2015#Setting_up_EventLogging_and_a_Dashboard [17:14:10] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#848266 (Ironholds) I don't understand what you mean in your last comment, Nemo. Could you expand? [17:43:33] Analytics-Engineering, Analytics-Wikimetrics: Story: WikimetricsUser deletes user from cohort [21 pts] - https://phabricator.wikimedia.org/T75350#848338 (kevinator) a:mforns [17:55:20] qchris: you there? [17:55:20] Yup. [17:55:24] What's up? [17:56:05] qchris: cool. i'm looking to use netaddr on the 1003 box. i was wondering what's the best way to load that in? i wanted to follow whatever installation practice you use for getting 3rd party python libs [17:56:15] (PS1) Milimetric: [WIP] Use the wonderful mwoauth [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/179962 [17:56:56] I guess that's a question for ottomata ^ :-) [17:57:46] I see that the netaddr has an ubuntu package. [17:58:12] One could just add that to the packages for stat1003 and ask ottomata to review. [18:00:30] dr0ptp4kt: ^ that is the correct way :) [18:00:31] or [18:00:38] you could just tell me the package nmae [18:00:38] and I cna do it [18:00:38] probably easier [18:01:58] ottomata: python-netaddr [18:04:01] YuviPanda|brb: when you get back I have a question about mwoauth [18:06:10] ottomata: for future reference, would i be updating class misc::statistics::packages::python in puppet/manifests/misc/statistics.pp if i were requesting your review in the future? for the time being, i'll happily take the assistance :) [18:07:02] dr0ptp4kt: probably, yes [18:08:36] ottomata: cool. ok, if you got it, lemme know. otherwise, if you want me to submit a patch for that section lemme know and i'll do so [18:12:06] YuviPanda|brb: never mind! sorry [18:22:46] dr0ptp4kt: done [18:22:54] ottomata: thx [18:40:27] milimetric: heh, ok. halfak literally wrote the library tho ;) [18:41:19] ah funny [18:41:36] well i'm past most problems, now only stuck on a weird thing with flask sessions [18:41:55] when I put a RequestToken object in session and then get it back out, it's turned into a tuple [18:45:04] RequestToken is a named tuple! [18:47:09] i must have some weird dependency issue then [18:47:16] oh no [18:47:37] i think it's just that our flask session is configured to store cookies, so it serializes it and probably loses the type that way [18:47:49] makes sense, quarry uses in-memory sessions then? [18:52:40] (PS2) Milimetric: Use the wonderful mwoauth [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/179962 [18:53:05] halfak: thank you very much for that package, so much nicer than all the hacky code that was sprinkled everywhere [18:53:25] :D [18:54:53] I'm stoked that it's being used. :) [18:55:11] mforns / nuria__: should I ping you about that review above or do you guys get notified when I add you? [18:55:40] milimetric, let me see [18:55:50] milimetric: i did get teh notification, i was just missing the dashiki ones i think [18:55:55] either way - make sure to run scripts/install if you test [18:55:56] milimetric: but i have corrected that [18:56:05] ok, cool, i won't ping you then :) [18:56:11] milimetric, I received the email [18:56:30] k, good, sorry for the ping, run scripts/install, and I'll test in staging after lunch [18:56:34] ok, thanks for the heads up [19:00:23] Analytics: Move stat1001, stat1002 and stat1003 into Analytics VLAN - https://phabricator.wikimedia.org/T76346#848569 (Ottomata) [19:18:15] milimetric, should we execute scripts/install with sudo? [19:18:39] yes [19:18:45] ok, thans [19:18:47] thanks [19:22:22] milimetric, can I execute scripts/install stuff with sudo? ;p [19:22:55] no Ironholds you may not [19:23:10] hmph [19:23:12] I see how it is. [19:23:23] One rule for the engineers, another rule for people who don't know what they're doing. [19:30:46] Ironholds: I donno, it looks like the fundraising phantomjs requests are like... 95 requests on a busy day in our busiest month. What me worry! [19:30:54] And thanks for standing up for up :) [19:31:16] I will fix the useragent string though, that's sloppy work on my part. [19:31:22] awight, sure! [19:31:32] like I said, qchris is probably right, because qchris is a smart cookie :D [19:31:42] but I wanted to avoid being like [19:31:55] "well, I had this conversation with someone some time ago and they told me that there were probably requests from them that were somewhere". [19:32:01] ..you know. Any more ;p [19:32:54] hehe. yes I'll put your name in the UA: "evil bot, stop trying to be smart and just ask Ironholds for my true identity" [19:33:13] I'll even throw in a literal tab character for your enjoyment :p [19:33:44] * qchris drops in https://meta.wikimedia.org/wiki/User-Agent_policy [19:33:55] awight, why do you do the things that hurt me :() [19:34:02] anyway, that's silly [19:34:08] if you wanted to really piss me off you'd put in *thinks* [19:34:16] lessee, accept_lang, x_analytics [19:34:20] you want three tabs and a newline. [19:34:23] for real win. [19:34:51] ', [19:35:12] what are those thinks? [19:35:43] oh, I ignore quotes [19:35:46] because device manufacturers are asses [19:43:21] goddammit [19:43:26] how is C++ memory leaking on a stack object. [19:43:28] how do you even do that. [19:46:46] awight, how is it possible I have the +2 option for this patch? [19:47:48] ohshit, I have it EVERYWHERE. [19:47:52] Ironholds: yikes. cos we're overly trusting old people. [19:48:03] evidently. Will scold ^d [19:48:12] I have +2 on core. [19:48:15] they gave me +2 on core. [19:48:18] Who thought that was a good idea. [19:48:21] -_- [19:48:38] Analytics-Wikimetrics, Analytics-Engineering: Story: WikimetricsUser deletes user from cohort [21 pts] - https://phabricator.wikimedia.org/T75350#764487 (kevinator) Moving this back to WIP column as I have found a bug. The bug will be logged as a child task. [19:48:46] ssh, you'll cause a stampede of devs hastily uninstalling MW [19:49:29] The thought of rewriting the entire thing did cross my mind [19:49:35] I don't know what in. A heady mix of R and C++. [19:49:47] That sounds efficient. [19:49:54] awight, anyway. Replied to your patchset. [19:50:17] Ironholds: yep, thanks I'll use your personal email then to cut out the intermediaries [19:50:52] that seems totally reasonable. [19:51:02] alternately, you can grab my mailing address off Katie. Just have them show up at my door. [20:03:05] Analytics-Wikimetrics, Analytics-Engineering: enwiki does not show up in my centrally expanded cohort - https://phabricator.wikimedia.org/T78584#848735 (kevinator) NEW a:mforns [20:04:39] Analytics-Wikimetrics, Analytics-Engineering: enwiki does not show up in my centralauth expanded cohort - https://phabricator.wikimedia.org/T78584#848735 (kevinator) [20:06:40] (CR) Milimetric: "Tested in staging, works as far as logging in is concerned. This commit is as much about cleaning up the old cruft as it is about getting" [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/179962 (owner: Milimetric) [20:07:02] mforns: J-Mo noticed some weird behavior while testing the “delete user” feature on staging. I streamlined the steps to reproduce and logged the bug https://phabricator.wikimedia.org/T78584 [20:07:13] aha [20:07:35] ok kevinator, will have a look [20:07:41] thanks [20:08:00] Should test2 wiki be recording event logging data? Verified that testwiki and mediawikiwiki are receiving the correct data, but on test2wiki it fails [20:08:28] can verify with: echo '$x = new RemoteSchema( "FlowReplies", "10561344" );echo $x->get(), "\n\n";' | mwscript eval.php --wiki=test2wiki [20:09:27] (you might want var_dump instead of echo depending on the feedback you want :) [20:10:00] kevinator, mforms: I confirmed that enwiki was the one marked as invalid. Mouseover the project column next to a user in the delete user page, and it shows you a comma separated list of the wikis for that user. After I click "remove invalid" for a user with 1 invalid project, enwiki no longer appears on that list. [20:10:02] Analytics-Wikimetrics, Analytics-Engineering: Epic: WikimetricsUser deletes user from cohort - https://phabricator.wikimedia.org/T76421#848754 (kevinator) [20:10:05] Analytics-Wikimetrics, Analytics-Engineering: Story: WikimetricsUser deletes user from cohort [21 pts] - https://phabricator.wikimedia.org/T75350#848750 (kevinator) Resolved>Open re-opening because of discovered bug: T78584 [20:10:09] (this is the part that shipps the schema to the browser via resourceloader) [20:11:37] mforns: I hadn’t noticed the mouseover feature. it’s beautiful! [20:11:44] thanks [20:16:59] mforns / kevinator: i'm sorry was staging being used for user testing? [20:17:19] I just used it to test my auth change [20:17:24] I was testing the “Delete User” on it [20:17:25] aha [20:17:27] and so any change that was there would be gone... [20:17:36] no problem, milimetric. [20:17:57] no worries… my list of test cohorts was starting to clutter my view :-) [20:17:58] I just noticed some stuff while verifying the new feature, and pinged kevinator. [20:18:01] nothing formal [20:18:39] milimetric: It’s trivial to reproduce the cohort and the problem [20:18:41] gotcha - we should figure out a way to call dibs on staging to prevent this - i'll make a note in the retro [20:19:00] ok [20:20:28] mforns: it's all yours now though, I am done with it all. Though if you revert you'll probably want to do scripts/install again [20:21:04] thanks milimetric, I think I won't need to revert, but thanks [20:34:08] J-Mo: I might spend the next few days setting up user groups in Quarry, to let some people be able to run queries for longer [20:34:13] like, 30m groups and 1h groups [20:34:39] sounds good. have people come up against the 10 minute limit? I don't think I ever have. [20:37:15] J-Mo: not much, but that might be because they come up against it once and then leave... [20:37:18] J-Mo: DarTar definitely hit it a few times [20:37:34] I bet he did [20:48:11] Tool-Labs-tools-tsreports, Quarry: RSS feeds - https://phabricator.wikimedia.org/T60830#848877 (valhallasw) [20:49:24] Quarry: Show a list of recently finished queries (possibly also via RSS) - https://phabricator.wikimedia.org/T60823#848882 (valhallasw) [20:49:44] I've never seen this TED talk from the very birth of Wikipedia: https://www.ted.com/talks/jimmy_wales_on_the_birth_of_wikipedia [20:49:54] do yourself a favor ^ [20:49:54] Quarry: Create 'reports' feature - https://phabricator.wikimedia.org/T78593#848886 (valhallasw) NEW [20:50:10] Quarry: Show a list of recently finished queries (possibly also via RSS) - https://phabricator.wikimedia.org/T60823#601832 (valhallasw) [20:50:35] Quarry: Create 'reports' feature - https://phabricator.wikimedia.org/T78593#848886 (valhallasw) [20:50:55] Tool-Labs-tools-tsreports, Quarry: Quarry-TSreports feature parity - https://phabricator.wikimedia.org/T78549#848902 (valhallasw) [20:53:11] Tool-Labs-tools-tsreports, Quarry: Provide redirects from old tsreports reports to new quarry reports - https://phabricator.wikimedia.org/T78595#848910 (valhallasw) NEW [20:53:55] (CR) Mforns: "Code makes sense, login/logout works. LGTM" (2 comments) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/179962 (owner: Milimetric) [20:55:36] (PS3) Milimetric: Use the wonderful mwoauth [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/179962 [20:55:45] thanks mforns: print statements removed [20:55:58] wow, ninja speed [20:56:06] Quarry: Ideas for reports - https://phabricator.wikimedia.org/T78597#848934 (valhallasw) NEW [20:57:12] Quarry: REPORTS-49 IP block SQL Query on en-wiki - https://phabricator.wikimedia.org/T60835#602808 (valhallasw) [20:59:45] Quarry: REPORTS-52 Add option to output report results to a wiki page - https://phabricator.wikimedia.org/T60833#848947 (valhallasw) [21:00:22] Quarry: REPORTS-68 Implement dynamic cache duration - https://phabricator.wikimedia.org/T60826#848950 (valhallasw) [21:00:59] Quarry: REPORTS-35 Add a pager for long reports - https://phabricator.wikimedia.org/T60839#603131 (valhallasw) [21:01:42] Analytics: find out what browsers Wikipedia editors use - https://phabricator.wikimedia.org/T78539#848959 (ggellerman) [21:01:52] Quarry: REPORTS-35 Add a pager for long reports - https://phabricator.wikimedia.org/T60839#848960 (yuvipanda) Quarry already has a pager. [21:02:11] Quarry: REPORTS-35 Add a pager for long reports - https://phabricator.wikimedia.org/T60839#848962 (valhallasw) Open>declined a:valhallasw [21:02:15] Analytics-EventLogging: Calls to EventLogging::logEvent should either return false or an error message when schema validation fails - https://phabricator.wikimedia.org/T78324#848964 (kaldari) Open>Resolved a:kaldari Duplicate of T75678 [21:03:06] Quarry: REPORTS-35 Add a pager for long reports - https://phabricator.wikimedia.org/T60839#603131 (valhallasw) [21:04:31] Quarry: Show replication lag - https://phabricator.wikimedia.org/T60841#848974 (valhallasw) [21:05:09] Quarry: Show replication lag - https://phabricator.wikimedia.org/T60841#848980 (yuvipanda) But labsdb always has zero replag! :D [21:05:35] Quarry: Allow filtering of the final report - https://phabricator.wikimedia.org/T61764#616142 (valhallasw) [21:06:37] Quarry: Reports: Add a thumbnail field - https://phabricator.wikimedia.org/T60844#848994 (valhallasw) [21:07:18] Quarry: Possible wikidata merges - https://phabricator.wikimedia.org/T63881#651842 (valhallasw) [21:09:15] Quarry: Report: nlwiki: list of all anon talk pages with a last edit > 3 years ago - https://phabricator.wikimedia.org/T63800#849017 (valhallasw) [21:22:09] so mforns: you're working on the annotation stuff right? [21:22:31] VisualEditor, Analytics-Engineering: Dashboard repository for Edit schema - https://phabricator.wikimedia.org/T76744#849042 (Jdforrester-WMF) p:Triage>High [21:22:44] VisualEditor, Analytics-Engineering: Dashboard repository for Edit schema - https://phabricator.wikimedia.org/T76744#819244 (Jdforrester-WMF) [21:22:52] well I stopped because kevinator and J-Mo found an issue when uploading a cohort [21:22:58] milimetric, ^ [21:23:19] k, i'll grab those other two little tasks in wikimetrics and you can do the annotation one when you're done with that [21:23:33] yes, no problem [21:23:47] I've already catched what that was [21:25:30] milimetric, when uploading a cohort with textarea, if the project name is separated from the comma by a space, this space goes together as part of the project name, and this causes problems in cohort expansion, who is not prepared to deal with it [21:27:17] mforns: I thought there was a "strip" in the normal pipeline which got rid of whitespace [21:27:45] milimetric, it's this: yield _username.strip().split(',') [21:27:53] oh - sorry i misread that - you got it :) [21:27:56] I think the split should be done before the split [21:28:14] sorry [21:28:25] the split should be done before the strip [21:28:54] milimetric, do you agree? [21:29:29] something like: yield [x.strip() for x in _username.split(',')] [21:29:36] with care to preserve the logic around usernames, yes. (usernames can have commas, etc.) [21:29:46] aha ok [21:34:56] Analytics-Engineering: set up hackathon at MWDS - https://phabricator.wikimedia.org/T76800#849150 (Aklapper) [21:36:45] Analytics-EventLogging: if logEvent fails due to not matching Schema requirements, it should return false (or an error) instead of true - https://phabricator.wikimedia.org/T75678#849152 (Nuria) >Right now, if you pass data to logEvent that doesn't match the schema, it will fail silently. >It would be nice if... [21:40:23] (CR) EBernhardson: [C: 2 V: 2] Initial graphs of FlowReplies EventLogging schema [analytics/limn-flow-data] - https://gerrit.wikimedia.org/r/178646 (owner: EBernhardson) [21:45:29] (CR) Jdlrobson: [C: -1] Update click tracking graphs (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 (owner: Bmansurov) [21:46:55] Analytics-Wikimetrics, Analytics-Engineering: Wikimetrics User reads disclaimer on website [3 pts] - https://phabricator.wikimedia.org/T76107#849193 (Milimetric) a:Milimetric [21:47:03] (PS4) Bmansurov: Update click tracking graphs [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 [21:49:32] Analytics-EventLogging: find a better way to identify events that fail validation as early as possible - https://phabricator.wikimedia.org/T78355#849208 (kevinator) related issue: T75678 [21:59:20] (CR) Jdlrobson: [C: -1] Update click tracking graphs (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 (owner: Bmansurov) [22:02:21] ebernhardson: It seems your question has been missed. [22:02:51] The test2wiki beheavior you described seems to be expected according to [22:02:55] https://git.wikimedia.org/blob/operations%2Fmediawiki-config.git/1754af996df868a7c7fdbe5f6649901689abc4ec/wmf-config%2FCommonSettings.php#L2660 [22:08:57] (CR) Bmansurov: Update click tracking graphs (1 comment) [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 (owner: Bmansurov) [22:18:40] qchris: seems odd, its supposed to be turned on but issue warnings to the browser on every attempt to eventlog? I suppose its fine, just seems odd to turn it on but have it broken [22:18:48] (PS1) Ottomata: [WIP] UDF for classifying pageviews according to https://meta.wikimedia.org/wiki/Research:Page_view/Generalised_filters [analytics/refinery/source] - https://gerrit.wikimedia.org/r/180023 [22:19:49] (it wasn't just the Flow schema that was missing, every schema delivered to js seems to be missing its properties due to the RemoteSchema object failing) [22:20:35] ebernhardson: See line 2661 in the link I sent. [22:21:01] I figured it's on purpose to have a separate Schema: namespace. [22:21:23] qchris: well i see it, but it only explains what not why, which is only half as usefull :) [22:22:13] Having it in a separate namespace allows you to experiment with a schema that is already in production without affecting the production use of the schema. [22:22:31] At least that would be one very convenient possibility. [22:23:12] Make sense? [22:23:25] s/Make/Makes/ [22:24:16] sounds reasonable, i havn't needed to test outside beta yet but could be a possibility [22:43:14] (PS5) Bmansurov: Update click tracking graphs [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 [22:44:28] (PS6) Bmansurov: Update click tracking graphs [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 [23:17:32] okay, ottomata, you around? [23:17:41] legal have a hyper-urgent query they'd like run that simply won't launch [23:18:42] Ironholds: if it's not sensitive, share the script. More eyes can only help. [23:19:34] Ironholds: ja [23:19:35] still here [23:19:40] qchris, "SELECT dt,ip,x_forwarded_for,user_agent, CONCAT(uri_host,uri_path,uri_query) AS url, referer FROM wmf_raw.webrequest WHERE year = 2014 AND month = 11 AND day [10 day range] AND uri_path LIKE('%sensitive_bit_goes_here%') AND webrequest_source IN('text','mobile','upload') [23:19:53] with, you know, some limited redaction [23:20:25] what's the problem? [23:20:35] it just stalls. Submit job, and job...never launches [23:20:44] Logging initialized using configuration in file:/etc/hive/conf.analytics-hadoop/hive-log4j.properties [23:20:44] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". [23:20:44] SLF4J: Defaulting to no-operation (NOP) logger implementation [23:20:44] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. [23:20:48] ...and then nothing happens [23:21:57] Ironholds: does it work with a smaller date range? [23:22:05] good Q [23:22:20] Just tried that. Did not work for me. [23:22:40] it does not [23:23:12] With a single hour, it just started for me. [23:24:03] huh :( [23:24:57] Now it started with a single day (did not start before) [23:25:39] Now also day > 20 started. [23:25:47] hrrm [23:25:50] this. is. weird. [23:25:52] Ironholds: Try your query again. Maybe it just works now. [23:25:56] Am doing! [23:26:09] * Ironholds twiddles thumbs [23:36:58] heh, Ironholds, we should probably str2lower the uri_host when grouping, eh? [23:37:01] (CR) Jdlrobson: [C: 2] "/me crosses fingers" [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 (owner: Bmansurov) [23:37:06] sure! [23:37:41] okay, I'm heading out. Too burnt to be any good :( [23:37:45] I hope you all have lovely evenings. [23:37:53] Ironholds: did your query not run? [23:38:10] I've launched it and stuck it in screen. That'll have to do for now :( [23:38:14] ok [23:38:17] goodnight! [23:38:20] if it still doesn't launch by the morning...ech. [23:38:52] (PS1) Mforns: Strip project when uploading cohort [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/180071 [23:40:45] (Merged) jenkins-bot: Update click tracking graphs [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/178381 (owner: Bmansurov) [23:42:53] Analytics-Engineering, Analytics-Wikimetrics: "Validate Again" functionality is broken - https://phabricator.wikimedia.org/T78339#849558 (kevinator) p:Triage>Normal [23:45:09] (CR) Nuria: Strip project when uploading cohort (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/180071 (owner: Mforns) [23:54:25] (PS2) Ottomata: [WIP] UDF for classifying pageviews according to https://meta.wikimedia.org/wiki/Research:Page_view/Generalised_filters [analytics/refinery/source] - https://gerrit.wikimedia.org/r/180023 [23:56:51] (CR) Mforns: Strip project when uploading cohort (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/180071 (owner: Mforns) [23:57:23] Analytics-Refinery: Hive User calls UDF to specify a date range in a query - https://phabricator.wikimedia.org/T76531#849589 (kevinator) [23:57:58] nuria__, thanks for the fast review