[00:03:48] qchris: Oh! So, not us in the apps team, at least. :) [00:04:03] qchris: I'm satisfied then. You're probably not. :-p [00:04:07] qchris: Thanks for your help. :) [00:04:45] Deskana: I could inject your event locally just fine. So the event you're producing is fine. [00:04:57] qchris: Excellent, good to know. Thank you. :) [00:05:46] Deskana: Events are flowing in again. So you should see the table created if you inject new events. [00:22:31] qchris: still there? [00:22:37] yup. [00:24:51] qchris: what was happening with the db? [00:25:51] nuria__: The eventlogging mysql consumer bailed out around 2014-11-25T03. [00:26:16] qchris: and was not re-started by upstart i take? [00:26:39] The service was running [00:26:47] So upstart did not restart it. [00:27:05] no, but , upstart will re-start just the consumer [00:27:22] qchris: even if the rest of the consumers are up [00:29:04] nuria__: I am tired. I want to start backfilling, write a heads-up to the mailing lists, and then sleep. [00:29:06] But! [00:29:09] Tomorrow, I'll gladly listen to you explaining to me how I screwed up. [00:29:13] ;-) [00:42:17] Analytics-Dashiki: Story: Vital Signs User selects the Daily Pageviews metrics - https://phabricator.wikimedia.org/T74740#786789 (kevinator) [00:43:00] Analytics-Dashiki: Story: Vital Signs User selects the Daily Pageviews metrics - https://phabricator.wikimedia.org/T74740#754561 (kevinator) [00:44:55] Analytics-Wikimetrics: Story: AnalyticsEng has editor_day table in labsdb - https://phabricator.wikimedia.org/T71145#786800 (kevinator) [00:46:03] Analytics-Dashiki: Story: User selects breakdown in Vital Signs - https://phabricator.wikimedia.org/T74739#786803 (kevinator) [00:47:05] Analytics-Wikimetrics: Story: WikimetricsUser reports pages edited by cohort - https://phabricator.wikimedia.org/T75072#763343 (kevinator) [00:50:26] Analytics-Wikimetrics: Story: WikimetricsUser reports pages edited by cohort - https://phabricator.wikimedia.org/T75072#786822 (kevinator) [00:50:41] Analytics-Wikimetrics: Story: WikimetricsUser reports pages edited by cohort - https://phabricator.wikimedia.org/T75072#786823 (kevinator) p:Triage>High [00:50:54] Analytics-Wikimetrics: Story: AnalyticsEng has editor_day table in labsdb - https://phabricator.wikimedia.org/T71145#786825 (kevinator) [00:50:58] Analytics-Dashiki: Story: User selects breakdown in Vital Signs - https://phabricator.wikimedia.org/T74739#786826 (kevinator) [00:51:03] Analytics-Wikimetrics: Story: AnalyticsEng has editor_day table in labsdb - https://phabricator.wikimedia.org/T71145#733833 (kevinator) [00:54:15] Analytics-Wikimetrics: Story: Wikimetrics compiles target-site breakdown on metrics based on MW tags - https://phabricator.wikimedia.org/T74736#786829 (kevinator) [00:55:43] Analytics-Wikimetrics: Story: Wikimetrics uses some EL data - https://phabricator.wikimedia.org/T74735#786836 (kevinator) [00:56:22] Analytics-Wikimetrics: Story: Wikimetrics has connection to Data Warehouse - https://phabricator.wikimedia.org/T74737#786839 (kevinator) [00:57:06] Analytics-Wikimetrics: Story: Dashiki uses Mediawiki for storage - https://phabricator.wikimedia.org/T70448#786841 (kevinator) [00:58:16] Analytics-Wikimetrics: Story: WikimetricsUser deletes user from cohort - https://phabricator.wikimedia.org/T75350#786847 (kevinator) [00:58:55] Analytics-EventLogging: Automate pruning of sampled logs after 90 days - https://phabricator.wikimedia.org/T74743#786849 (kevinator) [00:59:10] Analytics-EventLogging: Automate purge of rows older than 90 days for select tables/schemas - https://phabricator.wikimedia.org/T74744#786851 (kevinator) [00:59:47] Analytics-Wikimetrics: Story: Wikimetrics compiles target-site breakdown for remaining metrics - https://phabricator.wikimedia.org/T74738#786853 (kevinator) [01:00:22] Analytics-Wikimetrics: Story: WikimetricsUser reads user names in a JSON report - https://phabricator.wikimedia.org/T74747#786855 (kevinator) [01:01:07] Analytics-Dashiki: Story: VitalSignsUser selects Monthly Pageviews metric - https://phabricator.wikimedia.org/T75331#786866 (kevinator) p:Triage>Normal [01:01:36] Analytics-EventLogging: database consumer could batch inserts (sometimes) [34pts] - https://phabricator.wikimedia.org/T69450#786869 (kevinator) [01:01:59] Analytics-Dashiki: Story: Vital Signs User selects the Daily Pageviews metrics [34pts] - https://phabricator.wikimedia.org/T74740#786870 (kevinator) [01:02:19] Analytics-Wikimetrics: Story: AnalyticsEng has editor_day table in labsdb [34pts] - https://phabricator.wikimedia.org/T71145#786871 (kevinator) [01:02:36] Analytics-Dashiki: Story: User selects breakdown in Vital Signs [21pts] - https://phabricator.wikimedia.org/T74739#786872 (kevinator) [01:02:52] Analytics-Wikimetrics: Story: WikimetricsUser reports pages edited by cohort [13pts] - https://phabricator.wikimedia.org/T75072#786873 (kevinator) [01:05:39] Analytics-Wikimetrics: Story: WikimetricsUser deletes user from cohort [21]pts - https://phabricator.wikimedia.org/T75350#786885 (kevinator) [01:05:49] Analytics-Wikimetrics: Story: WikimetricsUser deletes user from cohort [21pts] - https://phabricator.wikimedia.org/T75350#764487 (kevinator) [01:06:30] Analytics-Wikimetrics: Story: Wikimetrics compiles target-site breakdown on metrics based on MW tags [34pts] - https://phabricator.wikimedia.org/T74736#786887 (kevinator) [01:06:39] Analytics-Wikimetrics: Story: Wikimetrics compiles target-site breakdown on metrics based on MW tags [34pts] - https://phabricator.wikimedia.org/T74736#754181 (kevinator) [01:07:05] Analytics-Wikimetrics: Story: Wikimetrics uses some EL data [13pts] - https://phabricator.wikimedia.org/T74735#786890 (kevinator) [01:07:10] Analytics-Wikimetrics: Story: Wikimetrics uses some EL data [13pts] - https://phabricator.wikimedia.org/T74735#754111 (kevinator) [01:07:33] Analytics-Wikimetrics: Story: Wikimetrics has connection to Data Warehouse [13pts] - https://phabricator.wikimedia.org/T74737#786892 (kevinator) [01:07:38] Analytics-Wikimetrics: Story: Wikimetrics has connection to Data Warehouse [13pts] - https://phabricator.wikimedia.org/T74737#754280 (kevinator) [01:08:01] Analytics-Wikimetrics: Story: Dashiki uses Mediawiki for storage [13pts] - https://phabricator.wikimedia.org/T70448#786894 (kevinator) [01:08:19] Analytics-Wikimetrics: Story: Dashiki uses Mediawiki for storage [13pts] - https://phabricator.wikimedia.org/T70448#713420 (kevinator) [01:08:39] Analytics-Wikimetrics: Story: WikimetricsUser deletes user from cohort [21pts] - https://phabricator.wikimedia.org/T75350#786896 (kevinator) [01:08:45] Analytics-Wikimetrics: Story: WikimetricsUser deletes user from cohort [21pts] - https://phabricator.wikimedia.org/T75350#764487 (kevinator) [01:09:26] Analytics-EventLogging: Automate purge of rows older than 90 days for select tables/schemas [0pts] - https://phabricator.wikimedia.org/T74744#786898 (kevinator) p:High>Normal [01:09:36] Analytics-EventLogging: Automate purge of rows older than 90 days for select tables/schemas [0pts] - https://phabricator.wikimedia.org/T74744#755337 (kevinator) [01:09:46] Analytics-EventLogging: Automate pruning of sampled logs after 90 days [0pts] - https://phabricator.wikimedia.org/T74743#786908 (kevinator) [01:09:52] Analytics-EventLogging: Automate pruning of sampled logs after 90 days [0pts] - https://phabricator.wikimedia.org/T74743#755235 (kevinator) [01:10:11] Analytics-Dashiki: Story: VitalSignsUser selects Monthly Pageviews metric - https://phabricator.wikimedia.org/T75331#786911 (kevinator) [01:10:17] Analytics-Dashiki: Story: VitalSignsUser selects Monthly Pageviews metric - https://phabricator.wikimedia.org/T75331#786912 (kevinator) [01:10:45] Analytics-Wikimetrics: Story: WikimetricsUser reads user names in a JSON report [8pts] - https://phabricator.wikimedia.org/T74747#786913 (kevinator) p:Normal>Low [01:10:49] Analytics-Wikimetrics: Story: WikimetricsUser reads user names in a JSON report [8pts] - https://phabricator.wikimedia.org/T74747#755620 (kevinator) [01:12:10] Analytics-Wikimetrics: Story: Wikimetrics compiles target-site breakdown for remaining metrics [34pts] - https://phabricator.wikimedia.org/T74738#786923 (kevinator) [01:12:23] Analytics-Wikimetrics: Story: Wikimetrics compiles target-site breakdown for remaining metrics [34pts] - https://phabricator.wikimedia.org/T74738#754384 (kevinator) [01:25:45] Analytics-Dashiki: Story: Vital Signs User selects the Daily Pageviews metrics [34pts] - https://phabricator.wikimedia.org/T74740#786993 (kevinator) [02:19:43] (CR) Springle: "Using Alembic in offline mode would be fine, and then doing --sql to generate and commit the raw SQL scripts along side." [analytics/data-warehouse] - https://gerrit.wikimedia.org/r/167839 (owner: QChris) [05:33:50] If I want userAgent in a EL schema, do I have to explicitly log it, or do I get it for free? [06:20:34] Hi all [06:20:38] Good morning :) [07:55:19] rtnpro: hello! [07:55:26] * YuviPanda had just woken up [08:11:00] good morning YuviPanda [08:11:07] good morning, GerardM- [08:11:32] re: me moving into a differnt time zone, I bet I'll be just as irregular in SF too, covering random time zones over time :) [08:12:06] I hope you do not mind that for me it is a step backward in having service in the European timezone [08:12:45] it is probably afternoon in India [08:13:41] it is :) [08:13:55] and european time, probably. I'll probably shift between US / Australia time in SF [08:14:03] but Europe has a lot of ops anyway [08:14:07] just no labs people [08:14:18] GerardM-: on the other hand, there's no way for me to move to Europe [08:14:39] I would if I could :) [08:14:58] so we need a labs person in Europe [08:15:20] because many tools particularly vital in Europe are on Labs [08:15:24] think GLAM for instance [08:16:57] yeah [08:16:59] I do agree [08:17:23] GerardM-: clearly the solution is for me to move to Europe :) [08:22:53] YuviPanda, sorry, I was having lunch :) [08:23:00] :) [09:34:11] (CR) Jhernandez: [C: 1] Switch to metadata inference for all graphs [analytics/limn-mobile-data] - https://gerrit.wikimedia.org/r/175887 (owner: Milimetric) [10:31:27] !seen hashar [13:23:58] Analytics-Features: test #2 - https://phabricator.wikimedia.org/T75742#787997 (Nosy79) a:kevinator>Nosy79 [15:01:33] ggellerman: Sneeeeaaaaky daily scrum meeting is happening :-) [15:33:34] (CR) Nemo bis: "" Cannot Merge "" [analytics/quarry/web] - https://gerrit.wikimedia.org/r/175402 (owner: Rtnpro) [15:35:41] (Abandoned) Yuvipanda: Flake8 cleanup in web/utils/pagination.py. [analytics/quarry/web] - https://gerrit.wikimedia.org/r/175402 (owner: Rtnpro) [16:12:04] (CR) Nuria: "Looks very good, comments only to build and distro." (3 comments) [analytics/mediawiki-storage] - https://gerrit.wikimedia.org/r/175467 (https://bugzilla.wikimedia.org/68448) (owner: Mforns) [16:12:40] mforns: real good job on mediawiki storage, i think the tweaks we need are quite small [16:13:07] nuria__, thanks, I'm looking at the comments now [16:13:25] mforns: in order to try use it from dashiki though this change needs to be merged 1st so it can be mirroed to github and thus being register on that address for bower [16:13:42] aha [16:13:55] I think dan already mirrored to github [16:14:17] https://github.com/wikimedia/analytics-mediawiki-storage [16:15:54] nuria means the gerrit change needs to be merged, github only mirrors master [16:16:03] milimetric, understand [16:16:58] nuria__, milimetric: I'll finish the readme and correct the code for nuria's comments and let you know [16:17:05] mforns: k [16:17:28] mforns: ya, but github will only see your "master" branch [16:17:35] mforns: ah sorry, dan just said that [16:17:42] hehe, ok [16:20:33] mforns: i can review the patch too if you like, let me know [16:21:23] milimetric, of course I'd like to [16:21:39] ok, i'll wait for your next patch [16:21:46] perfect [16:27:46] mobile page counts spiking as desktop page counts decline is such a cute trend [16:27:55] it's probably because people are going to sleep reading wikipedia [16:28:04] that's one of those things that makes me feel fuzzy inside [16:28:36] (sorry - i mean the daily trend, obviously, not the overall one) [17:35:35] milimetric, where'd you see that? [17:35:58] oh the breakdown in vital signs i'm working on [17:36:07] want a screenshot? [17:36:07] oh, gotcha [17:36:13] naw, I'm good. See, you know the cool thing? [17:36:26] for both edits and reads, that trend appears when you localise the timestamps [17:36:40] oh cool! :) [17:36:44] it's not just an artefact of UTC [17:36:57] see http://blog.ironholds.org/content/images/2014/Aug/circadian_patterns___all_usergroups__all_projects_.png for edits [17:38:20] (CR) Nuria: Add support for timezones while creating reports (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/175169 (https://bugzilla.wikimedia.org/72116) (owner: Bmansurov) [17:45:38] (CR) Bmansurov: Add support for timezones while creating reports (1 comment) [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/175169 (https://bugzilla.wikimedia.org/72116) (owner: Bmansurov) [17:54:59] nuria__: I see that firefox won't render the graph lines anymore [17:55:04] after my patch [17:55:08] do you have the same issue? [17:56:26] ah, it's the stroke-dasharray [17:56:27] grrr [17:58:48] (PS4) Mforns: Implement mediawiki-storage lib [analytics/mediawiki-storage] - https://gerrit.wikimedia.org/r/175467 (https://bugzilla.wikimedia.org/68448) [18:00:13] ah, figured it out :) firefox doesn't like [0] it wants [] instead [18:00:35] (PS6) Milimetric: Implement breakdowns for metrics with CSV data [analytics/dashiki] - https://gerrit.wikimedia.org/r/175458 [18:01:51] nuria__: I fixed up some of the refactor details (the total line was getting ignored and the observables were added too late and to only the default metrics), but PS6 is ready for your review [18:02:03] it has the dash patters on the left and I think that looks pretty nice actually [18:02:07] and it's fixed for firefox [18:05:59] milimetric: great, i am off for couple hours will look (& merge ) right after [18:06:21] cool :) [18:07:28] (CR) Mforns: Implement mediawiki-storage lib (3 comments) [analytics/mediawiki-storage] - https://gerrit.wikimedia.org/r/175467 (https://bugzilla.wikimedia.org/68448) (owner: Mforns) [18:53:31] Analytics-EventLogging: Epic: Simplify dashboard deployment with EventLogging data - https://phabricator.wikimedia.org/T75836#788879 (kevinator) p:Triage>High [18:53:46] Analytics: Look at proposed naming conventions for Diffusion - https://phabricator.wikimedia.org/T76057 (ggellerman) NEW p:Triage a:kevinator [18:54:38] Analytics-EventLogging: Announce to foundation how they can create their dashboard - https://phabricator.wikimedia.org/T76058 (kevinator) NEW p:High [18:55:40] Analytics-EventLogging: WMF reads announcement and documentation on how to get a dashboard - https://phabricator.wikimedia.org/T76058#788891 (kevinator) [19:01:08] (PS1) Rtnpro: Allow browsing all published queries. [analytics/quarry/web] - https://gerrit.wikimedia.org/r/176025 [19:01:38] halfak, Hey [19:01:47] hey rtnpro [19:01:49] what's up? [19:02:04] halfak, nothing much, working :) [19:02:19] halfak, I have pushed my work on https://phabricator.wikimedia.org/T72735 [19:02:30] halfak, could you give it a try? [19:02:51] halfak, let me know if it needs some improvements :) [19:03:10] regretfully, I'm in the middle of some stuff. Also, I don't have a nice quarry test environment set up :S [19:03:34] halfak, I am not in a hurry [19:03:53] Hokay :) [19:04:25] halfak, whenever you have time :) YuviPanda, you are welcome to check it out too ;) [19:04:36] rtnpro: I was just looking at it :) [19:05:05] rtnpro: hmm, I am thinking the query params should be just get params. [19:05:20] rtnpro: that way they're more flexible. we can then easily query by author, completion status, etc [19:05:37] YuviPanda, I agree +1 [19:05:42] rtnpro: so no params, all. we can have 'published=true', 'author=' etc [19:05:49] wikimedia/mediawiki-extensions-EventLogging#275 (wmf/1.25wmf10 - 5352239 : Reedy): The build passed. [19:05:49] Change view : https://github.com/wikimedia/mediawiki-extensions-EventLogging/commit/5352239fa72e [19:05:49] Build details : http://travis-ci.org/wikimedia/mediawiki-extensions-EventLogging/builds/42229203 [19:05:50] and I'm wary of introducing a link now that would break in the future [19:06:12] YuviPanda, then I need to improve the logic to add pagination params to the base URL with GET params :) [19:06:43] rtnpro: yup! :) I think just letting 'published=true' be a filter (or similar thing, as it makes sense to you) would work [19:06:45] YuviPanda, I get it, I will update the patch [19:07:11] rtnpro: cool :) [19:07:12] yay [20:01:27] (PS2) Rtnpro: Allow browsing all published queries. [analytics/quarry/web] - https://gerrit.wikimedia.org/r/176025 [20:02:25] YuviPanda, ^^ [20:03:55] rtnpro: yay. looking [20:04:05] :) [20:08:54] (CR) Yuvipanda: [C: -1] "Works as intended! Super minor nitpicks. Would probably need some UX love but that can come later." (2 comments) [analytics/quarry/web] - https://gerrit.wikimedia.org/r/176025 (owner: Rtnpro) [20:09:03] rtnpro: ^ [20:09:55] YuviPanda, :) [20:10:06] YuviPanda, were the nitpicks good or bad? [20:10:39] rtnpro: tiny things. CSS margin, plus 'All queries' and 'Published queries' instead of just what they are [20:10:42] code itself is fine [20:10:53] YuviPanda, ok [20:11:02] YuviPanda, I will amend the commit now, wait [20:12:13] (PS3) Rtnpro: Allow browsing all published queries. [analytics/quarry/web] - https://gerrit.wikimedia.org/r/176025 [20:12:30] YuviPanda, pushed updated commit [20:12:45] rtnpro: margin? [20:13:14] YuviPanda, ah! shit, please wait [20:13:56] :) [20:15:39] by margin, you meant the 80 chars margin, right? [20:15:49] no no [20:15:51] I meant margin-bottom [20:16:02] YuviPanda, ah! [20:16:05] hehe [20:22:46] Hi, anyone around who's involved in the maintenance of http://reportcard.wmflabs.org/? [20:23:55] YuviPanda, shall I add the CSS rule in views.css? [20:24:52] rtnpro: there should be a list.css, I think? [20:25:14] YuviPanda, no, it isn't [20:25:51] rtnpro: ah, then make on! :) [20:25:56] YuviPanda, the page loads only base.css and fonts.css [20:26:08] YuviPanda, yeah [20:26:12] :) [20:26:15] there's a list.js [20:26:17] I'm currently working on a project to provide monthly metrics for the email response team (OTRS), and I was wondering if https://www.mediawiki.org/wiki/Analytics/Limn could in any way be used to present the data. [20:26:18] so just needs list.css [20:26:33] pajz: you're looking for milimetric and nuria__, I think, if you've questions about Limn [20:26:39] hi pajz [20:26:59] limn is more useful for dashboarding and managing dashboards than it is for one-off visualization [20:27:17] Thanks, YuviPanda. Hi milimetric. [20:27:25] what tools are you comfortable with? I might be able to suggest something. Also - what kinds of things would you like to do? [20:28:53] This is our draft space: https://meta.wikimedia.org/wiki/OTRS/Reports/Monthly/sandbox. My preferred solution would be to write our reports on-wiki and then integrate plots via plot.ly, so something like https://plot.ly/~pz/1/permissions-tickets-per-month-oct-2005-through-oct-2014/ through an iframe. [20:29:11] (PS4) Rtnpro: Allow browsing all published queries. [analytics/quarry/web] - https://gerrit.wikimedia.org/r/176025 [20:29:19] YuviPanda, done :) [20:30:44] YuviPanda, I have a feature request related to the above feature [20:30:52] oh? [20:30:54] However, from what I understand, it's not possible to integrate iframes on any of our Wikis, right? [20:31:13] YuviPanda, what about remembering the user's filter selection using cookies? [20:32:04] YuviPanda, so that we can have more contextual hyperlinks in "Recent queries" tab [20:32:14] YuviPanda, does it make sense? [20:32:18] ah, hmm [20:32:32] what do you mean by 'contextual hyperlinks' [20:33:40] YuviPanda, let's say I had selected "Published queries" filter, the hyperlink for "Recent queries" tab becomes "/query/runs/all?published=true" [20:34:15] YuviPanda, so that the next time I click it, it takes me to the recent queries page with the "Published" filter pre selected [20:36:24] pajz: ah, hmm. [20:36:27] err, sorry pajz [20:36:29] rtnpro: ah, hmm. [20:36:37] hmm. [20:36:57] rtnpro: that does sound useful. File a task? I'd still prioritize it under fixing user page pagination, and more filtering options, for example [20:38:07] YuviPanda, :) [20:39:00] rtnpro: but definitely useful! [20:39:14] rtnpro: but not cookies directly, perhaps. just using flask's session object, which in our case persists to redis [20:39:45] YuviPanda, that's even better +1 [20:42:26] pajz: gotcha, yeah, limn doesn't integrate with mediawiki at all [20:42:36] so you're better off with plot.ly there [20:42:59] Hmm, but I can't integrate that in MediaWiki as well, right? [20:43:24] there is the graph extension though: http://www.mediawiki.org/wiki/Extension:Graph [20:43:51] pajz: yeah, the most mature thing I know of that plots stuff directly into mediawiki docs is that extension [20:44:15] I wrote a prototype for it and then this awesome dude named Yuri polished and pushed it live on some wikis. [20:45:21] pajz: this is the kind of stuff you can do with it: http://www.mediawiki.org/wiki/Extension:Graph/Demo [20:45:54] the data can either be embedded in the json that defines the graph or in an external document, but right now it has to be hosted on a wikimedia site [20:46:08] Hmm. [20:46:34] Goodnight folks :) [20:47:37] I'll look into that. [20:49:10] Doesn't the Foundation incidentally have some non-wiki site available where such reports could be posted, without that sort of restrictions? [20:51:08] pajz: that was the initial idea behind limn, but that project suffered some problems with scope creep [20:51:26] it's a good idea though, and something we keep in the back of our minds [21:13:13] milimetric, I see. What I mean is that there's labs for hosting tools, -- isn't there something similar for just hosting content? [21:15:41] pajz: well, yeah, labs. But "hosting content" is a seemingly simple phrase that hides a lot of complication [21:15:59] what kind of content? What kind of servers do you need? node? ruby? flask? etc. [21:17:51] Analytics-Dashiki: weekly/monthly granularity in Dashiki - https://phabricator.wikimedia.org/T76092#789358 (ggellerman) [21:19:22] Analytics: WSC data in a cube - https://phabricator.wikimedia.org/T76093#789370 (ggellerman) [21:19:45] Analytics: WSC data in a cube - https://phabricator.wikimedia.org/T76093#789370 (ggellerman) Not sure which project to put this in [21:23:09] Analytics-Refinery: WSC data in a cube - https://phabricator.wikimedia.org/T76093#789387 (ggellerman) [21:23:33] milimetric, well, the original idea (and from what I can see the by far easiest for us to work with) would be to simply be able to embed content from another site (i.e. embed plot.ly plots). [21:23:52] Analytics-Refinery: WSC data in a cube - https://phabricator.wikimedia.org/T76093#789370 (ggellerman) changed project to Analytics-Refinery per Kevin [21:27:26] Analytics-Refinery: WSC data in a cube - https://phabricator.wikimedia.org/T76093#789421 (Tnegrin) I think this is a good idea but I want to make really sure we don't end up with two cubes with different data. This should be explicitly for the purpose of harmonizing the page view definition with the new defi... [21:33:01] pajz: but you can't embed iframes in a wiki can you? [21:33:38] the graph extension is really cool, in that it has a human-readable format that other people can improve on. It makes a lot of sense in the wiki universe, take a look. And I'm happy to help explain its oddities. [21:33:40] I don't know, but I don't think you can. [21:34:09] yeah, I don't think so either [21:38:40] milimetric, I'll look into that. However, I feel we have some miscommunication going on regarding the last point (surely my fault, I'm just not really into that, as you probably noticed); what I meant was space for hosting the entire report, not doing any plot generation or something like that. [21:39:43] pajz: no problem, communicating via IRC is bound to have a few misunderstandings :) [21:39:56] but by hosting - what do you mean? Like HTML? [21:40:07] yeah. [21:40:47] well - you could pretty easily set up a labs instance, give it a proxy (like pajz.wmflabs.org), install apache (or select it in the configuration of the instance) and host anything you like [21:41:19] when I say "pretty easily" I don't mean for developers, I mean this should be approachable by most people [21:41:50] I have to do a few things to prepare for Thanksgiving but I can help you if you'd like to do that [21:46:53] milimetric, many thanks. I need to to some more testing first and check back with the others on the project, to make sure it is really what we want. It would be great if I could approach you again after that. [21:47:24] pajz: sure, no problem, are you familiar with the labs project? [21:47:47] Analytics-Wikimetrics: Story: AnalyticsEng has editor_day table in labsdb [34pts] - https://phabricator.wikimedia.org/T71145#789457 (kevinator) [21:47:51] Analytics-EventLogging: database consumer could batch inserts (sometimes) [34pts] - https://phabricator.wikimedia.org/T69450#789458 (ggellerman) [21:48:02] Analytics-Dashiki: Story: User selects breakdown in Vital Signs [21pts] - https://phabricator.wikimedia.org/T74739#789459 (kevinator) [21:48:07] if your teammates need context, it's this: https://wikitech.wikimedia.org/wiki/Main_Page [21:48:18] milimetric, alas, no, but some other OTRS admins are. [21:48:25] Analytics-Dashiki: Story: Vital Signs User selects the Daily Pageviews metrics [34pts] - https://phabricator.wikimedia.org/T74740#789460 (ggellerman) [21:48:51] Analytics-EventLogging: database consumer could batch inserts (sometimes) [34pts] - https://phabricator.wikimedia.org/T69450#789461 (kevinator) [21:49:01] cool cool, well talk to you later / sooner then. If I'm not around you can either head to #wikimedia-labs or email me at dandreescu@wikimedia.org [21:50:16] Thanks a lot, will do. And happy Thanksgiving :) [21:52:28] Happy Thanksgiving :) [22:14:43] k, now i'm really going - have a good long weekend those who are taking one, see you Monday [22:18:05] Happy TG :-) [22:40:04] Analytics-Wikimetrics: Story: WikimetricsUser deletes user from cohort [21pts] - https://phabricator.wikimedia.org/T75350#789584 (kevinator) Adding wireframes. {F16581} {F16583} {F16585} [22:51:42] hey, here's a question for people [22:51:52] who actually maintains geoiplookup.wikimedia? [23:05:20] Analytics-Wikimetrics: Uploading cohort by copy-pasting breaks if names contain special characters - https://phabricator.wikimedia.org/T76105 (mforns) NEW p:Normal [23:06:58] Analytics-Wikimetrics: Epic: Grantmaking User gets reports on Wikimetrics usage - https://phabricator.wikimedia.org/T76106#789667 (kevinator) [23:07:21] Analytics-Wikimetrics: Wikimetrics User clicks on Terms or Use link on website - https://phabricator.wikimedia.org/T76107 (kevinator) NEW p:High [23:07:38] Analytics-Wikimetrics: Wikimetrics-l receives email about Lab’s Terms of Use - https://phabricator.wikimedia.org/T76108 (kevinator) NEW p:High [23:07:58] Analytics-Wikimetrics: Wikimetrics auditor has read-only login to Wikimetrics DB - https://phabricator.wikimedia.org/T76109 (kevinator) NEW p:High [23:08:38] Analytics-Wikimetrics: Wikimetrics-l receives email about Lab’s Terms of Use - https://phabricator.wikimedia.org/T76108#789682 (kevinator) [23:09:35] Analytics-Wikimetrics: Wikimetrics User clicks on Terms or Use link on website - https://phabricator.wikimedia.org/T76107#789700 (kevinator) [23:10:49] Analytics-Wikimetrics: Uploading cohort by copy-pasting breaks if names contain special characters - https://phabricator.wikimedia.org/T76105#789702 (mforns) [23:15:22] Ironholds: I guess you're looking for O-ri. [23:15:36] The domain is basically just varnish magic. [23:16:18] The relevant file is templates/varnish/geoip.inc.vcl.erb in the operations/puppet repo [23:16:36] You want the geoip_lookup function. [23:17:15] While those are bits machines, note that there is also bits.wikimedia.org/geolookup (or something similar) [23:18:27] Analytics-Wikimetrics: Epic: Grantmaking User gets reports on Wikimetrics usage - https://phabricator.wikimedia.org/T76106#789713 (kevinator) [23:21:35] ggellerman: https://phabricator.wikimedia.org/T826 is "Migration of Analytics to Phabricator" and "Critters11" closed it as "Resolved". But who is this "carrie crittenden" [23:22:57] (CR) Nuria: [C: 2 V: 2] Implement mediawiki-storage lib [analytics/mediawiki-storage] - https://gerrit.wikimedia.org/r/175467 (https://bugzilla.wikimedia.org/68448) (owner: Mforns) [23:25:19] Analytics-EventLogging: database consumer could batch inserts (sometimes) [34pts] - https://phabricator.wikimedia.org/T69450#789723 (kevinator) [23:25:26] Analytics-Dashiki: Story: Vital Signs User selects the Daily Pageviews metrics [34pts] - https://phabricator.wikimedia.org/T74740#789724 (kevinator) [23:25:42] Analytics-Wikimetrics: Story: AnalyticsEng has editor_day table in labsdb [34pts] - https://phabricator.wikimedia.org/T71145#789725 (kevinator) [23:25:47] Analytics-Dashiki: Story: User selects breakdown in Vital Signs [21pts] - https://phabricator.wikimedia.org/T74739#789726 (kevinator) [23:25:59] qchris, ta! [23:26:18] yw [23:39:58] Analytics: Add central notice cookie to x-analytics field in web-request logs - https://phabricator.wikimedia.org/T75835#789749 (kevinator) p:Triage>High [23:41:51] Analytics: Analytics User uses CentralNotice cookie in x-analytics field of web-request logs - https://phabricator.wikimedia.org/T75835#789751 (kevinator) [23:42:22] Analytics: Analytics User uses CentralNotice cookie in x-analytics field of web-request logs - https://phabricator.wikimedia.org/T75835#789755 (kevinator) [23:56:16] (CR) Nuria: "Looks good, I think once files do not include 0 counts the UI will be as good as we can get it with the resolution of this data." [analytics/dashiki] - https://gerrit.wikimedia.org/r/175458 (owner: Milimetric) [23:56:29] Analytics-Visualization: correct attribution to comScore in monthly report card - https://phabricator.wikimedia.org/T75344#789815 (kevinator) [23:56:33] (CR) Nuria: [C: 2 V: 2] Implement breakdowns for metrics with CSV data [analytics/dashiki] - https://gerrit.wikimedia.org/r/175458 (owner: Milimetric) [23:56:58] Analytics-Visualization: correct attribution to comScore in monthly report card - https://phabricator.wikimedia.org/T75344#789824 (kevinator) p:Triage>Normal [23:57:10] Analytics-Wikimetrics: Epic: Grantmaking User gets reports on Wikimetrics usage - https://phabricator.wikimedia.org/T76106#789826 (kevinator) [23:57:15] Analytics-Wikimetrics: Wikimetrics User clicks on Terms or Use link on website - https://phabricator.wikimedia.org/T76107#789827 (kevinator) [23:57:19] Analytics-Wikimetrics: Wikimetrics-l receives email about Lab’s Terms of Use - https://phabricator.wikimedia.org/T76108#789828 (kevinator) [23:57:22] Analytics-Wikimetrics: Wikimetrics auditor has read-only login to Wikimetrics DB - https://phabricator.wikimedia.org/T76109#789829 (kevinator) [23:57:31] Analytics-Visualization: correct attribution to comScore in monthly report card - https://phabricator.wikimedia.org/T75344#763775 (kevinator)