[00:08:33] 10Analytics, 10EventBus, 10Reading-Web-Trending-Service, 13Patch-For-Review, and 2 others: Compute the trending articles over a period of 24h rather than 1h - https://phabricator.wikimedia.org/T156411#2995177 (10Jdlrobson) Done. I've updated the patch and changed period to filter to be more generic. Right... [00:11:17] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): [EPIC] Develop a JobQueue backend based on EventBus - https://phabricator.wikimedia.org/T157088#2995179 (10Pchelolo) [00:16:19] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Add storage to Change-Prop for deduplication - https://phabricator.wikimedia.org/T157089#2995197 (10Pchelolo) [00:16:50] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Add storage to Change-Prop for deduplication - https://phabricator.wikimedia.org/T157089#2995214 (10Pchelolo) [00:18:24] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2995218 (10Pchelolo) [00:19:07] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2995236 (10Pchelolo) [00:19:35] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): [EPIC] Develop a JobQueue backend based on EventBus - https://phabricator.wikimedia.org/T157088#2995245 (10Pchelolo) [00:21:08] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Make EventBus service support wildcards in schema definitions - https://phabricator.wikimedia.org/T157091#2995249 (10Pchelolo) [00:26:14] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Support per-topic configuration inn EventBus service - https://phabricator.wikimedia.org/T157092#2995276 (10Pchelolo) [00:28:30] (03CR) 10Nuria: "Are we sure this is actually agreed on by research? According to our definition there are several things we consider pageviews that are no" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335639 (https://phabricator.wikimedia.org/T156628) (owner: 10Joal) [00:30:32] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Create schema for Job event - https://phabricator.wikimedia.org/T157094#2995318 (10Pchelolo) [00:32:18] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Support per-topic configuration in EventBus service - https://phabricator.wikimedia.org/T157092#2995335 (10Pchelolo) [00:33:50] (03CR) 10Nuria: "Let's please triple test this . Apps data does not include a pageId neither namespace so for many of our records this data will be empty" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/335679 (https://phabricator.wikimedia.org/T156993) (owner: 10Joal) [00:34:14] 06Analytics-Kanban, 13Patch-For-Review: Add namespace ID to pageview_hourly - https://phabricator.wikimedia.org/T156993#2995343 (10Nuria) [00:35:31] 06Analytics-Kanban, 13Patch-For-Review: Add namespace ID to pageview_hourly - https://phabricator.wikimedia.org/T156993#2992233 (10Nuria) Correction to prior post: this is working fine for all requests but the ones that come from the apps, thus our code needs to take into account that the data might not always... [00:49:11] 10Analytics, 06Performance-Team: Check if the EventLogging User Agent schema upgrade breaks any performance tool/metric - https://phabricator.wikimedia.org/T156760#2995376 (10Nuria) [00:49:31] 10Analytics, 06Performance-Team: Check if the EventLogging User Agent schema upgrade breaks any performance tool/metric - https://phabricator.wikimedia.org/T156760#2985302 (10Nuria) [00:49:34] 10Analytics-EventLogging, 06Analytics-Kanban, 13Patch-For-Review: Change userAgent field to user_agent_map in EventCapsule - https://phabricator.wikimedia.org/T153207#2995377 (10Nuria) [01:01:04] 10Analytics, 10EventBus, 10Reading-Web-Trending-Service, 13Patch-For-Review, and 4 others: Compute the trending articles over a period of 24h rather than 1h - https://phabricator.wikimedia.org/T156411#2995401 (10Jdlrobson) [07:30:37] 10Analytics, 10Analytics-Wikistats, 10Android-app-Bugs, 06Wikipedia-Android-App-Backlog, 07I18n: Gõychi Konknni's English Wikistats translation is incorrect - https://phabricator.wikimedia.org/T156814#2995682 (10Nikerabbit) Language names are not translated in translatewiki.net. You have to check the sou... [08:13:38] morning! [08:13:49] aqs1008-a bootstrapped, just started aqs1008-b [08:30:49] 10Analytics, 10DBA: Json_extract available on analytics-store.eqiad.wmnet - https://phabricator.wikimedia.org/T156681#2995733 (10Marostegui) That function isn't available on 10.0 or 10.1, but only on 10.2 (https://mariadb.com/kb/en/mariadb/json_extract/) which we do not have in production. We are currently sta... [09:50:41] 10Analytics, 10Analytics-Cluster, 06Operations, 10Ops-Access-Requests: Requesting access to analytics-privatedata-users for musikanimal - https://phabricator.wikimedia.org/T156986#2991994 (10MoritzMuehlenhoff) @MusikAnimal : Please generate a new SSH key for production access (see https://wikitech.wikimedi... [10:05:53] Thanks elukey for managing cassandra :) [10:06:07] elukey: from what I see it all goes well, that's great ! [10:17:23] \o/ [10:18:05] tomorrow morning aqs1008-b should be ready, I'll kick off cleanups on 1005-a [10:19:24] tomorrow morning? faster than -a ? mayve because of 3 machines streaming instead of 2 [10:19:28] elukey: --^ [10:20:31] yep! [10:34:21] elukey: have you relaunched the upload job, or is it waiting since yesterday? [10:36:40] haven't noticed sorry, I assumed all the oozie alerts were related to the deployment :( [10:36:46] hm, wird [10:37:27] Wow ! I don't know how, but actually the job was suspended :( [10:37:38] Just restarted it [10:39:43] ah suspended?? [10:39:52] yes, weird :( [10:41:44] elukey: I noticed it because, despite the job showing in orange in hue, there was no job in yarn for that date/hour [10:42:02] what the hell I havent' suspendend it.. [10:42:36] elukey: I don't think it's you, maybe me (missclick?), or some weird behavior due to NM restarts [10:44:02] * elukey blames oozie [10:44:25] * joal ALWAYS blames oozie, even when it works [10:46:25] * elukey blames oozie since it always complains when we do bad things [10:46:39] oozie the complainer [10:50:37] elukey: I think sometimes oozie complains even when don't do bad thangs, so I don't take it too much personally ;) [10:54:58] (03CR) 10Joal: "This has not yet been discussed. I'll do some deeper analysis to provide context information of 'action=submit' usage and ask for feedback" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335639 (https://phabricator.wikimedia.org/T156628) (owner: 10Joal) [10:55:04] (03CR) 10Joal: [C: 04-1] Update pageview definition to remove previews [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335639 (https://phabricator.wikimedia.org/T156628) (owner: 10Joal) [11:22:40] * elukey lunch! [11:48:40] (03CR) 10Mforns: "I've vetted the data for the monthy and daily jobs after last changes, and it looks good!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/331794 (https://phabricator.wikimedia.org/T155141) (owner: 10Mforns) [11:49:45] hi team :] [11:49:48] elukey, yt? [12:01:39] mforns: o/ [12:01:51] hey elukey :] [12:02:21] what's up? :) [12:02:28] I just had one question: how can I give names to a pivot data set, so that it appears in the box in pivot? is it in puppet? [12:04:35] yep! [12:05:17] https://github.com/wikimedia/operations-puppet/blob/production/modules/pivot/templates/config.yaml.erb [12:05:27] (dataCubes) [12:10:19] elukey, thanks! [12:24:42] (03PS1) 10Addshore: Update list of BetaFeatures [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/335792 [12:25:01] (03PS1) 10Addshore: Update list of BetaFeatures [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/335793 [12:25:05] (03CR) 10Addshore: [V: 032 C: 032] Update list of BetaFeatures [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/335793 (owner: 10Addshore) [12:25:12] (03CR) 10Addshore: [V: 032 C: 032] Update list of BetaFeatures [analytics/wmde/scripts] - 10https://gerrit.wikimedia.org/r/335792 (owner: 10Addshore) [12:34:20] elukey, can I add you as a reviewer of the data cube config? [12:40:03] mforns: 5 euros [12:40:06] :D [12:41:36] jokes aside, the last time we broke pivot [12:41:46] so let me hack it quickly before merging [12:44:29] elukey, sure :] [12:44:43] mforns: yep it broke :D [12:44:46] pasting the error [12:44:55] O.o [12:45:23] end of the stream or a document separator is expected at line 145, column 1: [12:45:26] mmmm [12:45:59] ah the spacE! [12:46:01] :P [12:46:12] name is not aligned [12:46:19] elukey, yes, just saw it, sorry [12:46:23] my baaad [12:46:30] will fix now [12:46:56] done [12:48:58] mforns: check it now, live hack it [12:49:01] it seems to work fine [12:49:06] if you confirm I'll merge [12:49:36] elukey, yes! thanks :] [12:51:24] thanks a lot elukey [12:51:43] np :) [12:58:22] mforns_lunch: just noticed one nit - is "minutely" correct? [13:02:00] * elukey brb [13:02:03] (03Abandoned) 10Nschaaf: (in progress) Store sanitized data for WDQS [analytics/refinery] - 10https://gerrit.wikimedia.org/r/335211 (https://phabricator.wikimedia.org/T146915) (owner: 10Nschaaf) [13:09:02] (03CR) 10Joal: "@nuria: Tested using scripts in https://etherpad.wikimedia.org/p/webreq_update" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/335679 (https://phabricator.wikimedia.org/T156993) (owner: 10Joal) [13:12:41] (03CR) 10Joal: [V: 032 C: 032] "Yay ! Merging !" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/331794 (https://phabricator.wikimedia.org/T155141) (owner: 10Mforns) [13:17:08] 10Analytics, 06Operations, 10Traffic: Add global last-access cookie for top domain (*.wikipedia.org) - https://phabricator.wikimedia.org/T138027#2996314 (10BBlack) [14:01:32] elukey, I looked minutely up in the dictionary and it says it´s correct... http://www.dictionary.com/browse/minutely?s=t [14:02:19] it also sounds weird to me though xD [14:02:24] ahh good I've read something different but ok for me, just to double check [14:02:27] :) [14:02:56] what did you see being used before? [14:03:55] mforns milimetric fdans can you take a quick glance at the updated nav map to make sure the breakdowns shown make sense: https://www.dropbox.com/s/h4usel63w4jnemf/Wikistats%20Nav%20Model%20Final.png?dl=0 [14:04:08] i will update the commons png when i get the ok from you guys [14:04:09] sure ashgrigas, looking [14:04:12] sure! [14:07:59] mforns: something one "every minute" etc.. [14:08:12] but nevermind, I was just asking as curiosity because it looked strange [14:08:24] :) [14:09:18] ashgrigas: looks good to me [14:09:23] elukey, yes, it looks strange to me as well, but I thought it was because of my ignorance, hehehe. Maybe we can change that, but we'd have to reimport the whole data since december 1st and we'd loose Nov 29 and 30... [14:10:44] let's do it! [14:10:47] :P [14:11:04] * elukey hides to avoid Marcel's fury [14:11:13] xDDDD [14:12:56] mforns mdans look ok to you? [14:13:02] fdans sorry :) [14:13:05] elukey, (╯°□°）╯︵ ┻━┻ [14:13:20] mdans is my brother :) [14:13:30] ashgrigas, I'm writing an email to you with what I think should be the specific and universal breakdowns [14:13:51] ok [14:14:31] it does look good to me, curious about mforns 's comments [14:15:23] ashgrigas, fdans I can send it as a pastebin, one sec [14:15:59] mforns: ┬─┬ ︵ /(.□. \） [14:16:20] xDDD [14:17:56] ashgrigas, fdans http://pastebin.com/Fpe2qJSj [14:18:52] let me know if that makes sense, it's pretty different from what we had in the diagram [14:19:09] is Agent type OS? [14:19:26] ashgrigas, no, agent type would be: user or bot [14:19:31] ok [14:19:37] Access method? [14:19:47] is that platform or mobile/web? [14:20:00] access method is: desktop, mobile web, mobile app [14:20:03] ok [14:20:12] so you dont think we need browser [14:20:17] I removed a lot of stuff, not sure if you agree [14:20:22] im ok with it [14:20:24] less is more [14:20:32] as long as we think its enough for the main use cases [14:20:34] we also have OS and browser available if necessary [14:20:37] for pageviews [14:20:43] milimetric fdans thoughts? [14:21:46] mforns: you're excluding the filters here then? [14:22:00] you're only describing the ones that are mutually exclusive [14:22:17] whilst filters can overlap, right? [14:22:17] * elukey brb! [14:22:48] fdans, I think dimensions can be used as filters or breakdowns interchangeably [14:23:25] fdans, I'm not sure I understand your question [14:24:13] I see, nah I was just wondering about the rationale for removing all that [14:24:58] yeah, looks good to me as well. I'm not picky at this stage, after people weigh in we'll know more. But that's a plus for Marcel's approach, simpler [14:25:15] it does make sense though, and ashgrigas is right, as long as we think it's enough for base usercases, I'm ok with it too [14:25:33] we can change that fdans/milimetric if necessary totally [14:26:08] mforns / elukey: are you two talking about daily, hourly, minutely, that kind of minutely? That's perfectly fine! [14:26:24] yeah, I'm not picky at this stage either, I'd proceed with mforns' [14:26:34] ok [14:26:38] sounds good [14:26:39] updating [14:27:24] milimetric: yep yep, after the first question I was only joking with Marcel :D [14:27:53] heheh [14:28:03] ashgrigas: after you update the png too, let's ping on that page? That'll give a chance to the Europe folks to see it early. I was thinking it's hard to ping everyone individually, maybe a talk page message and a banner, then ping individually if we get nothing [14:28:37] elukey: oh ok, I saw reimport everything and wanted to make sure, hahaha [14:28:44] you mean the feedback page? [14:28:53] milimetric [14:29:02] the Future_per_report page [14:29:33] we were saying yesterday we'll start there and ping everyone individually [14:29:38] right [14:29:39] ok [14:37:30] how long should it take for it to show the right file [14:37:36] if i updated it on commons? [14:37:42] its still showing the old version [14:46:36] milimetric i cant seem to get it to update - shows correct on commons https://commons.wikimedia.org/wiki/File:Wikistats_Nav_Model_v4.png [14:46:39] so see what you can do [14:46:52] if you're going to ping the talk page [14:47:08] seems to be stretching it and showing the old one [14:47:57] hm, maybe it needs an update on the page it's included? To pull the latest? [14:48:18] I've got another meeting but will take a look before I ping about it [14:48:59] ok thanks! [14:49:22] i tried deleting it on the feedback page as well and re-inserting it but no luck [14:53:06] btw, ashgrigas: this meeting I have is with a Community Liason who might have time to help with the consultation, if you're interested and have time I can add you [14:53:09] (it's in 7 minutes) [14:53:29] ok sure [14:55:06] i think the image being outdate was stored cookies it worked in another browser so all good to go [14:56:44] ok, cool [15:04:29] ashgrigas: I added you [15:44:09] 06Analytics-Kanban: Document the difference in aggregate data on wikistats and wikistats 2.0 - https://phabricator.wikimedia.org/T150963#2996629 (10Elitre) Turns out that what this team needs ATM is actually related to T156287. What we will do is sending a MassMessage to people who previously showed interest in... [16:24:42] 10Analytics, 10EventBus, 10Reading-Web-Trending-Service, 13Patch-For-Review, and 5 others: Compute the trending articles over a period of 24h rather than 1h - https://phabricator.wikimedia.org/T156411#2996758 (10Fjalapeno) [16:44:17] 06Analytics-Kanban, 06Research-and-Data: Confirm with research a rational for edits not being counted as pageviews - https://phabricator.wikimedia.org/T157144#2996831 (10JAllemandou) [16:44:21] nuria: --^ [16:44:27] yessir [16:47:51] joal: I would just sent an e-mail now, i think this can be background work rather than needed points and such , will document on ticket [16:47:59] milimetric: round1 is really nice and it is understandable [16:48:20] great, thank you elukey! [16:49:55] milimetric: for example, very stupid thing - the main page is great, but I feel a bit caught by too many numbers [16:50:19] elukey: we were wondering about that, the numbers are just examples, so they're meant to be ignored [16:50:38] sure sure [16:50:40] but that would be good feedback if other people feel that way. Feel free to add it as a thought [16:50:58] I didn't mean the raw number but the overall feeling [16:51:03] gotcha [16:51:08] interesting, you should add that [16:51:29] maybe having them not so big [16:51:47] but I really like the layout [16:53:58] * elukey brb for a bit [16:54:23] (03CR) 10Nuria: "Thanks for the trough testing!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/335679 (https://phabricator.wikimedia.org/T156993) (owner: 10Joal) [16:54:27] (03CR) 10Nuria: [V: 032 C: 032] Add explicit namespace to webrequest and pageview [analytics/refinery] - 10https://gerrit.wikimedia.org/r/335679 (https://phabricator.wikimedia.org/T156993) (owner: 10Joal) [17:13:12] 10Analytics, 10Analytics-Cluster, 06Operations, 10Ops-Access-Requests: Requesting access to analytics-privatedata-users for musikanimal - https://phabricator.wikimedia.org/T156986#2996961 (10MusikAnimal) @MoritzMuehlenhoff Done! Should have clarified in the description, this is a new key pair and is not us... [17:17:04] 06Analytics-Kanban: Document the difference in aggregate data on wikistats and wikistats 2.0 - https://phabricator.wikimedia.org/T150963#2996977 (10Elitre) [[ https://www.mediawiki.org/w/index.php?title=User_talk%3AMilimetric_%28WMF%29&type=revision&diff=2383329&oldid=2383162 | Here's the message ]]. Dan will se... [17:47:25] going afk! [17:47:28] byeeee o/ [18:26:36] (03PS1) 10Joal: [WIP] Add xml-stubs dump job in scala [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335846 [18:27:28] (03PS2) 10Joal: [WIP] Add xml-stubs dump job in scala [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335846 [18:28:10] 06Analytics-Kanban, 06Research-and-Data: Confirm with research a rational for edits not being counted as pageviews - https://phabricator.wikimedia.org/T157144#2997134 (10JAllemandou) 05Open>03declined [18:28:25] 06Analytics-Kanban, 06Research-and-Data: Confirm with research a rational for edits not being counted as pageviews - https://phabricator.wikimedia.org/T157144#2996831 (10JAllemandou) Closed -- to be solved in an email. [18:39:12] 10Analytics, 06Discovery, 06Discovery-Analysis (Current work), 13Patch-For-Review: Add Maps tile usage counts as a Data Cube in Pivot - https://phabricator.wikimedia.org/T151832#2997183 (10Deskana) [18:39:39] 10Analytics, 06Discovery, 06Discovery-Analysis (Current work), 13Patch-For-Review: Add Maps tile usage counts as a Data Cube in Pivot - https://phabricator.wikimedia.org/T151832#2829353 (10Deskana) There is no work to do for the engineers in Interactive here, so removing #interactive-sprint. [18:46:14] 10Analytics, 07Easy: [REQUEST] Extract search queries from HTTP_REFERER field for a Wikibook - https://phabricator.wikimedia.org/T144714#2997225 (10Larsnooden) Does the above formula need tweaking? I am still curious about the occasional spikes in usage as well as other questions about how the book is found.... [18:50:32] (03Draft1) 10SimonWalkerAlt: Following up. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335849 [18:51:35] (03PS2) 10SimonWalkerAlt: Following up. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335849 [18:52:30] (03Draft1) 10SimonWalkerAlt: Creating follow up: Patch 4. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335850 [18:55:36] 06Analytics-Kanban, 06Discovery, 06Discovery-Analysis (Current work), 13Patch-For-Review: Add Maps tile usage counts as a Data Cube in Pivot - https://phabricator.wikimedia.org/T151832#2997258 (10Nuria) [18:55:47] 06Analytics-Kanban, 06Discovery, 06Discovery-Analysis (Current work), 13Patch-For-Review: Add Maps tile usage counts as a Data Cube in Pivot - https://phabricator.wikimedia.org/T151832#2829353 (10Nuria) Let's remove dataset from druid. [19:18:55] (03Abandoned) 10Legoktm: Creating follow up: Patch 4. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335850 (owner: 10SimonWalkerAlt) [19:19:01] (03Abandoned) 10Legoktm: Following up. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/335849 (owner: 10SimonWalkerAlt) [19:58:59] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2995218 (10GWicke) Most (if not all) use cases of //individual job deduplication// can alternatively be solved by making updates idempotent. This is what we have don... [20:01:32] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2997397 (10Pchelolo) > Most (if not all) use cases of individual job deduplication can alternatively be solved by making updates idempotent. For some of the jobs th... [20:10:08] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2997400 (10GWicke) >>! In T157090#2997397, @Pchelolo wrote: >> Most (if not all) use cases of individual job deduplication can alternatively be solved by making upda... [20:17:19] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2997435 (10Pchelolo) > In the short term, this might be true. In the long term, I'm not completely convinced that this kind of functionality necessarily belongs in t... [20:21:46] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2997442 (10GWicke) > Deduplication naturally fits into the 'job management' category. Sure, but as I hinted at earlier it is often in a bad position to do so well,... [20:25:03] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2997449 (10Pchelolo) > Sure, but as I hinted at earlier it is often in a bad position to do so well, as it can only deduplicate the job being triggered through the j... [20:34:21] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Support per-topic configuration in EventBus service - https://phabricator.wikimedia.org/T157092#2997457 (10GWicke) p:05Triage>03Low Lets perhaps put this on the backburner until we know we are actually going to be pressed for space? [20:43:17] 10Analytics, 10ChangeProp, 10EventBus, 06Services (later): Generalise deduplication in ChangeProp - https://phabricator.wikimedia.org/T157090#2997497 (10GWicke) >>! In T157090#2997449, @Pchelolo wrote: >> Sure, but as I hinted at earlier it is often in a bad position to do so well, as it can only deduplica... [20:49:37] 06Analytics-Kanban, 06Research-and-Data: Coordinate with research to vet metrics calculated from the data lake - https://phabricator.wikimedia.org/T153923#2997518 (10Milimetric) The data lake knows about the redirect status of a page today, the page_is_redirect field. It doesn't know how page_is_redirect chan... [20:58:51] 06Analytics-Kanban, 06Discovery, 06Discovery-Analysis (Current work), 13Patch-For-Review: Add Maps tile usage counts as a Data Cube in Pivot - https://phabricator.wikimedia.org/T151832#2997530 (10debt) 05Open>03Resolved Sounds good, @Nuria - thanks for your help! [20:59:33] kaldari: do ask milimetric to make sure your pivot query is ok [20:59:42] kaldari: i do not know that dataset as well [20:59:45] will do [20:59:49] hi kaldari, what's up [21:00:05] in meeting, will ping you in a little while [21:00:09] k [21:05:53] milimetric: So I was trying to use pivot to look at article creation numbers: http://tinyurl.com/zf6xol3 [21:06:01] but the numbers seem way too high [21:06:15] I was expecting something in the range of 1-2K per day [21:06:27] am I doing anything wrong there? [21:06:30] yep :) [21:06:43] ok, first, need to filter the event_entity [21:06:59] we have revision, page, and user events all in the same place, so drag the event_entity in there and select just revision [21:07:30] second, you have to select the right metric [21:07:38] or measure, as pivot calls it [21:08:02] that's in the bottom left, and you need "Events" if you're just looking for oh... sorry [21:08:13] you're looking for event_entity=page, event_type=create [21:08:39] when you filtered to those, pick "Events" as the Measure and you're good [21:09:05] milimetric: how do I pick the "meaasure"? [21:09:35] Ah, I found it [21:09:43] you click on "Events" under "Measures" [21:09:48] bottom left [21:09:48] k [21:10:00] does it look right now? [21:10:02] yes! [21:10:04] thanks!! [21:10:59] kaldari: if you remove page_namespace = 0 from the filter and put page_namespace in the breakdown, you'll be able to see page creations for each namespace, which is kind of cool too [21:11:31] interesting that there are more User: pages created than main namespace ones :) [21:13:15] milimetric: What are the 2 different kind of splits? There is one with a dotted box and one with a + sign. [21:13:26] When I go to add a split [21:13:40] kaldari: one is "add split" [21:13:48] kaldari: other is remove all splits and split by this [21:14:16] but if you want to look a t a timeline (as opposed to a bar chart for example) you need a time split [21:14:16] yep [21:14:26] kaldari: makes sense? [21:15:20] yes, very nice! [21:15:59] kaldari: okeis, please evangelize within your team [21:16:06] will do [21:49:05] milimetric: do you know how to delete a dataset from druid? I thought i deleted the pivot data but it says "disabled" [21:50:04] um, yes, but I don't remember exactly [21:50:18] you gotta make a tunnel and there's an admin interface [21:50:22] better wait for joseph [21:50:26] milimetric: i found it, ok it is a kill task [21:50:37] and we should clean up druid and pivot config in general [21:50:44] a bunch of nameless cubes there [21:51:19] milimetric: no i am looking at admin interface already, [21:51:26] milimetric: i documented that here: https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Druid#Druid_Administration [21:51:39] oh cool, good [21:51:43] milimetric: it is just the ui lets you disable but not kill ( i think) a dataset