[01:13:54] <wikibugs_>	 10Analytics, 10ChangeProp, 10EventBus, 10MediaWiki-JobQueue, and 4 others: Investigate use-cases for delayed job executions - https://phabricator.wikimedia.org/T172832#3540031 (10Mattflaschen-WMF) There are three considerations relevant to Echo: 1. Delayed notifications ({T156808}) 1a. Article reminder not...
[07:05:26] <fdans>	 moooorning!
[07:23:29] <wikibugs_>	 (03CR) 10Nikerabbit: "Is this still WIP or ready for review?" [analytics/limn-language-data] - 10https://gerrit.wikimedia.org/r/362877 (https://phabricator.wikimedia.org/T158835) (owner: 10Amire80)
[08:01:04] <wikibugs_>	 10Analytics-Kanban, 10Operations, 10ops-eqiad: Degraded RAID on analytics1055 - https://phabricator.wikimedia.org/T172809#3540324 (10Volans) p:05Triage>03Normal
[08:18:29] <wikibugs_>	 (03PS4) 10Joal: Improve resiliency of Banner streaming job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/359461 (https://phabricator.wikimedia.org/T169101)
[08:18:31] <wikibugs_>	 (03PS1) 10Joal: Add tranquility to the banner streaming job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/373030
[08:22:31] <wikibugs_>	 (03CR) 10jerkins-bot: [V: 04-1] Add tranquility to the banner streaming job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/373030 (owner: 10Joal)
[08:27:16] <joal>	 !log Rerun druid loading jobs after night failures
[08:27:17] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[08:37:46] <wikibugs_>	 (03PS2) 10Joal: Add tranquility to the banner streaming job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/373030
[09:39:17] <wikibugs_>	 10Analytics-Kanban: Troubleshoot Wikimetrics "magic button" - https://phabricator.wikimedia.org/T173585#3540509 (10Marostegui) >>! In T173585#3539637, @mforns wrote: > @Marostegui  >  > Hi! I'm looking into this problem and it looks very much like the one Dan was fixing a couple days ago in: > https://phabricato...
[10:06:40] <wikibugs_>	 10Analytics-Kanban: Troubleshoot Wikimetrics "magic button" - https://phabricator.wikimedia.org/T173585#3540595 (10mforns) Thanks @Marostegui !
[10:22:31] <addshore>	 moin moin
[10:23:51] <joal>	 Hi addshore 
[10:26:11] <wikibugs_>	 10Analytics, 10Contributors-Analysis, 10DBA, 10Chinese-Sites, 10Patch-For-Review: Data Lake edit data missing for many wikis - https://phabricator.wikimedia.org/T165233#3540619 (10Marostegui) Hi,   Is there anything pending here?
[10:28:31] <wikibugs_>	 10Analytics, 10Contributors-Analysis, 10DBA, 10Chinese-Sites, 10Patch-For-Review: Data Lake edit data missing for many wikis - https://phabricator.wikimedia.org/T165233#3540631 (10JAllemandou) @Marostegui : We're waiting for august run to happen (at the first days of september) before closing, but we exp...
[10:30:22] <wikibugs_>	 10Analytics, 10Contributors-Analysis, 10DBA, 10Chinese-Sites, 10Patch-For-Review: Data Lake edit data missing for many wikis - https://phabricator.wikimedia.org/T165233#3540632 (10Marostegui) Excellent! Thanks for the update!
[10:56:30] <wikibugs_>	 10Analytics, 10DBA, 10Research, 10cloud-services-team (Kanban): Implement technical details and process for "datasets_p" on wikireplica hosts - https://phabricator.wikimedia.org/T173511#3540700 (10jcrespo) One thought- after setting up the new labsdbs, we said we were going to consider the #DBA part of the...
[11:24:19] <addshore>	 nuria_: I have a question related to privacy for when you are here! Vaguely linked to analytics stuff
[11:25:02] <joal>	 addshore: nuria_ is in holidays for 10 days - ottomata is the one for now :)
[11:25:29] <addshore>	 ack! well, I'll just ask my question in here and see who comes up with answers :D
[11:28:34] <addshore>	 So this relates to the Campaigns mediawiki extension. Currently when a user lands on the registration page with campaign=foo in the url and registered then this gets recorded in an event logging table.
[11:28:34] <addshore>	 When a user hits a regular wikipage with campaign=foo and then navigates to the registration page there is no tracking done.
[11:28:34] <addshore>	 Is there any reason that I shouldnt go and write the code that allows landing on pages other than the registration page and then tracking once the user gets there?
[11:28:34] <addshore>	 basically this would be, when a user lands on a wikipage with a campaign in the URL param a session cookie would be set, and the registration page would then look for this as well as the url param?! :)
[11:31:31] <joal>	 addshore: if I understand correctly, this would mean full tracking of our users - any user get a session cookie when coming to us - which I think we don't want
[11:32:02] <addshore>	 "any user get a session cookie when coming to us", well, only when they have a campaign=XXX set
[11:32:27] <joal>	 Arh, forgetting that campaign point sorry
[11:32:36] <joal>	 hm ... I don't know !
[11:32:48] <addshore>	 also, I guess this will only apply for anon users, as there is no need to do it for logged in users
[12:13:52] <joal>	 taking a b
[12:13:54] <joal>	 reak
[12:42:15] <mforns>	 addshore, do you know which EventLogging schema is used to store the campaigns data?
[12:44:16] <mforns>	 I assume the related schema is correctly white-listed to purge/sanitize it after 90 days to avoid storing privacy sensitive information
[12:45:02] <mforns>	 maybe the reason it is not logging events in the normal wiki pages, is that it would be too much traffic?
[12:45:48] <mforns>	 EventLogging currently supports an average flow of 10 events per second per schema (with some exceptions)
[13:14:40] <wikibugs_>	 (03CR) 10Ottomata: [C: 031] Improve resiliency of Banner streaming job [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/359461 (https://phabricator.wikimedia.org/T169101) (owner: 10Joal)
[13:16:43] <wikibugs_>	 (03CR) 10Ottomata: "Cool!  Did you get this to work?!" (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/373030 (owner: 10Joal)
[13:39:43] <addshore>	 mforns: yes!
[13:40:31] <addshore>	 mforns: the schema is https://meta.wikimedia.org/wiki/Schema:AccountCreation
[13:41:23] <addshore>	 And it wont be logging events on normal wiki pages, still only on account creation. But if the user hits http://en.wikipedia.org/wiki/LandingPage?campaign=foo and then navigates to the create account page and then create an account that would be recorded in event logging, where right now it is not
[13:42:35] <addshore>	 I woudn't expect the number of events to increase really, I mean, these campaigns are only used in select locations / on select occasions. For example WMDEs usecase is for banners which go to a landing page, and then to record how many people register after hitting the landing page.
[13:42:54] <mforns>	 addshore, understand
[13:43:12] <mforns>	 the AccountCreation schema is not white-listed, so it's set up for full auto-purging after 90 days
[13:44:08] <ottomata>	 fy i'm looking into these failed oozie jobs
[13:44:14] <ottomata>	 druid jobs*
[13:44:23] <ottomata>	 this looks similar to what happened when we first upgraded to 0.9.2
[13:44:30] <mforns>	 ottomata, I think joal re-run them this morning?
[13:44:33] <ottomata>	 so i must have missed something, (or something isn't puppetized 100%)
[13:44:33] <ottomata>	 yes
[13:44:39] <ottomata>	 and they will succeed sometimes
[13:44:42] <ottomata>	 if it is the same problem
[13:44:44] <mforns>	 ok
[13:44:49] <ottomata>	 but fail others
[13:45:18] <mforns>	 addshore, then I think it's totally safe to add those logs
[13:45:37] <addshore>	 mforns: awesome! I'll get on to writing the code at some point then! :)
[13:48:46] <mforns>	 addshore, just a heads-up, we've notified this lots of times in different channels, but just in case: this schema is not white-listed, so its data will be full-purged after 90 days. If you wish to keep data for longer, it should be analyzed for privacy sensitive structures and white-listed accordingly. Having a first look at the schema, I think at least the internalReferrer field would have to be purged in any case.
[13:57:44] <ottomata>	 !log sudo -u hdfs hdfs  dfs -rm /tmp/druid-indexing/classpath/guava.jar (guava 11.0.2 is conflicting with guava 16.0.1. from druid-hdfs-storage-cdh extension).  Not sure how guava 11.0.2 got there, but let's see if it doesn't come back
[13:57:46] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[14:17:34] <wikibugs_>	 (03PS1) 10Mforns: [wIP] Close all sessions to avoid database connection errors [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/373078 (https://phabricator.wikimedia.org/T173585)
[14:18:26] <wikibugs_>	 (03CR) 10jerkins-bot: [V: 04-1] [wIP] Close all sessions to avoid database connection errors [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/373078 (https://phabricator.wikimedia.org/T173585) (owner: 10Mforns)
[14:46:46] <mforns_>	 ottomata, yt?
[14:52:22] <wikibugs_>	 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, and 2 others: rack/setup/install new kafka nodes kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T167992#3541450 (10Cmjohnson)
[14:54:10] <ottomata>	 mforns:  sorry
[14:54:10] <ottomata>	 ya
[14:54:11] <ottomata>	 hey
[14:54:22] <mforns>	 ottomata, hello
[14:54:59] <mforns>	 I have one question about wikimetrics-web service, do you recall how to restart it?
[14:55:06] <mforns>	 I can not see it...
[14:55:23] <mforns>	 I can see wikimetrics-queue, wikimetrics-scheduler
[14:55:29] <mforns>	 but not wikimetrics-web
[14:56:26] <mforns>	 I know mostly dan and madhuvishy knew more about this, but just in case
[14:56:53] <wikibugs_>	 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, 10User-Elukey: kafka-jumbo1004 h/w problem most likely raid card - https://phabricator.wikimedia.org/T173837#3541461 (10Cmjohnson)
[14:57:02] <ottomata>	 hmmmm
[14:57:11] <ottomata>	 can't say I do mforns...
[14:57:31] <mforns>	 ottomata, I can't even find apache...
[14:57:38] <ottomata>	 mforns: maybe
[14:57:45] <ottomata>	 uwsgi-wikimetrics-web
[14:57:45] <ottomata>	 ?
[14:57:57] <mforns>	 mmmmmm yea maybe
[14:58:02] <ottomata>	 just looking in puppet
[14:58:04] <ottomata>	 not sure
[14:58:53] <mforns>	 ottomata, yes!
[14:59:08] <mforns>	 thank youuuuuuu!
[15:01:54] <ottomata>	 AH
[15:01:59] <ottomata>	 SATANDUP
[15:02:01] <ottomata>	 whoa!
[15:02:04] <ottomata>	 satan dup
[15:13:39] <wikibugs_>	 (03CR) 10Ottomata: [wIP] Close all sessions to avoid database connection errors (031 comment) [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/373078 (https://phabricator.wikimedia.org/T173585) (owner: 10Mforns)
[15:55:08] <wikibugs_>	 (03PS2) 10Mforns: [wIP] Close all sessions to avoid database connection errors [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/373078 (https://phabricator.wikimedia.org/T173585)
[15:56:16] <wikibugs_>	 (03CR) 10jerkins-bot: [V: 04-1] [wIP] Close all sessions to avoid database connection errors [analytics/wikimetrics] - 10https://gerrit.wikimedia.org/r/373078 (https://phabricator.wikimedia.org/T173585) (owner: 10Mforns)
[16:07:19] <fdans>	 joal mforns whenever you folks want we can catch up for a couple mins
[16:07:27] <mforns>	 fdans, sure
[16:07:30] <mforns>	 anytime
[16:29:52] <joal>	 when you want guys :)
[16:37:44] <wikibugs_>	 10Analytics, 10Analytics-Cluster, 10Operations, 10ops-eqiad, 10User-Elukey: kafka-jumbo1004 h/w problem most likely raid card - https://phabricator.wikimedia.org/T173837#3541879 (10Cmjohnson) open a self dispatch with Dell for a new raid card
[16:39:00] <joal>	 actually, will be back after family diner
[16:58:14] <ottomata>	 joal:  no luck i guess huh?
[16:58:35] <fdans>	 damn, I just saw your message joal 
[16:58:43] <fdans>	 do you want to do it now mforns ?
[16:58:58] <mforns>	 fdans, ok!
[16:59:52] <fdans>	 I'm at the batcave having batcaviar
[17:02:24] <mforns>	 hehe ok
[18:23:48] <wikibugs_>	 10Analytics, 10Analytics-EventLogging, 10AbuseFilter, 10CirrusSearch, and 29 others: Possible WMF deployed extension PHP 7 issues - https://phabricator.wikimedia.org/T173850#3542316 (10Reedy)
[18:34:15] <wikibugs_>	 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 2 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3542387 (10Nettrom) I'm working on this and got ReportUpdater working locally. A couple of questions:   # Most of the examples I'v...
[18:46:14] <joal>	 fdans, mforns: still here?
[18:46:48] <fdans>	 joal I am! had a chat with mforns already
[18:46:59] <joal>	 ok fdans
[18:46:59] <fdans>	 we can talk tomorrow after standup if you want
[18:47:07] <joal>	 sounds good :)
[18:49:56] <joal>	 ottomata: nice post on event-oriented architecture !
[18:55:18] <joal>	 ottomata: no luck no ... Interesting post on class-path on spark: https://stackoverflow.com/questions/37132559/add-jars-to-a-spark-job-spark-submit
[18:55:26] <joal>	 ottomata: I'm gonna stop for now ...
[18:56:54] <wikibugs_>	 10Analytics, 10Analytics-EventLogging, 10AbuseFilter, 10CirrusSearch, and 29 others: Possible WMF deployed extension PHP 7 issues - https://phabricator.wikimedia.org/T173850#3541977 (10Anomie) I'm not impressed with the false positive rate for this tool. The warnings in OAuth, CentralAuth, and Scribunto al...
[18:57:37] <ottomata>	 ok joal 
[18:57:48] <joal>	 ottomata: I'm a bit sad :(
[18:59:12] <ottomata>	 joal
[18:59:12] <ottomata>	 	•	--jars vs SparkContext.addJar: These are identical, only one is set through spark submit and one via code. Choose the one which suites you better. One important thing to note is that using either of these options does not add the JAR to your driver/executor classpath, you'll need to explicitly add them using the extraClassPath config on both.
[18:59:30] <joal>	 Indeed
[18:59:34] <ottomata>	 did you try that?
[18:59:39] <ottomata>	 hha i guess tyou did
[18:59:42] <ottomata>	 you pasted this link to me :)
[19:00:18] <joal>	 What is needed (if I understand correctly), is the --jars AND the --extraClassPath
[19:03:10] <ottomata>	 right, did you try that?
[19:03:31] <joal>	 yes I did
[19:03:37] <joal>	 it didn't work :(
[19:04:34] <ottomata>	 rats
[19:05:10] <joal>	 logs say the 2 jars are present, but still no luck
[19:06:15] <ottomata>	 :/
[19:15:50] <wikibugs_>	 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 2 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3542638 (10kaldari) >What measurements are we interested in? Whatever you need for ACTRIAL, plus some basic ones:   - Page creatio...
[19:49:01] <ottomata>	 mforns:  you still there?
[19:49:06] <mforns>	 ottomata, yes!
[19:49:13] <mforns>	 sup?
[19:49:14] <ottomata>	 got a few mins for a python brain bounce?
[19:49:19] <mforns>	 sure!
[19:49:25] <mforns>	 batcave?
[19:49:27] <ottomata>	 ya
[19:49:29] <mforns>	 omw
[19:52:25] <joal>	 !log Drop / recreate wmf.mediawiki_history table for naming correction
[19:52:26] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[20:42:49] <wikibugs_>	 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 2 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3542935 (10Ottomata) @mforns has more reportupdater know how than me, I'll let him respond :)
[20:51:49] <wikibugs_>	 10Analytics, 10Analytics-EventLogging, 10Contributors-Analysis, 10EventBus, and 2 others: Visualize page create events for all wikis - https://phabricator.wikimedia.org/T170850#3542975 (10mforns) @Nettrom @kaldari   > Most of the examples I've seen create datasets with a single measurement, meaning there a...
[20:52:07] <wikibugs_>	 10Analytics, 10Operations, 10Ops-Access-Requests, 10Research, and 2 others: NDA, MOU and LDAP (analytics cluster) for Shilad Sen - https://phabricator.wikimedia.org/T171988#3542976 (10herron) Shell account `shiladsen` has been added to puppet and deployed to stat systems:    stat1003:~$ id shiladsen   uid=...
[20:52:39] <wikibugs_>	 10Analytics, 10Operations, 10Ops-Access-Requests, 10Research, and 2 others: NDA, MOU and LDAP (analytics cluster) for Shilad Sen - https://phabricator.wikimedia.org/T171988#3542977 (10herron)
[21:47:33] <wikibugs_>	 10Analytics, 10Operations, 10Ops-Access-Requests, 10Research, and 2 others: NDA, MOU and LDAP (analytics cluster) for Shilad Sen - https://phabricator.wikimedia.org/T171988#3543170 (10DarTar) Thanks @herron.   @Shilad: Aaron is currently traveling, but let me know if you need any assistance. If we have an...
[23:17:23] <wikibugs_>	 10Analytics, 10ChangeProp, 10EventBus, 10MediaWiki-JobQueue, and 4 others: Investigate use-cases for delayed job executions - https://phabricator.wikimedia.org/T172832#3543355 (10ggellerman) @dr0ptp4kt @Phuedx @Fjalapeno @kaldari  @TrevorParscal  adding you to make you aware of this request from Services t...