[00:13:13] (PS2) Madhuvishy: [WIP] Change config path in wsgi file [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/261604 [00:25:00] (PS1) Madhuvishy: Use find_packages to install module correctly [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/262683 [00:35:35] (CR) Yuvipanda: [C: 2] Use find_packages to install module correctly [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/262683 (owner: Madhuvishy) [00:36:27] (Merged) jenkins-bot: Use find_packages to install module correctly [analytics/wikimetrics] - https://gerrit.wikimedia.org/r/262683 (owner: Madhuvishy) [05:57:12] Analytics-Backlog, Analytics-Kanban, Patch-For-Review: Change analytics kafka cluster JMX metrics to be prefixed with cluster name and change alerts and dashboards [5 pts] - https://phabricator.wikimedia.org/T121643#1917480 (Krenair) [05:58:15] Analytics-Backlog, Analytics-EventLogging, Analytics-Kanban, MediaWiki-extensions-WikimediaEvents, Patch-For-Review: Provide oneIn() sampling function as part of standard library - https://phabricator.wikimedia.org/T112603#1917482 (Krenair) [14:13:41] Analytics-Cluster, Datasets-Archiving, Datasets-Webstatscollector: Mediacounts missing top1000 files after 2016-01-01 - https://phabricator.wikimedia.org/T122864#1917761 (ezachte) Open>Resolved a:ezachte Connection of stat1002 with /mnt/hdfs/wmf/data/archive/projectview/geo/hourly/ was lost... [17:31:08] Analytics-Backlog, operations, HTTPS: EventLogging sees too few distinct client IPs - https://phabricator.wikimedia.org/T119144#1918133 (Ottomata) Yeah! @nuria, how do we figure out if we should fix this, or drop IPs? It seems some want it dropped, but research needs them. Should we just fix, or is t... [17:36:11] Analytics: give DFoy access to Hue - https://phabricator.wikimedia.org/T122936#1918136 (Ottomata) Open>Resolved Done! [17:52:39] Analytics-Backlog, operations, HTTPS: EventLogging sees too few distinct client IPs - https://phabricator.wikimedia.org/T119144#1918172 (Nuria) @ottomata: I think it will be unfair to remove the IP if research is relying on it for near term projects, so let's fix it. salted IPs should be getting purged... [17:52:52] Analytics-Kanban, operations, HTTPS: EventLogging sees too few distinct client IPs - https://phabricator.wikimedia.org/T119144#1918173 (Nuria) [17:57:15] Analytics-Backlog: Create a central page in wikitech to act as a central hub so users know where to go for different types of data - https://phabricator.wikimedia.org/T122970#1918178 (Nuria) NEW [18:06:03] Analytics-Kanban, operations, HTTPS: EventLogging sees too few distinct client IPs - https://phabricator.wikimedia.org/T119144#1918199 (Ottomata) Ok, I think to fix this, we just need to change the varnishkafka format string to send the X-Client-IP header in place of the %h host IP header. [19:15:19] Analytics-Backlog, Analytics-EventLogging: Engineer finds events that fail validation as early as possible {oryx} - https://phabricator.wikimedia.org/T78355#1918455 (mforns) Since a couple months ago, we have all EventLogging errors in Logstash: https://logstash.wikimedia.org/#/dashboard/elasticsearch/eve... [19:17:57] Analytics-Kanban: Remove queue of batches from EventLogging - https://phabricator.wikimedia.org/T121151#1918482 (mforns) a:mforns [19:31:33] quick question: how should I request access to the analytics-alerts@ ML? [19:53:24] a-team: I have a question about EvengLogging: Are there any schemas which are not sampled? [19:53:57] are there any schemas which are? [19:56:33] yes [21:59:39] Analytics-Wikistats, Internet-Archive: String found too soon, while searching for ' Analytics-Wikistats, Internet-Archive: String found too soon, while searching for ' Analytics-Wikistats: String found too soon, while searching for ' Analytics-Wikistats: String found too soon, while searching for ' Analytics-Wikistats: String found too soon, while searching for ' joal: have some time to chat in the next two hours?