[02:09:04] 10Analytics, 10Event-Platform, 10Technical-blog-posts: Story idea for Blog: Wikimedia's Event Platform - https://phabricator.wikimedia.org/T253649 (10Ottomata) @srodlund made a first pass at an outline for a few posts here: https://docs.google.com/document/d/1mUo2tkdWtmF2rbjXgiOxXp5s37HZcfZdrw6CKl7fzh0/edit#... [04:36:57] 10Analytics, 10Analytics-Kanban: Unique devices, retrofit with bot detection code - https://phabricator.wikimedia.org/T250744 (10Nuria) 05Open→03Resolved [04:36:59] 10Analytics: Label high volume bot spikes in pageview data as automated traffic - https://phabricator.wikimedia.org/T238357 (10Nuria) [04:37:14] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Spike: POC of refine with airflow - https://phabricator.wikimedia.org/T241246 (10Nuria) 05Open→03Resolved [04:37:34] 10Analytics, 10Analytics-Kanban: Move the Analytics infrastructure to Debian Buster - https://phabricator.wikimedia.org/T234629 (10Nuria) [04:37:36] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review: Move Archiva to Debian Buster - https://phabricator.wikimedia.org/T252767 (10Nuria) 05Open→03Resolved [04:37:55] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Decommission EventLogging backend components by migrating to MEP - https://phabricator.wikimedia.org/T238230 (10Nuria) [04:37:57] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Vertical: Migrate SearchSatisfaction EventLogging event stream to Event Platform - https://phabricator.wikimedia.org/T249261 (10Nuria) 05Open→03Resolved [04:38:10] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Automate ingestion and refinement into Hive of event data from Kafka using stream configs and canary/heartbeat events - https://phabricator.wikimedia.org/T251609 (10Nuria) [04:38:12] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Add examples to all event schemas - https://phabricator.wikimedia.org/T242454 (10Nuria) 05Open→03Resolved [04:38:15] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: Modern Event Platform: Schema Registry: Implementation - https://phabricator.wikimedia.org/T206789 (10Nuria) [04:38:26] 10Analytics, 10Analytics-Kanban: Rename pageview_actor_hourly to pageview_actor - https://phabricator.wikimedia.org/T256415 (10Nuria) [04:38:36] 10Analytics, 10Analytics-Kanban: Rename pageview_actor_hourly to pageview_actor - https://phabricator.wikimedia.org/T256415 (10Nuria) 05Open→03Resolved [04:38:52] 10Analytics-Kanban, 10Analytics-Radar, 10Product-Analytics: Definition of not text content metrics for tuning session (rich media, images, etc) - https://phabricator.wikimedia.org/T247417 (10Nuria) 05Open→03Resolved [04:38:54] 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10Epic: Tech Tunning Session metrics - https://phabricator.wikimedia.org/T247100 (10Nuria) [04:39:10] 10Analytics, 10Analytics-Kanban: unique devices for project families, bug in signature computation for automatic traffic detection - https://phabricator.wikimedia.org/T257358 (10Nuria) 05Open→03Resolved [04:39:44] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Update skewed-join strategy in Mediawiki-history to prevent errors in case of task-retry - https://phabricator.wikimedia.org/T255548 (10Nuria) 05Open→03Resolved [07:00:07] 10Analytics-Clusters, 10Jupyter-Hub: Timeout during relaunch Jupyterhub server - https://phabricator.wikimedia.org/T258087 (10elukey) @Rvvalentim I think it might be quicker to diagnose if we meet on IRC in the #wikimedia-analytics chan, can you log in there so we can repro together? [09:03:53] 10Analytics, 10Discovery-Search, 10Code-Health: Update Code Conventions for Java and Scala - https://phabricator.wikimedia.org/T258680 (10Gehel) [10:49:28] * elukey misses joal already [11:48:23] 10Analytics-Clusters, 10Patch-For-Review, 10User-Elukey: Upgrade Druid to its latest upstream version (currently 0.18.1) - https://phabricator.wikimedia.org/T244482 (10elukey) I tried 0.19.0 with the `-Dhadoop.mapreduce.job.classloader=true` option for the middlemanager, and I was finally able to make the i... [12:02:44] * elukey lunch! [12:18:00] 10Analytics, 10Code-Health: Introduce various static analysis tools to analytics/refinery - https://phabricator.wikimedia.org/T258699 (10Gehel) [12:22:25] 10Analytics-Clusters, 10Patch-For-Review, 10User-Elukey: Upgrade Druid to its latest upstream version (currently 0.18.1) - https://phabricator.wikimedia.org/T244482 (10Ottomata) COOL! [12:22:38] (03PS1) 10Gehel: Introduce ForbiddenAPI as a static analysis tool. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615722 (https://phabricator.wikimedia.org/T258699) [12:23:36] (03CR) 10jerkins-bot: [V: 04-1] Introduce ForbiddenAPI as a static analysis tool. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615722 (https://phabricator.wikimedia.org/T258699) (owner: 10Gehel) [12:26:05] (03PS2) 10Gehel: Introduce Takari Maven Wrapper. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615481 [12:26:07] (03PS3) 10Gehel: Use properties to configure compiler source and target versions. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615485 [12:26:09] (03PS2) 10Gehel: Introduce ForbiddenAPI as a static analysis tool. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615722 (https://phabricator.wikimedia.org/T258699) [12:26:25] (03CR) 10Gehel: "> Patch Set 1:" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615481 (owner: 10Gehel) [12:27:29] (03CR) 10jerkins-bot: [V: 04-1] Introduce ForbiddenAPI as a static analysis tool. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615722 (https://phabricator.wikimedia.org/T258699) (owner: 10Gehel) [12:28:39] 10Analytics, 10Operations, 10User-MoritzMuehlenhoff: Replace firejail use in superset with native systemd features - https://phabricator.wikimedia.org/T258700 (10MoritzMuehlenhoff) [12:59:40] (03PS3) 10Gehel: Introduce ForbiddenAPI as a static analysis tool. [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615722 (https://phabricator.wikimedia.org/T258699) [14:08:52] ottomata: o/ [14:08:53] ssh -N analytics1041.eqiad.wmnet -L 8081:localhost:8081 [14:16:38] oh ho ho [14:16:42] very n ice [14:17:08] elukey: ....we should make a url with CAS like we have for yarn for the druid uis [14:20:18] ottomata: we could, I need to verify if enabling Kerberos triggers also some side effects when checking the UIs [14:51:37] (03CR) 10Nuria: "These seem like ok changes to do but it is worth having in mind that the code committed and the code running on the cluster are two differ" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/615722 (https://phabricator.wikimedia.org/T258699) (owner: 10Gehel) [15:00:36] aye [15:01:04] brt a-team [15:01:18] ping ottomata , mforns , fdans [15:02:22] holaaaa STANDDUPPPP [15:39:56] (03CR) 10Milimetric: Fix project field of geoeditors public monthly and semantics (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/593246 (https://phabricator.wikimedia.org/T244597) (owner: 10Lex Nasser) [16:46:54] 10Analytics, 10Analytics-EventLogging: Events being lost in Chrome when navigating to an external URL - https://phabricator.wikimedia.org/T258513 (10Jdlrobson) Yeh I can confirm this works fine. It doesn't explain the dropped events @mayakp.wiki was seeing though. I'm hoping however these were due to a miscomm... [16:49:10] 10Analytics, 10Analytics-EventLogging: Events being lost in Chrome when navigating to an external URL - https://phabricator.wikimedia.org/T258513 (10Nuria) >I'm going to advise my team not to rely on the network tab for testing these sorts of things in future and to instead focus on the database invalid events... [16:50:05] * elukey off! [18:56:32] 10Analytics, 10Event-Platform, 10Technical-blog-posts: Story idea for Blog: Wikimedia's Event Platform - https://phabricator.wikimedia.org/T253649 (10srodlund) @Ottomata Awesome! I will take a look! [19:09:49] 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, 10Goal, and 3 others: Modern Event Platform (TEC2) - https://phabricator.wikimedia.org/T185233 (10Ottomata) [19:59:31] 10Analytics, 10MediaWiki-REST-API, 10Platform Team Workboards (Green), 10Story: System administrator reviews API usage by client - https://phabricator.wikimedia.org/T251812 (10eprodromou) [20:15:26] 10Analytics: Check home/HDFS leftovers of nathante - https://phabricator.wikimedia.org/T256356 (10Groceryheist) Thanks @elukey and @halfak for catching this. I'm not actively working on this project, but I expect that reviews will come back next week and I may have some work to do for the revisions. I also want... [20:45:13] 10Analytics, 10Product-Analytics, 10Structured Data Engineering, 10Structured-Data-Backlog (Current Work): Instrument MediaSearch results page - https://phabricator.wikimedia.org/T258183 (10CBogen) Here's a link to the [[ https://docs.google.com/document/d/1djZm--cRwzq52sO8IW2KSyk9sbWD9yz8XssSqRxruQs/edit#... [21:09:27] 10Analytics: Check home/HDFS leftovers of nathante - https://phabricator.wikimedia.org/T256356 (10Nuria) @Groceryheist we need an active collaboration with a foundation member and @Halfak has departed WMF, is the upcoming work part of an ongoing project that you are collaborating with the research team on? (cc... [21:40:59] 10Analytics: Check home/HDFS leftovers of nathante - https://phabricator.wikimedia.org/T256356 (10Groceryheist) @Nuria this is work with the scoring team so I think the WMF collaborator is likely to be @calbon. [22:02:26] 10Analytics: Check home/HDFS leftovers of nathante - https://phabricator.wikimedia.org/T256356 (10leila) @Groceryheist halfak and I connected before his last date about your case. The plan was to make sure you have access to your data if the paper review requires it. My question is: is your paper review back? do...