[10:19:57] hello folks (elukey + joal ) I just started a lil bit ago today. I will deploy the cluster and restart the job after lunch [11:47:30] 10Analytics, 10MinervaNeue, 10Product-Analytics, 10Readers-Web-Backlog, and 2 others: [Spike ??hrs] Sticky header instrumentation - https://phabricator.wikimedia.org/T199157 (10Aklapper) a:05Tbayer→03None Resetting task assignee as the user is not active here anymore. [13:16:55] wait, I just remembered that we probably need to switch master branches in refinery source and re-do the release, let's talk in standup and I'll deploy after that [14:40:13] heya teammm [15:00:19] hola mforns [15:00:26] standup! [15:00:41] ping joal ? [15:01:16] ping fdans [15:01:25] sorryyyy [15:08:47] * fdans standup in Spanish wololoooo [15:18:03] 10Analytics, 10Product-Analytics: Identify imported revisions in mediawiki_history - https://phabricator.wikimedia.org/T221482 (10fdans) p:05Triage→03Normal [15:18:20] 10Analytics, 10Patch-For-Review: trying to get a clean master branch - https://phabricator.wikimedia.org/T221466 (10fdans) p:05Triage→03Unbreak! [15:19:33] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Remove dead code from refinery/oozie folders - https://phabricator.wikimedia.org/T221460 (10fdans) We have to remove mediawiki_history_druid [15:20:06] (03CR) 10Fdans: [V: 04-1] "Please hold until the problem with the master branch in refinery source is solved." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/504914 (https://phabricator.wikimedia.org/T221460) (owner: 10Joal) [15:20:37] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Remove dead code from refinery/oozie folders - https://phabricator.wikimedia.org/T221460 (10fdans) p:05Triage→03High [15:33:13] 10Analytics, 10Analytics-Wikistats: Add "Top used photos" metric - https://phabricator.wikimedia.org/T220485 (10mforns) @Urbanecm Do you mean images used in articles? [15:36:00] 10Analytics, 10Analytics-Wikistats: Add "Top linked article" metric - https://phabricator.wikimedia.org/T220484 (10mforns) Why do you think a list of most linked articles would be useful? We can see the value of the top images by num. of appearances, because the image uploaders might be interested in that. Can... [15:39:58] 10Analytics, 10Growth-Team, 10Product-Analytics: Revisions missing from mediawiki_revision_create - https://phabricator.wikimedia.org/T215001 (10mforns) @JAllemandou, is that something you're working on? [15:40:47] 10Analytics, 10Growth-Team, 10Product-Analytics: Revisions missing from mediawiki_revision_create - https://phabricator.wikimedia.org/T215001 (10mforns) p:05High→03Triage [15:40:50] 10Analytics, 10Growth-Team, 10Product-Analytics: Revisions missing from mediawiki_revision_create - https://phabricator.wikimedia.org/T215001 (10mforns) p:05Triage→03High [15:41:02] 10Analytics, 10Analytics-Wikistats: Add "Top used photos" metric - https://phabricator.wikimedia.org/T220485 (10Urbanecm) Yes, @mforns. [15:43:54] 10Analytics, 10MediaWiki-Database, 10Research, 10Wikidata: Improve interlingual links across wikis through Wikidata IDs - https://phabricator.wikimedia.org/T215616 (10mforns) @diego Hi! Is there anythin additional for us Analytics here? Thaanks [15:46:11] 10Analytics, 10Product-Analytics: Add UTC 'Z' suffix to webrequest `dt` field. - https://phabricator.wikimedia.org/T217040 (10mforns) p:05High→03Normal [15:47:51] 10Analytics, 10EventBus, 10Product-Analytics, 10Core Platform Team Backlog (Watching / External), 10Services (watching): Use Z UTC suffix in EventBus emitted events rather than +00:00 - https://phabricator.wikimedia.org/T217041 (10mforns) 05Open→03Invalid @Ottomata, this task can be closed right? Bec... [15:47:53] 10Analytics, 10Product-Analytics, 10MW-1.33-notes (1.33.0-wmf.21; 2019-03-12), 10Patch-For-Review: Standardize datetimes/timestamps in the Data Lake - https://phabricator.wikimedia.org/T212529 (10mforns) [15:48:14] 10Analytics: Publish data on seen page previews - https://phabricator.wikimedia.org/T193524 (10mforns) p:05Normal→03Low [15:50:54] 10Analytics: Sesssion reconstruction - evaluate privacy threat - https://phabricator.wikimedia.org/T194058 (10mforns) p:05Normal→03Triage [15:50:56] 10Analytics: Sesssion reconstruction - evaluate privacy threat - https://phabricator.wikimedia.org/T194058 (10mforns) p:05Triage→03Normal [15:53:12] 10Analytics: Use Snakebite instead of subprocess.Popen in HdfsUtils - https://phabricator.wikimedia.org/T200904 (10mforns) p:05Normal→03Low [15:53:58] 10Analytics: Unify logic in partition dropping scripts - https://phabricator.wikimedia.org/T202292 (10mforns) 05Open→03Resolved a:03mforns [15:57:21] 10Analytics, 10Product-Analytics: automatic ingestion from annotations on schemas into druid - https://phabricator.wikimedia.org/T218319 (10mforns) [15:57:23] 10Analytics: Transform EventLoggingToDruid job to read schemas to ingest from a whitelist and process them all - https://phabricator.wikimedia.org/T202312 (10mforns) [15:57:37] 10Analytics: Transform EventLoggingToDruid job to read schemas to ingest from a whitelist and process them all - https://phabricator.wikimedia.org/T202312 (10mforns) Waiting for a schema registry, so we can implement this. [15:57:46] 10Analytics: Transform EventLoggingToDruid job to read schemas to ingest from a whitelist and process them all - https://phabricator.wikimedia.org/T202312 (10mforns) p:05Normal→03Triage [15:57:48] 10Analytics: Transform EventLoggingToDruid job to read schemas to ingest from a whitelist and process them all - https://phabricator.wikimedia.org/T202312 (10mforns) p:05Triage→03Normal [15:58:17] 10Analytics, 10Product-Analytics: Streamline Superset signup and authentication - https://phabricator.wikimedia.org/T203132 (10mforns) p:05Normal→03Triage [15:58:19] 10Analytics, 10Product-Analytics: Streamline Superset signup and authentication - https://phabricator.wikimedia.org/T203132 (10mforns) p:05Triage→03Normal [15:59:24] 10Analytics: Sqoop e-mail is emailing errors in try1 for actions that suceeed in try 3 - https://phabricator.wikimedia.org/T203811 (10mforns) p:05Normal→03High [15:59:52] 10Analytics: Sqoop e-mail is emailing errors in try1 for actions that suceeed in try 3 - https://phabricator.wikimedia.org/T203811 (10mforns) p:05High→03Normal [16:00:03] 10Analytics: Sqoop e-mail is emailing errors in try1 for actions that suceeed in try 3 - https://phabricator.wikimedia.org/T203811 (10mforns) p:05Normal→03High [16:00:19] 10Analytics: Move the Analytics Refinery to Python 3 - https://phabricator.wikimedia.org/T204735 (10mforns) p:05Normal→03Low [16:00:48] 10Analytics: Move Analytics Report Updater to Python 3 - https://phabricator.wikimedia.org/T204736 (10mforns) p:05Normal→03Low [16:02:08] 10Analytics: Verify what Python 2 packages deployed to Analytics hosts are needed - https://phabricator.wikimedia.org/T204737 (10mforns) p:05Normal→03Low [16:03:24] 10Analytics: Import 2001 wikipedia data - https://phabricator.wikimedia.org/T155014 (10mforns) Can we do this in a hackathon? [16:03:31] 10Analytics: Import 2001 wikipedia data - https://phabricator.wikimedia.org/T155014 (10mforns) p:05Low→03Triage [16:03:33] 10Analytics: Import 2001 wikipedia data - https://phabricator.wikimedia.org/T155014 (10mforns) p:05Triage→03Low [16:52:33] 10Analytics, 10Knowledge-Integrity, 10Research, 10Epic, 10Patch-For-Review: Citation Usage: run third round of data collection - https://phabricator.wikimedia.org/T213969 (10bmansurov) @Miriam, an FYI that I'll be turning off data collection tomorrow. It's been a month. [17:16:43] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Fundraising-Backlog, and 2 others: Fix EventLogging schemas that use array for items type - https://phabricator.wikimedia.org/T218617 (10Nuria) @chelsyx after much thinking on whether we could support here here is what we have come to decide (let... [17:20:34] 10Analytics, 10Analytics-Kanban: Add caused_by_user_text to mediawiki_page_history - https://phabricator.wikimedia.org/T167608 (10Nuria) p:05Low→03Normal [17:24:11] 10Analytics, 10Analytics-Kanban: Add caused_by_user_text to mediawiki_page_history - https://phabricator.wikimedia.org/T167608 (10Nuria) Pinging #product-analytics to get feedback for column name. "caused_by_user_text" seems a bit obscure (but maybe it's just me). How about "caused_by_additional_info"? [19:48:47] 10Analytics, 10Analytics-Wikistats: Add "Top used photos" metric - https://phabricator.wikimedia.org/T220485 (10mforns) Thanks @Urbanecm, We'll look this task and prioritize it with the team this Thursday. [20:08:37] 10Analytics, 10Product-Analytics: Identify imported revisions in mediawiki_history - https://phabricator.wikimedia.org/T221482 (10Neil_P._Quinn_WMF) [20:09:13] 10Analytics, 10Product-Analytics: Identify imported revisions in mediawiki_history - https://phabricator.wikimedia.org/T221482 (10Neil_P._Quinn_WMF) [22:36:09] 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: Many revision events in mediawiki_history have missing page and namespace information - https://phabricator.wikimedia.org/T221338 (10Neil_P._Quinn_WMF) @Nuria, @JAllemandou, this is the most significant issue that I identified in T218819 (T218463 is... [22:38:24] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Fundraising-Backlog, and 2 others: Fix EventLogging schemas that use array for items type - https://phabricator.wikimedia.org/T218617 (10Ottomata) I don't think Chelsy is going to have much of an opinion here. The change to the code will only af... [23:03:43] (03PS1) 10GoranSMilovanovic: final [analytics/wmde/WD/WD_identifierLandscape] - 10https://gerrit.wikimedia.org/r/505684 [23:03:57] (03CR) 10GoranSMilovanovic: [V: 03+2 C: 03+2] final [analytics/wmde/WD/WD_identifierLandscape] - 10https://gerrit.wikimedia.org/r/505684 (owner: 10GoranSMilovanovic)