[01:51:03] 10Analytics, 10Analytics-Kanban, 10Page-Issue-Warnings, 10Product-Analytics, and 3 others: Ingest data from PageIssues EventLogging schema into Druid - https://phabricator.wikimedia.org/T202751 (10Tbayer) >>! In T202751#4656446, @Nuria wrote: >>BTW, I understand we are focusing on use in Turnilo for now, b... [02:59:28] 10Analytics, 10Analytics-Cluster, 10Contributors-Analysis, 10Product-Analytics: Hive join fails when using a HiveServer2 client - https://phabricator.wikimedia.org/T206279 (10Tbayer) FWIW, I encountered the same kind of error in beeline around the same time last week (October 2 I believe). Below is the que... [03:33:18] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Modern Event Platform: Event Schema Registry: Implementation - https://phabricator.wikimedia.org/T206789 (10Pchelolo) > Up to date JSONSchema support (Draft 7?) +1, but we need to evaluate... [03:37:47] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Modern Event Platform: Event Schema Registry: Implementation - https://phabricator.wikimedia.org/T206789 (10Pchelolo) > Q: should we use the term 'repository' or 'registry' here? I'm consid... [03:48:09] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Decide whether to use schema references in the schema registry - https://phabricator.wikimedia.org/T206824 (10Pchelolo) If we do adopt the policy to have the `latest` schema using the refer... [03:53:44] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Modern Event Platform: Event Schema Registry: Implementation - https://phabricator.wikimedia.org/T206789 (10Pchelolo) How're we satisfying the requirement of > As an engineer, I want to b... [06:44:10] (03CR) 10Gilles: [V: 032] Keep recently added navtiming + survey fields (032 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/466607 (https://phabricator.wikimedia.org/T187299) (owner: 10Gilles) [06:58:26] 10Analytics, 10Analytics-Wikistats, 10Internet-Archive: Allow WikiStats2 to be archived by the wayback machine - https://phabricator.wikimedia.org/T206836 (10Nemo_bis) [07:32:41] !log cleaned up all september files from eventlog1002's srv el archive to free some space (disk alerts) [07:32:43] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:11:28] 10Analytics, 10Operations, 10Patch-For-Review, 10User-Elukey: rack/setup/install an-master100[12].eqiad.wmnet - https://phabricator.wikimedia.org/T201939 (10elukey) 05Open>03Resolved [08:11:52] 10Analytics, 10Operations, 10ops-eqiad, 10Patch-For-Review, 10User-Elukey: setup/install an-coord1001/wmf7621 - https://phabricator.wikimedia.org/T204970 (10elukey) 05Open>03Resolved [08:38:36] so while reviewing the info provided for banner impressions and the KIS, I was wondering if Druid would need to be upgraded to 0.12.3 before doing so [08:38:49] there seems to be a ton of improvements to the Kafka Indexing Service [08:39:01] The caffeine cache is the default [08:39:11] They have fixed bugs in Kerberos auth [08:39:47] and also there is the basic auth extension [08:47:59] 10Analytics, 10New-Readers: Turnilo export and displayed data do not match - https://phabricator.wikimedia.org/T206760 (10Aamroz) Hi, github/adrianmroz here. Could I get access also to your turnilo instance? I couldn't reproduce issue on my data and code. > The export appears to be re-using the initial quer... [08:52:28] 10Analytics: Upgrade to Druid 0.12.3 - https://phabricator.wikimedia.org/T206839 (10elukey) p:05Triage>03Normal [08:52:34] there you go --^ [08:55:58] 10Analytics: Upgrade to Druid 0.12.3 - https://phabricator.wikimedia.org/T206839 (10elukey) [09:18:45] 10Analytics, 10User-Elukey: Upgrade to Druid 0.12.3 - https://phabricator.wikimedia.org/T206839 (10elukey) [10:02:09] Hi team - still not god today - will stay in bed :( [10:07:08] * elukey hugs joal [10:53:13] * addshore hands joal a hot cup of coco [11:10:26] * elukey afk for a bit! [12:01:42] question for whoever worked with Camus.. do I need to implement a decoder to be able to read Eventlogging's raw data? [14:42:21] * elukey is building druid 0.12.3-1 :) [14:45:25] joal: for when you'll feel better https://github.com/apache/incubator-druid/issues/6442 [14:45:28] :) [14:45:55] I am still thinking about deploying 0.12.3 if possible, seems a nice and stable version with a lot of fixes [15:05:23] in theory now both druid-parquet and druid-avro extensions are using avro 1.8, so more hacks to make them work together (we had to downgrade druid-parquet for 0.11) [15:06:10] going to upgrade the labs cluster, early next week we could test and possibly upgrade the analytics cluster easily [15:06:28] and after that, we'll have basic auth available + TLS [16:02:22] standup? [16:02:41] ah wait [16:02:47] I am the only one :D [16:02:51] just realized it now [16:04:51] joal: Druid cluster in labs updated to 0.12.3 :) [16:05:31] 10Analytics, 10User-Elukey: Upgrade to Druid 0.12.3 - https://phabricator.wikimedia.org/T206839 (10elukey) Created the 0.12.3 debs on boron and deployed the new version in Labs, ready for testing! [16:05:41] 10Analytics, 10Analytics-Kanban, 10User-Elukey: Upgrade to Druid 0.12.3 - https://phabricator.wikimedia.org/T206839 (10elukey) [16:06:58] * elukey off! [16:22:53] 10Analytics, 10Operations, 10SRE-Access-Requests, 10Patch-For-Review: Allow Analytics team members to restart Turnilo and Superset - https://phabricator.wikimedia.org/T206217 (10Dzahn) I had sent a mail to list to speed this up because there was no SRE meeting this week. But i have not had any responses, s... [18:49:10] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Modern Event Platform: Event Schema Registry: Implementation - https://phabricator.wikimedia.org/T206789 (10Ottomata) > I'm wondering if the HTTP service should be able to serve both extend... [18:51:21] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Services (watching): Modern Event Platform: Stream Intake Service: Implementation - https://phabricator.wikimedia.org/T206785 (10Ottomata) I'd prefer to keep the name or make up something new like it. A new service will be API compatible with what we no... [18:55:47] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Decide whether to use schema references in the schema registry - https://phabricator.wikimedia.org/T206824 (10Ottomata) Wow, two really great ideas in this task description! > we could use... [21:27:33] 10Analytics, 10Analytics-Data-Quality, 10Product-Analytics: mediawiki_history datasets have null user_text for IP edits - https://phabricator.wikimedia.org/T206883 (10Neil_P._Quinn_WMF) [23:18:06] 10Analytics, 10Analytics-EventLogging, 10EventBus, 10Core Platform Team (Modern Event Platform (TEC2)), and 2 others: Develop a library for JSON schema backwards incompatibility detection - https://phabricator.wikimedia.org/T206889 (10Pchelolo) p:05Triage>03Normal