[00:29:12] 10Analytics, 10DC-Ops, 10Operations, 10decommission, 10ops-eqiad: Decommission old Kafka analytics brokers: kafka1012,kafka1013,kafka1014,kafka1020,kafka1022,kafka1023 - https://phabricator.wikimedia.org/T226517 (10Papaul) Checked switch configuration is done. This task can be closed [00:30:07] 10Analytics, 10DC-Ops, 10Operations, 10decommission, 10ops-eqiad: Decommission old Kafka analytics brokers: kafka1012,kafka1013,kafka1014,kafka1020,kafka1022,kafka1023 - https://phabricator.wikimedia.org/T226517 (10Papaul) [00:30:23] 10Analytics, 10DC-Ops, 10Operations, 10decommission, 10ops-eqiad: Decommission old Kafka analytics brokers: kafka1012,kafka1013,kafka1014,kafka1020,kafka1022,kafka1023 - https://phabricator.wikimedia.org/T226517 (10Papaul) 05Open→03Resolved [00:30:24] 10Analytics, 10Analytics-Kanban: Decomission old analytics kafka cluster - https://phabricator.wikimedia.org/T183303 (10Papaul) [01:12:51] 10Analytics, 10Operations: setup/install weblog1001/WMF4750 as oxygen replacement - https://phabricator.wikimedia.org/T207760 (10Papaul) [11:30:44] interesting [11:31:00] I am trying to figure out why oozie doesn't work with Hive 2.3 [11:31:23] and I discovered that we still have zookeeper conf100X host references in all our configs [11:31:34] (the SRE cluster, our nodes are an-conf100X) [11:31:59] the conf100X hosts are not reachable from our VLAN, plus we've never really used Hive with Zookeeper [11:32:16] in the hive-site.xml comments we wrote that it was used to lock tables [11:32:26] but I think that it also may trigger some HA behavior [11:32:46] and I am now wondering if this can be related to the sporadic connection issues happened after kerberos. [11:34:15] so I am now going to remove that config [11:51:36] I'll restart hive server/metastore on an-coord1001 on monday [11:54:32] "Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases." [11:54:41] joal: --^ (this comes from the hive CLI tool :D) [11:55:30] from my tests beeline is way faster than hive cli [11:55:34] on hive 2 [11:56:42] mmm no no sorry they are the same [11:56:45] my bad [11:56:51] but both look fast [11:57:15] oozie hive2 actions though are not working yet [11:57:18] not sure why [12:02:07] anyway, lunch :) [13:32:26] elukey: WAT? aren't we Saturday? [13:32:47] elukey: If we can make hive use spark as backend engine I'll be so pleased :) [15:38:55] joal: I am working some hours to catch up the morning that I was off :) [15:46:20] 10Analytics, 10good first task: Create table in hive with a continent lookup for countries - https://phabricator.wikimedia.org/T127995 (10Chtnnh) Hello @Nuria! I am a new contributor to wikimedia and am Interested in helping build the analytics and ORES platform. Can you point me in the right direction in solv... [18:20:08] joal: https://oozie.apache.org/docs/4.3.0/DG_Hive2ActionExtension.html [18:20:14] * elukey cries in a corner [18:20:44] no sorry wrong link [18:21:15] anyway, it seems that from 4.1 to 4.2 oozie changed a lot in the way hive2 actions are implemented [18:21:30] I hope this will not mean rewriting workflows [18:21:34] :\ [18:21:51] 8/ even [18:21:53] but apparently an exception is raised here https://github.com/apache/oozie/blob/branch-4.3/core/src/main/java/org/apache/oozie/action/hadoop/Hive2Credentials.java#L72 [18:21:57] no idea why [18:22:11] and this code was not present in 4.1 [18:22:39] There must be a difference in creds I guess - I need to read the docs more carefully and test [18:26:42] anyway, we'll see, just wanted to share the usual oozie pain :D [18:44:31] joal: last one I promise - I haven't yet updated the packages on the hue host to bigtop [18:44:40] there are cdh stuff [18:44:50] this is almost surely why it doesn't work [18:45:54] and it makes sense, we'll probably need to package Hue to a new version, etc.. [18:46:01] okok mistery solved, finally [19:02:00] yep, I think it is it [19:02:18] so on Monday I'll start packaging Hue with Py3 + hopefully better hive 2 support [19:02:21] sigh [19:02:22] * elukey afk! [19:33:31] (03CR) 10Fdans: [C: 03+2] Localisation updates from https://translatewiki.net. [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/575289 (owner: 10L10n-bot) [21:20:33] 10Analytics, 10good first task: Create table in hive with a continent lookup for countries - https://phabricator.wikimedia.org/T127995 (10Nuria) Probably @aklapper can advice on a task that would be easier than this one as your first one