[06:36:59] !log restart oozie coords to pick up new hive2 actions (edit hourly, pageview druid daily/hourly/monthly, mobile apps uniques daily/monthly) [06:37:01] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [06:37:10] brb [08:08:34] (03PS1) 10Elukey: mediawiki: move oozie coordinators to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529315 (https://phabricator.wikimedia.org/T227257) [10:41:00] * elukey lunch! [11:35:44] elukey: but I restarted those jobs yesterday? [12:28:39] hey allll [12:55:18] fdans: hey sorry I was afk [12:55:51] I checked this morning but they seemed not running hive2 actions [12:56:02] and in their config there was no jdbc_url mentioned [12:56:39] I thought that you might have used a old refinery version or something and I restarted them.. after that I saw hive2 actions etc.. [12:58:21] fdans: for example, check https://hue.wikimedia.org/oozie/list_oozie_coordinator/0009812-190730075836326-oozie-oozi-C/ [12:58:28] that should be one of the one that I killed [12:58:44] the actions are "hive" and in the configuration I don't see the new jdbc url [12:59:16] but if you check the new one [12:59:16] https://hue.wikimedia.org/oozie/list_oozie_workflow/0010703-190730075836326-oozie-oozi-W/?coordinator_job_id=0010439-190730075836326-oozie-oozi-C [12:59:19] they are there [12:59:49] not sure if it was me sleepy or something else [13:03:24] (03CR) 10Mforns: [C: 03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529315 (https://phabricator.wikimedia.org/T227257) (owner: 10Elukey) [14:52:18] (03PS1) 10Elukey: projectview: move oozie coordinator to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529377 (https://phabricator.wikimedia.org/T227257) [15:13:41] hey a-team, I messed up my back so I’m going to sit and try to recover. Let me know if you need me for anything [15:14:19] hey milimetric hmmf, take care, don't worry [15:15:06] +1! [15:16:03] (03PS1) 10Elukey: unique_devies: move oozie coordinators to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529381 (https://phabricator.wikimedia.org/T227257) [15:24:09] (03PS1) 10Elukey: Move oozie's Hive utils workflows to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529384 (https://phabricator.wikimedia.org/T227257) [15:29:13] (03PS1) 10Elukey: virtualpageview: move oozie coords to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529385 (https://phabricator.wikimedia.org/T227257) [15:35:09] (03PS1) 10Elukey: webrequest: move oozie coords to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529387 (https://phabricator.wikimedia.org/T227257) [15:37:05] (03PS2) 10Elukey: webrequest: move oozie coords to hive2 actions [analytics/refinery] - 10https://gerrit.wikimedia.org/r/529387 (https://phabricator.wikimedia.org/T227257) [15:37:08] all code reviews for hive2 actions are out :) [15:38:40] O.o [15:40:03] mforns: ahahahha sorry please check them whenever you have time [15:40:10] not now [15:40:21] they shouldn't be too complex but a lot of things to restart [15:40:57] hehe, it was a face of admiration, not overwhelm-ation [15:41:19] elukey, are we going to deploy them next week? [15:41:45] mforns: if you are ok I'd love to, but if you want we can do only some of them [15:42:01] I understand that there are a lot of coords [15:42:12] no, volume is not a problem, but the fact we being alone in the team [15:42:26] BTW, the 15th is bank holiday in spain, is it as well for you? [15:42:48] oh yes [15:43:12] we could think about doing a early train next week [15:43:15] like monday/tue [15:43:47] ok [15:48:39] 10Analytics, 10Analytics-Kanban, 10Cleanup, 10Operations, 10Patch-For-Review: Archive zookeeper puppet submodule - https://phabricator.wikimedia.org/T227164 (10elukey) [15:48:45] 10Analytics, 10Analytics-Kanban, 10Cleanup, 10Operations, 10Patch-For-Review: Archive zookeeper puppet submodule - https://phabricator.wikimedia.org/T227164 (10elukey) 05Open→03Resolved [15:48:47] 10Analytics: Move the puppet cdh and zookeeper submodules into operations/puppet - https://phabricator.wikimedia.org/T226466 (10elukey) [15:50:00] 10Analytics, 10Analytics-Kanban, 10Cleanup, 10Operations: Archive cdh puppet submodule - https://phabricator.wikimedia.org/T226474 (10elukey) 05Open→03Resolved [15:50:02] 10Analytics: Move the puppet cdh and zookeeper submodules into operations/puppet - https://phabricator.wikimedia.org/T226466 (10elukey) [15:50:13] 10Analytics: Move the puppet cdh and zookeeper submodules into operations/puppet - https://phabricator.wikimedia.org/T226466 (10elukey) 05Open→03Resolved [15:55:51] a-team: I had to go out to run a couple errands before my parents come visit, I'm not going to make it to standup, will be on in about 45 min [16:45:51] 10Analytics, 10Analytics-Kanban: Rebuild spark2 for Debian Buster - https://phabricator.wikimedia.org/T229347 (10elukey) Interesting issue: python3-tk seems to require python3.5, forcing apt to uninstall python3.7 and libpython3.7, that puppet tries to add back. From git blame we added the package because: >I... [17:10:59] 10Analytics, 10Discovery, 10Discovery-Search (Current work), 10MW-1.34-notes (1.34.0-wmf.17; 2019-08-06): tons of errors on eventlogging events - https://phabricator.wikimedia.org/T229614 (10debt) 05Open→03Resolved [17:41:41] 10Analytics, 10Product-Analytics, 10VisualEditor (Current work): Enable Editing Team members to run queries independently - https://phabricator.wikimedia.org/T224029 (10JTannerWMF) a:05JTannerWMF→03marcella [18:26:26] * elukey off! [19:12:53] 10Analytics, 10Research: Recommend the best format to release public data lake as a dump - https://phabricator.wikimedia.org/T224459 (10leila) @milimetric @mforns I created [[ https://docs.google.com/forms/d/e/1FAIpQLScc15eSeFrVvAh_ydpX_1p0v6-WSx2qe3EcBHxIdshSd6omow/viewform | a survey ]] and added you both as... [19:35:36] 10Analytics-Kanban, 10ChangeProp, 10EventBus, 10MediaWiki-JobQueue, and 3 others: Change-Prop partitioner fails with eventgate event - https://phabricator.wikimedia.org/T230048 (10Pchelolo) 05Open→03Resolved [19:35:40] 10Analytics-EventLogging, 10Analytics-Kanban, 10EventBus, 10MediaWiki-JobQueue, and 4 others: Migrate JobQueue to eventgate - https://phabricator.wikimedia.org/T228705 (10Pchelolo) [20:25:42] 10Analytics, 10Operations, 10Core Platform Team Legacy (Watching / External), 10Patch-For-Review, and 2 others: Replace and expand kafka main hosts (kafka[12]00[123]) with kafka-main[12]00[12345] - https://phabricator.wikimedia.org/T225005 (10herron) [20:40:25] 10Analytics, 10Operations, 10Core Platform Team Legacy (Watching / External), 10Patch-For-Review, and 2 others: Replace and expand kafka main hosts (kafka[12]00[123]) with kafka-main[12]00[12345] - https://phabricator.wikimedia.org/T225005 (10herron) >>! In T225005#5396148, @Ottomata wrote: > In addition t... [21:44:28] 10Analytics, 10Research: Recommend the best format to release public data lake as a dump - https://phabricator.wikimedia.org/T224459 (10leila) a:03leila [21:51:35] 10Analytics, 10Research: Recommend the best format to release public data lake as a dump - https://phabricator.wikimedia.org/T224459 (10leila) @Halfak thanks for the input. We'll make sure we have it as part of our thinking.