[01:33:49] a-team: Heads-up that I'll be off Monday and Tuesday because of midterms [13:24:54] elukey: razzi upcoming kafka 2.8 will have the option to not use zookeeper! [13:24:54] https://blogs.apache.org/preview/kafka/?previewEntry=what-s-new-in-apache5 [13:25:04] not yet production ready but probably soon in kafka 3.0? [14:04:43] hello teamm [14:11:14] o/ [14:34:43] Hi team, good morning [14:34:43] elukey think we could sync up sometime today about the database issue that happened with the superset deploy? [14:42:53] (03PS2) 10Ottomata: Switch to eventutilities 1.0.4 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/676081 (owner: 10DCausse) [14:46:18] Hi team - most of europe is off today - Easter monday :) [14:46:40] (03CR) 10jerkins-bot: [V: 04-1] Switch to eventutilities 1.0.4 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/676081 (owner: 10DCausse) [14:50:10] (03CR) 10Ottomata: Switch to eventutilities 1.0.4 (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/676081 (owner: 10DCausse) [14:50:21] a-team: i'm out on an errand that's taking a bit longer than expected, so I'll be late to standup [14:51:48] !log rebalance kafka partitions for webrequest_text partitions 11, 12 [14:51:50] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:52:55] (03PS3) 10Ottomata: Switch to eventutilities 1.0.4 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/676081 (owner: 10DCausse) [14:54:44] !log remove empty /var/log/sqoop on an-launcher1002 (logs go in /var/log/refinery); sudo rmdir /var/log/sqoop [14:54:46] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [14:56:55] (03CR) 10jerkins-bot: [V: 04-1] Switch to eventutilities 1.0.4 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/676081 (owner: 10DCausse) [15:45:30] (03CR) 10Bstorm: Expand dbname validation regex (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [15:56:00] (03CR) 10BryanDavis: [C: 04-1] Expand dbname validation regex (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [16:00:32] (03CR) 10Bstorm: Expand dbname validation regex (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [16:07:37] (03PS4) 10Ottomata: Switch to eventutilities 1.0.4 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/676081 (owner: 10DCausse) [16:07:46] !log remove old hive logs on an-coord1001: sudo rm /var/log/hive/hive-*.log.2021-02-* [16:07:51] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:17:35] (03PS5) 10Ottomata: Switch to eventutilities 1.0.4 [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/676081 (owner: 10DCausse) [16:31:06] * razzi off for a walk [16:42:35] (03CR) 10Milimetric: "Sorry I missed this for so long. In the future, definitely ping me on IRC/slack if I'm more than a week late." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/331100 (https://phabricator.wikimedia.org/T137321) (owner: 10Gergő Tisza) [17:34:40] (03CR) 10Mholloway: [WIP] Metrics Platform context attribute schema fragment (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/676392 (https://phabricator.wikimedia.org/T276379) (owner: 10Jason Linehan) [17:46:17] (03PS2) 10BryanDavis: Expand dbname validation regex [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) [17:52:12] (03CR) 10BryanDavis: Expand dbname validation regex (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [17:56:13] (03CR) 10Bstorm: Expand dbname validation regex (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [18:11:11] (03PS3) 10BryanDavis: Expand dbname validation regex [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) [18:11:37] (03CR) 10BryanDavis: Expand dbname validation regex (031 comment) [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [18:13:42] (03PS4) 10BryanDavis: Expand dbname validation regex [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) [18:30:35] Hi razzi! I have a question for you on the recent Superset upgrade. I'm just curious why, in the UI, the version is listed as 0.999.0dev? [18:31:04] (03CR) 10Bstorm: "There's a weird thing in the test output:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [18:32:51] (03CR) 10Bstorm: "> Patch Set 4:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [18:43:28] (03PS20) 10Sharvaniharan: Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 [18:44:07] (03CR) 10jerkins-bot: [V: 04-1] Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 (owner: 10Sharvaniharan) [18:48:16] (03PS21) 10Sharvaniharan: Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 [18:48:48] (03CR) 10jerkins-bot: [V: 04-1] Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 (owner: 10Sharvaniharan) [18:53:10] Hi eyener! The upstream superset team hasn’t officially released the version I used, which I chose because it had a bugfix for an issue I found. It’ll probably be released as 1.1.0 in the next few days [18:53:32] Good eye :) [18:57:32] oh nice! Thanks razzi! [18:58:20] our Fundraising Superset instance mirrors what you all QA in product pretty closely. Is the unofficial-1.1.0 release the one we should be looking toward, or the official 1.0.1? [19:01:40] eyener: what we did was test our dashboards on the official version, then when we found a bug (https://github.com/apache/superset/issues/13229) and saw it was fixed on the main branch, we decided to test and deploy the unreleased version. For us at least it was more work to deploy a git commit, so I'd recommend testing 1.0.1 first [19:02:27] (03PS22) 10Sharvaniharan: Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 [19:03:48] (03CR) 10BryanDavis: "> Patch Set 4:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [19:08:06] (03CR) 10Sharvaniharan: Image recommendations table for android (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 (owner: 10Sharvaniharan) [19:13:00] (03CR) 10Bstorm: "> Patch Set 4:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [19:17:58] (03CR) 10BryanDavis: "> I have not tested it locally, but with the changes here I would imagine the vagrant machine runs ok? I can try it if you haven't. I've g" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [19:19:05] yoohoo fkaelin yt? can you test a jupyter thing for me? [20:31:49] (03PS23) 10Mholloway: Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 (owner: 10Sharvaniharan) [20:33:08] (03CR) 10Mholloway: [C: 03+2] Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 (owner: 10Sharvaniharan) [20:33:37] (03Merged) 10jenkins-bot: Image recommendations table for android [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/668244 (owner: 10Sharvaniharan) [20:47:35] (03PS4) 10Fdans: Add monthly pageview complete job [analytics/refinery] - 10https://gerrit.wikimedia.org/r/658348 (https://phabricator.wikimedia.org/T265732) [21:12:40] PROBLEM - Check unit status of produce_canary_events on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [21:15:26] (03CR) 10Bstorm: [C: 03+1] "Ok, testing in vagrant:" [analytics/quarry/web] - 10https://gerrit.wikimedia.org/r/676846 (https://phabricator.wikimedia.org/T278715) (owner: 10BryanDavis) [21:24:10] RECOVERY - Check unit status of produce_canary_events on an-launcher1002 is OK: OK: Status of the systemd unit produce_canary_events https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [22:52:04] ottomata: holaaa, could you gently point me to where the mw code that generates events is located on github? [23:16:27] 10Analytics-Clusters, 10Analytics-Kanban: Upgrade to Superset 1.0 - https://phabricator.wikimedia.org/T272390 (10nettrom_WMF) I've noticed a couple of issues related to annotation layers: 1. The annotation text is shown on a transparent background with default font color, so it blends into other text on the s... [23:57:16] 10Analytics-Clusters, 10Analytics-Kanban: Upgrade to Superset 1.0 - https://phabricator.wikimedia.org/T272390 (10razzi) Hmm, I definitely see these issues @nettrom_WMF; thanks for commenting. I'll see if upstream is aware and file a bug if not.