[00:27:58] nuria, milimetric: any docs that I need to update for either emoji or geoeditors changes? [00:29:39] lexnasser: yes, after testing, we should update pageView_hourly https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Pageview_hourly#Changes_and_known_problems_since_2015-06-16 [00:29:45] lexnasser: thanks for asking [00:29:57] lexnasser: as you can see the ticket is listed with teh day is solved [00:29:59] *the [00:30:07] nuria: perfect, will do [00:59:57] lexnasser: jobs look good, nothing failed and they're running on schedule. That pageview_hourly page is a good place to update that titles are now a little more exciting :) [01:00:26] I'm deploying a couple of other things now, and then will do your public monthly job [01:22:51] milimetric: great! I see the API works for the emoji pages: https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikipedia/all-access/user/🍆/daily/2020012700/2020042200 [01:23:07] sweet! [01:24:42] 10Analytics, 10Analytics-Kanban, 10Pageviews-API, 10Patch-For-Review: Pageviews missing for titles with emojis since April 23, 2019 - https://phabricator.wikimedia.org/T245468 (10lexnasser) https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikipedia/all-access/user/🍆/daily/2020010100/20200... [01:41:52] (03PS1) 10Milimetric: Use the right jar version [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591577 (https://phabricator.wikimedia.org/T249759) [01:42:09] (03CR) 10Milimetric: [V: 03+2 C: 03+2] Use the right jar version [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591577 (https://phabricator.wikimedia.org/T249759) (owner: 10Milimetric) [02:10:03] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Add hourly resolution to data quality outage/censhorship alarms - https://phabricator.wikimedia.org/T249759 (10Milimetric) follow-up docs: the README about the bundle is great, but it uses some outdated syntax for the example oozie command. I copied it bl... [04:50:12] 10Analytics, 10Analytics-Kanban, 10Research: Proposed adjustment to wmf.wikidata_item_page_link to better handle page moves - https://phabricator.wikimedia.org/T249773 (10Nuria) @Milimetric is to look at the work but just setting expectations that if we need to modify mediaiwki_history to do changes we will... [05:39:04] (03PS1) 10Elukey: Add a separate environment for Hadoop Test and stat100x to targets [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/591632 [05:39:39] (03CR) 10Elukey: [V: 03+2 C: 03+2] Add a separate environment for Hadoop Test and stat100x to targets [analytics/refinery/scap] - 10https://gerrit.wikimedia.org/r/591632 (owner: 10Elukey) [05:45:00] !log add a separate refinery scap target for the Hadoop test cluster and redeploy to check new settings [05:45:02] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [06:11:32] !log start data quality bundle hourly with --user=analytics [06:11:34] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [06:19:21] ah lovely now the bundle works but spark fails [06:19:22] sigh [06:19:58] see https://yarn.wikimedia.org/cluster/app/application_1583418280867_255778 [06:21:15] 2020-04-22 06:14:02,724 [Driver] ERROR org.apache.spark.deploy.yarn.ApplicationMaster - User class threw exception: java.lang.IllegalArgumentException: requirement failed [06:21:19] java.lang.IllegalArgumentException: requirement failed [06:32:37] ahhh very nice [06:32:38] https://github.com/criteo/Spark-RSVD/blob/master/src/main/scala/com/criteo/rsvd/GridPartitioner.scala#L36 [06:32:44] so require in scala is like an assert [06:36:28] mforns: around by any chance? [06:46:09] !log kill dataquality hourly bundle again, traffic_by_country keeps failing [06:46:12] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [11:30:35] elukey: I have to go get groceries this morning, but will be around later to take a look. You're not taking the day off? [11:55:01] milimetric: wait isn't that tomorrow and the next day? [12:24:37] Hi folks [12:26:40] I'm on for a couple of hours - let me know if I can help with the failing spark job [12:35:37] fdans: I think it's 3 days, starting today [12:36:14] oh [12:37:11] joal: yep, you're very right https://usercontent.irccloud-cdn.com/file/NG7KdiPn/%E3%82%B9%E3%82%AF%E3%83%AA%E3%83%BC%E3%83%B3%E3%82%B7%E3%83%A7%E3%83%83%E3%83%88%202020-04-22%20%E5%8D%88%E5%BE%8C2.36.55.png [12:37:35] ok cool :) [12:47:04] That’s why I can’t deploy! [13:10:11] 10Analytics, 10Analytics-Kanban, 10Research: covid19 data preservation - https://phabricator.wikimedia.org/T248600 (10Ottomata) Correct 90 days ago. January 23 now :) @Nuria Let me know if I should re-enable deletion. [13:39:10] milimetric: I am off yes but I was trying to fix the alerts :) [13:39:29] but I got stuck in the Spark failure, no idea about it [13:40:23] elukey: need to drop now (Lino just woke up) - I'll be back later to help [13:41:17] joal: I don't think it is very urgent, the bundle can wait :) [13:49:56] 10Analytics: SOlyoh21 rfc - https://phabricator.wikimedia.org/T250909 (10SOlyoh21) [13:56:17] 10Analytics, 10Trash: SOlyoh21 rfc - https://phabricator.wikimedia.org/T250909 (10Reedy) 05Open→03Invalid [14:34:25] 10Analytics, 10EventStreams: EventStreams socket stays connected without any traffic incoming - https://phabricator.wikimedia.org/T250912 (10stjn) [14:57:01] ack elukey :) [14:57:41] nuria: I have uploaded graphs and linked them in the docs - Let me know if this is ok for you or if you think we need more :) [15:52:39] 10Analytics, 10Analytics-Kanban, 10Research: covid19 data preservation - https://phabricator.wikimedia.org/T248600 (10Nuria) Let's please reenable cc @Ottomata [16:15:53] (03PS1) 10Nuria: Database name for data quality table shold be 'analytics' [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591952 (https://phabricator.wikimedia.org/T249759) [16:17:50] (03PS2) 10Nuria: Database name for data quality table shold be 'analytics' [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591952 (https://phabricator.wikimedia.org/T249759) [16:25:23] (03PS1) 10Nuria: Correcting examples in README for data quality jobs [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591956 (https://phabricator.wikimedia.org/T249759) [16:26:05] 10Analytics, 10Analytics-Kanban, 10Research, 10Patch-For-Review: covid19 data preservation - https://phabricator.wikimedia.org/T248600 (10Isaac) Thanks @Ottomata and @Nuria for coordinating this so we had time to put together the dataset! [18:08:36] (03CR) 10Mforns: Database name for data quality table shold be 'analytics' (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591952 (https://phabricator.wikimedia.org/T249759) (owner: 10Nuria) [18:19:45] (03CR) 10Nuria: Database name for data quality table shold be 'analytics' (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591952 (https://phabricator.wikimedia.org/T249759) (owner: 10Nuria) [18:20:09] (03CR) 10Mforns: Correcting examples in README for data quality jobs (033 comments) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591956 (https://phabricator.wikimedia.org/T249759) (owner: 10Nuria) [18:20:42] (03PS3) 10Nuria: Database name for data quality table shold be 'analytics' [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591952 (https://phabricator.wikimedia.org/T249759) [18:31:22] (03PS4) 10Nuria: Database name for data quality table should be 'analytics' [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591952 (https://phabricator.wikimedia.org/T249759) [18:36:34] (03CR) 10Nuria: Correcting examples in README for data quality jobs (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591956 (https://phabricator.wikimedia.org/T249759) (owner: 10Nuria) [19:09:35] (03PS1) 10Nuria: Bumping up jar version for spark-job-jar [analytics/refinery] - 10https://gerrit.wikimedia.org/r/592008 (https://phabricator.wikimedia.org/T249759) [20:16:15] (03CR) 10Mforns: [V: 03+2 C: 03+2] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/592008 (https://phabricator.wikimedia.org/T249759) (owner: 10Nuria) [20:22:33] (03CR) 10Mforns: Correcting examples in README for data quality jobs (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591956 (https://phabricator.wikimedia.org/T249759) (owner: 10Nuria) [20:24:25] (03CR) 10Mforns: "Yes, I understand and agree!" (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/591952 (https://phabricator.wikimedia.org/T249759) (owner: 10Nuria) [23:06:14] PROBLEM - Check the last execution of reportupdater-published_cx2_translations_mysql on an-launcher1001 is CRITICAL: CRITICAL: Status of the systemd unit reportupdater-published_cx2_translations_mysql https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers