[06:15:56] morning! [06:19:02] Morning [06:24:20] (03CR) 10Elukey: Introduce RefineFailuresChecker.scala (032 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) (owner: 10Elukey) [07:28:42] So do we know if this covid lockdown period has caused the highest page view days or weeks yet? [07:39:04] I did see some tweek from Jaime mentioning that we have registered an increadible peak of traffic in during the past days [07:39:12] so I guess that we might have reached some record [07:40:03] https://usercontent.irccloud-cdn.com/file/4UkA5zPB/image.png [07:40:22] ^^ from usperset, the lockdown seems to have busted the weekend dip trend, that has happened since forever [07:40:33] There was a Twitter posting about this yesterday: https://twitter.com/Wikipedia/status/1244688679861452802 [07:41:02] I missed that, awesome! [07:41:37] 645 for wikipedia 664 for all projects [07:41:40] ish [07:42:06] wow [07:42:09] good job we can scale to an extra 100 million page views without too many issues [07:42:11] xD [07:42:29] don't jinx it please :D [07:42:43] its okay, im "touching wood" basically hugging a wooden table [07:44:10] ahaahahah [07:44:34] (I learnt "touching wood" in Ireland, we touch iron instead) [07:47:58] super nice fact about https://it.wikipedia.org/wiki/Zola_Predosa (where I live) [07:48:27] I checked it today by chance and I noticed the "variante faunieri", that is a graffiti on a wall on the street that I see often in the car [07:48:55] but it is really not something to list among the best things in zola :D [07:49:08] I guess somebody wanted to have fun [07:50:01] (03PS6) 10Elukey: Introduce RefineFailuresChecker.scala [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) [08:00:25] touching iron, haha [08:05:58] I had the same laugh when I heard about wood :D [08:34:47] 10Analytics, 10Operations, 10Product-Analytics, 10SRE-Access-Requests: Hive access for Sam Patton - https://phabricator.wikimedia.org/T248097 (10jcrespo) Just a reminder than once a conversation with @Nuria or someone else from analytics is done to understand your needs, to follow the procedure at https://... [08:47:56] (03CR) 10Elukey: "Tested also with --config_file:" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) (owner: 10Elukey) [09:13:01] (03CR) 10Elukey: [C: 03+1] Introduce RefineFailuresChecker.scala [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) (owner: 10Elukey) [09:14:02] (03CR) 10Elukey: [V: 03+1] Introduce RefineFailuresChecker.scala [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) (owner: 10Elukey) [09:55:11] 10Analytics, 10Analytics-Kanban, 10Release Pipeline, 10Patch-For-Review, and 2 others: Migrate EventStreams to k8s deployment pipeline - https://phabricator.wikimedia.org/T238658 (10akosiaris) 05Open→03Resolved @Ottomata I think we can resolve this. Feel free to reopen. [10:01:04] 10Analytics, 10Operations, 10netops: Move netflow data to Eventgate Analytics - https://phabricator.wikimedia.org/T248865 (10elukey) Got it, so basically do all the process of creating the schemas etc.. but push data from pmacct directly to the kafka topic bypassing Eventgate. The fact that we'll have to hav... [10:40:25] * elukey lunch! [10:58:15] 10Analytics, 10Analytics-Kanban, 10Analytics-Wikistats, 10good first task: Wikistats - move from numeral to numbro for better localization support - https://phabricator.wikimedia.org/T199386 (10fdans) 05Invalid→03Open oh, interesting, I was looking at this task the other day thinking that it might be g... [12:56:47] (03CR) 10Ottomata: [C: 03+1] "Cool!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) (owner: 10Elukey) [12:57:50] !log updating icu on presto-analytics-canary and hadoop-worker-canary [12:57:51] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [13:15:39] jbond42: how dare you :) [13:15:46] (thanks for logging) [13:17:23] :) np, ill do the rest tomorrow unless there are errors [13:22:33] (03PS1) 10Hashar: document -DdeveloperConnection [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584923 (https://phabricator.wikimedia.org/T210271) [13:29:36] (03CR) 10Elukey: [V: 03+1] "> Cool!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) (owner: 10Elukey) [13:37:01] 10Analytics, 10Operations, 10netops: Move netflow to TLS encryption/authentication via librdkafka - https://phabricator.wikimedia.org/T248980 (10elukey) [13:37:19] 10Analytics, 10Analytics-Kanban, 10Release-Engineering-Team-TODO, 10Continuous-Integration-Infrastructure (phase-out-jessie), and 2 others: Migrate analytics/refinery/source release jobs to Docker - https://phabricator.wikimedia.org/T210271 (10hashar) The job seems to be working fine. @JAllemandou is going... [14:09:23] (03PS1) 10Hashar: Fix typo in update-refinery-source-jars [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584947 [14:10:52] (03PS1) 10Joal: Add ActorHash core and UDF functions [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584948 (https://phabricator.wikimedia.org/T247342) [14:11:06] (03CR) 10Elukey: [V: 03+2 C: 03+2] Fix typo in update-refinery-source-jars [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584947 (owner: 10Hashar) [14:11:19] :] [14:26:21] 10Analytics, 10Operations, 10netops: Move netflow data to Eventgate Analytics - https://phabricator.wikimedia.org/T248865 (10Ottomata) > We'll need to move current hive data to the new location in the event database You might end up just producing to a new topic name anyway. The topic name will eventually m... [14:33:53] (03PS1) 10Hashar: Double quote variables in update-refinery-source-jars [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584949 [14:40:01] a-team: a bunch of stuff went wrong with the house yesterday, I’ll have to miss standup and probably take the day off to fix it [14:41:11] milimetric: oh no! let me guess. Atlas got extra strong and mad and ripped threw a couch through wall? [14:41:15] threw* [14:47:38] (03CR) 10Ottomata: [C: 03+2] "No no let's merge!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584580 (https://phabricator.wikimedia.org/T240230) (owner: 10Elukey) [14:52:00] ottomata: is there a ticket for the work we wnat to do in EL to remove the python processor? [14:52:37] 10Analytics, 10Better Use Of Data, 10Product-Analytics, 10Epic: Session Length Metric. Web implementation - https://phabricator.wikimedia.org/T248987 (10Nuria) [15:00:52] ottomata: i just created: https://phabricator.wikimedia.org/T248987 [15:38:29] 10Analytics, 10Analytics-Kanban, 10Release-Engineering-Team-TODO, 10Continuous-Integration-Infrastructure (phase-out-jessie), and 2 others: Migrate analytics/refinery/source release jobs to Docker - https://phabricator.wikimedia.org/T210271 (10Nuria) @hashar noted, thanks for the quick turarround and help [15:43:04] 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Create UDF for actor id generation - https://phabricator.wikimedia.org/T247342 (10Nuria) [15:55:27] (03CR) 10Nuria: [C: 04-1] "Couple nits on naming, overall looks good." (035 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584948 (https://phabricator.wikimedia.org/T247342) (owner: 10Joal) [16:02:16] ping elukey standup [16:06:41] 10Analytics, 10Technical blog: Techblog: Change URL permalink style to better measure pageviews - https://phabricator.wikimedia.org/T248614 (10Nuria) mmmm, let me see if this is accessible through the ui [17:14:56] 10Analytics, 10Technical blog: Techblog: Change URL permalink style to better measure pageviews - https://phabricator.wikimedia.org/T248614 (10Nuria) I do not see any way to access config settings that are in the global config and per the issue you filed this looks like it no work so let's scrape my suggestion? [17:17:39] (03PS1) 10Hashar: Skip fetching commit hook when it is already present [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584984 (https://phabricator.wikimedia.org/T210271) [17:19:06] (03CR) 10Hashar: [C: 04-1] "On hold, I have to try it out first :)" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584984 (https://phabricator.wikimedia.org/T210271) (owner: 10Hashar) [17:31:14] 10Analytics, 10Readers-Web-Backlog, 10Performance-Team (Radar): Review referer configuration of origin/origin-when-crossorigin/origin-when-cross-origin - https://phabricator.wikimedia.org/T248526 (10Krinkle) The two questions in this task are questions that I'd like Analytics or Reading (whoever knows!) to h... [17:31:16] 10Analytics, 10Readers-Web-Backlog, 10Performance-Team (Radar): Review referer configuration of origin/origin-when-crossorigin/origin-when-cross-origin - https://phabricator.wikimedia.org/T248526 (10Krinkle) p:05Triage→03Medium [17:31:26] 10Analytics, 10Performance-Team, 10Readers-Web-Backlog: Review referer configuration of origin/origin-when-crossorigin/origin-when-cross-origin - https://phabricator.wikimedia.org/T248526 (10Krinkle) [17:41:02] (03PS2) 10Hashar: Fetch commit hook over https and skip if already present [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584984 (https://phabricator.wikimedia.org/T210271) [17:41:31] (03CR) 10Hashar: "I have replaced scp by wget. This way we don't depend on having proper ssh credentials to be setup." [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584984 (https://phabricator.wikimedia.org/T210271) (owner: 10Hashar) [17:45:17] (03CR) 10Hashar: "recheck" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/584984 (https://phabricator.wikimedia.org/T210271) (owner: 10Hashar) [18:20:41] * elukey off! [19:16:47] (03CR) 10Joal: "Patch to follow." (035 comments) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584948 (https://phabricator.wikimedia.org/T247342) (owner: 10Joal) [19:18:27] a-team - I forgot to mention at standup the work hasharAway has done for us lately - He has a working dockerized release job for refinery-source, and is in progress of having the refinery-update-jars one [19:19:30] I plan on deploying with the new version tomorrow and to update the docs accordingly [19:19:40] hasharAway: we owe you one :) [19:20:40] (03PS2) 10Joal: Add ActorIdGenerator and ActorIdUDF [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584948 (https://phabricator.wikimedia.org/T247342) [19:25:08] Hi analytics, I am getting a permission error when I am running a sql query on both notebook servers. query is: `wmf.mariadb.run(""" [19:25:08] SHOW tables [19:25:08] """, "wikishared")` and error is `ValueError: Failed reading file '/etc/mysql/conf.d/research-client.cnf': [Errno 13] Permission denied: '/etc/mysql/conf.d/research-client.cnf'`. I have confirmed the rest of team is not getting the error so I think it must be something with my account. Pls let me know. [19:26:12] snowick: has this ever worked for you or is this teh 1st tiem you tried? [19:26:17] *the 1st time [19:26:28] This is the first time I've tried [19:30:34] snowick:cen you connect to the replicas this way? [19:30:36] snowick: [19:30:40] https://www.irccloud.com/pastebin/pWArh2Mi/ [19:31:35] No, I get `ERROR 1698 (28000): Access denied for user 'snowick'@'10.64.21.109` [19:42:13] 10Analytics, 10Event-Platform, 10Inuka-Team, 10KaiOS-Wikipedia-app: Capture and send back client-side errors - https://phabricator.wikimedia.org/T248615 (10Ottomata) > Is there any plan to move to a more opaque dns (like logging.wikimedia.org`)? https://intake-logging.wikimedia.org :) See: https://gerrit.w... [20:02:29] (03CR) 10Ottomata: "See my comment about actor naming at https://phabricator.wikimedia.org/T238363#6011825" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/584948 (https://phabricator.wikimedia.org/T247342) (owner: 10Joal) [21:25:43] 10Analytics, 10Product-Analytics (Kanban), 10Readers-Web-Backlog (Needs Product Owner Decisions), 10covid-19: Weekly updates on editors - https://phabricator.wikimedia.org/T248427 (10kzimmerman) [21:34:09] 10Analytics, 10Product-Analytics (Kanban), 10Readers-Web-Backlog (Needs Product Owner Decisions), 10covid-19: Weekly updates on editors - https://phabricator.wikimedia.org/T248427 (10kzimmerman) [21:34:57] 10Analytics, 10Product-Analytics (Kanban), 10Readers-Web-Backlog (Needs Product Owner Decisions), 10covid-19: Weekly updates on editors - https://phabricator.wikimedia.org/T248427 (10kzimmerman)