[03:36:41] 10Analytics, 10Product-Analytics: New app pageview definition needs to be deployed - https://phabricator.wikimedia.org/T256515 (10Amarphab) Removed Amarphab as subscriber [06:44:20] goood morning [06:47:10] Hi elukey - will be caring this morning, back around lunch time :) [06:48:22] sure! [07:52:55] 10Analytics-Clusters, 10Patch-For-Review: Review an-coord1001's usage and failover plans - https://phabricator.wikimedia.org/T257412 (10elukey) The high level list of things to do are: [ ] Add TLS support to an-coord1001 and db1108 [ ] Think about a global setting to gather coordinates for the oozie/hive data... [08:18:54] !log move piwik to CAS (idp.wikimedia.org) [08:18:56] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:25:39] 10Analytics: Mediarequests dashboard card for specific wikis look sad - https://phabricator.wikimedia.org/T241470 (10fdans) 05Open→03Resolved a:03fdans k now it has more bars so it doesn't look sad. Closing. [09:04:04] PROBLEM - aqs endpoints health on aqs1009 is CRITICAL: /analytics.wikimedia.org/v1/edits/per-page/{project}/{page-title}/{editor-type}/{granularity}/{start}/{end} (Get daily edits for english wikipedia page 0) timed out before a response was received https://wikitech.wikimedia.org/wiki/Services/Monitoring/aqs [09:04:14] PROBLEM - aqs endpoints health on aqs1005 is CRITICAL: /analytics.wikimedia.org/v1/edits/per-page/{project}/{page-title}/{editor-type}/{granularity}/{start}/{end} (Get daily edits for english wikipedia page 0) timed out before a response was received https://wikitech.wikimedia.org/wiki/Services/Monitoring/aqs [09:04:22] PROBLEM - aqs endpoints health on aqs1007 is CRITICAL: /analytics.wikimedia.org/v1/edits/per-page/{project}/{page-title}/{editor-type}/{granularity}/{start}/{end} (Get daily edits for english wikipedia page 0) timed out before a response was received https://wikitech.wikimedia.org/wiki/Services/Monitoring/aqs [09:04:26] oh noes [09:04:42] I thought it was resolved... [09:04:46] * elukey cries in a corner [09:05:09] ah but this is not all the aqs hosts [09:05:12] interesting [09:05:26] fdans: o/ [09:05:27] around? [09:05:39] haha shit i was just dming you [09:06:17] so in theory 3/6 aqs nodes are timing out [09:06:23] but the rest should be working [09:06:24] is it the case? [09:06:41] namely, is stats v2 working ? [09:07:00] RECOVERY - aqs endpoints health on aqs1009 is OK: All endpoints are healthy https://wikitech.wikimedia.org/wiki/Services/Monitoring/aqs [09:07:11] interesting [09:07:16] RECOVERY - aqs endpoints health on aqs1005 is OK: All endpoints are healthy https://wikitech.wikimedia.org/wiki/Services/Monitoring/aqs [09:07:20] self recovery [09:07:24] RECOVERY - aqs endpoints health on aqs1007 is OK: All endpoints are healthy https://wikitech.wikimedia.org/wiki/Services/Monitoring/aqs [09:08:04] yes data dropped [09:08:21] way better than before, still not perfect [09:10:57] joal: so the issue seems still present, even if it presents in a mild variant (only some aqs nodes unresponsive, self-recovery) [09:12:27] 10Analytics, 10Analytics-Wikistats: Stats for newer projects not available - https://phabricator.wikimedia.org/T258033 (10The_Discoverer) [09:45:33] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Repurpose db1108 as generic Analytics db replica - https://phabricator.wikimedia.org/T234826 (10elukey) Side note - in T257412 I am investigating a failover plan to write down in case an-coord1001 goes down (currently a big SPOF).... [10:24:14] * elukey lunch! [11:08:50] Heya - back [11:10:56] joal hi!! I have a quick question, if you have time! Is there an equivalent of the page_props table in Hive? [11:11:07] Hi miriam_ [11:11:35] We don't have the page-props in hive nope - You're not the first one to ask, we should prioritize importing it [11:12:07] joal, oki, thanks! Does it help if I open a phab task? [11:14:41] yes please miriam_ :) [11:19:26] 10Analytics: Import page_props table to Hive - https://phabricator.wikimedia.org/T258047 (10Miriam) [11:19:38] done, thanks joal! [12:15:01] Thank you miriam_ :) [12:51:20] joal: really interesting https://research.google/pubs/pub45855/ [12:51:42] ack elukey - adding to my reading list :) [12:53:37] hi alll :] [12:53:55] hi mforns :) [12:56:37] a-team: piwik.wikimedia.org moved to cas, when you have a moment please try to log in and see if everything works [12:56:58] it does not use 2fa for the moment, only wikitech/dev credentials [12:57:24] but we'll move yarn/superset/turnilo very soon to it as well [12:57:32] so better to double check that all works for you [12:57:39] (eventually we'll enable 2FA as well) [13:03:06] worked for me elukey :) [13:04:55] with the SSO login you can also use these other services https://wikitech.wikimedia.org/wiki/CAS-SSO (if your group membership allows so) (sremap is SRE only e.g.) [13:05:19] in general, please read through https://wikitech.wikimedia.org/wiki/CAS-SSO for a quick intro [13:05:23] 10Analytics-Radar, 10Better Use Of Data, 10Product-Analytics, 10Epic, and 2 others: Session Length Metric. Web implementation - https://phabricator.wikimedia.org/T248987 (10jlinehan) I uploaded a new patchset (https://gerrit.wikimedia.org/r/c/mediawiki/extensions/WikimediaEvents/+/604051/15) implementing t... [13:08:38] * elukey takes notes [13:10:49] oooooh, sso! [13:10:57] (will look shortly) [15:01:06] ping milimetric ottomata [15:01:09] standdduppp [15:01:52] 10Analytics: No unique devices per family data from July 2019 - https://phabricator.wikimedia.org/T258064 (10fdans) [15:05:36] (03PS4) 10Fdans: [wip] Allow more than one dimension to be filtered in Wikistats [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/612574 (https://phabricator.wikimedia.org/T255757) [15:07:34] (03CR) 10jerkins-bot: [V: 04-1] [wip] Allow more than one dimension to be filtered in Wikistats [analytics/wikistats2] - 10https://gerrit.wikimedia.org/r/612574 (https://phabricator.wikimedia.org/T255757) (owner: 10Fdans) [15:35:33] ottomata, milimetric , joal : tunning session conflict with training so i will miss teh 1st hour [15:35:58] ack nuria [15:36:05] sorry to hear that :( [15:36:26] milimetric: would you have a minute for me to talk about the doc I wrote on incremental datasource? [15:37:03] joal: yea, sure, omw [15:50:26] joal: the fact that java needs a tuple2 class makes me love python [15:50:33] :) [15:50:37] or scala :) [16:26:40] 10Analytics-Clusters, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Repurpose db1108 as generic Analytics db replica - https://phabricator.wikimedia.org/T234826 (10elukey) >>! In T234826#6307751, @elukey wrote: > Side note - in T257412 I am investigating a failover plan to write down in case an-co... [16:50:40] joal: ssh -N analytics1041.eqiad.wmnet -L 8081:localhost:8081 [16:50:45] surprise [16:51:03] (not much in there, I had to restart from scratch, but hopefully we'll index some data soon) [16:51:48] wow :) [16:51:59] looks a lot better than the previous one! [16:56:55] it says [16:56:56] It appears that you are accessing the console on the Coordinator service. Due to the lack of access to some APIs on this service the console will operate in a limited mode. The full version of the console can be accessed on the Router service. [17:01:22] 10Analytics, 10MediaWiki-Vagrant, 10Services (watching): Vagrant's /var/log/daemon.log filling up with kafka errors - https://phabricator.wikimedia.org/T187102 (10DLynch) 05Resolved→03Open This is still happening, and is causing issues with our team's prototype-testing server. [17:20:35] * elukey off! [17:22:50] 10Analytics-Radar, 10Better Use Of Data, 10Product-Analytics, 10Epic, and 2 others: Session Length Metric. Web implementation - https://phabricator.wikimedia.org/T248987 (10Nuria) @jlinehan; some suggestions 1) let's start a new patch to avoid unnecessary confusion 2) let's apply lessons learned in the p... [17:30:12] cd [17:30:14] oops :) [17:43:32] 10Analytics-Radar, 10Product-Analytics (Kanban): Collect metrics/tables which might be touched by IP masking feature - https://phabricator.wikimedia.org/T255816 (10nettrom_WMF) [17:50:04] 10Analytics: No unique devices per family data from July 2019 - https://phabricator.wikimedia.org/T258064 (10JAllemandou) a:03JAllemandou [17:50:17] 10Analytics, 10Analytics-Kanban: No unique devices per family data from July 2019 - https://phabricator.wikimedia.org/T258064 (10JAllemandou) [17:51:19] (03PS1) 10Joal: Fix unique-devices per-project-family cassandra loading [analytics/refinery] - 10https://gerrit.wikimedia.org/r/612905 (https://phabricator.wikimedia.org/T258064) [17:58:52] !log Backfill cassandra unique-devices for per-project-family starting 2019-07 [17:58:54] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [18:54:42] (03CR) 10Nuria: Fix unique-devices per-project-family cassandra loading (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/612905 (https://phabricator.wikimedia.org/T258064) (owner: 10Joal) [19:24:53] 10Analytics, 10Dumps-Generation: Sample HTML Dumps - Request for feedback - https://phabricator.wikimedia.org/T257480 (10Nicolastorzec) @RBrounley_WMF: **RE redirects - **We don't reuse the redirect tables that @ArielGlenn dumps every few weeks because we need more up-to-date data, but we do something similar... [19:33:03] 10Analytics: actor_signature_per_project_family does not work for apps - https://phabricator.wikimedia.org/T258101 (10Isaac) [20:09:19] 10Analytics: actor_signature_per_project_family does not work for apps - https://phabricator.wikimedia.org/T258101 (10JAllemandou) Great finding @Isaac ! Thanks for documenting :) [20:12:11] (03PS2) 10Joal: Fix unique-devices per-project-family cassandra loading [analytics/refinery] - 10https://gerrit.wikimedia.org/r/612905 (https://phabricator.wikimedia.org/T258064) [20:12:25] (03CR) 10Joal: Fix unique-devices per-project-family cassandra loading (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/612905 (https://phabricator.wikimedia.org/T258064) (owner: 10Joal) [20:24:33] 10Analytics: actor_signature_per_project_family does not work for apps - https://phabricator.wikimedia.org/T258101 (10Isaac) Happily! I had done some analysis of these sorts of actor signatures a while back with app users to see how stable the signatures are ([[https://meta.wikimedia.org/wiki/Research_talk:Chara... [20:24:38] 10Analytics, 10Analytics-Kanban, 10MediaWiki-Vagrant: Vagrant's /var/log/daemon.log filling up with kafka errors - https://phabricator.wikimedia.org/T187102 (10Ottomata) a:05elukey→03Ottomata [21:22:39] (03CR) 10Nuria: [C: 03+1] Fix unique-devices per-project-family cassandra loading [analytics/refinery] - 10https://gerrit.wikimedia.org/r/612905 (https://phabricator.wikimedia.org/T258064) (owner: 10Joal) [23:13:39] 10Analytics, 10Product-Analytics (Kanban): Unique Devices Data for Mobile Apps in Wikistats - https://phabricator.wikimedia.org/T257998 (10SNowick_WMF) a:05SNowick_WMF→03None [23:42:20] 10Analytics, 10Product-Analytics (Kanban): Unique Devices Data for Mobile Apps in Wikistats - https://phabricator.wikimedia.org/T257998 (10Nuria) There are no Unique Devices counts for mobile apps computed the same way they are for the desktop and mobile sites (i.e. all requests are counting towards the total)...