[00:15:05] 10Analytics: Upgrade UA Parser to 1.5.1+ - https://phabricator.wikimedia.org/T272926 (10Milimetric) [00:15:42] 10Analytics: Upgrade UA Parser to 1.5.1+ - https://phabricator.wikimedia.org/T272926 (10Milimetric) https://github.com/ua-parser/uap-java/wiki/ChangeLog [00:25:57] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Superset presto error: Failed to list directory: hdfs://analytics-hadoop/wmf/data/event/... - https://phabricator.wikimedia.org/T272741 (10kzimmerman) @mforns I'm still getting the same error when I try to load `mforns.session_length` and `mforns.session... [01:06:25] 10Analytics-Clusters: cmake missing on stat1008 - https://phabricator.wikimedia.org/T272930 (10Tgr) [06:13:54] 10Analytics-Clusters: cmake missing on stat1008 - https://phabricator.wikimedia.org/T272930 (10Tgr) 05Open→03Invalid It was pip, the newest pip (obtainable with `pip install pip`) does not need it aparently. [06:45:42] (03CR) 10Lex Nasser: Create pageviews 'top-per-country' endpoint with tests (037 comments) [analytics/aqs] - 10https://gerrit.wikimedia.org/r/657228 (https://phabricator.wikimedia.org/T207171) (owner: 10Lex Nasser) [07:49:49] Good morning [07:50:43] bonjour :) [07:55:49] elukey: could you please restart the backup namenode, so that we check users and groups? [07:57:27] joal: in theory it shouldn't be needed [07:57:33] ack [08:13:09] 10Analytics-Clusters, 10DC-Ops, 10SRE, 10ops-eqiad: (Need By: TBD) rack/setup/install an-worker11[18-41] - https://phabricator.wikimedia.org/T260445 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by elukey on cumin1001.eqiad.wmnet for hosts: ` ['an-worker1119.eqiad.wmnet', 'an-worker1131.eqiad... [08:13:19] started the debian install on the missing two workers [08:22:56] elukey: from what I can read from HDFS-backup, users/groups are correctly defined [08:23:13] Ahhh no :) [08:23:27] correctly defined for existing users :) [08:23:58] and, even before you created the analytics-privatedata-users user, the group must have been there since I could use it in hadoop [08:24:41] I have copied /user data yesterday, and most of ownership is incorrectly set to hdfs:hadoop as users don't exist on the namenode [08:24:44] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: eventgate-wikimedia should emit metrics about validation errors - https://phabricator.wikimedia.org/T257237 (10JMeybohm) >>! In T257237#6769955, @Ottomata wrote: > I guess that's a Q for service-ops folks. @JMeybohm, @akosiaris: > > W... [08:29:57] joal: ah ok, but now if we drop/copy-again it should work in theory [08:30:29] elukey: we have all users set up? [08:33:35] yep [08:33:42] awesome!! [08:33:43] I deployed them yesterday [08:34:13] Ah - I thought it was only analytics-private and search users - But it's actually all related users [08:35:43] 10Analytics-Clusters, 10DC-Ops, 10SRE, 10ops-eqiad: (Need By: TBD) rack/setup/install an-worker11[18-41] - https://phabricator.wikimedia.org/T260445 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['an-worker1131.eqiad.wmnet', 'an-worker1119.eqiad.wmnet'] ` and were **ALL** successful. [08:38:57] joal: it is yes, but those are the groups that we deploy to our cluster as well [08:39:07] (analytics-privatedata it is now the only way to access the cluster) [08:39:33] elukey: and the deploy you did yesterday deploys all users in that gropu, right? [08:40:22] yep [08:40:35] Yes! I get it - thanks for the long explanation elukey :) [08:42:19] np sorry for the confusion :( [08:42:42] !log Copy /wmf/camus to backup cluster (120Gb) - T272846 [08:42:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [08:42:46] T272846: Backup HDFS data before BigTop upgrade - https://phabricator.wikimedia.org/T272846 [08:43:37] I am adding two workers to the cluster [08:43:55] Ack elukey - MOAR SPACE :) [08:44:34] after these we don't have anymore hosts racked, there are other 6 but they are on the DC floor :) [08:44:45] :( [08:44:59] elukey: It'd be awesome if we could find space for them [08:45:45] elukey: we'll have ~750Tb space, it'll be just enough (I'll try to find some more Tb here and there if needed) [08:47:53] joal: I think there is little change, no 10g space in racks that we want now [08:47:58] *chance [08:48:09] Yeah, I know :( [08:55:34] 773 TiB according to grafana [08:56:03] that is 850TB total in theory [08:56:04] great [08:56:10] Continuing my copy [08:57:11] mmm [08:57:12] elukey@an-worker1118:~$ hdfs dfs -df -h [08:57:12] Filesystem Size Used Available Use% [08:57:12] hdfs://analytics-backup-hadoop 773.3 T 249.2 T 524.0 T 32% [08:57:56] ah ok [08:57:57] elukey@an-worker1118:~$ hdfs dfs -df [08:57:57] Filesystem Size Used Available Use% [08:58:00] hdfs://analytics-backup-hadoop 850253667434496 273989665036666 576199393073579 32% [08:58:08] makes sense now [08:58:17] goooood [09:01:44] !log Copy /wmf/discovery to backup cluster (120Gb) - T272846 [09:01:46] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:01:46] T272846: Backup HDFS data before BigTop upgrade - https://phabricator.wikimedia.org/T272846 [09:07:33] !log Copy /wmf/refinery to backup cluster (1.1Tb) - T272846 [09:07:35] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:07:35] T272846: Backup HDFS data before BigTop upgrade - https://phabricator.wikimedia.org/T272846 [09:15:46] !log reboot dbstore1004 for kernel upgrades [09:15:48] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:31:57] !log reboot dbstore1003 for kernel upgrades [09:31:58] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:35:41] !log Copy /wmf/data/discovery to backup cluster (21Tb) - T272846 [09:35:45] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:35:45] T272846: Backup HDFS data before BigTop upgrade - https://phabricator.wikimedia.org/T272846 [09:37:42] !log reboot dbstore1005 for kernel upgrades [09:37:44] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [09:43:43] o/ [09:43:51] Hi dcausse [09:43:57] hi joal! [09:44:35] we're moving forward on importing commons RDF dumps to hdfs [09:44:45] super [09:45:21] dcausse: I have a request as well: could we change you RDF dumps processing of wikidata so that the dumps endup in a /wmf/data/wmf folder? [09:45:37] sure [09:45:42] dcausse: nothing urgent, but it'd be cool :) [09:45:54] makes sense [09:46:08] we'll move the commons one directly there [09:46:24] dcausse: /wmf/data/wmf/rdf ? [09:46:41] then /wmf/data/wmf/rdf/wikidata and /wmf/data/wmf/rdf/commons ? [09:46:44] /wmf/data/wmf/rdf/commons /wmf/data/wmf/rdf/wikidata [09:46:48] +1 [09:46:51] hehe :) [09:46:53] awesome [09:47:28] note that airflow is running under analytics-search [09:47:40] right [09:48:23] but it's not private data, we could make /wmf/data/wmf/rdf owned by analytic-search and have g+r with analytics-users? [09:48:31] analytics-search it'll be until we have an airflow of our own - and actually, instead of airflow of our own, we should separate airflow instances by the user that run them - makes a lot of sense [09:48:54] sure [09:49:08] dcausse: those rdf being public, let's actually have o+rw for the folders, and o+r for files [09:49:17] oh right [09:49:45] it's also a hive table [09:49:54] ok [09:52:02] currently discovery.wikidata_rdf, should it be wmf.wikidata_rdf ? [09:52:13] dcausse: That would be perfect yes :) [09:52:42] ok I'll create a ticket with all that [09:52:45] dcausse: while mentioning this, I'm thinking of how we could automate some of the thing we discuss now with Atlas (or similar)( [09:52:51] Thanks a lot dcausse :) [09:53:22] I don't what is Atlas actually [09:53:25] know* [09:53:40] apache atlas? [09:53:45] dcausse: correct [09:53:51] looking [09:54:18] dcausse: Data governance tools - Those allow for people to look for data, but for systems to look for metadata for data [09:54:45] * joal would like for hive schemas to be stored in atlas :) [09:54:57] ok I see [09:55:14] do you have it running in the cluster at the moment? [09:55:30] dcausse: we don't - it'll be the big project of next fiscal I assume [09:55:39] nice [09:57:20] so for the commons rdf I have https://gerrit.wikimedia.org/r/c/operations/puppet/+/642411 (which is perhaps a bit complex as I had to refactor and generalize wikidata->wikibase) [09:57:43] so that commons can reuse the wikidata hdfs_rsync tooling [09:59:24] dumps are around 16G for the moment (https://dumps.wikimedia.org/other/wikibase/commonswiki/) [09:59:56] That's great dcausse :) [10:00:42] thanks! [10:13:34] 10Analytics, 10Discovery-Search: Move wikidata RDF triples files/table to the wmf namespace in hdfs and hive - https://phabricator.wikimedia.org/T272961 (10dcausse) [10:14:37] 10Analytics, 10Discovery-Search: Move wikidata RDF triples files/table to the wmf namespace in hdfs and hive - https://phabricator.wikimedia.org/T272961 (10dcausse) [10:15:30] 10Analytics, 10Discovery-Search: Move wikidata RDF triples files/table to the wmf namespace in hdfs and hive - https://phabricator.wikimedia.org/T272961 (10dcausse) [10:20:51] * elukey coffee [10:51:28] (03CR) 10DCausse: Add rdf-streaming-updater schemas for side outputs (031 comment) [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/647723 (https://phabricator.wikimedia.org/T269619) (owner: 10DCausse) [10:51:30] (03PS6) 10DCausse: Add rdf-streaming-updater schemas for side outputs [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/647723 (https://phabricator.wikimedia.org/T269619) [11:13:04] 10Analytics-Clusters, 10Patch-For-Review: Create a temporary hadoop backup cluster - https://phabricator.wikimedia.org/T260411 (10elukey) Last two nodes added to the cluster, in theory it is ready to go. Will leave this task open for a bit in case something is needed :) [11:13:58] 10Analytics, 10EventStreams, 10Services: To provide performer array in RC stream - https://phabricator.wikimedia.org/T218063 (10Iluvatar) Several combined streams are bad for mobile (higher traffic, mobile device load) and sometimes maybe dysynch. For works with them need to create "proxy" where info about e... [11:35:25] (03PS4) 10Svantje Lilienthal: added editor type preferences [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/657362 (https://phabricator.wikimedia.org/T271902) [11:36:23] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: eventgate-wikimedia should emit metrics about validation errors - https://phabricator.wikimedia.org/T257237 (10fgiunchedi) >>! In T257237#6775245, @Ottomata wrote: > @fgiunchedi hello! Been reading some alert documentation stuff and I... [11:36:34] (03CR) 10Svantje Lilienthal: "Thanks for the comments. I adapted the code accordingly." (034 comments) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/657362 (https://phabricator.wikimedia.org/T271902) (owner: 10Svantje Lilienthal) [12:01:54] 10Analytics: Generalize the current Airflow puppet/scap code to deploy a dedicated Analytics instance - https://phabricator.wikimedia.org/T272973 (10elukey) [12:02:01] joal: --^ :) [12:06:23] * elukey lunch [12:06:56] <3 elukey :) [12:21:39] (03PS1) 10Neil P. Quinn-WMF: Improve documentation on deploying Oozie jobs [analytics/wmf-product/jobs] - 10https://gerrit.wikimedia.org/r/658578 (https://phabricator.wikimedia.org/T267940) [12:23:12] (03CR) 10Neil P. Quinn-WMF: [V: 03+2 C: 03+2] "Since this only changes the readme, I'll self-merge it." [analytics/wmf-product/jobs] - 10https://gerrit.wikimedia.org/r/658578 (https://phabricator.wikimedia.org/T267940) (owner: 10Neil P. Quinn-WMF) [12:38:56] good morning team :) [12:40:58] Hi fdans [12:52:53] Guys, I have to take care of a family situation (nothing too horrible), I'll take the afternoon off. [13:09:32] klausman: ack, take care [13:17:46] 10Analytics, 10Discovery-Search: Move wikidata RDF triples files/table to the wmf namespace in hdfs and hive - https://phabricator.wikimedia.org/T272961 (10JAllemandou) After reviewing permissions in `/wmf/data/wmf` folder, I think this ask should be done when we can move the airflow job computing the data to... [13:25:48] 10Analytics-EventLogging, 10Analytics-Radar, 10CSS: Schema code samples popup appears under the JSON table - https://phabricator.wikimedia.org/T272857 (10Ammarpad) I was about to report this... I found {T249557} which may suggests this worked in Vector skin at the time. It currently works correctly in MonoB... [13:58:22] hello teammmmm [13:58:30] Hi mforns [13:58:43] heya :] [14:03:07] elukey: holaa, is there anything I can work on related to thorium data? if you have time later today we can sync on that [14:14:01] btw elukey, I volunteer :D [14:14:20] mforns: oooof I completely forgot, I'll need to check, thanks for the ping [14:15:27] the volunteer part is re. 2FA, will look at the docs later today or tomorrow <- elukey [14:16:07] ahhh yes [14:17:40] mforns: if you have a yubikey ready I can set your account for 2fa [14:17:51] elukey: I do [14:17:58] the next time that you'll need to authenticate the yubikey will be required (and automatically registered) [14:18:21] mforns: done :) [14:18:27] O.o! [14:18:30] already? [14:18:42] yes it super quick! A single flag in ldap [14:18:59] elukey: which services does this affect? [14:22:41] mforns: all the ones behind CAS [14:22:50] ok [14:22:56] will read docs [14:25:42] mforns: basically for us, Superset Turnilo Hue-next Yarn [14:26:09] 10Analytics, 10EventStreams, 10Services: To provide performer array in RC stream - https://phabricator.wikimedia.org/T218063 (10Ottomata) > Several combined streams are bad for mobile (higher traffic, mobile device load) You can subscribe to multiple streams in the same HTTP connection, e.g. https://stream.w... [14:32:02] 10Analytics: Add kzeta to analytics-privatedata-users - https://phabricator.wikimedia.org/T272982 (10mforns) [14:32:27] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Superset presto error: Failed to list directory: hdfs://analytics-hadoop/wmf/data/event/... - https://phabricator.wikimedia.org/T272741 (10mforns) @kzimmerman I've checked and I could not find your username (kzeta right?) in the `analytics-privatedata-use... [14:38:31] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Superset presto error: Failed to list directory: hdfs://analytics-hadoop/wmf/data/event/... - https://phabricator.wikimedia.org/T272741 (10elukey) @kzimmerman https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Access_Groups We are trying to simpli... [14:49:46] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: NavigationTiming Extension schemas Event Platform Migration - https://phabricator.wikimedia.org/T271208 (10mforns) [15:11:22] 10Analytics: Follow up on Druid alarms not firing when Druid indexations were failing due to permission issues - https://phabricator.wikimedia.org/T271568 (10mforns) a:03mforns Weird... In puppet, `eventlogging_to_druid_job.pp` uses `$deploy_mode = 'client'`. Plus, `HiveToDruid` has: ` // Exit with pro... [15:30:05] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10EventStreams, and 5 others: Set up internal eventstreams instance exposing all streams declared in stream config (and in kafka jumbo) - https://phabricator.wikimedia.org/T269160 (10elukey) Created all the TLS certs and configs as described in https://wik... [15:30:15] a-team, anything that you want me to deploy today? deployment etherpad is empty [15:32:33] mforns: not from me - I forgot to add you to https://phabricator.wikimedia.org/T272973 [15:32:41] lemme know what you think about the plan when you have a moment [15:32:57] (not true I added you :D) [15:33:42] elukey: yes, I read your task description in the phab email, LGTM! [15:34:05] perfect :) [15:34:34] Erik brought up an interesting topic, namely what we want to do to share operators etc.. [15:35:04] the main challenging thing could be to keep 1.10.x and 2.x.x deployments [15:35:12] with different configs etc.. [15:35:21] maybe discovery is ready to move to airflow 2.x [15:44:58] a-team I am fixing up some eventgate metrics, trying to get some validation error alerts working better [15:45:05] got a nice panel in this dash now [15:45:05] https://grafana.wikimedia.org/d/ePFPOkqiz/eventgate?orgId=1&refresh=1m&var-service=eventgate-analytics-external&var-stream=All&var-kafka_broker=All&var-kafka_producer_type=All&var-dc=thanos&from=1611672255836&to=1611675855836&viewPanel=75 [15:46:02] elukey: yes, makes sense to share operators. and yes, would be cool for all of us to use airflow2 [15:49:06] ottomata: graph looks good! [15:56:16] 10Analytics: Check data currently stored on thorium and drop what it is not needed anymore - https://phabricator.wikimedia.org/T265971 (10elukey) Ok as Joseph was mentioning, my backup is missing something: ` elukey@thorium:/srv/backup$ sudo du -hs * 68G backup_wikistats_1 626G public-datasets 156G wikistats `... [16:28:45] 10Analytics-Clusters, 10DC-Ops, 10SRE, 10ops-eqiad: (Need By: TBD) rack/setup/install an-worker11[18-41] - https://phabricator.wikimedia.org/T260445 (10elukey) [16:33:41] 10Analytics-Clusters, 10DC-Ops, 10SRE, 10ops-eqiad: (Need By: TBD) rack/setup/install an-worker11[18-41] - https://phabricator.wikimedia.org/T260445 (10elukey) Ok all nodes racked are now working! We have 6 missing node still to rack, ideally in rows not already too used. For example, this is our current d... [16:34:04] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Superset presto error: Failed to list directory: hdfs://analytics-hadoop/wmf/data/event/... - https://phabricator.wikimedia.org/T272741 (10kzimmerman) Thanks @mforns ! [16:35:36] ottomata: o/ [16:35:43] do we need to keep puppet disabled on kafka-test nodes [16:35:44] ? [16:36:58] elukey: no, that was only needed while experimenting, and no active experiments [16:37:50] razzi: ah perfect, can you re-enable + run-puppet? [16:37:53] also good morning [16:37:55] :) [16:37:58] sure thing. Good morning :) [16:39:47] And while I'm at it... [16:39:54] !log reboot kafka-test1006 for kernel upgrade [16:39:56] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [16:42:59] :) [16:48:01] razzi: question for later on - what is the best procedure to safely reboot an-launcher1002? [16:48:11] (then we can look into it together) [17:01:27] a-team will be about 2-3 min late, still in mgmt meeting [17:01:32] pls start [17:01:36] k [17:01:50] 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10Patch-For-Review: eventgate-wikimedia should emit metrics about validation errors - https://phabricator.wikimedia.org/T257237 (10Ottomata) Status: got some good metrics in Prometheus/Grafana: https://grafana-rw.wikimedia.org/d/ePFPOkqiz/eventgate?orgId=... [17:02:22] 10Analytics-Radar, 10Domains, 10SRE, 10Traffic, and 2 others: Don't set cookies in traffic layer for non-user facing domains (avoid false third-party cookie warning) - https://phabricator.wikimedia.org/T262996 (10Krinkle) [17:02:36] 10Analytics-Radar, 10Domains, 10SRE, 10Traffic, 10Wikimedia-General-or-Unknown: Don't set cookies in traffic layer for non-user facing domains (avoid false third-party cookie warning) - https://phabricator.wikimedia.org/T262996 (10Krinkle) [17:02:40] 10Analytics-Radar, 10Domains, 10SRE, 10Traffic, 10Wikimedia-General-or-Unknown: Don't set cookies in traffic layer for non-user facing domains (avoid false third-party cookie warning) - https://phabricator.wikimedia.org/T262996 (10Krinkle) [17:17:07] 10Analytics, 10EventStreams, 10Services: To provide performer array in RC stream - https://phabricator.wikimedia.org/T218063 (10Iluvatar) Yes, I confirm this summarise. > am I correct in assuming that it is pages that are patrolled, not specific revisions? As I understand ([[https://www.mediawiki.org/wiki/... [17:39:08] 10Analytics-Clusters, 10DC-Ops, 10SRE, 10ops-eqiad: (Need By: TBD) rack/setup/install an-worker11[18-41] - https://phabricator.wikimedia.org/T260445 (10wiki_willy) Hi @elukey - in looking through Netbox and talking to Chris, this is what I'm thinking, but @Cmjohnson/@Jclark-ctr/@elukey - please call me out... [18:05:02] 10Analytics-Radar, 10Better Use Of Data, 10Instrument-ClientError, 10Wikimedia-Logstash, and 2 others: Documentation of client side error logging capabilities on mediawiki - https://phabricator.wikimedia.org/T248884 (10Jdlrobson) [19:06:30] * elukey afk! [19:25:13] 10Analytics-Clusters: Balance Kafka topic partitions on Kafka Jumbo to take advantage of the new brokers - https://phabricator.wikimedia.org/T255973 (10razzi) [19:44:12] 10Analytics-Clusters, 10Product-Analytics: Configure superset cache - https://phabricator.wikimedia.org/T268784 (10Jgreen) @razzi Did you get this working? I've been testing in my fundraising Superset dev environment, and so far Superset/Flask doesn't seem to enable the cache. See {T272636} [19:45:08] 10Analytics, 10Better Use Of Data, 10Event-Platform, 10Product-Infrastructure-Data, and 2 others: EventLogging PHP EventServiceClient should use EventBus->send(). - https://phabricator.wikimedia.org/T272863 (10Ottomata) @hashar We're having some issues with getting CI to run after merging https://gerrit.wi... [19:59:48] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: NavigationTiming Extension schemas Event Platform Migration - https://phabricator.wikimedia.org/T271208 (10Ottomata) @Gilles, for all 'analytics' event streams, we've been automating some monitoring and ingestion by... [20:03:25] 10Analytics, 10Product-Analytics: Presto error: Failed to list directory - https://phabricator.wikimedia.org/T272767 (10kzimmerman) @ppelberg yes, tagging Product Analytics was a good call, we can help direct this! I think the issue is that you're trying to directly query a table that is accessible to people... [20:09:06] (03PS1) 10Ottomata: Migrate 5 NavigationTiming extension schemas from metawiki [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/658668 (https://phabricator.wikimedia.org/T271208) [20:14:44] 10Analytics, 10Product-Analytics: Presto error: Failed to list directory - https://phabricator.wikimedia.org/T272767 (10Ottomata) @elukey, do Superset+Presto users need analytics-privatedata-users access? If so, we should give different advice than we did in https://phabricator.wikimedia.org/T271602#6735021!... [20:18:21] 10Analytics: Presto should warn or prevent users from querying without Hive partition predicates - https://phabricator.wikimedia.org/T273004 (10Ottomata) [20:18:58] 10Analytics, 10Product-Analytics: Presto error: Failed to list directory - https://phabricator.wikimedia.org/T272767 (10Ottomata) > I think Presto is allowing you to do this when it shouldn't. I'll file a ticket for that. FYI: {T273004} [20:22:02] (03CR) 10Ottomata: [C: 03+2] Migrate 5 NavigationTiming extension schemas from metawiki [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/658668 (https://phabricator.wikimedia.org/T271208) (owner: 10Ottomata) [20:30:44] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: NavigationTiming Extension schemas Event Platform Migration - https://phabricator.wikimedia.org/T271208 (10Ottomata) [20:45:06] 10Analytics-Clusters, 10Product-Analytics: Configure superset cache - https://phabricator.wikimedia.org/T268784 (10razzi) @Jgreen I did get this working, and confirmed it was working by visiting it in the UI, where you can see whether a chart is cached in the overflow menu: {F34027762} I also saw the log war... [20:56:00] (03PS1) 10Mholloway: Create fragment/analytics/dimensions/mediawiki [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/658677 (https://phabricator.wikimedia.org/T271456) [20:56:03] 10Analytics-Clusters, 10Product-Analytics: Configure superset cache - https://phabricator.wikimedia.org/T268784 (10Jgreen) >>! In T268784#6778345, @razzi wrote: > @Jgreen I did get this working, and confirmed it was working by visiting it in the UI, where you can see whether a chart is cached in the overflow m... [20:57:04] ottomata: o/ [20:57:32] yohoo [20:58:00] what do you mean with "we should give a different advice?" [20:58:03] oh [20:58:14] https://phabricator.wikimedia.org/T271602#6735021 says that it needs privatedata-users no? [20:58:41] I was reading https://phabricator.wikimedia.org/T272767 [20:58:42] OH wait I forgot! we put them in the group but without ssh access? [20:59:16] yes exactly :) [20:59:23] ah ok, so they don't need an ssh key [20:59:24] right? [20:59:30] yep yep [20:59:45] ok, but they still need manager approval i think. will comment on ticket, i see that it actually isn't even closed now [20:59:47] but with membership only they can list stuff from Superset in theory [21:00:01] ahhh okok I was worried that I wrote something weird [21:00:02] okok [21:00:20] I tried to write the use case in https://wikitech.wikimedia.org/wiki/Analytics/Data_access#Access_Groups [21:00:34] 10Analytics, 10Product-Analytics: Presto error: Failed to list directory - https://phabricator.wikimedia.org/T272767 (10Ottomata) Ah, yes ok. @ppelberg, your access ticket is not yet finished! {T271602} I'll comment over there. [21:02:14] right ok [21:04:33] 10Analytics, 10Product-Analytics: Presto error: Failed to list directory - https://phabricator.wikimedia.org/T272767 (10Ottomata) 05Open→03Invalid This will be fixed once @ppelberg access request is finished. Closing. [21:04:44] 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Event-Platform, and 2 others: NavigationTiming Extension schemas Event Platform Migration - https://phabricator.wikimedia.org/T271208 (10Ottomata) [21:05:22] (03PS2) 10Mholloway: Create fragment/analytics/dimensions/mediawiki [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/658677 (https://phabricator.wikimedia.org/T271456) [21:21:13] 10Analytics-Clusters: Improve logging for HDFS Namenodes - https://phabricator.wikimedia.org/T265126 (10Ottomata) @elukey after the new LVM partition is created, should it be declared in puppet with a `mount` resource? And should we also declare the directories and symlinks in puppet too? [21:32:52] 10Analytics-Clusters: Balance Kafka topic partitions on Kafka Jumbo to take advantage of the new brokers - https://phabricator.wikimedia.org/T255973 (10razzi)