[00:13:04] PROBLEM - Check unit status of drop_event on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit drop_event https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [06:05:36] !log kill christinedk's jupyter process on stat1007 (offboarded user) to allow puppet to run [06:05:39] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log [06:23:14] Good morning [06:33:02] bonjour [08:46:17] Morning joal ! If I had a question about WD triples, and figuring out how many there are for some "subsets" of things, would you be the person to talk to? [08:47:27] addshore: Hi! me and tanny411 :) [08:47:56] woo! [08:52:46] And actually I should have been more polite - tanny411 and me :) And also Mike Pham I think :) [08:53:08] joal: All permutations are fine :p [08:53:26] So, im currently looking at this [08:53:28] https://usercontent.irccloud-cdn.com/file/eGRBys8J/image.png [08:53:47] And wondering how quikc and easy it would end up being to count the number of triples in each of these boxes [08:55:17] addshore: there are tickets about some of that I think, managed by Mike, with tanny411 (and me as a helper) to do some analysis [08:56:35] addshore: If you could provide that exact chart with sparql-style ways of selecting them that would be very helpful (you're more fluent in sparql/wikidata than we are :) [08:57:18] 👍 sounds good! thanks :) [08:57:47] addshore: and you probably should talk to Mike about the tasks he's created, and how we should document the need for analysis [08:58:18] addshore: see https://phabricator.wikimedia.org/T281854 [08:58:23] hey folks, if possible let's move to libera [08:58:31] Yup, we on the WD side are actually looking at this in a slightly different context to wdqs disaster planning right now, but it ends up asking a bunch of the aame quesitons [08:59:02] indeed addshore - let's try to talk to each other enough so that we don't duplicate works (1 execution [08:59:09] for 2 contexts is what I prefer :) [08:59:12] yarp! [08:59:41] addshore: there is that one as well: https://phabricator.wikimedia.org/T282790 [09:00:32] also addshore, tanny411 - I'm on libera, same channel name if you wish :) [09:01:02] addshore: https://docs.google.com/document/d/1N2ludK2QllzndrlQiQ7c6V1dT3NZBiABQL_kZH1P5Io/edit [09:01:20] im also there :) [09:02:09] addshore: I assume that your chart correspond to https://phabricator.wikimedia.org/T282790 more or less - Can you please provide it there with the sparql defs? It'd make tanny411's life a lot easier for analysis I think [09:03:42] indeed, but not in the context of dropping. Awesome, will add this to our list of TODOs [09:06:25] And now I am on libera as well. [09:06:31] nice :) [14:06:12] (03PS1) 10Gilles: Add request context fields to CpuBenchmark schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/693163 (https://phabricator.wikimedia.org/T281243) [15:38:02] 10Analytics: account access - https://phabricator.wikimedia.org/T283250 (10jmixter) [15:38:07] 10Analytics: Question box in wikistats, instrument usage with piwik - https://phabricator.wikimedia.org/T247106 (10fdans) 05Open→03Resolved a:03fdans [15:38:09] 10Analytics: Remove Topic Explorer from Wikistats - https://phabricator.wikimedia.org/T247064 (10fdans) [15:38:33] 10Analytics: Remove Topic Explorer from Wikistats - https://phabricator.wikimedia.org/T247064 (10fdans) 05Open→03Declined [15:47:23] 10Analytics: Add ability to compare wikis - https://phabricator.wikimedia.org/T283251 (10fdans) [15:59:40] 10Analytics: Wikistats should allow more than one project - https://phabricator.wikimedia.org/T283254 (10fdans) [16:03:25] hey, sorry, just realized I disconnected after an internet hiccup [16:24:29] 10Analytics, 10Wikidata, 10Wikidata-Query-Service: Automate regular WDQS query parsing and data-extraction - https://phabricator.wikimedia.org/T273854 (10JAllemandou) a:05JAllemandou→03None [16:24:50] 10Analytics, 10Wikidata, 10Wikidata-Query-Service: Automate regular WDQS query parsing and data-extraction - https://phabricator.wikimedia.org/T273854 (10JAllemandou) [16:25:56] 10Analytics, 10Wikidata, 10Wikidata-Query-Service: Automate regular WDQS query parsing and data-extraction - https://phabricator.wikimedia.org/T273854 (10JAllemandou) [16:38:46] 10Analytics, 10LDAP-Access-Requests, 10SRE-Access-Requests: Account setup issues for jmixter-ctr - https://phabricator.wikimedia.org/T283250 (10elukey) [16:47:02] 10Analytics, 10Analytics-EventLogging, 10Event-Platform, 10Growth-Team, 10GrowthExperiments-Homepage: '.newcomer_task_token' should be string, '.homepage_pageview_token' should be string - https://phabricator.wikimedia.org/T283259 (10phuedx) [16:59:23] 10Analytics, 10Analytics-EventLogging, 10Event-Platform, 10Growth-Team, 10GrowthExperiments-Homepage: mediawiki.structured_task.article.link_suggestion_interaction: '.newcomer_task_token' should be string, '.homepage_pageview_token' should be string - https://phabricator.wikimedia.org/T283259 (10phuedx) [17:02:16] 10Analytics, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests: Account setup issues for jmixter-ctr - https://phabricator.wikimedia.org/T283250 (10elukey) Had a chat with Jeff on Slack (together with @JAllemandou), and the account `JMixter (WMF)` seems not accessible on meta (maybe the password reset +... [17:03:21] 10Analytics, 10Analytics-EventLogging, 10Event-Platform, 10Growth-Team, 10GrowthExperiments-Homepage: mediawiki.structured_task.article.link_suggestion_interaction: '.newcomer_task_token' should be string, '.homepage_pageview_token' should be string - https://phabricator.wikimedia.org/T283259 (10phuedx) [17:08:06] 10Analytics-Clusters, 10Data-Persistence-Backup: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10JAllemandou) [17:12:12] 10Analytics-Clusters, 10Data-Persistence-Backup: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10LSobanski) p:05Triage→03Medium My understanding based on recent conversations was that a decision is yet to be made about what approach to take with HDFS backup /... [17:14:21] 10Analytics-Clusters, 10Data-Persistence-Backup: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10JAllemandou) @LSobanski You're absolutely right, this task is about documenting on our end the priorities and sizes of datasets to be backed up so that we can be bette... [17:16:35] 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Request for access to analytics-privatedata-users - https://phabricator.wikimedia.org/T283190 (10odimitrijevic) a:03Ottomata [17:18:06] 10Analytics-Radar, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests: Account setup issues for jmixter-ctr - https://phabricator.wikimedia.org/T283250 (10odimitrijevic) [17:19:00] 10Analytics-Clusters, 10Data-Persistence-Backup: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10elukey) @JAllemandou I'd remove Data Persistence from this task, with the team's choices we'll not get any storage for the next fiscal year (so this task may be confus... [17:19:34] 10Analytics, 10Analytics-Kanban: Wikistats should allow more than one project - https://phabricator.wikimedia.org/T283254 (10odimitrijevic) p:05Triage→03High a:03fdans [17:20:03] 10Analytics-Clusters, 10Data-Persistence-Backup: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10JAllemandou) ACk - doing so - thanks @elukey [17:20:17] 10Analytics: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10JAllemandou) [17:20:20] 10Analytics-EventLogging, 10Analytics-Radar, 10Event-Platform, 10Growth-Team, 10GrowthExperiments-Homepage: mediawiki.structured_task.article.link_suggestion_interaction: '.newcomer_task_token' should be string, '.homepage_pageview_token' should be string - https://phabricator.wikimedia.org/T283259 (10odi... [17:20:55] 10Analytics-EventLogging, 10Analytics-Radar, 10Event-Platform, 10Growth-Team, 10GrowthExperiments-Homepage: mediawiki.structured_task.article.link_suggestion_interaction: '.newcomer_task_token' should be string, '.homepage_pageview_token' should be string - https://phabricator.wikimedia.org/T283259 (10kos... [17:21:48] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA, 10Patch-For-Review: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10odimitrijevic) [17:23:12] 10Analytics: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10odimitrijevic) p:05Medium→03High [17:23:42] 10Analytics: Define priorities for HDFS data to be backed up - https://phabricator.wikimedia.org/T283261 (10odimitrijevic) a:03JAllemandou [17:25:50] 10Analytics-Clusters, 10Data-Persistence-Backup: Evaluate possible solutions to backup Analytics Hadoop's HDFS data - https://phabricator.wikimedia.org/T277015 (10LSobanski) p:05Triage→03Low Blocked at least until we get a clear picture from T283261. [17:28:25] 10Analytics, 10Product-Analytics, 10wmfdata-python: wmfdata-python's Hive query output includes logspam - https://phabricator.wikimedia.org/T275233 (10Ottomata) @nshahquinn-wmf Hive CLI logs are certainly annoying/weird. Q though: any reason wmfdata.hive is using Hive CLI instead of a Hive Python Client? [17:30:19] 10Analytics, 10Analytics-Kanban, 10Product-Analytics, 10wmfdata-python: wmfdata-python's Hive query output includes logspam - https://phabricator.wikimedia.org/T275233 (10Milimetric) a:05nshahquinn-wmf→03Milimetric I think Andrew has some ideas, we'll get to the bottom of this one way or another. Then... [18:45:18] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by razzi on cumin1001.eqiad.wmnet for hosts: ` dbstore1006.eqiad.wmnet ` The log can be found in `/var/log/wmf-auto-reimage... [18:57:05] 10Analytics-Radar, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests: Account setup issues for jmixter-ctr - https://phabricator.wikimedia.org/T283250 (10Aklapper) On-wiki SUL account on meta, mentioned by elukey: https://meta.wikimedia.org/wiki/Special:Log?page=User:JMixter_(WMF) looks correct to me. W... [19:23:54] 10Analytics-Radar, 10LDAP-Access-Requests, 10SRE, 10SRE-Access-Requests: Account setup issues for jmixter-ctr - https://phabricator.wikimedia.org/T283250 (10jmixter) I was able to create the Developer Account following the instructions. I guess I am confused about all of the various accounts I needed to se... [19:42:57] (03CR) 10Ottomata: [C: 03+1] Add request context fields to CpuBenchmark schema [schemas/event/secondary] - 10https://gerrit.wikimedia.org/r/693163 (https://phabricator.wikimedia.org/T281243) (owner: 10Gilles) [19:45:30] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['dbstore1006.eqiad.wmnet'] ` Of which those **FAILED**: ` ['dbstore1006.eqiad.wmnet'] ` [19:45:53] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10ops-monitoring-bot) Script wmf-auto-reimage was launched by razzi on cumin1001.eqiad.wmnet for hosts: ` dbstore1006.eqiad.wmnet ` The log can be found in `/var/log/wmf-auto-reimage... [20:51:44] 10Analytics-Clusters, 10Analytics-Kanban, 10DBA: dbstore1004 85% disk space used. - https://phabricator.wikimedia.org/T283125 (10ops-monitoring-bot) Completed auto-reimage of hosts: ` ['dbstore1006.eqiad.wmnet'] ` Of which those **FAILED**: ` ['dbstore1006.eqiad.wmnet'] ` [20:55:22] Goodbye this channel, it was fun, see you on libera.chat [22:00:07] 10Analytics-Radar, 10GrowthExperiments, 10Growth-Team (Current Sprint), 10MW-1.36-notes (1.36.0-wmf.30; 2021-02-09): eventgate_validation_error for NewcomerTask, HomepageTask, and HomepageVisit schemas - https://phabricator.wikimedia.org/T273700 (10Etonkovidova) 05Open→03Resolved No errors on `wmf.6`.