[07:49:32] <wikibugs>	 (03PS1) 10Mforns: Fix bug in pingback/php_drilldown [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/545707 (https://phabricator.wikimedia.org/T223414)
[07:50:57] <wikibugs>	 (03CR) 10Mforns: [V: 03+2 C: 03+2] "Self-merging to correct production." [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/545707 (https://phabricator.wikimedia.org/T223414) (owner: 10Mforns)
[10:50:29] <wikibugs>	 10Analytics, 10Performance-Team, 10Research, 10Security-Team, 10WMF-Legal: A Large-scale Study of Wikipedia Users' Quality of Experience: data release - https://phabricator.wikimedia.org/T217318 (10Gilles) I've reviewed the data, it's exactly what we had requested and looks completely safe to release. @n...
[11:54:20] <icinga-wm>	 PROBLEM - eventlogging Varnishkafka log producer on cp3060 is CRITICAL: NRPE: Command check_varnishkafka-eventlogging not defined https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[11:58:26] <icinga-wm>	 PROBLEM - statsv Varnishkafka log producer on cp3060 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[12:18:56] <elukey>	 ah need to add the graph to the vk alerts
[12:19:12] <elukey>	 but basically there was a problem in esams, see #wikimedia-operations
[12:19:15] <elukey>	 mforns: --^
[12:19:41] <elukey>	 https://grafana.wikimedia.org/d/000000253/varnishkafka?orgId=1&from=now-1h&to=now
[12:20:35] <elukey>	 also esams is now depooled
[12:23:23] <elukey>	 more specifically, cp3036 is under reimaging
[12:26:01] <elukey>	 just sent an email
[12:31:36] <icinga-wm>	 RECOVERY - statsv Varnishkafka log producer on cp3060 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[12:32:44] <icinga-wm>	 RECOVERY - eventlogging Varnishkafka log producer on cp3060 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[13:05:32] <wikibugs>	 10Analytics, 10Research: Taxonomy of new user reading patterns - https://phabricator.wikimedia.org/T234188 (10MGerlach) == Updates 2019-10 ==  ==== Methods ==== I queried reading sessions of new users from webrequest-logs for 1 week 2019-09-09 -- 2019-09-15 for the English Wikipedia (access_method = desktop |...
[13:35:54] <mforns>	 hi team, just arrived...
[13:48:28] <fdans>	 !llog running top mediarequest backfill from 2015-01-02 to 2019-05-01
[13:49:33] <fdans>	 why is this thing not logging
[13:53:55] <fdans>	 oh
[13:53:58] <fdans>	 llog running top mediarequest backfill from 2015-01-02 to 2019-05-01
[13:54:02] <fdans>	 !log running top mediarequest backfill from 2015-01-02 to 2019-05-01
[13:54:07] <stashbot>	 Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log
[13:58:09] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Move reportupdater reports that pull data from eventlogging mysql to pull data from hadoop - https://phabricator.wikimedia.org/T223414 (10mforns) Hi @CCicalese_WMF   All data from `MySQL:log.MediaWikiPingback_*` is now present i...
[14:03:38] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Move reportupdater reports that pull data from eventlogging mysql to pull data from hadoop - https://phabricator.wikimedia.org/T223414 (10mforns) BTW @CCicalese_WMF  I also added the MediaWiki version 1.32 to the PHP drilldown D...
[14:09:22] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Better Use Of Data, 10Event-Platform, and 6 others: Modern Event Platform: Stream Configuration: Implementation - https://phabricator.wikimedia.org/T233634 (10Ottomata) Current status:  -  `$wgEventStreams` (name TBD) is a list of stream config entries, e.g.  `lang=...
[14:10:50] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Better Use Of Data, 10Event-Platform, and 6 others: Modern Event Platform: Stream Configuration: Implementation - https://phabricator.wikimedia.org/T233634 (10Ottomata) BTW, once this settles, we should use the finalized `wgEventStreams` to complete {T229863}
[14:11:10] <mforns_>	 fdans, hellooooo is the alert of mediarequests (non-backfilling) coord sth I should look into? I think it's the same error as yesterday
[14:11:45] <fdans>	 mforns_: nope, don't look into anything related to mediarequests
[14:11:58] <fdans>	 I'm keeping track of failed days to restart
[14:12:09] <mforns_>	 ok, thanks :]
[14:12:48] <fdans>	 mforns_: the failed ones last night were due to the R jobs consuming all the resources
[14:13:37] <mforns_>	 aha
[14:27:43] <milimetric>	 I'm sorry I'm silent in the mornings, I start working and immediately check pings and it's two hours later before I know it
[14:28:03] <milimetric>	 I should always start by saying hi to yall... imagine if we were in an office and I came in and just didn't talk to anyone for like two hours
[14:28:08] <milimetric>	 how ruDE!
[14:28:15] <milimetric>	 hiiii!
[14:48:00] <wikibugs>	 (03PS1) 10Awight: Report for ReferencePreviews popups [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/545869 (https://phabricator.wikimedia.org/T214493)
[15:00:28] <wikibugs>	 10Analytics, 10Event-Platform, 10Scoring-platform-team: Produce a ORES score event for HDFS - https://phabricator.wikimedia.org/T225210 (10Halfak)
[15:00:30] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Event-Platform, 10ORES, and 5 others: Emit revision-score event to EventBus and expose in EventStreams - https://phabricator.wikimedia.org/T167180 (10Halfak)
[15:09:24] <ottomata>	 milimetric:  naw, no hi necessary :!
[15:09:32] <ottomata>	 but hello!
[15:09:47] <milimetric>	 hi :)
[15:20:56] <mforns_>	 :]
[16:10:56] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban: Remove references in doc to mysql storage for EL data - https://phabricator.wikimedia.org/T236403 (10Nuria)
[16:20:26] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban: Remove references in doc to mysql storage for EL data - https://phabricator.wikimedia.org/T236403 (10Milimetric) p:05Triage→03High
[16:45:08] <wikibugs>	 10Analytics, 10Operations, 10ops-eqiad, 10User-Elukey: replace onboard NIC in kafka-jumbo100[1-6] - https://phabricator.wikimedia.org/T236327 (10fdans) p:05Triage→03High
[16:45:59] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10good first bug: Update pingback reports to use heartbeat pings to filter data - https://phabricator.wikimedia.org/T236178 (10fdans)
[16:47:49] <wikibugs>	 10Analytics, 10Better Use Of Data, 10Epic, 10Performance-Team (Radar), 10Product-Infrastructure-Team-Backlog (Kanban): Prototype client to log errors in vagrant - https://phabricator.wikimedia.org/T235189 (10jlinehan) Prototype error producer: https://github.com/linehan/wmf-error-mvp  Created a prototype...
[16:49:33] <wikibugs>	 10Analytics, 10CPT Initiatives (Revision Storage Schema Improvements), 10Epic, 10Technical-Debt: Remove revision_comment_temp and revision_actor_temp - https://phabricator.wikimedia.org/T215466 (10Nuria) ping @Milimetric
[16:50:46] <wikibugs>	 10Analytics: Update the AMD ROCm prometheus metric exporter to take into account changes to rocm-smi - https://phabricator.wikimedia.org/T236007 (10Nuria) p:05Triage→03High
[16:51:06] <wikibugs>	 10Analytics: Update the AMD ROCm prometheus metric exporter to take into account changes to rocm-smi - https://phabricator.wikimedia.org/T236007 (10Nuria) a:03elukey
[16:53:34] <wikibugs>	 10Analytics, 10Analytics-Kanban: Add Mon Wikipedia to analytics setup - https://phabricator.wikimedia.org/T235747 (10Nuria) Looks like this is still on incubator: https://incubator.wikimedia.org/w/index.php?title=Wp/mnw/%E1%80%99%E1%80%AF%E1%80%80%E1%80%BA%E1%80%9C%E1%80%AD%E1%80%80%E1%80%BA%E1%80%90%E1%80%99%...
[16:53:48] <wikibugs>	 10Analytics, 10Analytics-Kanban: Add Mon Wikipedia to analytics setup - https://phabricator.wikimedia.org/T235747 (10Nuria) p:05Triage→03High
[16:58:35] <wikibugs>	 10Analytics, 10Analytics-Cluster: Optimize archiva git-fat symlink script - https://phabricator.wikimedia.org/T235668 (10Nuria) p:05Triage→03High
[16:58:48] <wikibugs>	 10Analytics, 10Analytics-Cluster: Optimize archiva git-fat symlink script - https://phabricator.wikimedia.org/T235668 (10Nuria) p:05High→03Normal
[17:05:56] <wikibugs>	 10Analytics, 10Product-Analytics: Create a reports directory under analytics.wikimedia.org - https://phabricator.wikimedia.org/T235494 (10Nuria) a:03Ottomata
[17:07:02] <wikibugs>	 (03CR) 10MNeisler: Add the MobileWebUIActionsTracking schema to EventLogging whitelist (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/541946 (https://phabricator.wikimedia.org/T234563) (owner: 10MNeisler)
[17:08:29] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Create a reports directory under analytics.wikimedia.org - https://phabricator.wikimedia.org/T235494 (10Nuria)
[17:08:47] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Product-Analytics: Create a reports directory under analytics.wikimedia.org - https://phabricator.wikimedia.org/T235494 (10Nuria) p:05Triage→03High
[17:09:16] <wikibugs>	 10Analytics, 10Analytics-Kanban: Hive data quality alarms pipeline - https://phabricator.wikimedia.org/T235486 (10Nuria) p:05Triage→03High
[17:09:27] <wikibugs>	 10Analytics: Add data quality metric: distribution of page view article titles - https://phabricator.wikimedia.org/T235483 (10Nuria) p:05Triage→03Normal
[17:12:00] <wikibugs>	 10Analytics, 10Cloud-Services, 10Developer-Advocacy (Oct-Dec 2019): Puppetize reportupdater to run wmcs reports - https://phabricator.wikimedia.org/T235718 (10Nuria) 05Open→03Resolved
[17:12:02] <wikibugs>	 10Analytics, 10Cloud-Services, 10Developer-Advocacy (Oct-Dec 2019): Develop a tool or integrate feature in existing one to visualize WMCS edits data - https://phabricator.wikimedia.org/T226663 (10Nuria)
[17:14:28] <wikibugs>	 10Analytics, 10CPT Initiatives (MCR), 10Multi-Content-Revisions (Tech Debt), 10Schema-change: Once MCR is deployed, drop the rev_text_id, rev_content_model, and rev_content_format fields from the revision table - https://phabricator.wikimedia.org/T184615 (10Nuria) ping @Milimetric
[17:21:41] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: High volume mediawiki analytics events camus import is lagging - https://phabricator.wikimedia.org/T233718 (10Nuria) 05Open→03Resolved
[18:03:39] <wikibugs>	 10Analytics, 10Community-Tech, 10Product-Analytics (Kanban): Hash all pageTokens or temporary identifiers from the EL Sanitization white-list for Community Tech - https://phabricator.wikimedia.org/T226861 (10aezell) Is there a way for me to discover the schemas that this team has created? Our institutional m...
[18:13:42] <wikibugs>	 10Analytics, 10Better Use Of Data, 10Epic, 10Performance-Team (Radar), 10Product-Infrastructure-Team-Backlog (Kanban): Prototype client to log errors in vagrant - https://phabricator.wikimedia.org/T235189 (10Nuria) >Prototype error producer: https://github.com/linehan/wmf-error-mvp Nice, agreeing 100% th...
[18:20:59] <wikibugs>	 (03CR) 10Nuria: Add the MobileWebUIActionsTracking schema to EventLogging whitelist (031 comment) [analytics/refinery] - 10https://gerrit.wikimedia.org/r/541946 (https://phabricator.wikimedia.org/T234563) (owner: 10MNeisler)
[18:24:23] <wikibugs>	 10Analytics, 10Better Use Of Data, 10Epic, 10Performance-Team (Radar), 10Product-Infrastructure-Team-Backlog (Kanban): Prototype client to log errors in vagrant - https://phabricator.wikimedia.org/T235189 (10Nuria) mmm.. seeing this {T236386} looks like we are readay to start thinking about deploying eve...
[18:29:27] <wikibugs>	 10Analytics-EventLogging, 10Analytics-Kanban: Sunset MySQL data store for eventlogging - https://phabricator.wikimedia.org/T159170 (10Nuria) ping @Ottomata that I think we are ready to announce that mysql consumer on eventlogging will be shutdown, we will be working this week to remove references to mysql on t...
[18:40:19] <wikibugs>	 10Analytics, 10Performance-Team, 10Research, 10Security-Team, 10WMF-Legal: A Large-scale Study of Wikipedia Users' Quality of Experience: data release - https://phabricator.wikimedia.org/T217318 (10Nuria) Look3d at this, +1 on my end, @JFishback_WMF needs (per our privacy framework)  write up a risk asse...
[18:44:42] <wikibugs>	 (03PS1) 10Cicalese: Update to include 1.33 and 1.34 [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/545917 (https://phabricator.wikimedia.org/T223414)
[18:46:45] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Analytics-Kanban, 10Patch-For-Review: Move reportupdater reports that pull data from eventlogging mysql to pull data from hadoop - https://phabricator.wikimedia.org/T223414 (10CCicalese_WMF) Thank you, @mforns! I noticed looking at the graphs that the data for 1.33...
[18:59:06] <wikibugs>	 10Analytics, 10Analytics-EventLogging, 10Better Use Of Data, 10Event-Platform, and 6 others: Modern Event Platform: Stream Configuration: Implementation - https://phabricator.wikimedia.org/T233634 (10Ottomata) `lang=php  [   'stream' => '/^mediawiki\.job\..+/',   'schema_title' => 'mediawiki/job',   'Event...
[19:01:10] <wikibugs>	 10Analytics, 10Analytics-Kanban: Cannot  import tensorflow on stat1005 - https://phabricator.wikimedia.org/T235952 (10Nuria) 05Open→03Resolved
[19:01:52] <wikibugs>	 10Analytics, 10Analytics-Kanban: Update mediawiki-history dumper to use project in file names - https://phabricator.wikimedia.org/T235409 (10Nuria) 05Open→03Resolved
[19:03:13] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Chinese-Sites: MediaWiki history dumps have some events in 2025 - https://phabricator.wikimedia.org/T235269 (10Nuria) 05Open→03Resolved
[19:04:21] <wikibugs>	 10Analytics, 10Analytics-Kanban: Add partition pruning for wmf.browser_general and interlanguage - https://phabricator.wikimedia.org/T235283 (10Nuria) 05Open→03Resolved
[19:04:40] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Proof of concept: Entropy calculations can be used to alarm on anomalies for data quality metrics - https://phabricator.wikimedia.org/T215863 (10Nuria)
[19:04:50] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review: Proof of concept: Entropy calculations can be used to alarm on anomalies for data quality metrics - https://phabricator.wikimedia.org/T215863 (10Nuria) 05Open→03Resolved
[19:04:52] <wikibugs>	 10Analytics, 10Analytics-Kanban: Data Quality Alarms - https://phabricator.wikimedia.org/T198986 (10Nuria)
[19:04:54] <wikibugs>	 10Analytics: Alarm on data quality issues - https://phabricator.wikimedia.org/T159840 (10Nuria)
[19:05:02] <wikibugs>	 10Analytics, 10Analytics-Kanban: Add Balinese wikipedia to analytics setup - https://phabricator.wikimedia.org/T235448 (10Nuria) 05Open→03Resolved
[19:05:31] <wikibugs>	 10Analytics, 10Analytics-Kanban: HivePartition (refinery::Hive.py) does not allow partition values to have dots (.) - https://phabricator.wikimedia.org/T235268 (10Nuria) 05Open→03Resolved
[19:05:46] <wikibugs>	 10Analytics, 10Analytics-Kanban: Add data quality metric: distribution of eventlogging user agents - https://phabricator.wikimedia.org/T234588 (10Nuria) 05Open→03Resolved
[19:05:48] <wikibugs>	 10Analytics, 10Analytics-Kanban: Data Quality Alarms - https://phabricator.wikimedia.org/T198986 (10Nuria)
[19:06:25] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Operations, 10User-Elukey: Archiva relies on a tmpfs directory that is wiped after each reboot - https://phabricator.wikimedia.org/T214366 (10Nuria) 05Open→03Resolved
[19:06:37] <wikibugs>	 10Analytics, 10Analytics-Kanban: Upgrade matomo to its latest upstream version - https://phabricator.wikimedia.org/T234607 (10Nuria) 05Open→03Resolved
[19:07:01] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Decouple analytics zookeeper cluster from kafka zookeeper cluster [2019-2020] - https://phabricator.wikimedia.org/T217057 (10Nuria) 05Open→03Resolved
[19:07:20] <wikibugs>	 10Analytics, 10Analytics-Cluster, 10Analytics-Kanban: 500k files in hdfs /tmp - https://phabricator.wikimedia.org/T234954 (10Nuria) 05Open→03Resolved
[19:08:02] <wikibugs>	 10Analytics, 10Analytics-Cluster, 10Analytics-Kanban: 500k files in hdfs /tmp - https://phabricator.wikimedia.org/T234954 (10Nuria) @EBernhardson shinny start of the week for this one
[19:08:04] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10Services (watching): Create mediarequests top files AQS endpoint - https://phabricator.wikimedia.org/T233716 (10Nuria) 05Open→03Resolved
[19:08:06] <wikibugs>	 10Analytics, 10Patch-For-Review, 10Services (watching): Add mediacounts data to AQS and, from there, Restbase - https://phabricator.wikimedia.org/T207208 (10Nuria)
[19:08:08] <wikibugs>	 10Analytics, 10Analytics-Kanban: dumps.wikimedia.org/other/mediawiki_history is missing some files - https://phabricator.wikimedia.org/T235112 (10Nuria) 05Open→03Resolved
[19:08:32] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Research-Backlog, 10Patch-For-Review: Release edit data lake data as a public  json dump /mysql dump, other? - https://phabricator.wikimedia.org/T208612 (10Nuria) 05Open→03Resolved
[19:08:47] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Research-Backlog, 10Patch-For-Review: Release edit data lake data as a public  json dump /mysql dump, other? - https://phabricator.wikimedia.org/T208612 (10Nuria)
[19:08:56] <wikibugs>	 10Analytics: Enable Security (stronger authentication and data encryption) for the Analytics Hadoop cluster and its dependent services - https://phabricator.wikimedia.org/T211836 (10Nuria)
[19:08:58] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Operations, 10User-Elukey: Make the Kerberos infrastructure production ready - https://phabricator.wikimedia.org/T226089 (10Nuria) 05Open→03Resolved
[19:09:08] <wikibugs>	 10Analytics, 10Analytics-Kanban: Enable geoeditors_daily deletion - https://phabricator.wikimedia.org/T234238 (10Nuria) 05Open→03Resolved
[19:09:35] <wikibugs>	 10Analytics, 10Analytics-Kanban: Change HDFS balancer threshold - https://phabricator.wikimedia.org/T231828 (10Nuria) 05Open→03Resolved
[19:09:58] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Services (watching): Add cassandra loading job for mediarequests per referer - https://phabricator.wikimedia.org/T232858 (10Nuria)
[19:10:28] <wikibugs>	 10Analytics, 10Cloud-Services, 10Developer-Advocacy (Oct-Dec 2019): Develop a tool or integrate feature in existing one to visualize WMCS edits data - https://phabricator.wikimedia.org/T226663 (10Nuria)
[19:10:31] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Cloud-Services, 10Developer-Advocacy (Jul-Sep 2019), 10Patch-For-Review: add whether an edit happened on cloud VPS to geoeditors-daily dataset - https://phabricator.wikimedia.org/T233504 (10Nuria) 05Open→03Resolved
[19:10:43] <wikibugs>	 10Analytics: Enable Security (stronger authentication and data encryption) for the Analytics Hadoop cluster and its dependent services - https://phabricator.wikimedia.org/T211836 (10Nuria)
[19:10:46] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Patch-For-Review, 10User-Elukey: Allow all Analytics tools to work with Kerberos auth - https://phabricator.wikimedia.org/T226698 (10Nuria) 05Open→03Resolved
[19:11:04] <wikibugs>	 10Analytics, 10Analytics-Kanban, 10Services (watching): Add cassandra loading job for top mediarequests - https://phabricator.wikimedia.org/T233717 (10Nuria)
[19:11:38] <icinga-wm>	 PROBLEM - eventlogging Varnishkafka log producer on cp3054 is CRITICAL: NRPE: Command check_varnishkafka-eventlogging not defined https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:11:40] <icinga-wm>	 PROBLEM - Webrequests Varnishkafka log producer on cp3065 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:15:16] <icinga-wm>	 PROBLEM - Webrequests Varnishkafka log producer on cp3051 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:20:46] <icinga-wm>	 PROBLEM - eventlogging Varnishkafka log producer on cp3062 is CRITICAL: NRPE: Command check_varnishkafka-eventlogging not defined https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:21:56] <icinga-wm>	 RECOVERY - eventlogging Varnishkafka log producer on cp3062 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:25:04] <icinga-wm>	 PROBLEM - eventlogging Varnishkafka log producer on cp3064 is CRITICAL: NRPE: Command check_varnishkafka-eventlogging not defined https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:26:02] <icinga-wm>	 RECOVERY - Webrequests Varnishkafka log producer on cp3051 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:26:53] <ottomata>	 gotta run for a choir business meeting!  will be working tomorrow to make up for rest of afternoon and last friday's half day
[19:26:54] <ottomata>	 ttyl!
[19:29:14] <icinga-wm>	 RECOVERY - eventlogging Varnishkafka log producer on cp3064 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:35:58] <icinga-wm>	 RECOVERY - Webrequests Varnishkafka log producer on cp3065 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:52:33] <icinga-wm>	 PROBLEM - eventlogging Varnishkafka log producer on cp3054 is CRITICAL: NRPE: Command check_varnishkafka-eventlogging not defined https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:52:43] <icinga-wm>	 PROBLEM - Webrequests Varnishkafka log producer on cp3054 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:53:31] <icinga-wm>	 PROBLEM - statsv Varnishkafka log producer on cp3054 is CRITICAL: PROCS CRITICAL: 0 processes with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[19:53:43] <elukey>	 these are new hosts --^
[19:53:48] <elukey>	 nothing on fire :)
[20:02:46] <icinga-wm>	 RECOVERY - Webrequests Varnishkafka log producer on cp3054 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/webrequest.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[20:03:36] <icinga-wm>	 RECOVERY - eventlogging Varnishkafka log producer on cp3054 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/eventlogging.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[20:09:57] <icinga-wm>	 RECOVERY - statsv Varnishkafka log producer on cp3054 is OK: PROCS OK: 1 process with args /usr/bin/varnishkafka -S /etc/varnishkafka/statsv.conf https://wikitech.wikimedia.org/wiki/Analytics/Systems/Varnishkafka
[20:17:53] <wikibugs>	 10Analytics, 10Performance-Team, 10Research, 10Security-Team, 10WMF-Legal: A Large-scale Study of Wikipedia Users' Quality of Experience: data release - https://phabricator.wikimedia.org/T217318 (10Gilles) a:05Gilles→03JFishback_WMF
[20:59:37] <wikibugs>	 (03CR) 10Mforns: "Thanks for the patch!" (031 comment) [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/545917 (https://phabricator.wikimedia.org/T223414) (owner: 10Cicalese)
[21:11:36] <wikibugs>	 10Analytics, 10Community-Tech, 10Product-Analytics (Kanban): Hash all pageTokens or temporary identifiers from the EL Sanitization white-list for Community Tech - https://phabricator.wikimedia.org/T226861 (10mforns) Hi @aezell  The white-list which we use as single source of truth as of what EL data gets san...