[00:36:16] Sorry to page ottomata - I guess downtiming on icinga doesn’t do anything for victorops. Nothing is on fire, the check just isn’t working yet [00:51:29] PROBLEM - Check unit status of monitor_refine_eventlogging_legacy_failure_flags on an-launcher1002 is CRITICAL: CRITICAL: Status of the systemd unit monitor_refine_eventlogging_legacy_failure_flags https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [06:35:18] 10Analytics-EventLogging, 10Analytics-Radar, 10Front-end-Standards-Group, 10MediaWiki-extensions-WikimediaEvents, and 2 others: Provide a reusable getEditCountBucket function for analytics purposes - https://phabricator.wikimedia.org/T210106 (10awight) >>! In T210106#6981544, @Krinkle wrote: > You can and... [06:44:17] 10Analytics-EventLogging, 10Analytics-Radar, 10Front-end-Standards-Group, 10MediaWiki-extensions-WikimediaEvents, and 2 others: Provide a reusable getEditCountBucket function for analytics purposes - https://phabricator.wikimedia.org/T210106 (10awight) >>! In T210106#6988287, @awight wrote: > I'll go ahead... [08:26:38] (03PS1) 10Anjali041: Fix common typos in code [analytics/pivot/deploy] - 10https://gerrit.wikimedia.org/r/678306 (https://phabricator.wikimedia.org/T201491) [09:37:08] (03PS2) 10Awight: New UDF to normalize edit count bucket [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/678293 (https://phabricator.wikimedia.org/T210106) [11:08:59] RECOVERY - Check unit status of monitor_refine_eventlogging_legacy_failure_flags on an-launcher1002 is OK: OK: Status of the systemd unit monitor_refine_eventlogging_legacy_failure_flags https://wikitech.wikimedia.org/wiki/Analytics/Systems/Managing_systemd_timers [13:55:16] (03PS2) 10Anjali041: Fix the typos in code in 5 files [analytics/pivot/deploy] - 10https://gerrit.wikimedia.org/r/678306 (https://phabricator.wikimedia.org/T201491) [14:50:56] (03PS1) 10Ottomata: [POC][WIP] Integrate event utilities with Spark Structured Streaming [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/678322 [16:18:11] PROBLEM - eventgate-analytics-external validation error rate too high on alert1001 is CRITICAL: 2.146 gt 2 https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate https://grafana.wikimedia.org/d/ePFPOkqiz/eventgate?orgId=1&refresh=1m&var-service=eventgate-analytics-external&var-stream=All&var-kafka_broker=All&var-kafka_producer_type=All&var-dc=thanos [16:22:55] RECOVERY - eventgate-analytics-external validation error rate too high on alert1001 is OK: (C)2 gt (W)1 gt 0.2639 https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate https://grafana.wikimedia.org/d/ePFPOkqiz/eventgate?orgId=1&refresh=1m&var-service=eventgate-analytics-external&var-stream=All&var-kafka_broker=All&var-kafka_producer_type=All&var-dc=thanos [21:15:09] (03CR) 10Awight: "We're still waiting to validate this, but the report has been blocked by other issues. The latest attempted fix is Ie37ec0bd29109c, after" [analytics/reportupdater-queries] - 10https://gerrit.wikimedia.org/r/676333 (https://phabricator.wikimedia.org/T193170) (owner: 10Awight) [21:48:51] 10Analytics-EventLogging, 10Analytics-Radar, 10Front-end-Standards-Group, 10MediaWiki-extensions-WikimediaEvents, and 2 others: Provide a reusable getEditCountBucket function for analytics purposes - https://phabricator.wikimedia.org/T210106 (10awight) The one remaining implementation is [[ https://gerrit.... [22:28:50] 10Analytics: Improve Sonar job for analytics-refinery-source - https://phabricator.wikimedia.org/T279841 (10awight) [22:34:50] 10Analytics: Improve Sonar job for analytics-refinery-source - https://phabricator.wikimedia.org/T279841 (10awight)