[03:38:16] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [07:38:16] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [09:52:48] 14Analytics-Wikimetrics, 06Data-Engineering-Icebox, 10Projects-Cleanup, 10Wikimedia-GitHub: Archive analytics-wikimetrics (deprecated by Event Metrics) - https://phabricator.wikimedia.org/T219334#10408592 (10Aklapper) Phabricator Diffusion only: [x] `analytics-wikimetrics` deactivated at https://phabricato... [10:09:10] 10Data-Engineering (Q2 2024 October 1st - December 31th): load haproxykafka topics into HDFS via gobblin - https://phabricator.wikimedia.org/T377931#10408617 (10gmodena) [11:38:16] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [13:16:12] (03CR) 10Joal: "Nothing more than what Dan has mentioned :) LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1088232 (https://phabricator.wikimedia.org/T379230) (owner: 10Mforns) [13:27:14] (03CR) 10Joal: "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1088342 (https://phabricator.wikimedia.org/T379230) (owner: 10Mforns) [14:45:43] 06Data-Engineering: [NEEDS GROOMING] deequ repo should be instantiated from Wikimedia's DQ metrics store - https://phabricator.wikimedia.org/T353939#10409575 (10tchin) It seems like the conversion from Deequ's data model to the WMF metrics data model is currently not lossless. When calculating `Size` with a cond... [15:38:16] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [16:02:18] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Data-Platform-SRE (2024.11.30 - 2024.12.20), 13Patch-For-Review: Deploy the HDFS synchronizer (blunderbuss) service to the dse-k8s cluster - https://phabricator.wikimedia.org/T371994#10409912 (10amastilovic) [16:03:01] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10Data-Platform-SRE (2024.11.30 - 2024.12.20), 13Patch-For-Review: Deploy the HDFS synchronizer (blunderbuss) service to the dse-k8s cluster - https://phabricator.wikimedia.org/T371994#10409918 (10amastilovic) 05Open→03Resolved [16:05:32] 10Data-Engineering (Q2 2024 October 1st - December 31th): Implement automated deployment of refinery HQL files to HDFS (via blunderbuss) - https://phabricator.wikimedia.org/T365659#10409927 (10amastilovic) 05Open→03In progress [16:09:40] 10Data-Engineering (Q2 2024 October 1st - December 31th): Gitlab CI/CD Component for Blunderbuss - https://phabricator.wikimedia.org/T382348 (10amastilovic) 03NEW [16:10:52] 10Data-Engineering (Q2 2024 October 1st - December 31th): Implement automated deployment of refinery HQL files to HDFS (via blunderbuss) - https://phabricator.wikimedia.org/T365659#10409953 (10amastilovic) [16:12:19] 10Data-Engineering (Q2 2024 October 1st - December 31th): Gitlab CI/CD Component for Blunderbuss - https://phabricator.wikimedia.org/T382348#10409958 (10amastilovic) [17:28:10] 06Data-Engineering, 10Event-Platform: EventBus PageChangeHooks uses unconventional log channel name - https://phabricator.wikimedia.org/T382288#10410203 (10Ottomata) Hm! Perhaps instead of `lang=php $this->logger = LoggerFactory::getInstance( self::class ); ` we should have `lang=php $this->logger = LoggerF... [17:48:52] 10Data-Engineering (Q2 2024 October 1st - December 31th): Gitlab CI/CD Component for Blunderbuss - https://phabricator.wikimedia.org/T382348#10410236 (10Ottomata) > Component source code repository: https://gitlab.wikimedia.org/repos/data-engineering/blunderbuss-bugler Following up: In [[ https://wikimedia.slac... [18:38:20] (03CR) 10Joal: Rewrite MediawikiDumper partitioning implementation (031 comment) [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1101892 (owner: 10Peter Fischer) [19:38:16] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent [19:41:16] (03Abandoned) 10Gehel: ci: migrate to new parent pom [analytics/gobblin-wmf] - 10https://gerrit.wikimedia.org/r/1062711 (https://phabricator.wikimedia.org/T360219) (owner: 10Gehel) [21:10:50] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10MediaWiki-General, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#10411038 (10Ottomata) Just verified vi... [21:33:33] 10Data-Engineering (Q2 2024 October 1st - December 31th), 10MediaWiki-General, 10MediaWiki-Platform-Team (Radar), 13Patch-For-Review: Create legacy EventLogging proxy HTTP intake (for MediaWikiPingback) endpoint to EventGate - https://phabricator.wikimedia.org/T353817#10411130 (10Ottomata) Submitted the ne... [22:04:59] 06Data-Engineering, 10Event-Platform: EventBus PageChangeHooks uses unconventional log channel name - https://phabricator.wikimedia.org/T382288#10411214 (10tstarling) >>! In T382288#10410203, @Ottomata wrote: > `lang=php > $this->logger = LoggerFactory::getInstance( 'EventBus.PageChangeHooks' ); > ` Yes, that... [23:38:16] FIRING: HdfsCapacityRemainingPercent: Alarmingly low free space on the analytics-hadoop HDFS cluster. - https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Alerts#HDFS_Capacity_Remaining - https://grafana.wikimedia.org/d/000000585/hadoop?var-hadoop_cluster=analytics-hadoop&orgId=1&panelId=106&fullscreen - https://alerts.wikimedia.org/?q=alertname%3DHdfsCapacityRemainingPercent