[00:55:08] Analytics-Wikimetrics, Community-Wikimetrics: Make Wikimedia project titles more user-friendly - https://phabricator.wikimedia.org/T100692#1482942 (Aklapper) a:Aklapper>None [11:08:13] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0] [11:12:12] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0] [14:13:25] Analytics-Tech-community-metrics, Epic, Google-Summer-of-Code-2015: Allow contributors to update their own details in tech metrics directly - https://phabricator.wikimedia.org/T60585#1483346 (NiharikaKohli) [14:13:26] Analytics-Tech-community-metrics: Weekly report for "Allow contributors to update their own details in tech metrics directly" - https://phabricator.wikimedia.org/T101134#1483344 (NiharikaKohli) Open>Resolved [19:12:14] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0] [19:22:12] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0] [19:48:12] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0] [19:52:04] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0] [20:41:48] Ok, so for the mediacounts files [20:42:09] column 4 is hits for original, column #8 is for hits for video transcodes, right? [20:42:31] So in principle, column 4 + col 8 should give you the total hits for the time period, right? [20:42:53] and that should be less than or equal to column 23, total hits with an internal referrer, right? [20:44:37] oh wait [20:44:47] I get it, there's also hits for just the preview thumbnail [20:44:53] nevermind [22:17:23] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL 20.00% of data above the critical threshold [30.0] [22:19:23] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK Less than 15.00% above the threshold [20.0] [22:43:58] Analytics-Cluster, operations, ops-eqiad, Patch-For-Review: rack new hadoop worker nodes - https://phabricator.wikimedia.org/T104463#1483718 (kevinator) [22:44:02] Analytics-Backlog, Analytics-EventLogging, MediaWiki-extensions-MultimediaViewer, Multimedia: Parse mediaviewer team's requirements for EventLogging {oryx} - https://phabricator.wikimedia.org/T90766#1483719 (kevinator) [22:44:04] Analytics-Cluster, Analytics-Kanban: {mule} Cluster Expansion - https://phabricator.wikimedia.org/T99952#1483717 (kevinator) [22:44:28] Analytics-Cluster, Analytics-Kanban: {mule} Cluster Expansion - https://phabricator.wikimedia.org/T99952#1302561 (kevinator) [22:44:32] Analytics-Backlog, Analytics-EventLogging, MediaWiki-extensions-MultimediaViewer, Multimedia: Parse mediaviewer team's requirements for EventLogging {oryx} - https://phabricator.wikimedia.org/T90766#1066936 (kevinator) [22:45:08] Analytics-Cluster, Analytics-Kanban: {mule} Cluster Expansion - https://phabricator.wikimedia.org/T99952#1302561 (kevinator) linking task to rack up servers: {T104463} [22:52:33] Analytics-Backlog, Analytics-EventLogging, Analytics-Kanban: Write a new Camus consumer and store the data for Event Logging {stag} [21 pts] - https://phabricator.wikimedia.org/T98784#1483738 (kevinator) [22:52:35] Analytics-Kanban, Patch-For-Review: Processor writes valid and invalid events to separate Kafka topics {stag} [13 points] - https://phabricator.wikimedia.org/T98781#1483739 (kevinator) [22:52:37] Analytics-EventLogging, Analytics-Kanban: {stag} EventLogging on Kafka - https://phabricator.wikimedia.org/T102225#1483737 (kevinator) [22:57:23] Analytics-Backlog, Analytics-EventLogging: Make EventLogging alerts based on Kafka metrics {stag} - https://phabricator.wikimedia.org/T106254#1483750 (kevinator) [22:57:25] Analytics-EventLogging, Analytics-Kanban: {stag} EventLogging on Kafka - https://phabricator.wikimedia.org/T102225#1483749 (kevinator) [22:57:27] Analytics-EventLogging, Analytics-Kanban, Patch-For-Review: Implement parallel eventlogging-processor {stag} [13 pts] - https://phabricator.wikimedia.org/T104226#1483752 (kevinator) [22:57:29] Analytics-Backlog, Analytics-EventLogging: Load test parallel eventlogging-processor {stag} [3 pts] - https://phabricator.wikimedia.org/T104229#1483751 (kevinator) [23:02:16] Analytics-Cluster, Analytics-Kanban: {wren} PV Aggregates - https://phabricator.wikimedia.org/T96314#1483755 (kevinator) removing task T96314 as blocking task because it turns out we can use Hive for needs and it performs pretty fast. Impalla is not a blocker to this project. [23:05:10] Analytics-Kanban: Vet data in intermediate aggregate {wren} [8 pts] - https://phabricator.wikimedia.org/T102161#1483759 (kevinator) [23:05:11] Analytics-Cluster, Analytics-Kanban: Test Impalla operationally {wren} - https://phabricator.wikimedia.org/T96331#1483762 (kevinator) [23:05:13] Analytics-Backlog, Analytics-Cluster: test performance of Impala {wren} [8 pts] - https://phabricator.wikimedia.org/T96330#1483763 (kevinator) [23:05:15] Analytics-Cluster, Analytics-Kanban: {wren} PV Aggregates - https://phabricator.wikimedia.org/T96314#1483758 (kevinator) [23:05:17] Analytics-Cluster, Analytics-Kanban, Patch-For-Review: Install Impala on cluster {wren} - https://phabricator.wikimedia.org/T96329#1483764 (kevinator) [23:10:47] Analytics-Cluster, Analytics-Kanban: {wren} PV Aggregates - https://phabricator.wikimedia.org/T96314#1483769 (kevinator) [23:11:04] Analytics-Cluster, Analytics-Kanban: Test Impalla operationally - https://phabricator.wikimedia.org/T96331#1483770 (kevinator)