[03:40:33] PROBLEM - Difference between raw and validated EventLogging overall message rates on graphite1001 is CRITICAL: CRITICAL: 26.67% of data above the critical threshold [30.0] [03:42:14] RECOVERY - Difference between raw and validated EventLogging overall message rates on graphite1001 is OK: OK: Less than 25.00% above the threshold [20.0] [10:39:58] Analytics-Tech-community-metrics: Microtask: Create a very simple REST API - https://phabricator.wikimedia.org/T114838#1718980 (jgbarah) [11:03:44] (PS1) Addshore: Use irc2go for irc channel count [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/245468 [11:04:19] (CR) Addshore: [C: 2 V: 2] Use irc2go for irc channel count [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/245468 (owner: Addshore) [11:08:56] (PS1) Addshore: Update IRC readme [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/245470 [11:09:08] (CR) Addshore: [C: 2 V: 2] Update IRC readme [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/245470 (owner: Addshore) [12:31:44] (PS1) Addshore: Fix crat metric [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/245474 [12:32:03] (CR) Addshore: [C: 2 V: 2] Fix crat metric [analytics/limn-wikidata-data] - https://gerrit.wikimedia.org/r/245474 (owner: Addshore) [14:57:43] holaaa [15:02:44] nobody there... [15:02:55] I am (but invisbly here) [15:03:01] ;) [15:20:16] hello joal invisible ninja [15:22:45] * joal hides behind the blue line of the IRC client irssi [15:23:23] * joal then run and jump onto a few letters, and finally disappears for tonight ;-P [15:24:41] Analytics-Tech-community-metrics, DevRel-October-2015: "Oldest open Gerrit changesets without code review" panel should filter WIP etc - https://phabricator.wikimedia.org/T112661#1719423 (Aklapper) I don't even find any related code when grep'ing for `WIP` in random codebases. @dicortazar: Where exactly... [15:42:44] Analytics-Tech-community-metrics: Microtask: Create a very simple REST API for SortingHat - https://phabricator.wikimedia.org/T114838#1719443 (Qgil) [15:47:54] yurik: yt? [15:48:08] nuria, yep [15:48:34] yurik: question regarding x-analytics and varnish if you may [15:49:28] yurik: do we stripoff the x-analytics header when sending the response to the client? [15:49:39] i don't think so [15:49:55] yurik: so it does get send back as a regular header then? [15:50:03] yep [15:50:18] yurik: but it's not read on our incoming flow right? [15:50:38] yurik: thus for our purposes is as if it wasn't sent [15:50:55] yurik: rightt? ( this is the part i am not sure about how varnish does it) [15:50:56] nuria, that header is formulated by the varnish layer and returned [15:51:15] yurik: right, but it is "started" by varnish from "" [15:51:18] different parts of varnish add pices to it [15:51:18] every time [15:51:23] correct? [15:51:49] i think a while back it was initially set by the backend and appended by varnish, but i think now it is mostly set by varnish [15:51:59] see what i am saying? That varnish does not care what the "incoming " value of teh header is [15:53:02] *the [15:54:16] right [15:54:31] yurik: ok, that is what i thought, thank you [15:54:36] it basically appends values to it, but initially it could have been set by the phph [15:54:37] php [15:55:28] but it appends starting from "", thus if the header were to contain zero=whatever [15:56:03] it woulkn't matter as the request header x-analytics is not used to build the response header x-analytics [15:56:20] backend shouldn't return zero=whatever, because it would duplicate [15:56:53] nuria, i'm a bit confused what you are tryig to solve [15:57:11] yurik: np, thank you for answering to ping [15:57:55] np [16:00:30] nuria, btw, just fyi, bblack is currently refactoring varnish to always include x-analytics for all traffic [16:00:47] yurik: ya, it's done. I am modyfing a small thing [16:00:56] yurik: https://gerrit.wikimedia.org/r/#/c/244626/2/templates/varnish/nocookies.inc.vcl.erb [16:01:49] nuria, could you refrase that comment? no idea what it means :)) [16:02:25] yurik: ahem .. it was a note to self , so no wonder [16:13:20] Analytics, Deployment-Systems, Services, operations, Scap3: Use Scap3 for deploying AQS - https://phabricator.wikimedia.org/T114999#1719499 (mmodell) [16:19:07] hey a-team in standup [16:19:21] just wanted to mention that this is in review: https://gerrit.wikimedia.org/r/#/c/244729/ probably to be reviewed by marcel [18:17:09] Analytics-Kanban: Investigate sample cube pageview_count vs unsampled log pageview count [13 pts] {hawk} - https://phabricator.wikimedia.org/T108925#1719740 (Nuria) >This is a new and quite important finding. I should say that for the purposes of the Reading team (such as the aforementioned quarterly review)... [18:25:46] Analytics-Cluster, Database: Replicate Echo databases to analytics-store - https://phabricator.wikimedia.org/T115275#1719755 (Krenair) [18:25:49] Analytics-Cluster, Database: Replicate Echo databases to analytics-store - https://phabricator.wikimedia.org/T115275#1719758 (Neil_P._Quinn_WMF) [18:29:01] Analytics-Kanban, Analytics-Wikistats: Feed Wikistats traffic reports with aggregated hive data {lama} [8 pts] - https://phabricator.wikimedia.org/T114379#1719766 (Tbayer) @ezachte: It looks like we are on the same page here (no pun intended ;), so no need to dig further into this, but perhaps it's worth... [23:52:41] (CR) Nuria: "Since there is no filtering we are moving to cassandra both pageviews but also views of files (like pngs) and some spam. There seems to be" (1 comment) [analytics/refinery] - https://gerrit.wikimedia.org/r/236224 (https://phabricator.wikimedia.org/T108174) (owner: Joal)