[08:14:59] ottomata: https://gerrit.wikimedia.org/r/#/c/353287/ [08:57:42] 06Analytics-Kanban: Artificial spike in offset of unique devices from November 14th to February 6th - https://phabricator.wikimedia.org/T165560#3270089 (10Nuria) [09:23:23] fdans: https://pastebin.com/rMnmVtSR [09:39:10] 06Analytics-Kanban: Artificial spike in offset of unique devices from November 14th to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270223 (10Nuria) [09:55:03] 06Analytics-Kanban: Artificial spike in offset of unique devices from November 14th to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270355 (10Nuria) Offset spikes and underestimate decreases in the same amount (so total is same) . Best seen in wikidata mobile: https://goo.gl/o8oAzj [09:56:54] joal: https://github.com/wikimedia/puppet/commit/0edbbabdfd76b95bdde6f26fdb4062fad6af6b69 [10:13:57] joal: https://github.com/wikimedia/puppet/commit/0edbbabdfd76b95bdde6f26fdb4062fad6af6b69#diff-58669ddeeda52acaea0f384407c42ffc [10:19:01] 06Analytics-Kanban: Artificial spike in offset of unique devices from November to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270401 (10Nuria) [10:19:05] 06Analytics-Kanban, 06Operations, 10Traffic: Artificial spike in offset of unique devices from November 14th to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270402 (10ema) [10:20:11] 06Analytics-Kanban, 06Operations, 10Traffic: Artificial spike in offset of unique devices from November to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270406 (10ema) [10:23:53] 06Analytics-Kanban, 06Operations, 10Traffic: Artificial spike in offset of unique devices from November to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270435 (10Nuria) Summing up from IRC's conversation between @nuria and @ema: From the 2nd of November we start seeing a shift of th... [10:24:49] 06Analytics-Kanban, 06Operations, 10Traffic: Artificial spike in offset of unique devices from November to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270438 (10Nuria) {F8109003} This is the offset data for wikimedia mobile [10:31:15] 06Analytics-Kanban, 06Operations, 10Traffic: Artificial spike in offset of unique devices from November to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270516 (10Nuria) [12:22:01] 06Analytics-Kanban, 06Operations, 10Traffic: Artificial spike in offset of unique devices from November to February 6th on wikidata - https://phabricator.wikimedia.org/T165560#3270816 (10Nuria) @ema: has the way we compute nocookies flag on X-analytics changed? It should take into account "all" cookies not... [12:57:22] 10Analytics, 10Analytics-Cluster, 06Operations, 10Traffic: Enable Kafka TLS and secure the kafka traffic with it - https://phabricator.wikimedia.org/T121561#3270926 (10Ottomata) [12:57:30] 10Analytics, 10Analytics-Cluster, 06Operations, 10Traffic: Enable Kafka TLS and secure the kafka traffic with it - https://phabricator.wikimedia.org/T121561#1881737 (10Ottomata) [12:58:02] 10Analytics-Cluster, 06Analytics-Kanban: Provision new Kafka cluster(s) with security features - https://phabricator.wikimedia.org/T152015#3270929 (10Ottomata) [13:34:09] RECOVERY - Hadoop NodeManager on analytics1030 is OK: PROCS OK: 1 process with command name java, args org.apache.hadoop.yarn.server.nodemanager.NodeManager [13:34:19] RECOVERY - Hadoop DataNode on analytics1030 is OK: PROCS OK: 1 process with command name java, args org.apache.hadoop.hdfs.server.datanode.DataNode [13:49:00] 10Analytics, 10Analytics-Cluster, 06Operations, 10Traffic: Enable Kafka TLS and secure the kafka traffic with it - https://phabricator.wikimedia.org/T121561#3271107 (10Ottomata) It looks like a lot of the hard work for this has been done for Cassandra over in T108953 and T111113. Documentation for this is... [13:50:40] 10Analytics-Cluster, 06Analytics-Kanban: Provision new Kafka cluster(s) with security features - https://phabricator.wikimedia.org/T152015#3271117 (10Ottomata) [14:46:58] 06Analytics-Kanban, 13Patch-For-Review: Count global unique devices per top domain (like *.wikipedia.org) - https://phabricator.wikimedia.org/T143928#3271300 (10JAllemandou) Another round of explanations, trying to explain my understanding of the issue: - First, extract subset ofdata from webrequest ``` AD... [15:52:03] joal: query in question [15:52:07] https://www.irccloud.com/pastebin/vrctJRjO/ [16:33:31] joal: at least half of the req with last access set but no global last access are from IE6 [18:39:23] 10Quarry, 10Community-Wikimetrics, 10DBA, 10Icinga, and 2 others: Evaluate future of wmf puppet module "mysql" - https://phabricator.wikimedia.org/T165625#3272009 (10jcrespo) [18:42:21] 10Quarry, 10Community-Wikimetrics, 10DBA, 10Icinga, and 2 others: Evaluate future of wmf puppet module "mysql" - https://phabricator.wikimedia.org/T165625#3272026 (10Paladox) I vote to migrate to use the mariadb class as it is maintained :) [18:44:39] 10Quarry, 10Community-Wikimetrics, 10DBA, 10Icinga, and 2 others: Evaluate future of wmf puppet module "mysql" - https://phabricator.wikimedia.org/T165625#3272032 (10jcrespo) Paladox- if this is for your own usage- you can do that now, what I cannot guarantee is that it will fullfill your needs easily (for... [18:45:49] 10Quarry, 10Community-Wikimetrics, 10DBA, 10Icinga, and 2 others: Evaluate future of wmf puppet module "mysql" - https://phabricator.wikimedia.org/T165625#3272033 (10Paladox) Oh, i think the puppet role I'm using right now (deployment_server) is using mysql. Since somehow it is using the mysql class. [21:00:58] 10Analytics, 10Analytics-Wikistats, 10Wikimedia-Site-requests: Add li: Wikibooks to Wikistats - https://phabricator.wikimedia.org/T165634#3272286 (10Ooswesthoesbes)