[07:58:51] The A team have arrived in the Prague office! [08:18:39] πŸ‡¨πŸ‡ΏπŸ‡¨πŸ‡ΏπŸ‡¨πŸ‡ΏπŸ‡¨πŸ‡Ώ [08:42:23] neilpquinn: how about we load a small sample of the data lake in analytics-store:staging db? [08:42:34] a-team: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2016-2017/draft [08:42:39] then you can explore there, tune the queries, and run them on the real thing, cc nuria_ [08:44:47] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Draft [08:45:44] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Privacy_Security_and_Data_Management [08:46:16] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Technology#Program_7._Smart_tools_for_better_data [08:46:48] https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Draft/Programs/Technology#Program_1:_Availability.2C_performance.2C_and_maintenance [10:10:11] 10Analytics, 10EventBus, 13Patch-For-Review, 06Services (watching): Check eventbus Kafka cluster settings for reliability - https://phabricator.wikimedia.org/T144637#3262336 (10Ottomata) T149594 [10:15:52] 10Analytics, 10Analytics-Cluster, 15User-Elukey: Monitor that no worker nodes are in the default rack in net topology - https://phabricator.wikimedia.org/T163909#3262355 (10elukey) [10:16:17] 10Analytics, 10Analytics-Cluster, 15User-Elukey: Monitor HDFS blocks problems - https://phabricator.wikimedia.org/T163908#3262357 (10elukey) [10:16:29] 10Analytics, 10Analytics-Cluster, 15User-Elukey: Monitor hdfs-balancer - https://phabricator.wikimedia.org/T163907#3262358 (10elukey) [10:45:11] milimetric: that's a great idea! Maybe a week of data to get a good cross section? [11:28:36] yeah, I was thinking like a week of everything and all time for some small wiki so you can test time aggregations [11:28:54] opening task [11:35:29] 10Analytics: Create small sample mediawiki-history table in MariaDB - https://phabricator.wikimedia.org/T165309#3262615 (10Milimetric) [11:55:35] 10Analytics, 10Analytics-Cluster, 15User-Elukey: Monitor HDFS blocks problems - https://phabricator.wikimedia.org/T163908#3214017 (10elukey) Just checked https://graphite.wikimedia.org and we are collecting all these metrics, so it is only a matter of adding them to the https://grafana.wikimedia.org/dashboa... [14:00:54] 06Analytics-Kanban, 10Fundraising-Backlog, 13Patch-For-Review: Productionize banner impressions druid/pivot dataset - https://phabricator.wikimedia.org/T155141#3263119 (10AndyRussG) Merci!! :) [14:58:38] a-team: ssh -N thorium.eqiad.wmnet -L 9089:thorium.eqiad.wmnet:9089 [14:58:44] http://localhost:9089/ [15:12:06] 06Analytics-Kanban, 06DC-Ops, 06Operations, 10ops-eqiad: analytics1030 stuck in console while booting - https://phabricator.wikimedia.org/T162046#3263525 (10Cmjohnson) I've been contacted by Dell regarding the support task. The part is back ordered and may be a few more days. [17:27:15] 06Analytics-Kanban, 06Operations, 10ops-eqiad: analytics1030 stuck in console while booting - https://phabricator.wikimedia.org/T162046#3264155 (10Cmjohnson) [17:57:29] 10Analytics, 10Analytics-Cluster, 06Operations: rack/setup/install replacement to stat1003 (stat1004 or misc name?) - https://phabricator.wikimedia.org/T165366#3264224 (10RobH) [17:58:03] 10Analytics, 10Analytics-Cluster, 06Operations: rack/setup/install replacement to stat1003 (stat1005 or misc name?) - https://phabricator.wikimedia.org/T165366#3264272 (10RobH) [17:58:43] 10Analytics-Cluster, 06Analytics-Kanban: Replacement of stat1002 and stat1003 - https://phabricator.wikimedia.org/T152712#3264277 (10RobH) 05Open>03Resolved Both of these systems are ordered and being received in on linked #procurement tasks, as well as setup on tasks T165366 and T165368 respectively. As... [17:58:45] 10Analytics-Cluster, 06Analytics-Kanban, 06Operations: Reinstall Analytics Hadoop Cluster with Debian Jessie - https://phabricator.wikimedia.org/T157807#3264282 (10RobH) [17:59:47] 10Analytics-Cluster, 06Analytics-Kanban, 06Operations: Reinstall Analytics Hadoop Cluster with Debian Jessie - https://phabricator.wikimedia.org/T157807#3017036 (10RobH) [17:59:49] 10Analytics-Cluster, 06Analytics-Kanban: Replacement of stat1002 and stat1003 - https://phabricator.wikimedia.org/T152712#3264284 (10RobH) 05Resolved>03Open Actually, I meant to put that on the hardware request, this wasn't my task to resolve, sorry about that! [18:00:26] 10Analytics, 10Analytics-Cluster, 06Operations, 10Research-management: GPU upgrade for stats machine - https://phabricator.wikimedia.org/T148843#3264307 (10RobH) [18:00:28] 10Analytics, 10Analytics-Cluster, 06Operations, 10hardware-requests: EQIAD: stat1002 replacement - https://phabricator.wikimedia.org/T159838#3264301 (10RobH) 05Open>03Resolved This is ordered and being received in on linked #procurement task, as well as setup on task T165368. As such, this #hw-request... [18:00:33] 10Analytics-Cluster, 06Analytics-Kanban: Replacement of stat1002 and stat1003 - https://phabricator.wikimedia.org/T152712#2857791 (10RobH) [18:00:36] 10Analytics, 10Analytics-Cluster, 06Operations, 10hardware-requests: EQIAD: stat1003 replacement - https://phabricator.wikimedia.org/T159839#3264308 (10RobH) 05Open>03Resolved This is ordered and being received in on linked #procurement task, as well as setup on task T165366. As such, this #hw-request... [19:19:39] 10Analytics, 10Analytics-Cluster, 06Operations, 10ops-eqiad: rack/setup/install replacement to stat1002 (stat1004 or misc name?) - https://phabricator.wikimedia.org/T165368#3264256 (10RobH) [19:19:43] 10Analytics, 10Analytics-Cluster, 06Operations, 10ops-eqiad: rack/setup/install replacement to stat1003 (stat1005 or misc name?) - https://phabricator.wikimedia.org/T165366#3264842 (10RobH)