[08:11:06] <wikibugs>	 Analytics-Tech-community-metrics, Engineering-Community, ECT-July-2015: Automated generation of repositories for Korma - https://phabricator.wikimedia.org/T104845#1451340 (Dicortazar) Hi,  I've started to work on this. In first place I've modified the code of Automator to accept external config files w...
[14:57:08] <wikibugs>	 Analytics-Cluster, operations, ops-eqiad: rack new hadoop worker nodes - https://phabricator.wikimedia.org/T104463#1451836 (Ottomata) Heya Chris, any updates?
[15:27:15] <wikibugs>	 Analytics-Cluster, operations, ops-eqiad: rack new hadoop worker nodes - https://phabricator.wikimedia.org/T104463#1451927 (Cmjohnson) 3 of 4 are racked in row D and connected to mgmt.  They only need re-install. The 4th one was broken and I didn't get to replace it before I left on vacation. Dell has...
[16:05:35] <mforns>	 ottomata, the pageview counts by page name without k-anonymization for 1 day is 7.7GB. It's in stat1002:/home/mforns/mexico/page_view_counts_by_page_name.tsv
[16:08:43] <ottomata>	 that is much larger than we though!
[16:08:46] <ottomata>	 thought!
[16:10:05] <mforns>	 yea, I've added the same thing with k=100, and will add also k=10
[16:14:58] <ottomata>	 oh where?
[16:15:02] <ottomata>	 oh i see 10
[16:15:03] <ottomata>	 100
[16:15:08] <ottomata>	 mforns: ^
[16:15:36] <mforns>	 ottomata, yes, I'm executing the query for k=10 now, will ping you when done
[16:15:40] <ottomata>	 oh k
[16:20:01] <ottomata>	 mforns: i'm going to compress these files, sok?
[16:20:10] <mforns>	 ottomata, sure!
[16:20:21] <mforns>	 the k=10 file is already there
[16:20:25] <mforns>	 ottomata, ^
[17:16:53] <halfak>	 joal|mexico, is there any chance that you have a distribution of revision sizes from enwiki handy?
[17:17:04] <halfak>	 Or maybe some metadata that would make that easy to generate?
[17:19:45] <joal|mexico>	 halfak: best way to grab info : the worklog I wrote a month ago
[17:19:59] * halfak digs for that
[17:21:56] <wikibugs>	 Analytics-Kanban, Research-and-Data: Pipeline from Research to productization - https://phabricator.wikimedia.org/T105815#1452179 (ggellerman) NEW a:DarTar
[21:16:02] <joal|mexico>	 exit
[21:16:04] <joal|mexico>	 oops
[21:42:37] <halfak>	 joal|mexico,
[21:42:37] <joal|mexico>	 mforns: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+WindowingAndAnalytics
[21:42:40] <halfak>	 joal|mexico,
[21:42:42] <halfak>	 joal|mexico,
[21:42:47] <joal|mexico>	 halfak: ?
[21:42:48] <joal|mexico>	 halfak: ?
[21:42:50] <joal|mexico>	 halfak: ?
[21:45:58] <joal|mexico>	 org.wikimedia.wikihadoop.job.MediaWikiDumpXMLToJSON
[21:46:03] <joal|mexico>	 halfak: --^