[04:16:59] (PS5) Joal: Normalize oozie job names (bundles, coords, wfs) [analytics/refinery] - https://gerrit.wikimedia.org/r/285400 (https://phabricator.wikimedia.org/T130732) [04:17:32] (PS4) Joal: Include webrequest refine oozie job into load one [analytics/refinery] - https://gerrit.wikimedia.org/r/285998 (https://phabricator.wikimedia.org/T130731) [13:21:22] Analytics-Kanban: Examine wikistats reports, make a summary of the most granular data needed that would serve all reports - https://phabricator.wikimedia.org/T131783#2253570 (Nemo_bis) > Counts of links are seldom mentioned anywhere. I usually see mentions in mailing lists and Meta-Wiki pages comparing vari... [13:42:21] !log disabled puppet on analytics1047 and scheduled downtime for the host, IO errors in the dmesg for /dev/sdd. Stopped also Hadoop daemons to remove it from the cluster temporarily (not sure how to do it properly, will write docs). [13:42:23] Logged the message at https://www.mediawiki.org/wiki/Analytics/Server_Admin_Log, Master [14:06:27] for some reason I can't tunnel in 1001, grr [14:06:33] but on yarn's logs: [14:06:34] 2016-04-30 13:53:24,889 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler: Removed node analytics1047.eqiad.wmnet:8041 cluster capacity: [14:06:38] so it should be fine [14:08:53] ah tunnelling via stat1001 works, bast1001 it doesn't [14:08:54] mmmm [14:13:24] might also been possible to use https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Hadoop/Administration#Decommissioning but I'll double check with ottomata [14:13:52] anyhow, my understanding is that shutting down yarn and hdfs on the node it will get removed from the cluster [14:14:06] not really clean but.. [14:24:18] sent an email to analytics just in case :) [20:15:13] Analytics-Kanban: Dedicated and/or automated Wikimedia pageviews API project/tag in Phabricator Maniphest [1 pts] - https://phabricator.wikimedia.org/T119151#2254017 (Nemo_bis) Looks like usage of this tag is impossible due to Herald: https://phabricator.wikimedia.org/T124314#2234426 [20:15:37] Analytics-Kanban, Datasets-Webstatscollector, RESTBase-Cassandra: Better response times on AQS (Pageview API mostly) {melc} - https://phabricator.wikimedia.org/T124314#2254018 (Nemo_bis)