[06:37:17] PROBLEM - Hadoop DataNode on analytics1061 is CRITICAL: connect to address 10.64.21.113 port 5666: Connection refused https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [06:37:49] PROBLEM - Hadoop NodeManager on analytics1061 is CRITICAL: connect to address 10.64.21.113 port 5666: Connection refused https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [06:37:53] PROBLEM - Disk space on Hadoop worker on analytics1061 is CRITICAL: connect to address 10.64.21.113 port 5666: Connection refused https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [08:47:01] 10Analytics, 10Operations: analytics1061 is down - https://phabricator.wikimedia.org/T244081 (10jijiki) [08:47:09] 10Analytics, 10Operations: analytics1061 is down - https://phabricator.wikimedia.org/T244081 (10jijiki) p:05Triage→03Normal [08:53:03] RECOVERY - Hadoop DataNode on analytics1061 is OK: PROCS OK: 1 process with command name java, args org.apache.hadoop.hdfs.server.datanode.DataNode https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [08:53:35] RECOVERY - Hadoop NodeManager on analytics1061 is OK: PROCS OK: 1 process with command name java, args org.apache.hadoop.yarn.server.nodemanager.NodeManager https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration [08:53:39] RECOVERY - Disk space on Hadoop worker on analytics1061 is OK: DISK OK https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration