Locked History Actions

Diff for "ilHadoopStatus"

Differences between revisions 6 and 36 (spanning 30 versions)
⇤ ← Revision 6 as of 2014-12-04 03:07:53 →
Size: 778
Editor: akrevl
Comment:
← Revision 36 as of 2015-10-16 03:01:31 → ⇥
Size: 2666
Editor: akrevl
Comment:
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
==== References ==== ##{{{#!wiki warning
##'''Offline'''
##
##The cluster is currently not operational. See notes below.
##}}}
Line 5: Line 9:
 * [[ilHadoopStats|Hadoop stats]]
 * [[http://ilHadoop1.stanford.edu:50070/dfshealth.html|NameNode information]]
 * [[http://ilHadoop1.stanford.edu:8088/cluster|Application tracker]]		 ##{{{#!wiki note
##'''Monitoring'''
##
##Ganglia monitoring is currently having some issues.
##}}}
Line 9: Line 15:
==== Current cluster stats ==== ==== Cluster status ====

|| 2015-10-15 20:01:00 PDT || Cluster back online. ||
|| 2015-10-15 19:40:00 PDT || Cluster issues due to a DNS configuration failure. ||
|| 2015-07-06 11:20:00 PDT || Cluster is online, Yarn back on good behavior. ||
|| 2015-07-05 12:15:00 PDT || Jobs stuck in Yarn queue. ||
|| 2015-06-12 15:15:00 PDT || Cluster is online. ||
|| 2015-06-11 16:30:00 PDT || Cluster is offline for upgrade to CDH 5.4.2 and Spark. ||
|| 2015-05-11 15:40:00 PDT || Cluster is online. Problem fixed. ||
|| 2015-05-11 07:05:00 PDT || HDFS and local FS full. Jobs are not running. ||
|| 2015-05-05 15:40:00 PDT || Cluster is online. Problem fixed. ||
|| 2015-05-05 10:05:00 PDT || Cluster is online but jobs are not getting processed. Looking into the issue. ||
|| 2015-04-30 11:40:00 PDT || Cluster is online. Upgraded to CDH 5.4.0 and JDK 8u45. ||
|| 2015-04-29 16:30:00 PDT || Cluster is offline due to package upgrades (moving to CDH 5.4.0). ||
|| 2015-04-09 06:42:00 PDT || Cluster is online. ||
|| 2015-04-08 06:00:00 PDT || Cluster is offline due to NameNode issues. Investigating + trying to repair the problem. ||
|| 2014-12-05 22:32:00 PST || Cluster is online. ||
|| 2014-12-04 21:05:00 PST || Maintenance in progress. Installing the secondary namenode, Spark, etc. ||
|| 2014-12-04 06:28:00 PST || Ganglia back to normal. Cluster is online. ||
|| 2014-12-04 05:40:00 PST || Ganglia reporting is currently having issues. ||
|| 2014-12-04 05:18:00 PST || Cluster is back online. ||
|| 2014-12-03 19:15:00 PST || Cluster offline for system updates. Should be back online by --(22:00 PST)-- 2014-12-04 02:00 PST. ||

==== Cluster usage statistics ====
Line 15: Line 44:

==== References ====

 * [[ilHadoopStats|Hadoop Cluster Statistics]]
 * [[http://ilHadoop1.stanford.edu:50070/dfshealth.html|NameNode information]]
 * [[http://ilHadoop1.stanford.edu:8088/cluster|Application tracker]]

Hadoop Cluster Status

Cluster status

2015-10-15 20:01:00 PDT

Cluster back online.

2015-10-15 19:40:00 PDT

Cluster issues due to a DNS configuration failure.

2015-07-06 11:20:00 PDT

Cluster is online, Yarn back on good behavior.

2015-07-05 12:15:00 PDT

Jobs stuck in Yarn queue.

2015-06-12 15:15:00 PDT

Cluster is online.

2015-06-11 16:30:00 PDT

Cluster is offline for upgrade to CDH 5.4.2 and Spark.

2015-05-11 15:40:00 PDT

Cluster is online. Problem fixed.

2015-05-11 07:05:00 PDT

HDFS and local FS full. Jobs are not running.

2015-05-05 15:40:00 PDT

Cluster is online. Problem fixed.

2015-05-05 10:05:00 PDT

Cluster is online but jobs are not getting processed. Looking into the issue.

2015-04-30 11:40:00 PDT

Cluster is online. Upgraded to CDH 5.4.0 and JDK 8u45.

2015-04-29 16:30:00 PDT

Cluster is offline due to package upgrades (moving to CDH 5.4.0).

2015-04-09 06:42:00 PDT

Cluster is online.

2015-04-08 06:00:00 PDT

Cluster is offline due to NameNode issues. Investigating + trying to repair the problem.

2014-12-05 22:32:00 PST

Cluster is online.

2014-12-04 21:05:00 PST

Maintenance in progress. Installing the secondary namenode, Spark, etc.

2014-12-04 06:28:00 PST

Ganglia back to normal. Cluster is online.

2014-12-04 05:40:00 PST

Ganglia reporting is currently having issues.

2014-12-04 05:18:00 PST

Cluster is back online.

2014-12-03 19:15:00 PST

Cluster offline for system updates. Should be back online by 22:00 PST 2014-12-04 02:00 PST.

Cluster usage statistics

CPU load
[%]

RAM used
[bytes]

NETWORK traffic IN

OUT


[bytes/s]

DISK read
[bytes/s]

DISK write
[bytes/s]

References

last edited 2015-10-16 03:01:31 by akrevl