Locked History Actions

Diff for "InfolabCluster"

Differences between revisions 11 and 12
Revision 11 as of 2012-10-17 04:14:57
Size: 1233
Editor: akrevl
Comment:
Revision 12 as of 2012-10-17 18:35:43
Size: 1258
Editor: akrevl
Comment:
Deletions are marked like this. Additions are marked like this.
Line 36: Line 36:
 * Hadoop cluster  * [[InfolabClusterHadoop|Hadoop cluster]]

Infolab cluster

Beta warning

If Google can keep things in Beta, why can't we? So.. beware... Things might break. Please join the mailing list and report any glitches that you come across.

Hardware

  • 2 head nodes
  • 2 development nodes
  • 36 compute nodes:
    • 1152 cores
    • 2.25 TB RAM
  • Each node:
    • 2x AMD Opteron 6276 (Interlagos) @2.3GHz - 3.2GHz, 16 cores/CPU, AMD64, VT
    • 64 GB RAM
    • 2 TB local HDD

Mailing list

There is a mailing list for all those interested in what is currently happening with the cluster and the configuration of the cluster:

Software

We decided that it is not good to have a split personality that is why we now have a set of nodes dedicated to the compute cluster and another set of nodes dedicated to a hadoop cluster.

  • Compute cluster:

    • TORQUE resource manager, MAUI job scheduler
    • Nodes: iln01-iln28
    • Submission node: ilhead1
  • Hadoop cluster

    • Apache Hadoop
    • Nodes: iln29-iln36
    • Submission node: iln29