Locked History Actions

Diff for "InfolabCluster"

Differences between revisions 4 and 11 (spanning 7 versions)
Revision 4 as of 2012-08-10 22:15:37
Size: 609
Editor: akrevl
Comment:
Revision 11 as of 2012-10-17 04:14:57
Size: 1233
Editor: akrevl
Comment:
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:

{{{#!wiki caution
'''Beta warning'''

If Google can keep things in Beta, why can't we? So.. beware... Things might break. Please join the mailing list and report any glitches that you come across.
}}}
Line 14: Line 20:
  
Line 22: Line 28:
=== Access === === Software ===
Line 24: Line 30:
More coming soon... We decided that it is not good to have a split personality that is why we now have a set of nodes dedicated to the compute cluster and another set of nodes dedicated to a hadoop cluster.

 * [[InfolabClusterCompute|Compute cluster]]:
   * TORQUE resource manager, MAUI job scheduler
   * Nodes: iln01-iln28
   * Submission node: ilhead1
 * Hadoop cluster
   * Apache Hadoop
   * Nodes: iln29-iln36
   * Submission node: iln29

Infolab cluster

Beta warning

If Google can keep things in Beta, why can't we? So.. beware... Things might break. Please join the mailing list and report any glitches that you come across.

Hardware

  • 2 head nodes
  • 2 development nodes
  • 36 compute nodes:
    • 1152 cores
    • 2.25 TB RAM
  • Each node:
    • 2x AMD Opteron 6276 (Interlagos) @2.3GHz - 3.2GHz, 16 cores/CPU, AMD64, VT
    • 64 GB RAM
    • 2 TB local HDD

Mailing list

There is a mailing list for all those interested in what is currently happening with the cluster and the configuration of the cluster:

Software

We decided that it is not good to have a split personality that is why we now have a set of nodes dedicated to the compute cluster and another set of nodes dedicated to a hadoop cluster.

  • Compute cluster:

    • TORQUE resource manager, MAUI job scheduler
    • Nodes: iln01-iln28
    • Submission node: ilhead1
  • Hadoop cluster
    • Apache Hadoop
    • Nodes: iln29-iln36
    • Submission node: iln29