Size: 1233
Comment:
|
Size: 1258
Comment:
|
Deletions are marked like this. | Additions are marked like this. |
Line 36: | Line 36: |
* Hadoop cluster | * [[InfolabClusterHadoop|Hadoop cluster]] |
Infolab cluster
Beta warning
If Google can keep things in Beta, why can't we? So.. beware... Things might break. Please join the mailing list and report any glitches that you come across.
Hardware
- 2 head nodes
- 2 development nodes
- 36 compute nodes:
- 1152 cores
- 2.25 TB RAM
- Each node:
- 2x AMD Opteron 6276 (Interlagos) @2.3GHz - 3.2GHz, 16 cores/CPU, AMD64, VT
- 64 GB RAM
- 2 TB local HDD
Mailing list
There is a mailing list for all those interested in what is currently happening with the cluster and the configuration of the cluster:
List address: ilcluster@lists.stanford.edu
Manage your subscription: https://mailman.stanford.edu/mailman/listinfo/ilcluster
Software
We decided that it is not good to have a split personality that is why we now have a set of nodes dedicated to the compute cluster and another set of nodes dedicated to a hadoop cluster.
- TORQUE resource manager, MAUI job scheduler
- Nodes: iln01-iln28
- Submission node: ilhead1
- Apache Hadoop
- Nodes: iln29-iln36
- Submission node: iln29