4277
Comment:
|
4800
|
Deletions are marked like this. | Additions are marked like this. |
Line 24: | Line 24: |
* [[InfolabClusterHadoop|Using Infolab Hadoop Cluster]] | * [[InfolabClusterHadoop|Using the Infolab Hadoop Cluster]] |
Line 35: | Line 35: |
* [[InfolabClusterCompute|Using the Infolab Compute Cluster]] | |
Line 40: | Line 41: |
=== Hadoop Cluster === | === Old Hadoop Cluster === |
Line 42: | Line 43: |
|| Server || OS || Memory [GB] || CPU Type || Arch || CPU Speed || CPUs || Cores || Threads || Local Storage [TB] || Login || Description || || ilc0-ilc21 || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || Hadoop nodes || |
* Total CPU cores: '''88''' * Total memory: '''88 GB''' * Total storage: '''79 TB''' || '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' || || ilc0, ilc0-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !JobTracker, !NameNode || || ilc1-ilc20 || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !TaskTracker, !DataNode || || ilc21, ilc21-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || ? || |
Line 47: | Line 54: |
|| Server || OS || Memory [GB] || CPU Type || Arch || CPU Speed || CPUs || Cores || Threads || Local Storage [TB] || Login || Description || | || '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' || |
Infolab Servers
Compute Servers
Total CPU cores: 156
Total memory: 2392 GB
Total storage: 131 TB
Server |
OS |
Memory [GB] |
CPU Type |
Arch |
CPU Speed |
CPUs |
Cores |
Threads |
Local Storage [TB] |
Login |
CentOS 6.3 |
1024 |
Xeon E7-8837 |
64 bit |
2.66 |
8 |
64 |
64 |
13 |
CS |
|
CentOS 5.6 |
512 |
Xeon X7560 |
64 bit |
2.266 |
4 |
32 |
64 |
11 |
Infolab |
|
CentOS 6.3 |
192 |
Xeon X5680 |
64 bit |
3.33 |
2 |
12 |
24 |
26 |
CS |
|
CentOS 5.7 |
192 |
Xeon X5680 |
64 bit |
3.33 |
2 |
12 |
24 |
19 |
CS |
|
CentOS 5.6 |
192 |
Xeon X5680 |
64 bit |
3.33 |
2 |
12 |
24 |
20 |
Infolab |
|
CentOS 5.8 |
144 |
Xeon X5667 |
64 bit |
3.06 |
2 |
8 |
16 |
19 |
CS |
|
CentOS 5.3 |
72 |
Xeon X5570 |
64 bit |
2.93 |
2 |
8 |
16 |
20 |
Infolab |
|
CentOS 5 |
64 |
Xeon X5365 |
64 bit |
3.0 |
2 |
8 |
8 |
3.4 |
Infolab |
Hadoop Cluster
Total CPU cores: 256
Total memory: 512 GB
Total storage: 11 TB
Server |
OS |
Memory [GB] |
CPU Type |
Arch |
CPU Speed |
CPUs |
Cores |
Threads |
Local Storage [TB] |
Login |
Description |
iln29 |
CentOS 6.3 |
64 |
Opteron 6276 |
64 bit |
2.3 |
2 |
32 |
32 |
2 |
CS |
JobTracker, NameNode |
iln30-36 |
CentOS 6.3 |
64 |
Opteron 6276 |
64 bit |
2.3 |
2 |
32 |
32 |
2 |
N/A |
TaskTracker, DataNode |
Compute Cluster
Total CPU cores: 896
Total memory: 1792 GB
Total storage: 56 TB
Server |
OS |
Memory [GB] |
CPU Type |
Arch |
CPU Speed |
CPUs |
Cores |
Threads |
Local Storage [TB] |
Login |
Description |
ilhead1 |
CentOS 6.3 |
64 |
Opteron 6276 |
64 bit |
2.3 |
2 |
32 |
32 |
2 |
CS |
Job submission node |
iln01-28 |
CentOS 6.3 |
64 |
Opteron 6276 |
64 bit |
2.3 |
2 |
32 |
32 |
2 |
N/A |
Compute nodes |
Old Hadoop Cluster
Total CPU cores: 88
Total memory: 88 GB
Total storage: 79 TB
Server |
OS |
Memory [GB] |
CPU Type |
Arch |
CPU Speed |
CPUs |
Cores |
Threads |
Local Storage [TB] |
Login |
Description |
ilc0, ilc0-ext |
Ubuntu 10.04 |
4 |
Core2 Q6600 |
64 bit |
2.4 |
1 |
4 |
4 |
3.6 |
Other |
JobTracker, NameNode |
ilc1-ilc20 |
Ubuntu 10.04 |
4 |
Core2 Q6600 |
64 bit |
2.4 |
1 |
4 |
4 |
3.6 |
Other |
TaskTracker, DataNode |
ilc21, ilc21-ext |
Ubuntu 10.04 |
4 |
Core2 Q6600 |
64 bit |
2.4 |
1 |
4 |
4 |
3.6 |
Other |
? |
Infrastructure Servers
Server |
OS |
Memory [GB] |
CPU Type |
Arch |
CPU Speed |
CPUs |
Cores |
Threads |
Local Storage [TB] |
Login |
Description |
CentOS 5.8 |
12 |
Xeon E5620 |
64 bit |
2.66 |
1 |
4 |
8 |
18 |
CS |
New file server |
|
CentOS 5.3 |
8 |
Core2 Q9400 |
64 bit |
2.66 |
1 |
4 |
4 |
5.3 |
Infolab |
SNAP group's web server |
|
Fedora 8 |
4 |
Xeon MP |
32 bit |
2.0 |
4 |
4 |
8 |
0.04 |
Infolab |
Remote login server |
|
Fedora 8 |
4 |
Xeon MP |
32 bit |
2.0 |
4 |
4 |
8 |
0.04 |
Infolab |
? |
|
N/A |
32 |
Opteron 865 |
64 bit |
1.8 |
4 |
8 |
8 |
N/A |
N/A |
Crawling server |
|
CentOS 6.3 |
24 |
Xeon W5580 |
64 bit |
3.2 |
4 |
8 |
8 |
N/A |
N/A |
Crawling server |
|
Vmware ESXi 5.1 |
64 |
Xeon E5-2640 |
64 bit |
2.5 |
2 |
12 |
24 |
4 |
N/A |
Virtual infrastructure server 1 |
|
Vmware ESXi 5.1 |
64 |
Xeon E5-2640 |
64 bit |
2.5 |
2 |
12 |
24 |
4 |
N/A |
Virtual infrastructure server 2 |