Locked History Actions

Diff for "InfolabServers"

Differences between revisions 1 and 60 (spanning 59 versions)
Revision 1 as of 2012-08-30 21:04:45
Size: 150
Editor: akrevl
Comment:
Revision 60 as of 2013-02-21 23:30:13
Size: 5042
Editor: akrevl
Comment:
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
== Compute Servers == === Compute Servers ===
Line 5: Line 5:
|| [[Rulk]] ||
|| [[Hulk]] ||
|| [[Rocky]] ||
|| [[Rambo]] ||
|| [[Bruce]] ||
|| [[Zarya]] ||
 * Total CPU cores: '''156'''
 * Total memory: '''2392 GB'''
 * Total storage: '''131 TB'''
 * [[InfolabComputeServersStats|Live Statistics]]

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' ||
|| [[MadMax2]] || CentOS 6.3 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[Madmax]] || CentOS 6.3 || 1024 || Xeon E7-8837 || 64 bit || 2.66 || 8 || 64 || 64 || 13 || CS ||
|| [[Rambo]] || CentOS 5.6 || 512 || Xeon X7560 || 64 bit || 2.266 || 4 || 32 || 64 || 11 || Infolab ||
|| [[Rulk]] || CentOS 6.3 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 26 || CS ||
|| [[Hulk]] || CentOS 5.7 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 19 || CS ||
|| [[Bruce]] || CentOS 5.6 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 20 || Infolab ||
|| [[Rocky]] || CentOS 5.8 || 144 || Xeon X5667 || 64 bit || 3.06 || 2 || 8 || 16 || 19 || CS ||
|| [[Zarya]] || CentOS 5.3 || 72 || Xeon X5570 || 64 bit || 2.93 || 2 || 8 || 16 || 20 || Infolab ||
|| [[Eel]] || CentOS 5 || 64 || Xeon X5365 || 64 bit || 3.0 || 2 || 8 || 8 || 3.4 || Infolab ||

=== Hadoop Cluster ===
 
 * Total CPU cores: '''256'''
 * Total memory: '''512 GB'''
 * Total storage: '''11 TB'''
 * [[InfolabHadoopStats|Live Statistics]]
 * [[InfolabClusterHadoop|Using the Infolab Hadoop Cluster]]

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| iln29 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || !JobTracker, !NameNode ||
|| iln30-36 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || !TaskTracker, !DataNode ||

=== Compute Cluster ===

 * Total CPU cores: '''896'''
 * Total memory: '''1792 GB'''
 * Total storage: '''56 TB'''
 * [[InfolabClusterCompute|Using the Infolab Compute Cluster]]

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilhead1 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || Job submission node ||
|| iln01-28 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || Compute nodes ||

=== Old Hadoop Cluster ===

 * Total CPU cores: '''88'''
 * Total memory: '''88 GB'''
 * Total storage: '''79 TB'''

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilc0, ilc0-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !JobTracker, !NameNode ||
|| ilc1-ilc20 || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !TaskTracker, !DataNode ||
|| ilc21, ilc21-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || ? ||

=== Infrastructure Servers ===

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| [[il-fs-1]] || CentOS 5.8 || 12 || Xeon E5620 || 64 bit || 2.66 || 1 || 4 || 8 || 18 || CS || New file server ||
|| [[Snap]] || CentOS 5.3 || 8 || Core2 Q9400 || 64 bit || 2.66 || 1 || 4 || 4 || 5.3 || Infolab || SNAP group's web server ||
|| [[Shark]] || Fedora 8 || 4 || Xeon MP || 32 bit || 2.0 || 4 || 4 || 8 || 0.04 || Infolab || Remote login server ||
|| [[Skate]] || Fedora 8 || 4 || Xeon MP || 32 bit || 2.0 || 4 || 4 || 8 || 0.04 || Infolab || ? ||
|| [[Whale]] || N/A || 32 || Opteron 865 || 64 bit || 1.8 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[Silk]] || CentOS 6.3 || 24 || Xeon W5580 || 64 bit || 3.2 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[ilvm1]] || Vmware ESXi 5.1 || 64 || Xeon E5-2640 || 64 bit || 2.5 || 2 || 12 || 24 || 4 || N/A || Virtual infrastructure server 1 ||
|| [[ilvm2]] || Vmware ESXi 5.1 || 64 || Xeon E5-2640 || 64 bit || 2.5 || 2 || 12 || 24 || 4 || N/A || Virtual infrastructure server 2 ||


----

Infolab Servers

Compute Servers

  • Total CPU cores: 156

  • Total memory: 2392 GB

  • Total storage: 131 TB

  • Live Statistics

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

MadMax2

CentOS 6.3

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

Madmax

CentOS 6.3

1024

Xeon E7-8837

64 bit

2.66

8

64

64

13

CS

Rambo

CentOS 5.6

512

Xeon X7560

64 bit

2.266

4

32

64

11

Infolab

Rulk

CentOS 6.3

192

Xeon X5680

64 bit

3.33

2

12

24

26

CS

Hulk

CentOS 5.7

192

Xeon X5680

64 bit

3.33

2

12

24

19

CS

Bruce

CentOS 5.6

192

Xeon X5680

64 bit

3.33

2

12

24

20

Infolab

Rocky

CentOS 5.8

144

Xeon X5667

64 bit

3.06

2

8

16

19

CS

Zarya

CentOS 5.3

72

Xeon X5570

64 bit

2.93

2

8

16

20

Infolab

Eel

CentOS 5

64

Xeon X5365

64 bit

3.0

2

8

8

3.4

Infolab

Hadoop Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

iln29

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

JobTracker, NameNode

iln30-36

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

TaskTracker, DataNode

Compute Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhead1

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

Job submission node

iln01-28

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

Compute nodes

Old Hadoop Cluster

  • Total CPU cores: 88

  • Total memory: 88 GB

  • Total storage: 79 TB

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilc0, ilc0-ext

Ubuntu 10.04

4

Core2 Q6600

64 bit

2.4

1

4

4

3.6

Other

JobTracker, NameNode

ilc1-ilc20

Ubuntu 10.04

4

Core2 Q6600

64 bit

2.4

1

4

4

3.6

Other

TaskTracker, DataNode

ilc21, ilc21-ext

Ubuntu 10.04

4

Core2 Q6600

64 bit

2.4

1

4

4

3.6

Other

?

Infrastructure Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

il-fs-1

CentOS 5.8

12

Xeon E5620

64 bit

2.66

1

4

8

18

CS

New file server

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Shark

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

Remote login server

Skate

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

?

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk

CentOS 6.3

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server

ilvm1

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 1

ilvm2

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 2