Locked History Actions

Diff for "InfolabServers"

Differences between revisions 1 and 86 (spanning 85 versions)
Revision 1 as of 2012-08-30 21:04:45
Size: 150
Editor: akrevl
Comment:
Revision 86 as of 2016-09-27 16:30:27
Size: 5812
Editor: PeterKacin
Comment:
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
== Compute Servers == === Compute Servers ===
Line 5: Line 5:
|| [[Rulk]] ||
|| [[Hulk]] ||
|| [[Rocky]] ||
|| [[Rambo]] ||
|| [[Bruce]] ||
|| [[Zarya]] ||
 * [[InfolabComputeServersStats|Live Statistics]]

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' ||
|| [[MadMax7]] || Ubuntu 14.04 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax6]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax5]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax4]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax3]] || CentOS 7 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax2]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[Madmax1]] || CentOS 6 || 1024 || Xeon E7-8837 || 64 bit || 2.66 || 8 || 64 || 64 || 13 || CS ||
|| [[Rambo]] || CentOS 6 || 512 || Xeon X7560 || 64 bit || 2.266 || 4 || 32 || 64 || 11 || CS ||
|| [[Rulk]] || CentOS 6 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 26 || CS ||
|| [[Rocky]] || CentOS 5 || 144 || Xeon X5667 || 64 bit || 3.06 || 2 || 8 || 16 || 19 || CS ||
|| [[raiders1]] || Ubuntu 14.04 || 1024 || Xeon E5-4657L v2 || 64 bit || 2.4 || 4 || 48 || 96 || 15 || CS ||
|| [[raiders2]] || Ubuntu 14.04 || 1024 || Xeon E5-4657L v2 || 64 bit || 2.4 || 4 || 48 || 96 || 15 || CS ||
|| [[raiders3]] || Ubuntu 14.04 || 1024 || Xeon E5-4657L v2 || 64 bit || 2.4 || 4 || 48 || 96 || 48 || CS ||
|| [[raiders6]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 + 4.4(SSD) || CS ||
|| [[raiders7]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 + 4.4(SSD) || CS ||
|| [[raiders8]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 || CS ||
|| [[raiders9]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 || CS ||
|| [[raiders10]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 || CS ||
=== Hadoop Cluster ===
 
 * Total CPU cores: '''320'''
 * Total memory: '''2560 GB'''
 * Raw storage: '''266 TB'''
 * [[ilHadoopStats|Live Statistics]]


|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilhadoop || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || !JobTracker, !NameNode ||
|| ilh01-ilh40 || CentOS 6.3 || 64 || Opteron 6320 || 64 bit || 2.8 || 1 || 8 || 8 || 8 || N/A || !TaskTracker, !DataNode ||

=== Compute Cluster ===

 * Total CPU cores: '''1216'''
 * Total memory: ''' 2432 GB'''
 * Total storage: '''76 TB'''
 * [[InfolabClusterCompute|Using the Infolab Compute Cluster]]

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilhead1 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || Job submission node ||
|| iln01-iln38 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || Compute nodes ||


=== Infrastructure Servers ===

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| [[Snap]] || CentOS 5.3 || 8 || Core2 Q9400 || 64 bit || 2.66 || 1 || 4 || 4 || 5.3 || Infolab || SNAP group's web server ||
|| [[Whale]] || N/A || 32 || Opteron 865 || 64 bit || 1.8 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[Silk04-silk24]] || CentOS 6.8 || 24 || Xeon W5580 || 64 bit || 3.2 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[ilvm1]] || Vmware ESXi 5.1 || 64 || Xeon E5-2640 || 64 bit || 2.5 || 2 || 12 || 24 || 4 || N/A || Virtual infrastructure server 1 ||
|| [[ilvm2]] || Vmware ESXi 5.1 || 64 || Xeon E5-2640 || 64 bit || 2.5 || 2 || 12 || 24 || 4 || N/A || Virtual infrastructure server 2 ||


=== Virtual Machines ===

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' ||
|| [[Snap]] || CentOS 5.3 || 8 || Core2 Q9400 || 64 bit || 2.66 || 1 || 4 || 4 || 5.3 || Infolab || SNAP group's web server ||
|| [[Whale]] || N/A || 32 || Opteron 865 || 64 bit || 1.8 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[Silk04-silk24]] || CentOS 6.8 || 24 || Xeon W5580 || 64 bit || 3.2 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
----

Infolab Servers

Compute Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

MadMax7

Ubuntu 14.04

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax6

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax5

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax4

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax3

CentOS 7

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax2

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

Madmax1

CentOS 6

1024

Xeon E7-8837

64 bit

2.66

8

64

64

13

CS

Rambo

CentOS 6

512

Xeon X7560

64 bit

2.266

4

32

64

11

CS

Rulk

CentOS 6

192

Xeon X5680

64 bit

3.33

2

12

24

26

CS

Rocky

CentOS 5

144

Xeon X5667

64 bit

3.06

2

8

16

19

CS

raiders1

Ubuntu 14.04

1024

Xeon E5-4657L v2

64 bit

2.4

4

48

96

15

CS

raiders2

Ubuntu 14.04

1024

Xeon E5-4657L v2

64 bit

2.4

4

48

96

15

CS

raiders3

Ubuntu 14.04

1024

Xeon E5-4657L v2

64 bit

2.4

4

48

96

48

CS

raiders6

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33 + 4.4(SSD)

CS

raiders7

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33 + 4.4(SSD)

CS

raiders8

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33

CS

raiders9

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33

CS

raiders10

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33

CS

Hadoop Cluster

  • Total CPU cores: 320

  • Total memory: 2560 GB

  • Raw storage: 266 TB

  • Live Statistics

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhadoop

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

JobTracker, NameNode

ilh01-ilh40

CentOS 6.3

64

Opteron 6320

64 bit

2.8

1

8

8

8

N/A

TaskTracker, DataNode

Compute Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhead1

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

Job submission node

iln01-iln38

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

Compute nodes

Infrastructure Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk04-silk24

CentOS 6.8

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server

ilvm1

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 1

ilvm2

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 2

Virtual Machines

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk04-silk24

CentOS 6.8

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server