Locked History Actions

Diff for "InfolabServers"

Differences between revisions 60 and 76 (spanning 16 versions)
⇤ ← Revision 60 as of 2013-02-21 23:30:13 →
Size: 5042
Editor: akrevl
Comment:
← Revision 76 as of 2016-09-24 02:09:49 → ⇥
Size: 4436
Editor: PeterKacin
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
 * Total CPU cores: '''156'''
 * Total memory: '''2392 GB'''
 * Total storage: '''131 TB'''		  * Total CPU cores: '''396'''
 * Total memory: '''8536 GB'''
 * Total storage: '''176 TB'''
Line 11: Line 11:
|| [[MadMax2]] || CentOS 6.3 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[Madmax]] || CentOS 6.3 || 1024 || Xeon E7-8837 || 64 bit || 2.66 || 8 || 64 || 64 || 13 || CS ||
|| [[Rambo]] || CentOS 5.6 || 512 || Xeon X7560 || 64 bit || 2.266 || 4 || 32 || 64 || 11 || Infolab ||
|| [[Rulk]] || CentOS 6.3 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 26 || CS  ||
|| [[Hulk]] || CentOS 5.7 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 19 || CS ||
|| [[Bruce]] || CentOS 5.6 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 20 || Infolab ||
|| [[Rocky]] || CentOS 5.8 || 144 || Xeon X5667 || 64 bit || 3.06 || 2 || 8 || 16 || 19 || CS ||
|| [[Zarya]] || CentOS 5.3 || 72 || Xeon X5570 || 64 bit || 2.93 || 2 || 8 || 16 || 20 || Infolab ||
|| [[Eel]] || CentOS 5 || 64 || Xeon X5365 || 64 bit || 3.0 || 2 || 8 || 8 || 3.4 || Infolab ||		 || [[MadMax7]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax6]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax5]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax4]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax3]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax2]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[Madmax1]] || CentOS 6 || 1024 || Xeon E7-8837 || 64 bit || 2.66 || 8 || 64 || 64 || 13 || CS ||
|| [[Rambo]] || CentOS 6 || 512 || Xeon X7560 || 64 bit || 2.266 || 4 || 32 || 64 || 11 || CS ||
|| [[Rulk]] || CentOS 6 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 26 || CS ||
|| [[Rocky]] || CentOS 5 || 144 || Xeon X5667 || 64 bit || 3.06 || 2 || 8 || 16 || 19 || CS ||
Line 23: Line 25:
 * Total CPU cores: '''256'''
 * Total memory: '''512 GB'''
 * Total storage: '''11 TB'''
 * [[InfolabHadoopStats|Live Statistics]]
 * [[InfolabClusterHadoop|Using the Infolab Hadoop Cluster]]		  * Total CPU cores: '''320'''
 * Total memory: '''2560 GB'''
 * Raw storage: '''266 TB'''
 * [[ilHadoopStats|Live Statistics]]
Line 30: Line 32:
|| iln29 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || !JobTracker, !NameNode ||
|| iln30-36 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || !TaskTracker, !DataNode ||		 || ilhadoop || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || !JobTracker, !NameNode ||
|| ilh01-ilh40 || CentOS 6.3 || 64 || Opteron 6320 || 64 bit || 2.8 || 1 || 8 || 8 || 8 || N/A || !TaskTracker, !DataNode ||
Line 35: Line 37:
 * Total CPU cores: '''896'''
 * Total memory: '''1792 GB'''
 * Total storage: '''56 TB'''		  * Total CPU cores: '''1216'''
 * Total memory: ''' 2432 GB'''
 * Total storage: '''76 TB'''
Line 42: Line 44:
|| iln01-28 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || Compute nodes || || iln01-38 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || Compute nodes ||
Line 44: Line 46:
=== Old Hadoop Cluster ===

 * Total CPU cores: '''88'''
 * Total memory: '''88 GB'''
 * Total storage: '''79 TB'''

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilc0, ilc0-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !JobTracker, !NameNode ||
|| ilc1-ilc20 || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !TaskTracker, !DataNode ||
|| ilc21, ilc21-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || ? ||

Infolab Servers

Compute Servers

  • Total CPU cores: 396

  • Total memory: 8536 GB

  • Total storage: 176 TB

  • Live Statistics

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

MadMax7

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax6

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax5

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax4

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax3

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax2

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

Madmax1

CentOS 6

1024

Xeon E7-8837

64 bit

2.66

8

64

64

13

CS

Rambo

CentOS 6

512

Xeon X7560

64 bit

2.266

4

32

64

11

CS

Rulk

CentOS 6

192

Xeon X5680

64 bit

3.33

2

12

24

26

CS

Rocky

CentOS 5

144

Xeon X5667

64 bit

3.06

2

8

16

19

CS

Hadoop Cluster

  • Total CPU cores: 320

  • Total memory: 2560 GB

  • Raw storage: 266 TB

  • Live Statistics

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhadoop

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

JobTracker, NameNode

ilh01-ilh40

CentOS 6.3

64

Opteron 6320

64 bit

2.8

1

8

8

8

N/A

TaskTracker, DataNode

Compute Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhead1

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

Job submission node

iln01-38

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

Compute nodes

Infrastructure Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

il-fs-1

CentOS 5.8

12

Xeon E5620

64 bit

2.66

1

4

8

18

CS

New file server

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Shark

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

Remote login server

Skate

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

?

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk

CentOS 6.3

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server

ilvm1

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 1

ilvm2

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 2

last edited 2019-04-03 20:45:24 by adrijan