Locked History Actions

Diff for "InfolabServers"

Differences between revisions 73 and 87 (spanning 14 versions)
Revision 73 as of 2016-09-24 02:07:25
Size: 5145
Editor: PeterKacin
Comment:
Revision 87 as of 2016-09-27 16:31:47
Size: 5744
Editor: PeterKacin
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
 * Total CPU cores: '''396'''
 * Total memory: '''8536 GB'''
 * Total storage: '''176 TB'''
Line 11: Line 8:
|| [[MadMax7]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS || || [[MadMax7]] || Ubuntu 14.04 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
Line 15: Line 12:
|| [[MadMax3]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS || || [[MadMax3]] || CentOS 7 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
Line 21: Line 18:

|| [[raiders1]] || Ubuntu 14.04 || 1024 || Xeon E5-4657L v2 || 64 bit || 2.4 || 4 || 48 || 96 || 15 || CS ||
|| [[raiders2]] || Ubuntu 14.04 || 1024 || Xeon E5-4657L v2 || 64 bit || 2.4 || 4 || 48 || 96 || 15 || CS ||
|| [[raiders3]] || Ubuntu 14.04 || 1024 || Xeon E5-4657L v2 || 64 bit || 2.4 || 4 || 48 || 96 || 48 || CS ||
|| [[raiders6]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 + 4.4(SSD) || CS ||
|| [[raiders7]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 + 4.4(SSD) || CS ||
|| [[raiders8]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 || CS ||
|| [[raiders9]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 || CS ||
|| [[raiders10]] || Ubuntu 14.04 || 1024 || Xeon E7-4850 v3 || 64 bit || 2.2 || 4 || 56 || 112 || 33 || CS ||
Line 37: Line 40:
 * Total CPU cores: '''896'''
 * Total memory: '''1792 GB'''
 * Total storage: '''56 TB'''
 * Total CPU cores: '''1216'''
 * Total memory: ''' 2432 GB'''
 * Total storage: '''76 TB'''
Line 44: Line 47:
|| iln01-38 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || Compute nodes || || iln01-iln38 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || Compute nodes ||
Line 46: Line 49:
=== Old Hadoop Cluster ===

 * Total CPU cores: '''88'''
 * Total memory: '''88 GB'''
 * Total storage: '''79 TB'''

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilc0, ilc0-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !JobTracker, !NameNode ||
|| ilc1-ilc20 || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !TaskTracker, !DataNode ||
|| ilc21, ilc21-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || ? ||
Line 60: Line 53:
|| [[il-fs-1]] || CentOS 5.8 || 12 || Xeon E5620 || 64 bit || 2.66 || 1 || 4 || 8 || 18 || CS || New file server ||
Line 62: Line 54:
|| [[Shark]] || Fedora 8 || 4 || Xeon MP || 32 bit || 2.0 || 4 || 4 || 8 || 0.04 || Infolab || Remote login server ||
|| [[Skate]] || Fedora 8 || 4 || Xeon MP || 32 bit || 2.0 || 4 || 4 || 8 || 0.04 || Infolab || ? ||
Line 65: Line 55:
|| [[Silk]] || CentOS 6.3 || 24 || Xeon W5580 || 64 bit || 3.2 || 4 || 8 || 8 || N/A || N/A || Crawling server || || [[Silk04-silk24]] || CentOS 6.8 || 24 || Xeon W5580 || 64 bit || 3.2 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
Line 70: Line 60:
=== Virtual Machines ===

|| '''Server''' || '''OS''' || '''Memory [MB]''' || '''Arch''' || '''Cores''' ||
|| [[Snap]] || CentOS 5.3 || 8 || Core2 Q9400 || 64 bit || 2.66 || 1 || 4 || 4 || 5.3 || Infolab || SNAP group's web server ||
|| [[Whale]] || N/A || 32 || Opteron 865 || 64 bit || 1.8 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[Silk04-silk24]] || CentOS 6.8 || 24 || Xeon W5580 || 64 bit || 3.2 || 4 || 8 || 8 || N/A || N/A || Crawling server ||

Infolab Servers

Compute Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

MadMax7

Ubuntu 14.04

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax6

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax5

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax4

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax3

CentOS 7

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax2

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

Madmax1

CentOS 6

1024

Xeon E7-8837

64 bit

2.66

8

64

64

13

CS

Rambo

CentOS 6

512

Xeon X7560

64 bit

2.266

4

32

64

11

CS

Rulk

CentOS 6

192

Xeon X5680

64 bit

3.33

2

12

24

26

CS

Rocky

CentOS 5

144

Xeon X5667

64 bit

3.06

2

8

16

19

CS

raiders1

Ubuntu 14.04

1024

Xeon E5-4657L v2

64 bit

2.4

4

48

96

15

CS

raiders2

Ubuntu 14.04

1024

Xeon E5-4657L v2

64 bit

2.4

4

48

96

15

CS

raiders3

Ubuntu 14.04

1024

Xeon E5-4657L v2

64 bit

2.4

4

48

96

48

CS

raiders6

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33 + 4.4(SSD)

CS

raiders7

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33 + 4.4(SSD)

CS

raiders8

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33

CS

raiders9

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33

CS

raiders10

Ubuntu 14.04

1024

Xeon E7-4850 v3

64 bit

2.2

4

56

112

33

CS

Hadoop Cluster

  • Total CPU cores: 320

  • Total memory: 2560 GB

  • Raw storage: 266 TB

  • Live Statistics

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhadoop

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

JobTracker, NameNode

ilh01-ilh40

CentOS 6.3

64

Opteron 6320

64 bit

2.8

1

8

8

8

N/A

TaskTracker, DataNode

Compute Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhead1

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

Job submission node

iln01-iln38

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

Compute nodes

Infrastructure Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk04-silk24

CentOS 6.8

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server

ilvm1

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 1

ilvm2

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 2

Virtual Machines

Server

OS

Memory [MB]

Arch

Cores

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk04-silk24

CentOS 6.8

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server