Locked History Actions

Diff for "InfolabServers"

Differences between revisions 4 and 69 (spanning 65 versions)
⇤ ← Revision 4 as of 2012-08-30 22:07:45 →
Size: 560
Editor: akrevl
Comment:
← Revision 69 as of 2016-09-24 01:57:54 → ⇥
Size: 5147
Editor: PeterKacin
Comment:
Deletions are marked like this. Additions are marked like this.
Line 3: Line 3:
== Compute Servers == === Compute Servers ===
Line 5: Line 5:
|| [[Rulk]] ||
|| [[Hulk]] ||
|| [[Rocky]] ||
|| [[Rambo]] ||
|| [[Bruce]] ||
|| [[Zarya]] ||
|| ganglia-exnode || {{http://ganglia-gmetad.gonzo.local/ganglia/graph.php?g=mem_report&z=medium&c=Infolab%20Compute%20Nodes&h=ganglia-exnode.gonzo.local&m=load_one&r=hour&s=descending&hc=19&mc=2&st=1346388969}} || {{http://ganglia-gmetad.gonzo.local/ganglia/graph.php?g=cpu_report&z=medium&c=Infolab%20Compute%20Nodes&h=ganglia-exnode.gonzo.local&m=load_one&r=hour&s=descending&hc=19&mc=2&st=1346389572}} ||		  * Total CPU cores: '''396'''
 * Total memory: '''8536 GB'''
 * Total storage: '''176 TB'''
 * [[InfolabComputeServersStats|Live Statistics]]

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' ||
|| [[MadMax7]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax6]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax5]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax4]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax3]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[MadMax2]] || CentOS 6 || 1024 || Xeon E7-4870 || 64 bit || 2.4 || 4 || 40 || 80 || 8 || CS ||
|| [[Madmax1]] || CentOS 6 || 1024 || Xeon E7-8837 || 64 bit || 2.66 || 8 || 64 || 64 || 13 || CS ||
|| [[Rambo]] || CentOS 6 || 512 || Xeon X7560 || 64 bit || 2.266 || 4 || 32 || 64 || 11 || CS ||
|| [[Rulk]] || CentOS 6 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 26 || CS ||
|| [[Rocky]] || CentOS 5 || 144 || Xeon X5667 || 64 bit || 3.06 || 2 || 8 || 16 || 19 || CS ||


=== Hadoop Cluster ===
 
 * Total CPU cores: '''320'''
 * Total memory: '''2560 GB'''
 * Raw storage: '''266 TB'''
 * [[ilHadoopStats|Live Statistics]]


|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilhadoop || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || !JobTracker, !NameNode ||
|| ilh01-ilh40 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || !TaskTracker, !DataNode ||

=== Compute Cluster ===

 * Total CPU cores: '''896'''
 * Total memory: '''1792 GB'''
 * Total storage: '''56 TB'''
 * [[InfolabClusterCompute|Using the Infolab Compute Cluster]]

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilhead1 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || Job submission node ||
|| iln01-28 || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || N/A || Compute nodes ||

=== Old Hadoop Cluster ===

 * Total CPU cores: '''88'''
 * Total memory: '''88 GB'''
 * Total storage: '''79 TB'''

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| ilc0, ilc0-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !JobTracker, !NameNode ||
|| ilc1-ilc20 || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || !TaskTracker, !DataNode ||
|| ilc21, ilc21-ext || Ubuntu 10.04 || 4 || Core2 Q6600 || 64 bit || 2.4 || 1 || 4 || 4 || 3.6 || Other || ? ||

=== Infrastructure Servers ===

|| '''Server''' || '''OS''' || '''Memory [GB]''' || '''CPU Type''' || '''Arch''' || '''CPU Speed''' || '''CPUs''' || '''Cores''' || '''Threads''' || '''Local Storage [TB]''' || '''Login''' || '''Description''' ||
|| [[il-fs-1]] || CentOS 5.8 || 12 || Xeon E5620 || 64 bit || 2.66 || 1 || 4 || 8 || 18 || CS || New file server ||
|| [[Snap]] || CentOS 5.3 || 8 || Core2 Q9400 || 64 bit || 2.66 || 1 || 4 || 4 || 5.3 || Infolab || SNAP group's web server ||
|| [[Shark]] || Fedora 8 || 4 || Xeon MP || 32 bit || 2.0 || 4 || 4 || 8 || 0.04 || Infolab || Remote login server ||
|| [[Skate]] || Fedora 8 || 4 || Xeon MP || 32 bit || 2.0 || 4 || 4 || 8 || 0.04 || Infolab || ? ||
|| [[Whale]] || N/A || 32 || Opteron 865 || 64 bit || 1.8 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[Silk]] || CentOS 6.3 || 24 || Xeon W5580 || 64 bit || 3.2 || 4 || 8 || 8 || N/A || N/A || Crawling server ||
|| [[ilvm1]] || Vmware ESXi 5.1 || 64 || Xeon E5-2640 || 64 bit || 2.5 || 2 || 12 || 24 || 4 || N/A || Virtual infrastructure server 1 ||
|| [[ilvm2]] || Vmware ESXi 5.1 || 64 || Xeon E5-2640 || 64 bit || 2.5 || 2 || 12 || 24 || 4 || N/A || Virtual infrastructure server 2 ||


----

Infolab Servers

Compute Servers

  • Total CPU cores: 396

  • Total memory: 8536 GB

  • Total storage: 176 TB

  • Live Statistics

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

MadMax7

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax6

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax5

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax4

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax3

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

MadMax2

CentOS 6

1024

Xeon E7-4870

64 bit

2.4

4

40

80

8

CS

Madmax1

CentOS 6

1024

Xeon E7-8837

64 bit

2.66

8

64

64

13

CS

Rambo

CentOS 6

512

Xeon X7560

64 bit

2.266

4

32

64

11

CS

Rulk

CentOS 6

192

Xeon X5680

64 bit

3.33

2

12

24

26

CS

Rocky

CentOS 5

144

Xeon X5667

64 bit

3.06

2

8

16

19

CS

Hadoop Cluster

  • Total CPU cores: 320

  • Total memory: 2560 GB

  • Raw storage: 266 TB

  • Live Statistics

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhadoop

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

JobTracker, NameNode

ilh01-ilh40

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

TaskTracker, DataNode

Compute Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhead1

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

Job submission node

iln01-28

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

Compute nodes

Old Hadoop Cluster

  • Total CPU cores: 88

  • Total memory: 88 GB

  • Total storage: 79 TB

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilc0, ilc0-ext

Ubuntu 10.04

4

Core2 Q6600

64 bit

2.4

1

4

4

3.6

Other

JobTracker, NameNode

ilc1-ilc20

Ubuntu 10.04

4

Core2 Q6600

64 bit

2.4

1

4

4

3.6

Other

TaskTracker, DataNode

ilc21, ilc21-ext

Ubuntu 10.04

4

Core2 Q6600

64 bit

2.4

1

4

4

3.6

Other

?

Infrastructure Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

il-fs-1

CentOS 5.8

12

Xeon E5620

64 bit

2.66

1

4

8

18

CS

New file server

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Shark

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

Remote login server

Skate

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

?

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk

CentOS 6.3

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server

ilvm1

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 1

ilvm2

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 2

last edited 2019-04-03 20:45:24 by adrijan