Locked History Actions

Diff for "InfolabServersMetrics1"

Differences between revisions 1 and 27 (spanning 26 versions)
Revision 1 as of 2012-10-23 17:47:25
Size: 4874
Editor: akrevl
Comment:
Revision 27 as of 2012-10-24 01:50:41
Size: 6576
Editor: akrevl
Comment:
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
|| Server || OS || Memory [GB] || CPU Type || Arch || CPU Speed || CPUs || Cores || Threads || Local Storage [TB] || Login || CPU load ||
|| [[Madmax]] || CentOS 6.3 || 1024 || Xeon E7-8837 || 64 bit || 2.66 || 8 || 64 || 64 || 13 || CS || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=madmax.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
|| [[Rambo]] || CentOS 5.6 || 512 || Xeon X7560 || 64 bit || 2.266 || 4 || 32 || 64 || 11 || Infolab || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=Rambo.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
|| [[Rulk]] || CentOS 6.3 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 26 || CS || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=rulk.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
|| [[Hulk]] || CentOS 5.7 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 19 || CS || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=hulk.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
|| [[Bruce]] || CentOS 5.6 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 20 || Infolab || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=Bruce.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
|| [[Rocky]] || CentOS 5.8 || 144 || Xeon X5667 || 64 bit || 3.06 || 2 || 8 || 16 || 19 || CS || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=rocky.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
|| [[Zarya]] || CentOS 5.3 || 72 || Xeon X5570 || 64 bit || 2.93 || 2 || 8 || 16 || 20 || Infolab || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=Zarya.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
|| [[Eel]] || CentOS 5 || 64 || Xeon X5365 || 64 bit || 3.0 || 2 || 8 || 8 || 3.4 || Infolab || {{http://ilmon.stanford.edu/ganglia/graph.php?g=akcpu_report&z=large&c=InfolabServers&h=eel.Stanford.EDU&m=load_one&r=hour&s=descending&hc=4&mc=2&st=1350959718}} ||
||<v:rowspan=2> '''Server''' ||<v:rowspan=2> '''OS''' ||<v:rowspan=2> '''Memory''' <<BR>>[GB] ||<v:colspan=6> '''CPU'''||<v:rowspan=2> '''Storage''' <<BR>> [TB] ||<v:rowspan=2> '''Login''' ||<v:rowspan=2> '''CPU load''' <<BR>> [%] ||<v:rowspan=2> '''RAM used''' <<BR>> [bytes] ||
|| Type || Arch || Clock || CPUs || Cores || Threads ||
|| [[Madmax]] || CentOS 6.3 || 1024 || Xeon E7-8837 || 64 bit || 2.66 || 8 || 64 || 64 || 13 || CS || <<Ganglia(cpu,InfolabServers,madmax)>> || <<Ganglia(mem,InfolabServers,madmax)>> ||
|| [[Rambo]] || CentOS 5.6 || 512 || Xeon X7560 || 64 bit || 2.266 || 4 || 32 || 64 || 11 || Infolab || <<Ganglia(cpu,InfolabServers,Rambo)>> || <<Ganglia(mem,InfolabServers,Rambo)>> ||
|| [[Rulk]] || CentOS 6.3 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 26 || CS || <<Ganglia(cpu,InfolabServers,hulk)>> || <<Ganglia(mem,InfolabServers,hulk)>> ||
|| [[Hulk]] || CentOS 5.7 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 19 || CS || <<Ganglia(cpu,InfolabServers,rulk)>> || <<Ganglia(mem,InfolabServers,rulk)>> ||
|| [[Bruce]] || CentOS 5.6 || 192 || Xeon X5680 || 64 bit || 3.33 || 2 || 12 || 24 || 20 || Infolab || <<Ganglia(cpu,InfolabServers,Bruce)>> || <<Ganglia(mem,InfolabServers,Bruce)>> ||
|| [[Rocky]] || CentOS 5.8 || 144 || Xeon X5667 || 64 bit || 3.06 || 2 || 8 || 16 || 19 || CS || <<Ganglia(cpu,InfolabServers,rocky)>> || <<Ganglia(mem,InfolabServers,rocky)>> ||
|| [[Zarya]] || CentOS 5.3 || 72 || Xeon X5570 || 64 bit || 2.93 || 2 || 8 || 16 || 20 || Infolab || <<Ganglia(cpu,InfolabServers,Zarya)>> || <<Ganglia(mem,InfolabServers,Zarya)>> ||
|| [[Eel]] || CentOS 5 || 64 || Xeon X5365 || 64 bit || 3.0 || 2 || 8 || 8 || 3.4 || Infolab || <<Ganglia(cpu,InfolabServers,Eel)>> || <<Ganglia(mem,InfolabServers,Eel)>> ||

Detailed view by [[InfolabServersDetailHour|hour]], [[InfolabServersDetailHour|day]], [[InfolabServersDetailHour|month]], [[InfolabServersDetailHour|year]].

=== Infolab Hadoop Cluster ===

||<v:rowspan=2> '''Server''' ||<v:rowspan=2> '''OS''' ||<v:rowspan=2> '''Memory''' <<BR>>[GB] ||<v:colspan=6> '''CPU'''||<v:rowspan=2> '''Storage''' <<BR>> [TB] ||<v:rowspan=2> '''Login''' ||<v:rowspan=2> '''CPU load''' <<BR>> [%] ||<v:rowspan=2> '''RAM used''' <<BR>> [bytes] ||<v:rowspan=2> '''Description''' ||
|| Type || Arch || Clock || CPUs || Cores || Threads ||
|| [[iln29]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln29)>> || <<Ganglia(mem,InfolabHadoop,iln29)>> || !NameNode, !JobTracker ||
|| [[iln30]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln30)>> || <<Ganglia(mem,InfolabHadoop,iln30)>> || !DataNode, !TaskTracker ||
|| [[iln31]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln31)>> || <<Ganglia(mem,InfolabHadoop,iln31)>> || !DataNode, !TaskTracker ||
|| [[iln32]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln32)>> || <<Ganglia(mem,InfolabHadoop,iln32)>> || !DataNode, !TaskTracker ||
|| [[iln33]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln33)>> || <<Ganglia(mem,InfolabHadoop,iln33)>> || !DataNode, !TaskTracker ||
|| [[iln34]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln34)>> || <<Ganglia(mem,InfolabHadoop,iln34)>> || !DataNode, !TaskTracker ||
|| [[iln35]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln35)>> || <<Ganglia(mem,InfolabHadoop,iln35)>> || !DataNode, !TaskTracker ||
|| [[iln36]] || CentOS 6.3 || 64 || Opteron 6276 || 64 bit || 2.3 || 2 || 32 || 32 || 2 || CS || <<Ganglia(cpu,InfolabHadoop,iln36)>> || <<Ganglia(mem,InfolabHadoop,iln36)>> || !DataNode, !TaskTracker ||

Infolab Servers

Compute Servers

Server

OS

Memory
[GB]

CPU

Storage
[TB]

Login

CPU load
[%]

RAM used
[bytes]

Type

Arch

Clock

CPUs

Cores

Threads

Madmax

CentOS 6.3

1024

Xeon E7-8837

64 bit

2.66

8

64

64

13

CS

Rambo

CentOS 5.6

512

Xeon X7560

64 bit

2.266

4

32

64

11

Infolab

Rulk

CentOS 6.3

192

Xeon X5680

64 bit

3.33

2

12

24

26

CS

Hulk

CentOS 5.7

192

Xeon X5680

64 bit

3.33

2

12

24

19

CS

Bruce

CentOS 5.6

192

Xeon X5680

64 bit

3.33

2

12

24

20

Infolab

Rocky

CentOS 5.8

144

Xeon X5667

64 bit

3.06

2

8

16

19

CS

Zarya

CentOS 5.3

72

Xeon X5570

64 bit

2.93

2

8

16

20

Infolab

Eel

CentOS 5

64

Xeon X5365

64 bit

3.0

2

8

8

3.4

Infolab

Detailed view by hour, day, month, year.

Infolab Hadoop Cluster

Server

OS

Memory
[GB]

CPU

Storage
[TB]

Login

CPU load
[%]

RAM used
[bytes]

Description

Type

Arch

Clock

CPUs

Cores

Threads

iln29

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

NameNode, JobTracker

iln30

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

DataNode, TaskTracker

iln31

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

DataNode, TaskTracker

iln32

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

DataNode, TaskTracker

iln33

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

DataNode, TaskTracker

iln34

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

DataNode, TaskTracker

iln35

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

DataNode, TaskTracker

iln36

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

DataNode, TaskTracker

Infolab Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilhead1,ilhead2

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

Job submission nodes

iln01-iln29

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

Compute nodes

iln30-iln36

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

N/A

Hadoop nodes

ild1,ild2

CentOS 6.3

64

Opteron 6276

64 bit

2.3

2

32

32

2

CS

Development nodes

Hadoop Cluster

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

ilc0-ilc21

Ubuntu 10.04

4

Core2 Q6600

64 bit

2.4

1

4

4

3.6

Other

Hadoop nodes

Infrastructure Servers

Server

OS

Memory [GB]

CPU Type

Arch

CPU Speed

CPUs

Cores

Threads

Local Storage [TB]

Login

Description

il-fs-1

CentOS 5.8

12

Xeon E5620

64 bit

2.66

1

4

8

18

CS

New file server

Snap

CentOS 5.3

8

Core2 Q9400

64 bit

2.66

1

4

4

5.3

Infolab

SNAP group's web server

Shark

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

Remote login server

Skate

Fedora 8

4

Xeon MP

32 bit

2.0

4

4

8

0.04

Infolab

?

Whale

N/A

32

Opteron 865

64 bit

1.8

4

8

8

N/A

N/A

Crawling server

Silk

CentOS 6.3

24

Xeon W5580

64 bit

3.2

4

8

8

N/A

N/A

Crawling server

ilvm1

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 1

ilvm2

Vmware ESXi 5.1

64

Xeon E5-2640

64 bit

2.5

2

12

24

4

N/A

Virtual infrastructure server 2