why cluster computing?
Companies that use it
High performance Clusters (HPC)
A computer cluster consists of a set of loosely connected
computers that work together so that in many respects they
can be viewed as a single system.
Cluster consists of:
Cluster middleware: It permits
compute clustering programs
to be portable to a wide variety
Cluster Middle ware
High Speed Local Network
Consists of many of the same or similar type of machines.
Tightly-coupled using dedicated network connections.
The components of a cluster are usually connected to each other
through fast local area networks, each node running its own
instance on an operating system.
All machines share resources.
They must trust each other so that does not require a password,
otherwise you would need to do a manual start on each machine.
The first commercial clustering product was ARCnet, developed
by Data point in 1977.
Digital Equipment Corporation released their VAX cluster product
in 1984 for the VAX/VMS operating system.
The ARCnet and VAX cluster products not only supported parallel
computing, but also shared file systems and peripheral devices.
The idea was to provide the advantages of parallel processing,
while maintaining data reliability and uniqueness.
Message passing and communication
Node failure management
Debugging and monitoring
It consists of a collection of interconnected stand-alone computers
cooperatively working together a single, integrated computing
a single or multiprocessor system with memory, I/O facilities, &OS
generally 2 or more computers (nodes) connected together in a single
cabinet, or physically separated & connected via a LAN appear as a
single system to users and applications provide a cost-effective way to
gain features and benefits
The components required to the development
of low cost clusters are:
Motherboards, busses, and other sub-systems
Start from 1994
Donald Becker of NASA assembled this cluster.
Also called Beowulf cluster
Applications like data mining, simulations, parallel processing,
weather modeling, etc
A Beowulf Cluster is a computer design that uses parallel processing
across multiple computers to create cheap and powerful
supercomputers. A Beowulf Cluster in practice is usually a collection of
generic computers connected through an internal network.
A cluster has two types of computers, a master computer, and node
When a large problem or set of data is given to a Beowulf cluster, the
master computer first runs a program that breaks the problem into small
discrete pieces; it then sends a piece to each node to compute. As nodes
finish their tasks, the master computer continually sends more pieces to
them until the entire problem has been computed.
Master: or service node or front node ( used to interact with users and manage the
Nodes : a group of computers (computing node
s)( keyboard, mouse, floppy, video…)
Communications between nodes on an interconnect network platform
( Ethernet, Myrinet….)
In order for the master and node computers to communicate, some sort message
passing control structure is required. MPI,(Message Passing Interface) is the most
commonly used such control.
Brief Technical Parameters:
CentOS 5 managed by Rochs-cluster
1 (Intel P4 2.4 GHz)
32(Intel P4 2.4- 2.8 GHz)
1 GB per node
Gigabit Ethernet, 2 cards per node
Myrinet 2 G
Language: C, C++, Fortran, java
Compiler: Intel compiler, sun Java compiler
High Performance Networks/Switches
a. Ethernet (10Mbps),
b. Fast Ethernet (100Mbps),
c. Gigabit Ethernet (1Gbps)
f. Myrinet (1.2Gbps)
g. Digital Memory Channel
ISSUES TO BE CONSIDERED
OS (Operating System )
Three of the most commonly used OS are :
mainly used to build a High Availability Cluster or a NLB(Network Local
Balance) Cluster, provide services such as Database, File/Print,Web,Stream
Media .Support 2-4 SMP or 32 processors. Hardly used to build a Science
The most used OS for a Beowulf Cluster. provides High Performance and
Scalability / High Reliability / Low Cost ( get freely and uses inexpensive
commodity hardware )
Uses expensive and unpopular hardware
State of the art Operating Systems with
b. Microsoft NT
c. SUN Solaris
d. IBM AIX
e. HP UX (Illinois - PANDA)