SlideShare a Scribd company logo
1 of 14
VISHWESHWARAYA TECHNOLOLOGICAL UNIVERSITY, BELGAUM.




              Clusters
                                      Yasir H Wani
                                      M.Tech, VTU
What is clustering?

An approach to provide:

•   High Performance
•   High Availability

                          Server Application
Definition:

    “A cluster is a group of interconnected, whole computers
    working together as a unified computing resource that can
    create an illusion of being one single machine.”

•    Whole Computer? What the heck is that???

•   How would a cluster then look like?
NASA 128-processor Beowulf cluster: A
cluster built from 64 ordinary PC's.
Benefits /Objectives/Design Requirements

•   Absolute Scalability
•   Incremental Scalability
•   High Availability
•   Superior price/performance (Google mantra!)



    But same is achieved if SMP is used! How is it different then?
    (We will see later)
Cluster Configuration 1
 •   High speed link is used to exchange messages for coordination
     of cluster activity




      Figure: Standby Server with no shared disk)
Cluster Configuration 2
Shared disk
 • Use of RAID (Redundant Array of Independent Disks;
   originally Redundant Array Of Inexpensive Disks)
Clustering Approaches
 1: Passive Standby

 •     One computer handle all the processing load
 •     Other computer remains inactive (for backup)

       What about coordination?
 •     Primary system periodically sends “ heart beat” message
 •     Increased Availability, but same old Performance
        Not at all Clustering coz :-

 I.      Not maintaining the image of Single System to outside world.
 II.     “All are actively doing process” not followed.
Clustering Approaches continued…
 2: Separate Server

 •   Each computer is a Separate Server
 •   Private disk is maintained
 •   High performance and high availability
 •   Scheduling software needed to schedule tasks among sep. ser.
 •   Load balancing provided

 (Q): How availability?
  Data is constantly copied among systems to maintain current
  state of data in all the systems.
  Disadv: Comes at cost of performance penalty.
Shared Nothing
  Common disks partitioned into volumes & each system given a
    volume
• Each volume is owned by a single computer
• If a system fail, volume ownership changes


Shared Disk
All computers have access to all the systems

•   This requires some locking facility
Operating System Issues

Enhancement to the single system OS


•   Failure management
•   Load Balancing
•   Parallelizing Computation
         a.   Compiler time
         b.   At Application layer via Message Passing
         c.   Parametric Computing E.g. Simulation
Cluster Middleware
Cluster middleware is a set of programs which provide SSI


Cluster middleware Duties/Functional Components:
• job management system
• cluster monitoring system
• parallel libraries
• automatic client installation systems
• cluster management tools
• distributed and parallel file systems
• global process space
Cluster Computer Architecture
References:

 1)   Cluster-Based Scalable Network Services -Armando Fox Steven
      D. Gribble Yatin Chawathe Eric A. BrewePaul Gauthier,
      University of California at Berkeley

 2)   Operating Systems- Internals and Design Principles(6th Edition)
      by William Stalling

 3)   http://www.scfbio-iitd.res.in/doc/clustering.pdf
 4)   http://en.wikipedia.org/wiki/Cluster_computing 
 5)   http://www.cro-ngi.hr/en/technologies/cluster-technologies/

More Related Content

What's hot

Cluster Computing
Cluster ComputingCluster Computing
Cluster Computing
NIKHIL NAIR
 
WAN & LAN Cluster with Diagrams and OSI explanation
WAN & LAN Cluster with Diagrams and OSI explanationWAN & LAN Cluster with Diagrams and OSI explanation
WAN & LAN Cluster with Diagrams and OSI explanation
Jonathan Reid
 

What's hot (19)

Cluster computing ppt
Cluster computing pptCluster computing ppt
Cluster computing ppt
 
Cluster Computing
Cluster ComputingCluster Computing
Cluster Computing
 
Cluster Computing
Cluster ComputingCluster Computing
Cluster Computing
 
Cluster computing2
Cluster computing2Cluster computing2
Cluster computing2
 
Clusters
ClustersClusters
Clusters
 
Cluster computing report
Cluster computing reportCluster computing report
Cluster computing report
 
Cluster computing
Cluster computingCluster computing
Cluster computing
 
Cluster computing
Cluster computingCluster computing
Cluster computing
 
Cluster Computing
Cluster ComputingCluster Computing
Cluster Computing
 
Clusetrreport
ClusetrreportClusetrreport
Clusetrreport
 
Cluster Computing
Cluster ComputingCluster Computing
Cluster Computing
 
Clustering - Eric Vanderburg
Clustering - Eric VanderburgClustering - Eric Vanderburg
Clustering - Eric Vanderburg
 
Cluster computer
Cluster  computerCluster  computer
Cluster computer
 
Computer cluster
Computer clusterComputer cluster
Computer cluster
 
Designing Distributed Systems: Google Cas Study
Designing Distributed Systems: Google Cas StudyDesigning Distributed Systems: Google Cas Study
Designing Distributed Systems: Google Cas Study
 
Cluster computing
Cluster computingCluster computing
Cluster computing
 
Cluster computing
Cluster computingCluster computing
Cluster computing
 
WAN & LAN Cluster with Diagrams and OSI explanation
WAN & LAN Cluster with Diagrams and OSI explanationWAN & LAN Cluster with Diagrams and OSI explanation
WAN & LAN Cluster with Diagrams and OSI explanation
 
Comparison between Cloud Mirror, Mesos Cluster, and Google Omega
Comparison between Cloud Mirror, Mesos Cluster, and Google OmegaComparison between Cloud Mirror, Mesos Cluster, and Google Omega
Comparison between Cloud Mirror, Mesos Cluster, and Google Omega
 

Similar to Cluster

Apos week 1 4
Apos week 1   4Apos week 1   4
Apos week 1 4
alixafar
 
Big data and hadoop
Big data and hadoopBig data and hadoop
Big data and hadoop
Mohit Tare
 

Similar to Cluster (20)

Distributed systems and scalability rules
Distributed systems and scalability rulesDistributed systems and scalability rules
Distributed systems and scalability rules
 
Cluster computing
Cluster computingCluster computing
Cluster computing
 
CCUnit1.pdf
CCUnit1.pdfCCUnit1.pdf
CCUnit1.pdf
 
Linux12 clustering onlinux
Linux12 clustering onlinuxLinux12 clustering onlinux
Linux12 clustering onlinux
 
introduction to cloud computing for college.pdf
introduction to cloud computing for college.pdfintroduction to cloud computing for college.pdf
introduction to cloud computing for college.pdf
 
Cluster Computing
Cluster ComputingCluster Computing
Cluster Computing
 
OS_MD_1.pdf
OS_MD_1.pdfOS_MD_1.pdf
OS_MD_1.pdf
 
Cluster Technique used in Advanced Computer Architecture.pptx
Cluster Technique used in Advanced Computer Architecture.pptxCluster Technique used in Advanced Computer Architecture.pptx
Cluster Technique used in Advanced Computer Architecture.pptx
 
Apos week 1 4
Apos week 1   4Apos week 1   4
Apos week 1 4
 
Big data and hadoop
Big data and hadoopBig data and hadoop
Big data and hadoop
 
Pdc lecture1
Pdc lecture1Pdc lecture1
Pdc lecture1
 
Linux container, namespaces & CGroup.
Linux container, namespaces & CGroup. Linux container, namespaces & CGroup.
Linux container, namespaces & CGroup.
 
Introduction
IntroductionIntroduction
Introduction
 
Parallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.pptParallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.ppt
 
EMBEDDED OS
EMBEDDED OSEMBEDDED OS
EMBEDDED OS
 
chap-0 .ppt
chap-0 .pptchap-0 .ppt
chap-0 .ppt
 
HPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journeyHPC and cloud distributed computing, as a journey
HPC and cloud distributed computing, as a journey
 
Sanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticiansSanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticians
 
Flexible compute
Flexible computeFlexible compute
Flexible compute
 
CLOUD ENABLING TECHNOLOGIES.pptx
 CLOUD ENABLING TECHNOLOGIES.pptx CLOUD ENABLING TECHNOLOGIES.pptx
CLOUD ENABLING TECHNOLOGIES.pptx
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 

Cluster

  • 1. VISHWESHWARAYA TECHNOLOLOGICAL UNIVERSITY, BELGAUM. Clusters Yasir H Wani M.Tech, VTU
  • 2. What is clustering? An approach to provide: • High Performance • High Availability Server Application
  • 3. Definition: “A cluster is a group of interconnected, whole computers working together as a unified computing resource that can create an illusion of being one single machine.” • Whole Computer? What the heck is that??? • How would a cluster then look like?
  • 4. NASA 128-processor Beowulf cluster: A cluster built from 64 ordinary PC's.
  • 5. Benefits /Objectives/Design Requirements • Absolute Scalability • Incremental Scalability • High Availability • Superior price/performance (Google mantra!) But same is achieved if SMP is used! How is it different then? (We will see later)
  • 6. Cluster Configuration 1 • High speed link is used to exchange messages for coordination of cluster activity Figure: Standby Server with no shared disk)
  • 7. Cluster Configuration 2 Shared disk • Use of RAID (Redundant Array of Independent Disks; originally Redundant Array Of Inexpensive Disks)
  • 8. Clustering Approaches 1: Passive Standby • One computer handle all the processing load • Other computer remains inactive (for backup) What about coordination? • Primary system periodically sends “ heart beat” message • Increased Availability, but same old Performance Not at all Clustering coz :- I. Not maintaining the image of Single System to outside world. II. “All are actively doing process” not followed.
  • 9. Clustering Approaches continued… 2: Separate Server • Each computer is a Separate Server • Private disk is maintained • High performance and high availability • Scheduling software needed to schedule tasks among sep. ser. • Load balancing provided (Q): How availability? Data is constantly copied among systems to maintain current state of data in all the systems. Disadv: Comes at cost of performance penalty.
  • 10. Shared Nothing Common disks partitioned into volumes & each system given a volume • Each volume is owned by a single computer • If a system fail, volume ownership changes Shared Disk All computers have access to all the systems • This requires some locking facility
  • 11. Operating System Issues Enhancement to the single system OS • Failure management • Load Balancing • Parallelizing Computation a. Compiler time b. At Application layer via Message Passing c. Parametric Computing E.g. Simulation
  • 12. Cluster Middleware Cluster middleware is a set of programs which provide SSI Cluster middleware Duties/Functional Components: • job management system • cluster monitoring system • parallel libraries • automatic client installation systems • cluster management tools • distributed and parallel file systems • global process space
  • 14. References: 1) Cluster-Based Scalable Network Services -Armando Fox Steven D. Gribble Yatin Chawathe Eric A. BrewePaul Gauthier, University of California at Berkeley 2) Operating Systems- Internals and Design Principles(6th Edition) by William Stalling 3) http://www.scfbio-iitd.res.in/doc/clustering.pdf 4) http://en.wikipedia.org/wiki/Cluster_computing 5) http://www.cro-ngi.hr/en/technologies/cluster-technologies/