SlideShare a Scribd company logo
Quo vadis Linux-HA?



Developments in Linux
   Clustersoftware
   Michael Schwartzkopff
  misch@schwartzkopff.org



                   (c) Michael Schwartzkopff, 2011   1 / 26
Background




         (c) Michael Schwartzkopff, 2011   2 / 26
Linux Clustersoftware

   Linux Virtual Server
       Scales nicely...
       … but is not high available.
   Linux-HA
       Offers high availability ...
       … but does not scale.

       Code is not maintained any more.
       Is beeing replaced by a collection of other
        programs.
                                        (c) Michael Schwartzkopff, 2011   3 / 26
Linux-HA Version 1 (heartbeat)

   Two servers exchange heartbeats.
   If the standby server does not receive
    heartbeats from the active node any more it
    starts the services.
   Configuration in a plain text file haresources.
   Cons:
       No monitoring of the services.
       No management of the resources.


                                         (c) Michael Schwartzkopff, 2011   4 / 26
Linux-HA Version 2 (CRM)

   Mangement of the resources by a
    Cluster Resource Manager (CRM):
       Aktive monitoring of the reosurces by the cluster
        software.
       Up to 16 nodes in a cluster.
       Resources free moveable between the nodes.
       Communication in the cluster via heartbeat.
       Constraints determine which resource should run
        on what node.


                                        (c) Michael Schwartzkopff, 2011   5 / 26
Constraints in Linux-HAv2

   Order
    A resource should start before or after an other
    resource.
   Colocation
    A resource should run on the same node as an
    other resource.
   Location
    A resource should run on a node with specific
    attributes.

                                  (c) Michael Schwartzkopff, 2011   6 / 26
Features of Linux-HAv2?

   Pros
       Monitoring of the resources.
   Cons
       Configuration in XML.
       Administration via the command line.
       GUI not really usable.
       Not maintained any more after 2007 (version 2.1.4).




                                       (c) Michael Schwartzkopff, 2011   7 / 26
Linux-HA


Managment                        CRM


Utilities
                 heartbeat     heartbeat

Communication



                Linux-HAv1    Linux-HAv2




                                   (c) Michael Schwartzkopff, 2011   8 / 26
Restart

   If the CRM uses heartbeat only for the
    communicaton in the cluster, this could be done
    also by another program.
   The other software was OpenAIS.
   The developers organized the CRM code in a
    separate project called pacemaker. It uses
    either heartbeat or OpenAIS.
   Some utilities from the heartbeat-package
    were still nescessary.

                                 (c) Michael Schwartzkopff, 2011   9 / 26
pacemaker

Managment
                               CRM                       pacemaker


Utilities


                heartbeat    heartbeat             heart-
                                                    beat
Communication
                                                                   OpenAIS


                Linux-HAv1   Linux-HAv2                  pacemaker




                                          (c) Michael Schwartzkopff, 2011    10 / 26
pacemaker

   Uses heartbeat or OpenAIS.
   Suitable GUI.
   Own subshell additional to the CLI.
   Sandboxes for testing.
       First test what would happen, if ...
        → only afterwards activate the new configuration.
   Exact history, what happened why.



                                      (c) Michael Schwartzkopff, 2011   11 / 26
pacemaker: The GUI




             (c) Michael Schwartzkopff, 2011   12 / 26
Sandboxes with graphics!




                (c) Michael Schwartzkopff, 2011   13 / 26
The development goes on

   OpenAIS offers much more as needed by
    pacemaker. The communication stack is
    forked into a separate project called corosync.
   corosync is responsible for the
    communication in the cluster.
   OpenAIS takes care for all ”higher” services in
    a cluster.
   Simple clusters with pacemaker only need
    corosync.

                                 (c) Michael Schwartzkopff, 2011   14 / 26
Decomposition of heartbeat

   With pacemaker 1.0.5, heartbeat is
    decomposed into three projects:
       cluster-glue includes all nescessary utilities.
       The package resource-agents combines all
        resource agents, the interface between pacemaker
        and the application's binaries.
       In heartbeat (version ≥ 3.0.2) remains, what is
        left from the project.



                                      (c) Michael Schwartzkopff, 2011   15 / 26
HA-cluster with Linux

Management                               pacemaker                    pacemaker
                            CRM


                                                                       resource-
                                                                         agents
Utilities

                                                                      cluster-glue
             heartbeat    heartbeat    heart-
                                        beat


Communi-                                                           heart-         coro-
cation                                          OpenAIS
                                                                    beat          sync



             Linux-HAv1   Linux-HAv2     pacemaker               pacemaker ≥ 1.0.5


                                                (c) Michael Schwartzkopff, 2011           16 / 26
Master Control Process

   pacemaker in version 1.1 got a Master Control
    Process. So it can be started outside from
    corosync though the init-system.
   Of course, corosync has to be running.
   Causes less trouble.
   Is more stable.




                                (c) Michael Schwartzkopff, 2011   20 / 26
DRBD Managment Console

   From company Linbit.
   Written in Java.
   Originally ment to manage DRBDs
   Now full blown cluster management tool:
       Nodes, resources, constraints
       Graphical representation of the configuration
       Emphasis on virtual machines: Config & console.



                                        (c) Michael Schwartzkopff, 2011   21 / 26
Utilizations in pacemaker 1.1

   Every node has utilizations like CPUs, RAM
    configured.
   Every resource has utilizations configured.
   The cluster manager takes care that resources
    only run on nodes with enough utilizations.

   TODO: Make resource utilizations dynamic.



                                 (c) Michael Schwartzkopff, 2011   22 / 26
Role Based Access Model

   From version 1.1 administrators access to
    resources can be limited:
       You can only destroy your own resources.
   Complete RBAC model implemented.
   Think about a provider offering HA services.




                                     (c) Michael Schwartzkopff, 2011   23 / 26
External Quorum Providers

   Quorum descisions are quite simple up to now.
   corosync can use external quorum providers.
   cman is a possible external provider.
       For now it is the only one.




                                      (c) Michael Schwartzkopff, 2011   24 / 26
Beering


   Lavandevil
    Schusterusstrasse 3

    U Richard Wagner Platz: U7 / M45




                               (c) Michael Schwartzkopff, 2011   25 / 26
Thank you very much for your attention!

             Questions?




                          (c) Michael Schwartzkopff, 2011   26 / 26

More Related Content

Similar to Developments in linux

Pacemaker+DRBD
Pacemaker+DRBDPacemaker+DRBD
Pacemaker+DRBD
Dan Frincu
 
test
testtest
Network simulator 2 a simulation tool for linux
Network simulator 2 a simulation tool for linuxNetwork simulator 2 a simulation tool for linux
Network simulator 2 a simulation tool for linux
Pratik Joshi
 
2008-11-13 CAVMEN RHEL for System z Deep Dive
2008-11-13 CAVMEN RHEL for System z Deep Dive2008-11-13 CAVMEN RHEL for System z Deep Dive
2008-11-13 CAVMEN RHEL for System z Deep Dive
Shawn Wells
 
Deployment of an HPC Cloud based on Intel hardware
Deployment of an HPC Cloud based on Intel hardwareDeployment of an HPC Cloud based on Intel hardware
Deployment of an HPC Cloud based on Intel hardware
Intel IT Center
 
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP AcceleratorsFPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
FlexTiles Team
 
LLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS ProgramsLLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS Programs
Akihiro Hayashi
 
Got Big Data? Splunk on Nutanix
Got Big Data? Splunk on NutanixGot Big Data? Splunk on Nutanix
Got Big Data? Splunk on Nutanix
NEXTtour
 
Kernel Recipes 2016 - New hwmon device registration API - Jean Delvare
Kernel Recipes 2016 -  New hwmon device registration API - Jean DelvareKernel Recipes 2016 -  New hwmon device registration API - Jean Delvare
Kernel Recipes 2016 - New hwmon device registration API - Jean Delvare
Anne Nicolas
 
Introduction to OpenVX
Introduction to OpenVXIntroduction to OpenVX
Introduction to OpenVX
家榮 張
 
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP IntegrationBKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
Linaro
 
Hacking+linux+kernel
Hacking+linux+kernelHacking+linux+kernel
Hacking+linux+kernel
robertsong
 
LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1
Hajime Tazaki
 
LO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
LO-PHI: Low-Observable Physical Host Instrumentation for Malware AnalysisLO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
LO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
Pietro De Nicolao
 
Disaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
Disaster Recovery in the Hadoop Ecosystem: Preparing for the ImprobableDisaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
Disaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
Stefan Kupstaitis-Dunkler
 
Parallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.pptParallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.ppt
MohmdUmer
 
An Introduce of OPNFV (Open Platform for NFV)
An Introduce of OPNFV (Open Platform for NFV)An Introduce of OPNFV (Open Platform for NFV)
An Introduce of OPNFV (Open Platform for NFV)
Mario Cho
 
Network Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source ToolsNetwork Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source Tools
sidneel
 
Cluster computer
Cluster  computerCluster  computer
Cluster computer
Ashraful Hoda
 
ARM HPC Ecosystem
ARM HPC EcosystemARM HPC Ecosystem
ARM HPC Ecosystem
inside-BigData.com
 

Similar to Developments in linux (20)

Pacemaker+DRBD
Pacemaker+DRBDPacemaker+DRBD
Pacemaker+DRBD
 
test
testtest
test
 
Network simulator 2 a simulation tool for linux
Network simulator 2 a simulation tool for linuxNetwork simulator 2 a simulation tool for linux
Network simulator 2 a simulation tool for linux
 
2008-11-13 CAVMEN RHEL for System z Deep Dive
2008-11-13 CAVMEN RHEL for System z Deep Dive2008-11-13 CAVMEN RHEL for System z Deep Dive
2008-11-13 CAVMEN RHEL for System z Deep Dive
 
Deployment of an HPC Cloud based on Intel hardware
Deployment of an HPC Cloud based on Intel hardwareDeployment of an HPC Cloud based on Intel hardware
Deployment of an HPC Cloud based on Intel hardware
 
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP AcceleratorsFPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
 
LLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS ProgramsLLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS Programs
 
Got Big Data? Splunk on Nutanix
Got Big Data? Splunk on NutanixGot Big Data? Splunk on Nutanix
Got Big Data? Splunk on Nutanix
 
Kernel Recipes 2016 - New hwmon device registration API - Jean Delvare
Kernel Recipes 2016 -  New hwmon device registration API - Jean DelvareKernel Recipes 2016 -  New hwmon device registration API - Jean Delvare
Kernel Recipes 2016 - New hwmon device registration API - Jean Delvare
 
Introduction to OpenVX
Introduction to OpenVXIntroduction to OpenVX
Introduction to OpenVX
 
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP IntegrationBKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
 
Hacking+linux+kernel
Hacking+linux+kernelHacking+linux+kernel
Hacking+linux+kernel
 
LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1
 
LO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
LO-PHI: Low-Observable Physical Host Instrumentation for Malware AnalysisLO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
LO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
 
Disaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
Disaster Recovery in the Hadoop Ecosystem: Preparing for the ImprobableDisaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
Disaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
 
Parallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.pptParallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.ppt
 
An Introduce of OPNFV (Open Platform for NFV)
An Introduce of OPNFV (Open Platform for NFV)An Introduce of OPNFV (Open Platform for NFV)
An Introduce of OPNFV (Open Platform for NFV)
 
Network Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source ToolsNetwork Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source Tools
 
Cluster computer
Cluster  computerCluster  computer
Cluster computer
 
ARM HPC Ecosystem
ARM HPC EcosystemARM HPC Ecosystem
ARM HPC Ecosystem
 

More from hik_lhz

Log4c developersguide
Log4c developersguideLog4c developersguide
Log4c developersguide
hik_lhz
 
D bus specification
D bus specificationD bus specification
D bus specification
hik_lhz
 
自动生成 Makefile 的全过程详解!
自动生成 Makefile 的全过程详解!自动生成 Makefile 的全过程详解!
自动生成 Makefile 的全过程详解!
hik_lhz
 
Larena3 0架构与关键技术
Larena3 0架构与关键技术Larena3 0架构与关键技术
Larena3 0架构与关键技术
hik_lhz
 
Considerations when implementing_ha_in_dmf
Considerations when implementing_ha_in_dmfConsiderations when implementing_ha_in_dmf
Considerations when implementing_ha_in_dmf
hik_lhz
 
8 集群
8 集群8 集群
8 集群
hik_lhz
 
0 mq the guide
0 mq   the guide0 mq   the guide
0 mq the guide
hik_lhz
 
Memcached内存分析、调优、集群
Memcached内存分析、调优、集群Memcached内存分析、调优、集群
Memcached内存分析、调优、集群
hik_lhz
 
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
hik_lhz
 

More from hik_lhz (9)

Log4c developersguide
Log4c developersguideLog4c developersguide
Log4c developersguide
 
D bus specification
D bus specificationD bus specification
D bus specification
 
自动生成 Makefile 的全过程详解!
自动生成 Makefile 的全过程详解!自动生成 Makefile 的全过程详解!
自动生成 Makefile 的全过程详解!
 
Larena3 0架构与关键技术
Larena3 0架构与关键技术Larena3 0架构与关键技术
Larena3 0架构与关键技术
 
Considerations when implementing_ha_in_dmf
Considerations when implementing_ha_in_dmfConsiderations when implementing_ha_in_dmf
Considerations when implementing_ha_in_dmf
 
8 集群
8 集群8 集群
8 集群
 
0 mq the guide
0 mq   the guide0 mq   the guide
0 mq the guide
 
Memcached内存分析、调优、集群
Memcached内存分析、调优、集群Memcached内存分析、调优、集群
Memcached内存分析、调优、集群
 
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
 

Recently uploaded

Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStrDeep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
saastr
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!
GDSC PJATK
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
Shinana2
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Jeffrey Haguewood
 
Operating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptxOperating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptx
Pravash Chandra Das
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
alexjohnson7307
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
Dinusha Kumarasiri
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 

Recently uploaded (20)

Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStrDeep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
Deep Dive: Getting Funded with Jason Jason Lemkin Founder & CEO @ SaaStr
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
dbms calicut university B. sc Cs 4th sem.pdf
dbms  calicut university B. sc Cs 4th sem.pdfdbms  calicut university B. sc Cs 4th sem.pdf
dbms calicut university B. sc Cs 4th sem.pdf
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
 
Operating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptxOperating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptx
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 

Developments in linux

  • 1. Quo vadis Linux-HA? Developments in Linux Clustersoftware Michael Schwartzkopff misch@schwartzkopff.org (c) Michael Schwartzkopff, 2011 1 / 26
  • 2. Background (c) Michael Schwartzkopff, 2011 2 / 26
  • 3. Linux Clustersoftware  Linux Virtual Server  Scales nicely...  … but is not high available.  Linux-HA  Offers high availability ...  … but does not scale.  Code is not maintained any more.  Is beeing replaced by a collection of other programs. (c) Michael Schwartzkopff, 2011 3 / 26
  • 4. Linux-HA Version 1 (heartbeat)  Two servers exchange heartbeats.  If the standby server does not receive heartbeats from the active node any more it starts the services.  Configuration in a plain text file haresources.  Cons:  No monitoring of the services.  No management of the resources. (c) Michael Schwartzkopff, 2011 4 / 26
  • 5. Linux-HA Version 2 (CRM)  Mangement of the resources by a Cluster Resource Manager (CRM):  Aktive monitoring of the reosurces by the cluster software.  Up to 16 nodes in a cluster.  Resources free moveable between the nodes.  Communication in the cluster via heartbeat.  Constraints determine which resource should run on what node. (c) Michael Schwartzkopff, 2011 5 / 26
  • 6. Constraints in Linux-HAv2  Order A resource should start before or after an other resource.  Colocation A resource should run on the same node as an other resource.  Location A resource should run on a node with specific attributes. (c) Michael Schwartzkopff, 2011 6 / 26
  • 7. Features of Linux-HAv2?  Pros  Monitoring of the resources.  Cons  Configuration in XML.  Administration via the command line.  GUI not really usable.  Not maintained any more after 2007 (version 2.1.4). (c) Michael Schwartzkopff, 2011 7 / 26
  • 8. Linux-HA Managment CRM Utilities heartbeat heartbeat Communication Linux-HAv1 Linux-HAv2 (c) Michael Schwartzkopff, 2011 8 / 26
  • 9. Restart  If the CRM uses heartbeat only for the communicaton in the cluster, this could be done also by another program.  The other software was OpenAIS.  The developers organized the CRM code in a separate project called pacemaker. It uses either heartbeat or OpenAIS.  Some utilities from the heartbeat-package were still nescessary. (c) Michael Schwartzkopff, 2011 9 / 26
  • 10. pacemaker Managment CRM pacemaker Utilities heartbeat heartbeat heart- beat Communication OpenAIS Linux-HAv1 Linux-HAv2 pacemaker (c) Michael Schwartzkopff, 2011 10 / 26
  • 11. pacemaker  Uses heartbeat or OpenAIS.  Suitable GUI.  Own subshell additional to the CLI.  Sandboxes for testing.  First test what would happen, if ... → only afterwards activate the new configuration.  Exact history, what happened why. (c) Michael Schwartzkopff, 2011 11 / 26
  • 12. pacemaker: The GUI (c) Michael Schwartzkopff, 2011 12 / 26
  • 13. Sandboxes with graphics! (c) Michael Schwartzkopff, 2011 13 / 26
  • 14. The development goes on  OpenAIS offers much more as needed by pacemaker. The communication stack is forked into a separate project called corosync.  corosync is responsible for the communication in the cluster.  OpenAIS takes care for all ”higher” services in a cluster.  Simple clusters with pacemaker only need corosync. (c) Michael Schwartzkopff, 2011 14 / 26
  • 15. Decomposition of heartbeat  With pacemaker 1.0.5, heartbeat is decomposed into three projects:  cluster-glue includes all nescessary utilities.  The package resource-agents combines all resource agents, the interface between pacemaker and the application's binaries.  In heartbeat (version ≥ 3.0.2) remains, what is left from the project. (c) Michael Schwartzkopff, 2011 15 / 26
  • 16. HA-cluster with Linux Management pacemaker pacemaker CRM resource- agents Utilities cluster-glue heartbeat heartbeat heart- beat Communi- heart- coro- cation OpenAIS beat sync Linux-HAv1 Linux-HAv2 pacemaker pacemaker ≥ 1.0.5 (c) Michael Schwartzkopff, 2011 16 / 26
  • 17. Master Control Process  pacemaker in version 1.1 got a Master Control Process. So it can be started outside from corosync though the init-system.  Of course, corosync has to be running.  Causes less trouble.  Is more stable. (c) Michael Schwartzkopff, 2011 20 / 26
  • 18. DRBD Managment Console  From company Linbit.  Written in Java.  Originally ment to manage DRBDs  Now full blown cluster management tool:  Nodes, resources, constraints  Graphical representation of the configuration  Emphasis on virtual machines: Config & console. (c) Michael Schwartzkopff, 2011 21 / 26
  • 19. Utilizations in pacemaker 1.1  Every node has utilizations like CPUs, RAM configured.  Every resource has utilizations configured.  The cluster manager takes care that resources only run on nodes with enough utilizations.  TODO: Make resource utilizations dynamic. (c) Michael Schwartzkopff, 2011 22 / 26
  • 20. Role Based Access Model  From version 1.1 administrators access to resources can be limited:  You can only destroy your own resources.  Complete RBAC model implemented.  Think about a provider offering HA services. (c) Michael Schwartzkopff, 2011 23 / 26
  • 21. External Quorum Providers  Quorum descisions are quite simple up to now.  corosync can use external quorum providers.  cman is a possible external provider.  For now it is the only one. (c) Michael Schwartzkopff, 2011 24 / 26
  • 22. Beering  Lavandevil Schusterusstrasse 3 U Richard Wagner Platz: U7 / M45 (c) Michael Schwartzkopff, 2011 25 / 26
  • 23. Thank you very much for your attention! Questions? (c) Michael Schwartzkopff, 2011 26 / 26