This document discusses building a fault tolerant and high availability architecture for OpenStack. It proposes using master-master clustering for MySQL, disk-level replication for databases using DBRD, session-level replication for RabbitMQ, and high availability for networking, Horizon dashboard, and all components. Pacemaker relies on Corosync for reliable cluster communications to provide high availability. Required packages include pacemaker, corosync, cluster-glue, and resource-agents. Architectures show implementing DBRD and Pacemaker/Corosync for MySQL and RabbitMQ high availability between cloud controllers. Nova and cloud controllers would have recovery modes to handle failures.

1. High Availability and Fault Tolerance
(OpenStack)
Deepak Mane
Cloud Architect

2. Objective & Motivation
• To Build a a Fault Tolerance and High Availability
Architecture (OpenStack)
• Motivation
– To build a fault tolerance architecture for OpenStack
– Build a Cluster Architecture for MySQL RabbitMQ
components
– To build high availability architecture for network
– To build a predictive and reactive model for detecting
failures of Nova , Swift and Compute.
–

3. Use cases
• Master-Master Cluster architecture for MySQL
• Disk Level replication for mySQL using DBRD for
Glance , Swift and Cinder
• Session level replication for RabbitMQ
• High availability for networking
• High availability for Horizon (Openstack
dashboard)
• Predictive model for detecting failure for all
components
• Reactive model for recovery for all components.

4. Non Use Cases
• Scenarios not suitable for cloud
– Redundancy of network components, such as
switches and routers,
– Redundancy of applications and automatic service
migration,
– Redundancy of storage components,
– Redundancy of facility services such as power, air
conditioning, fire protection, and others

5. Pacemaker – High availability for
OpenStack
• Cluster stack, the state of- the-art high availability
and load balancing stack for the Linux platform
• Storage- and application-agnostic, and is in no
way specific to OpenStack
• Pacemaker relies on the Corosync messaging
layer for reliable cluster communications.
• Corosync implements the Totem single-ring
ordering and membership protocol and provides
UDP and InfiniBand based messaging, quorum,
and cluster membership to Pacemaker.

6. Required packages
• pacemaker
• corosync
• cluster-glue
• resource-agents

7. Architecture and Technology
Information

8. HA Architecture – Cloud Controller
High availability
Implemented using DBRD , Pacemaker , Corosync

9. DBRD Architecture – MySQL-Cloud
Controller
Master Cloud controller Slave Cloud controller

10. DBRD Architecture – RabbitMQ- Cloud Controller
Master Cloud controller Slave Cloud controller

11. Nova - Recovery mode Approach
• Nova - Recovery mode Approach

12. Cloud Controller – Recovery approach