SlideShare a Scribd company logo
1 of 11
Download to read offline
IBM Integration Bus
High Availability Overview
Peter Broadhurst
IBM Messaging & Integration
© 2013, 2014 International Business Machines Corporation 2
Introduction
These charts provide a high-level overview of IIB HA topologies:
• Comparison of active/active and active/passive HA
• Solutions for active/passive HA failover with IBM Integration Bus
• Solutions for active/active processing with IBM Integration Bus
• Adding Global Cache to active/active processing
• Combining all of the above
Only HTTP and JMS (MQ) workloads are shown
© 2013, 2014 International Business Machines Corporation 3
Active/active vs. active/passive
Scale High Availability Design Considerations
Active/Active All N instances contribute to
the processing capacity of
the system
New requests can be serviced
immediately after the planned
or unplanned termination of
an active instance.
Often referred to as
continuous availability.
Each instance must be able to
operate independently, without
relying on the availability of any
other instance in the environment.
The order of processing for two
items of work cannot be
guaranteed, as there are multiple
instances that might perform each
item of work
Active/Passive Only one of N instances
contributes to the processing
capacity of the system
There is a failover period after
the planned or unplanned
termination of an active
instance. This failover period
commonly lasts for a small
number of minutes,
depending on the technology
used.
An infrastructure for HA failover
must exist, that ensures only one
instance is ever activated, as well
as detecting when one instance
fails to initiate the failover.
The active and the passive
system must have identical copies
of persistent data, such as
persisted transaction state, and
persisted messages. In IBM
Integration Bus this is achieved by
sharing a filesystem between the
two machines.
© 2013, 2014 International Business Machines Corporation 4
Active/passive high availability
Machine 1 Machine 2
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
Shared
file system
HA
failover
• Single instance of the IIB runtime
• Single instance of all state
– Configuration, MQ messages and Transaction coordinator
• Highly available due to automatic fail-over. Two options available for HA failover:
– Out-of-the-box with Multi-Instance capability,
– Or using external HA cluster software
JMS workloads
HTTP workloads
© 2013, 2014 International Business Machines Corporation 5
Option 1: Out of the box Multi-Instance failover
• IP address of each machine is different
– IP address redirect is required for HTTP workloads
– MQ client libraries automatically handle IP redirect for JMS workloads
• Requires highly available network-attached storage (NAS). Examples:
– IBM GPFS
– Veritas Cluster File System
– Highly available NFSv4
• More information on choosing a suitable NAS:
– https://ibm.biz/BdFxfz
Machine 1 – IP addr 1 Machine 2 – IP addr 2
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
Network-
attached
file system (NAS)
TCP/ IP
Failover
managed
via
NAS file
locks
IP redirect (Gateway / Load Balancer)
JMS workloads
TCP/ IP
© 2013, 2014 International Business Machines Corporation 6
Option 2: HA cluster failover
• Allows use of direct-attached storage
• IP address failed over by HA cluster software
• Requires HA cluster software. Examples:
– IBM PowerHA (HACMP)
– Veritas Cluster Server (VCS)
– Microsoft Cluster Service (MSCS)
– Red Hat Cluster
Machine 1 – IP addr 1 Machine 2 – IP addr 1
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
Direct-attached
file system
switched by HA
Failover
managed
via
health
checking
Fibre/SCSI
HA cluster Software HA cluster Software
Heartbeat
Healthcheck Healthcheck
JMS workloads
HTTP workloads
Fibre/SCSI
IP addr
failover
© 2013, 2014 International Business Machines Corporation 7
Multi-instance or HA cluster?
Multi-instance queue manager
• Integrated into the IIB and MQ products
• Faster failover than HA cluster*
• Delay before queue manager restart is much shorter*
• Runtime performance of networked storage must be considered
• IP address of standby instance is different to primary
• No automatic fail-back to primary hardware when restored
• More susceptible to MQ and OS defects
HA cluster
• Capable of handling a wider range of failures
• Failover historically rather slow, but some HA clusters are improving
• Some customers frustrated by unnecessary failovers
• Require MC91 SupportPac or equivalent configuration
• Extra product purchase and skills required
Storage distinction
• Multi-instance queue manager typically uses NAS
• HA clustered queue manager typically uses SAN
*depends on NAS file-system tuning and specific customer environment
© 2013, 2014 International Business Machines Corporation 8
Active/active topologies
Machine 1 Machine 2
IIB Integration Node
MQ Messaging
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
WESB AppTargetWESB AppTargetIntegration Server
Gateway / Load Balancer for HTTP workloads
HTTP workloads
JMS workloads
• Each Integration Node operates independently
• Continuous availability of the service during a failure
– Individual in-flight requests on the failed node receive errors, but the service stays available
• HTTP workloads require external workload balancing
– Hardware load balancer is the most common solution
• JMS workloads require load balancing
– Via an MQ cluster when remote applications have their own MQ queue managers
– Options for direct MQ client attachment (over TCP/IP) described here: https://ibm.biz/BdFxfS
© 2013, 2014 International Business Machines Corporation 9
Adding Global Cache to active/active topologies
Machine 1 Machine 2
IIB Integration Node
MQ Messaging
Global
Cache
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
WESB AppTargetWESB AppTargetIntegration Server
• Highly available in-memory state store
– High performance compared to disk persistence (DB/MQ Messaging)
– High availability through redundancy – cannot be recovered if all nodes are stopped concurrently
– Built with WebSphere eXtreme Scale technology
• Alternative to using MQ or a Database for state storage/retrieval
– Correlation state between asynchronous request/reply flows
• Only needed if replies might be routed via a different runtime, otherwise simply use memory (LocalEnvironment etc.)
– Regularly accessed reference data, such as routing tables
© 2013, 2014 International Business Machines Corporation 10
Global
Cache
Putting it all together
• Active/active processing. HA fail-over for state and in-flight message recovery
• Individual queues/flows can be configured active/passive if required
– Single flow instance for message ordering or file-based processing
– Single correlation state queue shared between active flow instances
Machine 1 Machine 2
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
IIB Integration Node
MQ Messaging
WESB AppTargetWESB AppTargetIntegration Server
Shared
Filesystem
Failover
Failover
Gateway / Load Balancer for HTTP workloads
JMS workloads
HTTP workloads
© 2013, 2014 International Business Machines Corporation 11
More information
• Knowledge Center starting points:
IIB Active/passive HA: https://ibm.biz/BdFxfe
IIB Active/active HA for HTTP: https://ibm.biz/BdFxfb
IIB Global cache: https://ibm.biz/BdFxfp
MQ HA Cluster configurations: https://ibm.biz/BdFxf8
• Wiki article with detailed description of IIB topology choices
Tailored to customers migrating from WebSphere WESB, but useful to all
https://ibm.biz/BdFxfa
• MQDev blog on attaching MQ clients to active/active qmgrs:
https://ibm.biz/BdFxfS
• Testing and support statement for multi-instance
https://ibm.biz/BdFxfz

More Related Content

What's hot

IBM MQ and Kafka, what is the difference?
IBM MQ and Kafka, what is the difference?IBM MQ and Kafka, what is the difference?
IBM MQ and Kafka, what is the difference?David Ware
 
IBM MQ - What's new in 9.2
IBM MQ - What's new in 9.2IBM MQ - What's new in 9.2
IBM MQ - What's new in 9.2David Ware
 
Securing your IBM MQ environment.
Securing your IBM MQ environment.Securing your IBM MQ environment.
Securing your IBM MQ environment.Robert Parker
 
An Introduction to the Message Queuing Technology & IBM WebSphere MQ
An Introduction to the Message Queuing Technology & IBM WebSphere MQAn Introduction to the Message Queuing Technology & IBM WebSphere MQ
An Introduction to the Message Queuing Technology & IBM WebSphere MQRavi Yogesh
 
Fault tolerant and scalable ibm mq
Fault tolerant and scalable ibm mqFault tolerant and scalable ibm mq
Fault tolerant and scalable ibm mqDavid Ware
 
Introduction to Apache Kafka
Introduction to Apache KafkaIntroduction to Apache Kafka
Introduction to Apache KafkaJeff Holoman
 
Kafka with IBM Event Streams - Technical Presentation
Kafka with IBM Event Streams - Technical PresentationKafka with IBM Event Streams - Technical Presentation
Kafka with IBM Event Streams - Technical PresentationWinton Winton
 
IBM MQ Whats new - including 9.3 and 9.3.1
IBM MQ Whats new - including 9.3 and 9.3.1IBM MQ Whats new - including 9.3 and 9.3.1
IBM MQ Whats new - including 9.3 and 9.3.1Robert Parker
 
IBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprintIBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprintMatt Roberts
 
IBM WebSphere MQ Introduction
IBM WebSphere MQ Introduction IBM WebSphere MQ Introduction
IBM WebSphere MQ Introduction ejlp12
 
Event Sourcing & CQRS, Kafka, Rabbit MQ
Event Sourcing & CQRS, Kafka, Rabbit MQEvent Sourcing & CQRS, Kafka, Rabbit MQ
Event Sourcing & CQRS, Kafka, Rabbit MQAraf Karsh Hamid
 
Websphere MQ admin guide
Websphere MQ admin guideWebsphere MQ admin guide
Websphere MQ admin guideRam Babu
 
Micro services Architecture
Micro services ArchitectureMicro services Architecture
Micro services ArchitectureAraf Karsh Hamid
 
[오픈소스컨설팅]오픈스택에 대하여
[오픈소스컨설팅]오픈스택에 대하여[오픈소스컨설팅]오픈스택에 대하여
[오픈소스컨설팅]오픈스택에 대하여Ji-Woong Choi
 
414: Build an agile CI/CD Pipeline for application integration
414: Build an agile CI/CD Pipeline for application integration414: Build an agile CI/CD Pipeline for application integration
414: Build an agile CI/CD Pipeline for application integrationTrevor Dolby
 
Red Hat Ansible 적용 사례
Red Hat Ansible 적용 사례Red Hat Ansible 적용 사례
Red Hat Ansible 적용 사례Opennaru, inc.
 
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATIONIBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATIONKellton Tech Solutions Ltd
 
[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트
[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트
[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트OpenStack Korea Community
 

What's hot (20)

IBM MQ and Kafka, what is the difference?
IBM MQ and Kafka, what is the difference?IBM MQ and Kafka, what is the difference?
IBM MQ and Kafka, what is the difference?
 
WebSphere MQ tutorial
WebSphere MQ tutorialWebSphere MQ tutorial
WebSphere MQ tutorial
 
IBM MQ - What's new in 9.2
IBM MQ - What's new in 9.2IBM MQ - What's new in 9.2
IBM MQ - What's new in 9.2
 
Securing your IBM MQ environment.
Securing your IBM MQ environment.Securing your IBM MQ environment.
Securing your IBM MQ environment.
 
An Introduction to the Message Queuing Technology & IBM WebSphere MQ
An Introduction to the Message Queuing Technology & IBM WebSphere MQAn Introduction to the Message Queuing Technology & IBM WebSphere MQ
An Introduction to the Message Queuing Technology & IBM WebSphere MQ
 
Fault tolerant and scalable ibm mq
Fault tolerant and scalable ibm mqFault tolerant and scalable ibm mq
Fault tolerant and scalable ibm mq
 
Introduction to Apache Kafka
Introduction to Apache KafkaIntroduction to Apache Kafka
Introduction to Apache Kafka
 
Kafka with IBM Event Streams - Technical Presentation
Kafka with IBM Event Streams - Technical PresentationKafka with IBM Event Streams - Technical Presentation
Kafka with IBM Event Streams - Technical Presentation
 
IBM MQ Whats new - including 9.3 and 9.3.1
IBM MQ Whats new - including 9.3 and 9.3.1IBM MQ Whats new - including 9.3 and 9.3.1
IBM MQ Whats new - including 9.3 and 9.3.1
 
IBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprintIBM MQ cloud architecture blueprint
IBM MQ cloud architecture blueprint
 
IBM WebSphere MQ Introduction
IBM WebSphere MQ Introduction IBM WebSphere MQ Introduction
IBM WebSphere MQ Introduction
 
Event Sourcing & CQRS, Kafka, Rabbit MQ
Event Sourcing & CQRS, Kafka, Rabbit MQEvent Sourcing & CQRS, Kafka, Rabbit MQ
Event Sourcing & CQRS, Kafka, Rabbit MQ
 
Apache kafka
Apache kafkaApache kafka
Apache kafka
 
Websphere MQ admin guide
Websphere MQ admin guideWebsphere MQ admin guide
Websphere MQ admin guide
 
Micro services Architecture
Micro services ArchitectureMicro services Architecture
Micro services Architecture
 
[오픈소스컨설팅]오픈스택에 대하여
[오픈소스컨설팅]오픈스택에 대하여[오픈소스컨설팅]오픈스택에 대하여
[오픈소스컨설팅]오픈스택에 대하여
 
414: Build an agile CI/CD Pipeline for application integration
414: Build an agile CI/CD Pipeline for application integration414: Build an agile CI/CD Pipeline for application integration
414: Build an agile CI/CD Pipeline for application integration
 
Red Hat Ansible 적용 사례
Red Hat Ansible 적용 사례Red Hat Ansible 적용 사례
Red Hat Ansible 적용 사례
 
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATIONIBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
 
[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트
[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트
[OpenStack Days Korea 2016] Track3 - 오픈스택 환경에서 공유 파일 시스템 구현하기: 마닐라(Manila) 프로젝트
 

Similar to IBM Integration Bus High Availability Overview

IBM MQ High Availabillity and Disaster Recovery (2017 version)
IBM MQ High Availabillity and Disaster Recovery (2017 version)IBM MQ High Availabillity and Disaster Recovery (2017 version)
IBM MQ High Availabillity and Disaster Recovery (2017 version)MarkTaylorIBM
 
What's new in informix v11.70
What's new in informix v11.70What's new in informix v11.70
What's new in informix v11.70am_prasanna
 
2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...
2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...
2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...Hendrik van Run
 
IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...
IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...
IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...Peter Broadhurst
 
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep dive dee...
Accelerate with ibm storage  ibm spectrum virtualize hyper swap deep dive dee...Accelerate with ibm storage  ibm spectrum virtualize hyper swap deep dive dee...
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep dive dee...xKinAnx
 
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep dive
Accelerate with ibm storage  ibm spectrum virtualize hyper swap deep diveAccelerate with ibm storage  ibm spectrum virtualize hyper swap deep dive
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep divexKinAnx
 
Hyper-V’s Virtualization Enhancements - EPC Group
Hyper-V’s Virtualization Enhancements - EPC GroupHyper-V’s Virtualization Enhancements - EPC Group
Hyper-V’s Virtualization Enhancements - EPC GroupEPC Group
 
Geographically Distributed Multi-Master MySQL Clusters
Geographically Distributed Multi-Master MySQL ClustersGeographically Distributed Multi-Master MySQL Clusters
Geographically Distributed Multi-Master MySQL ClustersContinuent
 
IBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceIBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceRobert Nicholson
 
1480-techintrotoiib-150224130001-conversion-gate01.pptx
1480-techintrotoiib-150224130001-conversion-gate01.pptx1480-techintrotoiib-150224130001-conversion-gate01.pptx
1480-techintrotoiib-150224130001-conversion-gate01.pptxBalakoteswaraReddyM
 
W23 - Advanced Performance Tactics for WebSphere Performance
W23 - Advanced Performance Tactics for WebSphere PerformanceW23 - Advanced Performance Tactics for WebSphere Performance
W23 - Advanced Performance Tactics for WebSphere PerformanceHendrik van Run
 
Virtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - VarrowVirtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - VarrowAndrew Miller
 
PCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptxPCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptxssuser21ded1
 
WSI35 - WebSphere Extreme Scale Customer Scenarios and Use Cases
WSI35 - WebSphere Extreme Scale Customer Scenarios and Use CasesWSI35 - WebSphere Extreme Scale Customer Scenarios and Use Cases
WSI35 - WebSphere Extreme Scale Customer Scenarios and Use CasesHendrik van Run
 
Multi Tenancy In The Cloud
Multi Tenancy In The CloudMulti Tenancy In The Cloud
Multi Tenancy In The Cloudrohit_ainapure
 
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...Andrew Miller
 
Hhm 3474 mq messaging technologies and support for high availability and acti...
Hhm 3474 mq messaging technologies and support for high availability and acti...Hhm 3474 mq messaging technologies and support for high availability and acti...
Hhm 3474 mq messaging technologies and support for high availability and acti...Pete Siddall
 
Simplifying Hyper-V Management for VMware Administrators
Simplifying Hyper-V Management for VMware AdministratorsSimplifying Hyper-V Management for VMware Administrators
Simplifying Hyper-V Management for VMware Administrators5nine
 

Similar to IBM Integration Bus High Availability Overview (20)

IBM MQ High Availabillity and Disaster Recovery (2017 version)
IBM MQ High Availabillity and Disaster Recovery (2017 version)IBM MQ High Availabillity and Disaster Recovery (2017 version)
IBM MQ High Availabillity and Disaster Recovery (2017 version)
 
What's new in informix v11.70
What's new in informix v11.70What's new in informix v11.70
What's new in informix v11.70
 
2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...
2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...
2689 - Exploring IBM PureApplication System and IBM Workload Deployer Best Pr...
 
IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...
IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...
IBM IMPACT 2014 - AMC-1882 Building a Scalable & Continuously Available IBM M...
 
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep dive dee...
Accelerate with ibm storage  ibm spectrum virtualize hyper swap deep dive dee...Accelerate with ibm storage  ibm spectrum virtualize hyper swap deep dive dee...
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep dive dee...
 
Could the “C” in HPC stand for Cloud?
Could the “C” in HPC stand for Cloud?Could the “C” in HPC stand for Cloud?
Could the “C” in HPC stand for Cloud?
 
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep dive
Accelerate with ibm storage  ibm spectrum virtualize hyper swap deep diveAccelerate with ibm storage  ibm spectrum virtualize hyper swap deep dive
Accelerate with ibm storage ibm spectrum virtualize hyper swap deep dive
 
Hyper-V’s Virtualization Enhancements - EPC Group
Hyper-V’s Virtualization Enhancements - EPC GroupHyper-V’s Virtualization Enhancements - EPC Group
Hyper-V’s Virtualization Enhancements - EPC Group
 
Geographically Distributed Multi-Master MySQL Clusters
Geographically Distributed Multi-Master MySQL ClustersGeographically Distributed Multi-Master MySQL Clusters
Geographically Distributed Multi-Master MySQL Clusters
 
IBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceIBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech Conference
 
1480-techintrotoiib-150224130001-conversion-gate01.pptx
1480-techintrotoiib-150224130001-conversion-gate01.pptx1480-techintrotoiib-150224130001-conversion-gate01.pptx
1480-techintrotoiib-150224130001-conversion-gate01.pptx
 
W23 - Advanced Performance Tactics for WebSphere Performance
W23 - Advanced Performance Tactics for WebSphere PerformanceW23 - Advanced Performance Tactics for WebSphere Performance
W23 - Advanced Performance Tactics for WebSphere Performance
 
Txlf2012
Txlf2012Txlf2012
Txlf2012
 
Virtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - VarrowVirtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - Varrow
 
PCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptxPCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptx
 
WSI35 - WebSphere Extreme Scale Customer Scenarios and Use Cases
WSI35 - WebSphere Extreme Scale Customer Scenarios and Use CasesWSI35 - WebSphere Extreme Scale Customer Scenarios and Use Cases
WSI35 - WebSphere Extreme Scale Customer Scenarios and Use Cases
 
Multi Tenancy In The Cloud
Multi Tenancy In The CloudMulti Tenancy In The Cloud
Multi Tenancy In The Cloud
 
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
 
Hhm 3474 mq messaging technologies and support for high availability and acti...
Hhm 3474 mq messaging technologies and support for high availability and acti...Hhm 3474 mq messaging technologies and support for high availability and acti...
Hhm 3474 mq messaging technologies and support for high availability and acti...
 
Simplifying Hyper-V Management for VMware Administrators
Simplifying Hyper-V Management for VMware AdministratorsSimplifying Hyper-V Management for VMware Administrators
Simplifying Hyper-V Management for VMware Administrators
 

More from Peter Broadhurst

Kaleido Platform Overview and Full-stack Blockchain Services
Kaleido Platform Overview and Full-stack Blockchain ServicesKaleido Platform Overview and Full-stack Blockchain Services
Kaleido Platform Overview and Full-stack Blockchain ServicesPeter Broadhurst
 
The Emerging Role of ZKP in the Privacy Stack of Production Business Networks...
The Emerging Role of ZKP in thePrivacy Stack ofProduction Business Networks...The Emerging Role of ZKP in thePrivacy Stack ofProduction Business Networks...
The Emerging Role of ZKP in the Privacy Stack of Production Business Networks...Peter Broadhurst
 
Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...
Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...
Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...Peter Broadhurst
 
What does it take to deploy large scale decentralized applications?
What does it take to deploy large scale decentralized applications?What does it take to deploy large scale decentralized applications?
What does it take to deploy large scale decentralized applications?Peter Broadhurst
 
IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...
IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...
IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...Peter Broadhurst
 
IBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging Capabilities
IBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging CapabilitiesIBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging Capabilities
IBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging CapabilitiesPeter Broadhurst
 

More from Peter Broadhurst (6)

Kaleido Platform Overview and Full-stack Blockchain Services
Kaleido Platform Overview and Full-stack Blockchain ServicesKaleido Platform Overview and Full-stack Blockchain Services
Kaleido Platform Overview and Full-stack Blockchain Services
 
The Emerging Role of ZKP in the Privacy Stack of Production Business Networks...
The Emerging Role of ZKP in thePrivacy Stack ofProduction Business Networks...The Emerging Role of ZKP in thePrivacy Stack ofProduction Business Networks...
The Emerging Role of ZKP in the Privacy Stack of Production Business Networks...
 
Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...
Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...
Enterprise Blockchain: Lessons from Global Innovators in Production (All Thin...
 
What does it take to deploy large scale decentralized applications?
What does it take to deploy large scale decentralized applications?What does it take to deploy large scale decentralized applications?
What does it take to deploy large scale decentralized applications?
 
IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...
IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...
IBM IMPACT 2014 - AMC-1883 - Where's My Message - Analyze IBM WebSphere MQ Re...
 
IBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging Capabilities
IBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging CapabilitiesIBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging Capabilities
IBM IMPACT 2014 AMC-1866 Introduction to IBM Messaging Capabilities
 

Recently uploaded

What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number SystemsJheuzeDellosa
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about usDynamic Netsoft
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Engage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyEngage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyFrank van der Linden
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVshikhaohhpro
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackVICTOR MAESTRE RAMIREZ
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfkalichargn70th171
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
cybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningcybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningVitsRangannavar
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 

Recently uploaded (20)

What is Binary Language? Computer Number Systems
What is Binary Language?  Computer Number SystemsWhat is Binary Language?  Computer Number Systems
What is Binary Language? Computer Number Systems
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about us
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Engage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The UglyEngage Usergroup 2024 - The Good The Bad_The Ugly
Engage Usergroup 2024 - The Good The Bad_The Ugly
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStack
 
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdfThe Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
The Essentials of Digital Experience Monitoring_ A Comprehensive Guide.pdf
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
cybersecurity notes for mca students for learning
cybersecurity notes for mca students for learningcybersecurity notes for mca students for learning
cybersecurity notes for mca students for learning
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 

IBM Integration Bus High Availability Overview

  • 1. IBM Integration Bus High Availability Overview Peter Broadhurst IBM Messaging & Integration
  • 2. © 2013, 2014 International Business Machines Corporation 2 Introduction These charts provide a high-level overview of IIB HA topologies: • Comparison of active/active and active/passive HA • Solutions for active/passive HA failover with IBM Integration Bus • Solutions for active/active processing with IBM Integration Bus • Adding Global Cache to active/active processing • Combining all of the above Only HTTP and JMS (MQ) workloads are shown
  • 3. © 2013, 2014 International Business Machines Corporation 3 Active/active vs. active/passive Scale High Availability Design Considerations Active/Active All N instances contribute to the processing capacity of the system New requests can be serviced immediately after the planned or unplanned termination of an active instance. Often referred to as continuous availability. Each instance must be able to operate independently, without relying on the availability of any other instance in the environment. The order of processing for two items of work cannot be guaranteed, as there are multiple instances that might perform each item of work Active/Passive Only one of N instances contributes to the processing capacity of the system There is a failover period after the planned or unplanned termination of an active instance. This failover period commonly lasts for a small number of minutes, depending on the technology used. An infrastructure for HA failover must exist, that ensures only one instance is ever activated, as well as detecting when one instance fails to initiate the failover. The active and the passive system must have identical copies of persistent data, such as persisted transaction state, and persisted messages. In IBM Integration Bus this is achieved by sharing a filesystem between the two machines.
  • 4. © 2013, 2014 International Business Machines Corporation 4 Active/passive high availability Machine 1 Machine 2 IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server Shared file system HA failover • Single instance of the IIB runtime • Single instance of all state – Configuration, MQ messages and Transaction coordinator • Highly available due to automatic fail-over. Two options available for HA failover: – Out-of-the-box with Multi-Instance capability, – Or using external HA cluster software JMS workloads HTTP workloads
  • 5. © 2013, 2014 International Business Machines Corporation 5 Option 1: Out of the box Multi-Instance failover • IP address of each machine is different – IP address redirect is required for HTTP workloads – MQ client libraries automatically handle IP redirect for JMS workloads • Requires highly available network-attached storage (NAS). Examples: – IBM GPFS – Veritas Cluster File System – Highly available NFSv4 • More information on choosing a suitable NAS: – https://ibm.biz/BdFxfz Machine 1 – IP addr 1 Machine 2 – IP addr 2 IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server Network- attached file system (NAS) TCP/ IP Failover managed via NAS file locks IP redirect (Gateway / Load Balancer) JMS workloads TCP/ IP
  • 6. © 2013, 2014 International Business Machines Corporation 6 Option 2: HA cluster failover • Allows use of direct-attached storage • IP address failed over by HA cluster software • Requires HA cluster software. Examples: – IBM PowerHA (HACMP) – Veritas Cluster Server (VCS) – Microsoft Cluster Service (MSCS) – Red Hat Cluster Machine 1 – IP addr 1 Machine 2 – IP addr 1 IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server Direct-attached file system switched by HA Failover managed via health checking Fibre/SCSI HA cluster Software HA cluster Software Heartbeat Healthcheck Healthcheck JMS workloads HTTP workloads Fibre/SCSI IP addr failover
  • 7. © 2013, 2014 International Business Machines Corporation 7 Multi-instance or HA cluster? Multi-instance queue manager • Integrated into the IIB and MQ products • Faster failover than HA cluster* • Delay before queue manager restart is much shorter* • Runtime performance of networked storage must be considered • IP address of standby instance is different to primary • No automatic fail-back to primary hardware when restored • More susceptible to MQ and OS defects HA cluster • Capable of handling a wider range of failures • Failover historically rather slow, but some HA clusters are improving • Some customers frustrated by unnecessary failovers • Require MC91 SupportPac or equivalent configuration • Extra product purchase and skills required Storage distinction • Multi-instance queue manager typically uses NAS • HA clustered queue manager typically uses SAN *depends on NAS file-system tuning and specific customer environment
  • 8. © 2013, 2014 International Business Machines Corporation 8 Active/active topologies Machine 1 Machine 2 IIB Integration Node MQ Messaging IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server WESB AppTargetWESB AppTargetIntegration Server Gateway / Load Balancer for HTTP workloads HTTP workloads JMS workloads • Each Integration Node operates independently • Continuous availability of the service during a failure – Individual in-flight requests on the failed node receive errors, but the service stays available • HTTP workloads require external workload balancing – Hardware load balancer is the most common solution • JMS workloads require load balancing – Via an MQ cluster when remote applications have their own MQ queue managers – Options for direct MQ client attachment (over TCP/IP) described here: https://ibm.biz/BdFxfS
  • 9. © 2013, 2014 International Business Machines Corporation 9 Adding Global Cache to active/active topologies Machine 1 Machine 2 IIB Integration Node MQ Messaging Global Cache IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server WESB AppTargetWESB AppTargetIntegration Server • Highly available in-memory state store – High performance compared to disk persistence (DB/MQ Messaging) – High availability through redundancy – cannot be recovered if all nodes are stopped concurrently – Built with WebSphere eXtreme Scale technology • Alternative to using MQ or a Database for state storage/retrieval – Correlation state between asynchronous request/reply flows • Only needed if replies might be routed via a different runtime, otherwise simply use memory (LocalEnvironment etc.) – Regularly accessed reference data, such as routing tables
  • 10. © 2013, 2014 International Business Machines Corporation 10 Global Cache Putting it all together • Active/active processing. HA fail-over for state and in-flight message recovery • Individual queues/flows can be configured active/passive if required – Single flow instance for message ordering or file-based processing – Single correlation state queue shared between active flow instances Machine 1 Machine 2 IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server IIB Integration Node MQ Messaging WESB AppTargetWESB AppTargetIntegration Server Shared Filesystem Failover Failover Gateway / Load Balancer for HTTP workloads JMS workloads HTTP workloads
  • 11. © 2013, 2014 International Business Machines Corporation 11 More information • Knowledge Center starting points: IIB Active/passive HA: https://ibm.biz/BdFxfe IIB Active/active HA for HTTP: https://ibm.biz/BdFxfb IIB Global cache: https://ibm.biz/BdFxfp MQ HA Cluster configurations: https://ibm.biz/BdFxf8 • Wiki article with detailed description of IIB topology choices Tailored to customers migrating from WebSphere WESB, but useful to all https://ibm.biz/BdFxfa • MQDev blog on attaching MQ clients to active/active qmgrs: https://ibm.biz/BdFxfS • Testing and support statement for multi-instance https://ibm.biz/BdFxfz