ESB Usage Scenarios and Patterns


Published on

Hursley comes to you 2011
ESB Usage Scenarios and Patterns
Brian Hulse
WSRR Development

Published in: Business
1 Comment
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

ESB Usage Scenarios and Patterns

  1. 1. Hursley Comes To YouESB Usage Scenarios and PatternsBrian HulseWSRR WebSphere © 2010 IBM Corporation
  2. 2. Hursley Comes To YouAgenda  ESB and Connectivity Overview  ESB Usage Patterns © 2010 IBM Corporation2
  3. 3. Hursley Comes To You ESB and Connectivity Overview © 2010 IBM Corporation3
  4. 4. Hursley Comes To YouESBs Simplify Connectivity File MQ/JMS soap/jms soap/http Enterprise Service Bushttp WebSphere MQ © 2010 IBM Corporation4
  5. 5. Hursley Comes To YouEnrich your SOA connectivity … Service Enrichment •Match & Route communications between services •Converts between transport protocols •Transforms between data formats •Identifies and distributes bus events … simplifying the overall architecture and reducing IT cost © 2010 IBM Corporation5
  6. 6. Hursley Comes To YouAgile Connectivity:The Enterprise Service Bus (ESB) Connects everything Matches & routes communications to everything between services Transforms between Distributes different data formats Business events Converts between different transport protocols An ESB enables flexible SOA connectivity for integrating business applications, services and processes © 2010 IBM Corporation6
  7. 7. Hursley Comes To YouTwo core principles enable flexibility The ESB facilitates the decoupling of interactions between requestor(s) and provider(s) Service Service Provider Provider Service Service Service Service Requestor Requestor Requestor Requestor The ESB fulfils two core principles in support of separation of concerns:Service VirtualizationService Virtualization Aspect Oriented Connectivity Aspect Oriented Connectivity  Routing  Routing Security Security Log and Audit  Protocol and transports  Protocol and transports Management Management Event tracking  Transformation of interfaces  Transformation of interfaces etc … etc … © 2010 IBM Corporation7
  8. 8. Hursley Comes To You Processing Scenarios & Usage Patterns © 2010 IBM Corporation8
  9. 9. Hursley Comes To YouMany Defined Patterns for ESB-based Solutions Service Virtualization Service Gateway Enablement OR OR OR Message-based Event-driven Integration Integration File Processing © 2010 IBM Corporation9
  10. 10. Hursley Comes To YouTypical Customer Usage Patterns  Extend the Reach of Existing Applications  Connect File with Online for End-to-End Efficiency  Connect Devices to the Enterprise  Get the Most from Packaged Applications  Distribute Database Information to Where It’s Needed  Make An Application Inventory and Govern processing with a Registry  Provide a PEP for Secure Application Connectivity  Monitor your Business Activity and Act Intelligently  Develop and Reuse Solutions with Patterns © 2010 IBM Corporation10
  11. 11. Hursley Comes To YouExtend the Reach of Existing ApplicationsExpose existing applications without changeSOAP & Web 2.0 based access to existing systemsCreate a gateway for routing and securityINBOUND and OUTBOUND scenariosSOAP Web Services Established as Interoperability Standard – SOAP support allows ESB to act as WS-* façade to existing non WS-* applications • Support for SOAP/HTTP and SOAP/JMS (any), includes transactions & asynchronous processing Web 2.0/REST Provides Lightweight Universal Access – HTTP ubiquity & REST semantic provide universal access to existing systems – Popular with both XML and JSON payloads (JSON for lightweight clients) ESB Outbound Scenarios enable Existing Applications to request New Services – Existing application can invoke and exploit new services with existing technology WS provider clients Typical Customers – US Payroll Corp. exposes MQ applications via self service SOAP interface for responsiveness & accuracy – WW (US based) Airline access external web services from existing JMS/MQ reservation system – US Wireless Operator expose legacy billing systems via HTTP/XML for customer self service © 2010 IBM Corporation11
  12. 12. Hursley Comes To YouConnect File and Online for End-to-End EfficiencyUnlock the valuable business data in your files Files exchange between applications still popular and effective – Flexible method of exchange: Neither enterprise has to mandate technology There are legitimate reasons for using files to exchange information – Usually relate to the way businesses run or physical processes occur Examples – A cargo ship has thousands of containers each with hundreds of palettes – Reduce unit transaction costs by aggregating numerous clients requests End to End File Movement and File Processing – Reliable and secure delivery File Transfer with MQ FTE – File processing allows clients to get file/batch work online, easily Typical Customers – German Retailer uses ESB & FTE for POS reporting to HQ & price list distribution to store – NE US Retailer using FTE & ESB to provide timely inventory updates to and from online systems © 2010 IBM Corporation12
  13. 13. Hursley Comes To YouConnect Devices to the EnterpriseMonitor remote systems and devicesProvide near real-time insight about physical systems, and act Industry Observation – “How to we get information from everywhere, understand it, and act?” – Medical, Energy and Utilities, Distribution, Transport, Gaming… – Issues based e.g. traffic congestion, efficient energy, timely supply… A Smarter Planet is full of devices – Data is generated *outside* the enterprise • Typically very large numbers of devices: • Often concentrator technology; differentiate, integrate & forward – MQTT for standards based device integration IBM is working with Brisbane, • Small footprint client, embeddable, Low bandwidth cost London, Singapore and • Fragile network support for hostile environments Stockholm to deploy smarter traffic systems. Stockholm has seen approximately 20 percent ESB to Connect Devices, Apply Intelligence less traffic, a 12 percent drop in – Connects MQTT devices to enterprise systems emissions and a reported 40,000 additional daily users of – Apply intelligence in near real-time; systems tend to be passive today public transportation. Typical Customers – US Medical and Technology services company monitors pacemakers for home health – Swedish city congestion charging, traffic calming and pollution reduction © 2010 IBM Corporation13
  14. 14. Hursley Comes To YouGet the Most from Packaged ApplicationsProvide broad access to EIS systemsMove information to and from packaged systems Packaged Applications Provide Best of Breed Business Function – SAP for purchasing, sales, inventory… – SEBL for Sales, PeopleSoft for HR – Oracle, JDEdwards…etc Interfaces are often non standard: e.g. SAP BAPIs, IDOCs – Processing and data are isolated from other applications – Result: packaged apps have difficultly using/generating information for other apps – Inhibits adoption of a best of breed philosophy Support for SAP, SEBL, PeopleSoft, JDEdwards… inbound and outbound – Connectivity built-in – no extra moving parts – Drive new work into its packaged application from any other supported source – Can send information from packaged application to any other supported target – Packaged applications can focus on what they do best and be integrated Typical customers – NA Railroad uses MB for all SAP to SAP communication – WW Pharmaceutical uses MB for order payment to SAP and distribution notification from SAP – WW Hotel chain uses MB for SEBL customer billing and sales systems © 2010 IBM Corporation14
  15. 15. Hursley Comes To YouProvide a PEP for Secure Application Connectivity Provide secure access to applications and services Understand and convert broad range of security domain identities Provide secure external access services to partners  Connectivity often implies security domain change – ESB supports a broad variety of security tokens – Userid/pw, X509, SAML, Kerberos, LTPA…  ESB is Policy Enforcement Point (PEP) – Security is enforced here, still owned by PDP – Identity management, access control, authorization and authentication mechanisms (AAA) are essential  Policy Decision Point (PDP) and ESB work together – PDP combination provides a secure infrastructure – Ensures conformance to centralized security policy – Many different PDP technologies supported • Lightweight Directory Access Protocol (LDAP) Microsoft Active Directory, Open LDAP… • Tivoli Federated Identity Manager (TFIM) • WS-Trust, zOS SAF including RACF  External Partner Access to Services – Security hardened DMZ device strengths15 – Combine network and ESB functionality © 2010 IBM Corporation
  16. 16. Hursley Comes To YouA Flexible Infrastructure to Support ChangeEnable Application and Service Replacement with minimum risk ESB creates a Virtual Service – Implementation details of a service to be hidden – Flexibility in implementation; change implementations without affecting consumers – Introduce new interfaces to existing service in parallel with new interfaces Examples include M&A, Decommissioning & External partner communication – Connect newly acquired systems, particularly relevant in M&A – Formats and Protocols of acquired technology differ from current systems – ESB provides managed interface to acquired systems for in-house systems – Provides new interface for acquired systems – Staged decommission of legacy implementations – Maintain existing interface to new implementation – Allows Managed risk of client migration – Often combined with new interface definition, often to enable service orientation – External partner communication – ESB provides interface to external systems – Allows partners to be swapped in and out without affecting consumers © 2010 IBM Corporation16
  17. 17. Hursley Comes To YouMake an Application Inventory & Govern Processing Understand your application assets and control their access dynamically Dynamically change processing without redeployment Provide processing policy and governance Catalog application and service assets using a registry, e.g. WSRR – Web Service and MQ Service definitions – Classifications: by function, owning department – Relationships: applications dependencies for life-cycle management, versioning – User defined properties (meta-data): Application=GOLD or Service=SILVER Service Use registry information in ESB routing Provider – Built-in ESB facilities allow access registry Use metadata to implement ‘smart’ • In memory cache for high performance mediations – Enables policy based processing, examples Virtual 3 • Simple routing based on client meta-data Service • Dynamic WS-SecurityPolicy processing • Dynamic transformation based on endpoint Service A’ A 1 Requestor – WSRR as critical governance point 2 Capture metadata about services for Advertise use by Service Bus availability of the ‘virtual Typical Customers services’ – US automotive sales company uses MB+WSRR • Timely match vehicle availability with customer request © 2010 IBM Corporation17
  18. 18. Hursley Comes To YouMonitor Your Business and Act Intelligently Understand the business relevance of ESB data Apply business rules to ESB data in-flight Detect business situations and act quickly ESB Connectivity Processes Events from many Sources, Targets – Capture business relevant information for WebSphere Business Monitor • Examples: total dollar trade value per day, orders per hour – Capture business events to correlation with WebSphere Business Events • Look for correlations in data, e.g. fraud, sales opportunities, CRM – Audit, Repair and Replay transported events ILOG rules Generate Business Monitoring Events from existing connectivity engine – Enables integration with WebSphere Monitor to display & analyze KPIs – Design time and operational time event activation – Notification via CEI & Publish subscribe Inputs Outputs Rule-based Decision Services render decisions on input data – Most often this data comes from a variety of data sources: aggregation, transformation is required – Rule-based Decision Services send outcome decisions to other systems: rule based routing Typical Customers – European Motor manufacturer creates virtual system of record for audit – NA Insurance company uses MB+ILOG for business decisions routing – UK Retail group measures store throughput by item for real-time trending © 2010 IBM Corporation18
  19. 19. Hursley Comes To YouDetect and Act Upon Business Events Compose existing applications and services to create new value  ESB Event Capture and Process Initiation – Breadth of ESB connectivity enables multiple business process starting points • Identify event and initiate business process • e.g. message, file, web service, device endpoints can start business process – Synchronous and asynchronous invocation for short & long running transactions • Multiple options with Process Server, Lombardi, FileNet…  Business Process Connectivity – Exploit range of ESB connectivity to abstract and simplify BPM – Process focus on WHAT rather than ESB focus on WHERE, HOW concerns – ESB receives service request and routes, re-formats, interacts with provider Business Process Business Process IBM BPM 7.5 ESB ESB © 2010 IBM Corporation19 Web Service, SAP, MQ, File…
  20. 20. Hursley Comes To YouDevelop & Reuse Solutions with Patterns Develop connectivity solutions quickly Capture previous experience for cost reduction Ensure solutions conform to best practices Use ESB’s built-in Patterns to Kick-start Development – Built-in patterns for Web Services, Messaging, File, SAP... – Guided solutions using top-down, parameterized approach – Development artefacts are generated from solution template Create your own Patterns to suit your Business needs – Simple to create your own solution template – User patterns! – Start from an existing Message Broker solution or IBM pattern – Ensure specific business: e.g. audit, notification, validation… Create and Participate in Public and Private Communities – Create reusable assets for sharing across your business – Full check-in/out & versioning with any Library Control System – Private Communities for internal sharing via Web Content tools – Public communities for more widely available patterns Typical Customers – Swedish partner providing patterns for low cost off-premises connectivity – WW GSI using patterns for quicker time-to-value and cost reduction – public patterns community launched Nov 2010 • Patterns created, rated & used by community © 2010 IBM Corporation20
  21. 21. Hursley Comes To You Patterns: WESB Service Gateway accelerator © 2010 IBM Corporation21
  22. 22. Hursley Comes To You Patterns: WESB Service Gateway accelerator © 2010 IBM Corporation22
  23. 23. Hursley Comes To You Patterns: WESB Service Gateway accelerator (Static 3) © 2010 IBM Corporation23
  24. 24. Hursley Comes To YouMultiple ESB offeringsSolutions to Meet Any and Every Demand Platform Based Integration Based WebSphere WebSphere Message BrokerEnterprise Service Bus  Built for universal connectivity Optimized with WebSphere and transformation in Application server for an heterogeneous integrated SOA platform IT environments Shares common registry, Appliance Based  Message transformation security, administrative and developed to accommodate development tools WebSphere disparate service interfaces Services hosted on the  Adapters, protocol bridges DataPower application server Integration Appliance XI50 packaged with applications and legacy platforms  Hardware built for simplified deployment and hardened security  Functions developed in one device © 2010 IBM Corporation24
  25. 25. Hursley Comes To YouThe ESB … at the heart of a smart connectivity ‘ecosystem’ Service Orchestration and BPM Service Monitoring Business Rules IBM BPM 7.5 Tivoli CAM for SOA WebSphere iLog JRules Service Security UniversalTivoli Security Products Transformation Service Registry Publish Find Enrich Manage Govern WebSphere Transformation WebSphere Service Extender Registry and Repository Messaging Backbone for SOA MQI Java JMS XMS for .NET C# XMS for C/C++ WebSphere MQ messaging backbone © 2010 IBM Corporation25 WebSphere MQ