SOA for Data Management

6,514 views

Published on

SOA Brings New Opportunities for Data Management. Presentation delivered at DAMA International Symposium, San Diego 2008.

Published in: Economy & Finance, Technology
8 Comments
35 Likes
Statistics
Notes
No Downloads
Views
Total views
6,514
On SlideShare
0
From Embeds
0
Number of Embeds
89
Actions
Shares
0
Downloads
0
Comments
8
Likes
35
Embeds 0
No embeds

No notes for slide

SOA for Data Management

  1. 1. SOA Brings New Opportunities to Data Management DAMA International Symposium San Diego, March 2008 Richard Veryard
  2. 2. Agenda <ul><li>Brief Overview </li></ul><ul><ul><li>Service Oriented Architecture (SOA) </li></ul></ul><ul><ul><li>Service Based Business (SBB) </li></ul></ul><ul><li>Basic Principles of Data Management </li></ul><ul><ul><li>Abstraction </li></ul></ul><ul><li>Semantic Decoupling </li></ul><ul><ul><li>Identity and Context </li></ul></ul><ul><ul><li>Security and Compliance </li></ul></ul><ul><li>Network Centricity </li></ul><ul><ul><li>Supply Chain Visibility </li></ul></ul><ul><ul><li>Interoperability </li></ul></ul><ul><li>Data Management Process </li></ul><ul><ul><li>Enterprise Architecture </li></ul></ul><ul><ul><li>DMBOK </li></ul></ul>
  3. 3. <ul><li>Data Management </li></ul>Key themes of this presentation … <ul><li>Service Oriented Architecture </li></ul>agility Model-Driven Architecture interoperability Need for Semantic Precision Loose Coupling + economics of scale Database Administration Data Security Management Data Architecture, Analysis & Design Metadata Management Data Warehousing & Business Intelligence Reference & Master Data Management Data Quality Improvement Unstructured Data Management Data Stewardship, Strategy & Governance
  4. 4. The origins of SOA … Computing Modular programming Model-based development Object Orientation Software Components Networks Internet WWW Open Systems Open Distributed Processing Net-Centricity System-of- Systems Engineering SOA Web Services Enterprise Mash-Ups ESB & Grid Software As A Service Business Long Tail Mass Customization Business As A Platform Outsourcing Loosely Coupled Organization Enterprise Federation agility interoperability economics of scale
  5. 5. SOA Vision – Flexible, Federated Business Processes Service Service Service Service Service Payment Inventory Manufacturing Logistics Ordering Resource Resource Resource Ticket Sales Service Service Ticket Collection Service Service Service Availability federation reuse flexibility aggregation
  6. 6. The Service-Based Business (SBB) <ul><li>Strategic Focus </li></ul><ul><li>Edge of the organization </li></ul><ul><li>Identification and delivery of added-value to customers. </li></ul><ul><li>Identification and consumption of added value from suppliers. </li></ul><ul><li>Operational Focus </li></ul><ul><li>Understanding the organization as a network of services. </li></ul><ul><li>Managing IT support via SOA. </li></ul><ul><li>Internal transformation. </li></ul>
  7. 7. <ul><li>Data Management </li></ul>Evolution or revolution ??? <ul><li>SOA </li></ul>agility interoperability + economics of scale Model-Driven Architecture Need for Semantic Precision Loose Coupling Database Administration Data Security Management Data Architecture, Analysis & Design Metadata Management Data Warehousing & Business Intelligence Reference & Master Data Management Data Quality Improvement Unstructured Data Management Data Stewardship, Strategy & Governance
  8. 8. from complex world … to simple schema
  9. 9. … via abstraction generalization aggregation classification
  10. 10. … via abstraction generalization aggregation classification HOTEL MOTEL ACCOMMODATION MEAL TICKET TRAVEL & SUBSISTENCE CHARGING POLICY TAXATION RULE EXPENSE ITEM
  11. 11. abstraction equals attenuation but sometimes … less reach less richness less agility less assurance
  12. 12. generalization A picture is worth a thousand words. A word is worth a thousand pictures. VEHICLE
  13. 13. different people generalize differently but sometimes … Jack and Jill … … went up the hill … … to fetch a pail of water
  14. 14. “ lumpers” see similarities <ul><li>Jack fell down and broke his crown … </li></ul><ul><li>… and Jill came tumbling after. </li></ul>“ Jack and Jill are essentially the same, and belong to the same type.”
  15. 15. “ splitters” focus on differences <ul><li>Jack fell down and broke his crown … </li></ul><ul><li>… and Jill came tumbling after. </li></ul>“ There are important differences between Jack and Jill, so they belong to different types.”
  16. 16. Who is right - lumper or splitter? OR AND
  17. 17. What if lumper and splitter are both right? PATIENT PERSON is-a PATIENT PERSON PERSON PATIENT TREATMENT Subtypes and Inheritance various notations PARTY
  18. 18. Decoupling Abstraction Layers PATIENT PERSON TREATMENT Splitter Model Lumper Model
  19. 19. Decoupled Services PATIENT PERSON TREATMENT Medical Services ANIMAL Other Services Other Services *
  20. 20. Decoupled Identity, Security, Privacy, Context CRIMINAL PERSON CRIME Justice Services NATIONAL THREAT Other Services Homeland Security *
  21. 21. Business Services rest on Underlying Services - e.g Identity and Context Identity Services Underlying Services Core Business Services Context Services Customer Product User-Centric Identity Identity Metasystem Identity 2.0 CardSpace Higgins YADIS SXIP
  22. 22. Identity and Identifier PERSON Business Identifier PERSON PERSONAL IDENTIFIER PASSPORT DRIVING LICENCE CREDIT CARD … *
  23. 23. User-Centric Identity Consumer Service Provider Identity Services Identity Data Business Services Consumer Service Provider Identity Services Identity Data Business Services Service Provider Business Services
  24. 24. So who is the Identity Service Provider? Consumer Service Provider Identity Services Identity Data Business Services Service Provider Business Services Credit Card Company? Telephone Company? Google Yahoo Microsoft? National / Local Government?
  25. 25. security and compliance Data as Liability Data as Asset
  26. 26. Business Services rest on Underlying Services - e.g Identity and Context Identity Services Underlying Services Core Business Services Context Services Customer Product Differentiated Service Situation Awareness
  27. 27. situation awareness Differentiated Service One-Size Fits All
  28. 28. Pay As You Drive Variable Insurance Fixed Insurance
  29. 29. Decoupling WHAT from HOW <ul><li>WHAT </li></ul><ul><li>Abstract business semantics </li></ul><ul><li>Abstract business capabilities </li></ul><ul><li>Standardized </li></ul><ul><li>HOW </li></ul><ul><li>Policy </li></ul><ul><li>Context </li></ul><ul><li>Identity </li></ul><ul><li>Differentiated </li></ul>
  30. 30. … information gets more complex in a net-centric world … more reach more richness more agility more assurance
  31. 31. NCW Maturity Model Traditional Self-Synchronization Collaboration Organic Sources Information Sharing Shared Awareness Developing Situational Awareness Command and Control 0 1 2 3 4 source: Power to the Edge (Alberts & Hayes, DoD CCRP, 2003)
  32. 32. Example of net-centric information Supply chain visibility Materiel Distribution Information Distribution Knowledge & Intelligence 1 Historical Asset Visibility Shipment last recorded 2 Current Asset Visibility Shipment right now 3 Predictive Asset Visibility Expected arrival 4 Process Visibility Current state of process 5 Information Visibility Reliability of information 6 Knowledge Visibility Show me your reasoning Past Shipment Present Shipment Future Shipment 1 2 3 4 5 6
  33. 33. Another key semantic question … HOW MANY? BANK “ Jack and Jill have a joint checking account, so we regard them as a single instance of CUSTOMER.” HOSPITAL “ Every time Jack is admitted to hospital, we start a new patient record.” LIBRARY “ When Jill was a student, she had a student card. Now she is a member of staff, she is registered through a completely different system.”
  34. 34. How many books? <ul><li>Identity Rule </li></ul><ul><li>Does the paperback version count as a separate instance of BOOK? </li></ul><ul><li>Membership Rule </li></ul><ul><li>Does the audio version count as a BOOK? </li></ul>
  35. 35. Different Use of Same System / Service Legacy System Sales Prospect Prospect’s secretary Sales Exec 1 Sales Prospect and secretary is another Sales Prospect Sales Exec 2 Sales Prospect System Designer
  36. 36. Semantic Alignment Heterogeneous Service Composition Composition mySAP Wrapped Legacy Mashup eBay SalesForce GoogleMap
  37. 37. Semantic Generalization CUSTOMER Identity Rule CUSTOMER IDENTITY POLICY Membership Rule MEMBERSHIP POLICY
  38. 38. Making the Data Model more flexible <ul><li>Weaker Model </li></ul><ul><li>Broad inclusive concepts </li></ul><ul><li>Broad time horizon </li></ul><ul><li>Weak constraints </li></ul><ul><ul><li>optional </li></ul></ul><ul><ul><li>many </li></ul></ul><ul><ul><li>transferable </li></ul></ul><ul><li>Stronger Model </li></ul><ul><li>Narrow exclusive concepts </li></ul><ul><li>Narrow time horizon </li></ul><ul><li>Strong constraints </li></ul><ul><ul><li>mandatory </li></ul></ul><ul><ul><li>one </li></ul></ul><ul><ul><li>fixed </li></ul></ul>From the Strong to the Weak Post Before Processing
  39. 39. Semantic Precision <ul><li>Semantic Modeling </li></ul><ul><li>Need semantic clarity and precision - especially membership and identity </li></ul><ul><li>Designers often fail to anticipate the full semantic experience </li></ul><ul><li>Users often find ways of informally enriching the semantics </li></ul><ul><li>What’s New For SOA </li></ul><ul><li>At the logical level, the semantic issues are much the same as for pre-SOA </li></ul><ul><li>But the emphasis has changed. </li></ul><ul><li>The biggest interoperability risks are at the semantic level. </li></ul><ul><li>Therefore semantic precision is a critical success factor for the achievement of SOA goals. </li></ul>
  40. 40. ≈ knowledge ≈ data ≈ information Location Route Shipment Core Business Services Planning Deployment Distribution Problem-Solving Process Services Automated Reasoning Capability Manifesting Service ERP capability Routing and Rating Service Capability Services Identity & Security Services Geospatial Services Collaboration Services Utility Services COTS Underlying Services Text file Database Portal Warehouse Data Mart Heterogeneous Data Sources Metadata Repository Registry Metadata Storage Translation & Mapping Services Text access Database access Portal access Warehouse access Data Mart access Data Integration Services
  41. 41. Understanding Business Semantics Business Semantic Model Business Type Model Business Information Needs Resource-Based Services Information Schemas Document & Message Schemas Interface & Storage Schemas Enquiry-Based Services Services Business Capability Model
  42. 42. Semantic Modeling feeds Service Planning Company Accounts and other documents Business Concept Model Business Type Model Customer Relationship <<concept>> Customer <<type>> Semantic Modeling Business Semantics Service View (for a Domain) Customers Service <<service>> <<domain>> Customer Management Business Domain Definitions Identify (Core Business) Services & Dependencies high-level model detailed domain model Identify Business Domains Service Portfolio Planning
  43. 43. How does EA accommodate SOA? WHAT HOW WHERE WHO WHEN WHY FOR WHOM? Zachman TOGAF DODAF MODAF Single Business System Model (Logical) Service Interoperability Single Service Business Collaboration Enterprise Model (Conceptual)
  44. 44. How does the DMBOK accommodate SOA? <ul><li>Agility? </li></ul><ul><li>Interoperability? </li></ul><ul><li>Semantic? </li></ul><ul><li>Service? </li></ul>Database Administration Data Security Management Data Architecture, Analysis & Design Metadata Management Data Warehousing & Business Intelligence Reference & Master Data Management Data Quality Improvement Unstructured Data Management Data Stewardship, Strategy & Governance
  45. 45. What data architects need to do to accommodate SOA … <ul><li>Architectural Modeling </li></ul><ul><li>Develop high-level business type model </li></ul><ul><li>Recovery, consolidation and reengineering of existing data architectures & models </li></ul><ul><li>Develop detailed business type models </li></ul><ul><li>Architectural Framework </li></ul><ul><li>Establish Reference Architecture for Data </li></ul><ul><li>Identify data architecture deliverables - levels, level of detail, for each stage </li></ul><ul><li>Architectural Governance </li></ul><ul><li>Establish Data Policy </li></ul><ul><li>Exert Architectural Control </li></ul><ul><li>Service Planning </li></ul><ul><li>Support Domain Identification </li></ul><ul><li>Data Triage </li></ul><ul><li>Asset Strategy </li></ul><ul><li>Review third-party data architectures and industry models </li></ul><ul><li>Determine data architecture strategy for external models </li></ul><ul><li>MetaData Strategy </li></ul><ul><li>Establish metadata repository linkage </li></ul><ul><li>Use metadata to drive service factory </li></ul>
  46. 46. … the story continues … <ul><li>Editorial </li></ul><ul><li>New Year Directions </li></ul><ul><li>SOA Meta Model Report </li></ul><ul><li>Creating a UML Profile from the CBDI SAE Meta Model </li></ul><ul><li>CBDI, with assistance from our members, has put a tremendous amount of effort into the creation of a meta model for SOA and has received very positive feedback. We are frequently asked how to actually use it in the course of day to day service planning and provisioning. This article lays out a UML profile that maps the SAE Meta Model to UML and may be used as the basis for capturing a complete set of SAE models in a standard UML tool. </li></ul><ul><li>Product Report </li></ul><ul><li>Salamander’s MooD - Modeling Business Driven SOA </li></ul><ul><li>The Salamander Organization have recently introduced SOA modeling capabilities to their MooD Business Architect toolset, supporting the CBDI Forum’s SAE Meta Model for SOA. In this report we look at how MooD delivers convergence of both business and Service architecture modeling, and examine the coverage it provides for the meta model. </li></ul><ul><li>RVSOAPBOX .blogspot.com </li></ul><ul><li>SOA from Web Services to the Service Economy. Analysis of service-oriented business and service-oriented technology. by Richard Veryard </li></ul><ul><li>Why Buy The Cow </li></ul><ul><ul><li>Webex (along with Unyte and a few others) provides a facility for meeting over the internet. Since Cisco acquired Webex, it has saved nearly a third of its travel and expense budget … </li></ul></ul><ul><li>Real-Time Events </li></ul><ul><ul><li>Opher reports a car accident and concludes that people need to process events in real-time and not in batch … </li></ul></ul><ul><li>Technological Perfecta </li></ul><ul><ul><li>There are several technologies that might work well together, indeed they certainly should work well together … </li></ul></ul><ul><li>Case Studies </li></ul><ul><ul><li>There is a significant demand for SOA case studies, from would-be adopters and practitioners of SOA. There is also a considerable supply of SOA case studies, mostly from vendors. But I don't see the supply meeting the demand … </li></ul></ul><ul><li>Flight From Quality </li></ul><ul><ul><li>This week TIBCO shares have fallen to a 52-week low, following a Sell advisory from Goldman Sachs. Goldman Sachs analyst Derek Bingham predicts a flight from quality … </li></ul></ul>Subscribe January 2008
  47. 47. Independent Guidance for Service Architecture and Engineering www.cbdiforum.com www.everware-cbdi.com

×