SOA Brings New Opportunities to Data Management DAMA International Symposium San Diego, March 2008 Richard Veryard

Agenda Brief Overview Service Oriented Architecture (SOA) Service Based Business (SBB) Basic Principles of Data Management Abstraction Semantic Decoupling Identity and Context Security and Compliance Network Centricity Supply Chain Visibility Interoperability Data Management Process Enterprise Architecture DMBOK

Brief Overview

Service Oriented Architecture (SOA)

Service Based Business (SBB)

Basic Principles of Data Management

Abstraction

Semantic Decoupling

Identity and Context

Security and Compliance

Network Centricity

Supply Chain Visibility

Interoperability

Data Management Process

Enterprise Architecture

DMBOK

Data Management Key themes of this presentation … Service Oriented Architecture agility Model-Driven Architecture interoperability Need for Semantic Precision Loose Coupling + economics of scale Database Administration Data Security Management Data Architecture, Analysis & Design Metadata Management Data Warehousing & Business Intelligence Reference & Master Data Management Data Quality Improvement Unstructured Data Management Data Stewardship, Strategy & Governance

Data Management

Service Oriented Architecture

The origins of SOA … Computing Modular programming Model-based development Object Orientation Software Components Networks Internet WWW Open Systems Open Distributed Processing Net-Centricity System-of- Systems Engineering SOA Web Services Enterprise Mash-Ups ESB & Grid Software As A Service Business Long Tail Mass Customization Business As A Platform Outsourcing Loosely Coupled Organization Enterprise Federation agility interoperability economics of scale

SOA Vision – Flexible, Federated Business Processes Service Service Service Service Service Payment Inventory Manufacturing Logistics Ordering Resource Resource Resource Ticket Sales Service Service Ticket Collection Service Service Service Availability federation reuse flexibility aggregation

The Service-Based Business (SBB) Strategic Focus Edge of the organization Identification and delivery of added-value to customers. Identification and consumption of added value from suppliers. Operational Focus Understanding the organization as a network of services. Managing IT support via SOA. Internal transformation.

Strategic Focus

Edge of the organization

Identification and delivery of added-value to customers.

Identification and consumption of added value from suppliers.

Operational Focus

Understanding the organization as a network of services.

Managing IT support via SOA.

Internal transformation.

Data Management Evolution or revolution ??? SOA agility interoperability + economics of scale Model-Driven Architecture Need for Semantic Precision Loose Coupling Database Administration Data Security Management Data Architecture, Analysis & Design Metadata Management Data Warehousing & Business Intelligence Reference & Master Data Management Data Quality Improvement Unstructured Data Management Data Stewardship, Strategy & Governance

Data Management

SOA

from complex world … to simple schema

… via abstraction generalization aggregation classification

… via abstraction generalization aggregation classification HOTEL MOTEL ACCOMMODATION MEAL TICKET TRAVEL & SUBSISTENCE CHARGING POLICY TAXATION RULE EXPENSE ITEM

abstraction equals attenuation but sometimes … less reach less richness less agility less assurance

generalization A picture is worth a thousand words. A word is worth a thousand pictures. VEHICLE

different people generalize differently but sometimes … Jack and Jill … … went up the hill … … to fetch a pail of water

“ lumpers” see similarities Jack fell down and broke his crown … … and Jill came tumbling after. “ Jack and Jill are essentially the same, and belong to the same type.”

Jack fell down and broke his crown …

… and Jill came tumbling after.

“ splitters” focus on differences Jack fell down and broke his crown … … and Jill came tumbling after. “ There are important differences between Jack and Jill, so they belong to different types.”

Jack fell down and broke his crown …

… and Jill came tumbling after.

Who is right - lumper or splitter? OR AND

What if lumper and splitter are both right? PATIENT PERSON is-a PATIENT PERSON PERSON PATIENT TREATMENT Subtypes and Inheritance various notations PARTY

Decoupling Abstraction Layers PATIENT PERSON TREATMENT Splitter Model Lumper Model

Decoupled Services PATIENT PERSON TREATMENT Medical Services ANIMAL Other Services Other Services *

Decoupled Identity, Security, Privacy, Context CRIMINAL PERSON CRIME Justice Services NATIONAL THREAT Other Services Homeland Security *

Business Services rest on Underlying Services - e.g Identity and Context Identity Services Underlying Services Core Business Services Context Services Customer Product User-Centric Identity Identity Metasystem Identity 2.0 CardSpace Higgins YADIS SXIP

Identity and Identifier PERSON Business Identifier PERSON PERSONAL IDENTIFIER PASSPORT DRIVING LICENCE CREDIT CARD … *

User-Centric Identity Consumer Service Provider Identity Services Identity Data Business Services Consumer Service Provider Identity Services Identity Data Business Services Service Provider Business Services

So who is the Identity Service Provider? Consumer Service Provider Identity Services Identity Data Business Services Service Provider Business Services Credit Card Company? Telephone Company? Google Yahoo Microsoft? National / Local Government?

security and compliance Data as Liability Data as Asset

Business Services rest on Underlying Services - e.g Identity and Context Identity Services Underlying Services Core Business Services Context Services Customer Product Differentiated Service Situation Awareness

situation awareness Differentiated Service One-Size Fits All

Pay As You Drive Variable Insurance Fixed Insurance

Decoupling WHAT from HOW WHAT Abstract business semantics Abstract business capabilities Standardized HOW Policy Context Identity Differentiated

WHAT

Abstract business semantics

Abstract business capabilities

Standardized

HOW

Policy

Context

Identity

Differentiated

… information gets more complex in a net-centric world … more reach more richness more agility more assurance

NCW Maturity Model Traditional Self-Synchronization Collaboration Organic Sources Information Sharing Shared Awareness Developing Situational Awareness Command and Control 0 1 2 3 4 source: Power to the Edge (Alberts & Hayes, DoD CCRP, 2003)

Example of net-centric information Supply chain visibility Materiel Distribution Information Distribution Knowledge & Intelligence 1 Historical Asset Visibility Shipment last recorded 2 Current Asset Visibility Shipment right now 3 Predictive Asset Visibility Expected arrival 4 Process Visibility Current state of process 5 Information Visibility Reliability of information 6 Knowledge Visibility Show me your reasoning Past Shipment Present Shipment Future Shipment 1 2 3 4 5 6

Another key semantic question … HOW MANY? BANK “ Jack and Jill have a joint checking account, so we regard them as a single instance of CUSTOMER.” HOSPITAL “ Every time Jack is admitted to hospital, we start a new patient record.” LIBRARY “ When Jill was a student, she had a student card. Now she is a member of staff, she is registered through a completely different system.”

How many books? Identity Rule Does the paperback version count as a separate instance of BOOK? Membership Rule Does the audio version count as a BOOK?

Identity Rule

Does the paperback version count as a separate instance of BOOK?

Membership Rule

Does the audio version count as a BOOK?

Different Use of Same System / Service Legacy System Sales Prospect Prospect’s secretary Sales Exec 1 Sales Prospect and secretary is another Sales Prospect Sales Exec 2 Sales Prospect System Designer

Semantic Alignment Heterogeneous Service Composition Composition mySAP Wrapped Legacy Mashup eBay SalesForce GoogleMap

Semantic Generalization CUSTOMER Identity Rule CUSTOMER IDENTITY POLICY Membership Rule MEMBERSHIP POLICY

Making the Data Model more flexible Weaker Model Broad inclusive concepts Broad time horizon Weak constraints optional many transferable Stronger Model Narrow exclusive concepts Narrow time horizon Strong constraints mandatory one fixed From the Strong to the Weak Post Before Processing

Weaker Model

Broad inclusive concepts

Broad time horizon

Weak constraints

optional

many

transferable

Stronger Model

Narrow exclusive concepts

Narrow time horizon

Strong constraints

mandatory

one

fixed

Semantic Precision Semantic Modeling Need semantic clarity and precision - especially membership and identity Designers often fail to anticipate the full semantic experience Users often find ways of informally enriching the semantics What’s New For SOA At the logical level, the semantic issues are much the same as for pre-SOA But the emphasis has changed. The biggest interoperability risks are at the semantic level. Therefore semantic precision is a critical success factor for the achievement of SOA goals.

Semantic Modeling

Need semantic clarity and precision - especially membership and identity

Designers often fail to anticipate the full semantic experience

Users often find ways of informally enriching the semantics

What’s New For SOA

At the logical level, the semantic issues are much the same as for pre-SOA

But the emphasis has changed.

The biggest interoperability risks are at the semantic level.

Therefore semantic precision is a critical success factor for the achievement of SOA goals.

≈ knowledge ≈ data ≈ information Location Route Shipment Core Business Services Planning Deployment Distribution Problem-Solving Process Services Automated Reasoning Capability Manifesting Service ERP capability Routing and Rating Service Capability Services Identity & Security Services Geospatial Services Collaboration Services Utility Services COTS Underlying Services Text file Database Portal Warehouse Data Mart Heterogeneous Data Sources Metadata Repository Registry Metadata Storage Translation & Mapping Services Text access Database access Portal access Warehouse access Data Mart access Data Integration Services

Understanding Business Semantics Business Semantic Model Business Type Model Business Information Needs Resource-Based Services Information Schemas Document & Message Schemas Interface & Storage Schemas Enquiry-Based Services Services Business Capability Model

Semantic Modeling feeds Service Planning Company Accounts and other documents Business Concept Model Business Type Model Customer Relationship <<concept>> Customer <<type>> Semantic Modeling Business Semantics Service View (for a Domain) Customers Service <<service>> <<domain>> Customer Management Business Domain Definitions Identify (Core Business) Services & Dependencies high-level model detailed domain model Identify Business Domains Service Portfolio Planning

How does EA accommodate SOA? WHAT HOW WHERE WHO WHEN WHY FOR WHOM? Zachman TOGAF DODAF MODAF Single Business System Model (Logical) Service Interoperability Single Service Business Collaboration Enterprise Model (Conceptual)

How does the DMBOK accommodate SOA? Agility? Interoperability? Semantic? Service? Database Administration Data Security Management Data Architecture, Analysis & Design Metadata Management Data Warehousing & Business Intelligence Reference & Master Data Management Data Quality Improvement Unstructured Data Management Data Stewardship, Strategy & Governance

Agility?

Interoperability?

Semantic?

Service?

What data architects need to do to accommodate SOA … Architectural Modeling Develop high-level business type model Recovery, consolidation and reengineering of existing data architectures & models Develop detailed business type models Architectural Framework Establish Reference Architecture for Data Identify data architecture deliverables - levels, level of detail, for each stage Architectural Governance Establish Data Policy Exert Architectural Control Service Planning Support Domain Identification Data Triage Asset Strategy Review third-party data architectures and industry models Determine data architecture strategy for external models MetaData Strategy Establish metadata repository linkage Use metadata to drive service factory

Architectural Modeling

Develop high-level business type model

Recovery, consolidation and reengineering of existing data architectures & models

Develop detailed business type models

Architectural Framework

Establish Reference Architecture for Data

Identify data architecture deliverables - levels, level of detail, for each stage

Architectural Governance

Establish Data Policy

Exert Architectural Control

Service Planning

Support Domain Identification

Data Triage

Asset Strategy

Review third-party data architectures and industry models

Determine data architecture strategy for external models

MetaData Strategy

Establish metadata repository linkage

Use metadata to drive service factory

… the story continues … Editorial New Year Directions SOA Meta Model Report Creating a UML Profile from the CBDI SAE Meta Model CBDI, with assistance from our members, has put a tremendous amount of effort into the creation of a meta model for SOA and has received very positive feedback. We are frequently asked how to actually use it in the course of day to day service planning and provisioning. This article lays out a UML profile that maps the SAE Meta Model to UML and may be used as the basis for capturing a complete set of SAE models in a standard UML tool. Product Report Salamander’s MooD - Modeling Business Driven SOA The Salamander Organization have recently introduced SOA modeling capabilities to their MooD Business Architect toolset, supporting the CBDI Forum’s SAE Meta Model for SOA. In this report we look at how MooD delivers convergence of both business and Service architecture modeling, and examine the coverage it provides for the meta model. RVSOAPBOX .blogspot.com SOA from Web Services to the Service Economy. Analysis of service-oriented business and service-oriented technology. by Richard Veryard Why Buy The Cow Webex (along with Unyte and a few others) provides a facility for meeting over the internet. Since Cisco acquired Webex, it has saved nearly a third of its travel and expense budget … Real-Time Events Opher reports a car accident and concludes that people need to process events in real-time and not in batch … Technological Perfecta There are several technologies that might work well together, indeed they certainly should work well together … Case Studies There is a significant demand for SOA case studies, from would-be adopters and practitioners of SOA. There is also a considerable supply of SOA case studies, mostly from vendors. But I don't see the supply meeting the demand … Flight From Quality This week TIBCO shares have fallen to a 52-week low, following a Sell advisory from Goldman Sachs. Goldman Sachs analyst Derek Bingham predicts a flight from quality … Subscribe January 2008

Editorial

New Year Directions

SOA Meta Model Report

Creating a UML Profile from the CBDI SAE Meta Model

CBDI, with assistance from our members, has put a tremendous amount of effort into the creation of a meta model for SOA and has received very positive feedback. We are frequently asked how to actually use it in the course of day to day service planning and provisioning. This article lays out a UML profile that maps the SAE Meta Model to UML and may be used as the basis for capturing a complete set of SAE models in a standard UML tool.

Product Report

Salamander’s MooD - Modeling Business Driven SOA

The Salamander Organization have recently introduced SOA modeling capabilities to their MooD Business Architect toolset, supporting the CBDI Forum’s SAE Meta Model for SOA. In this report we look at how MooD delivers convergence of both business and Service architecture modeling, and examine the coverage it provides for the meta model.

RVSOAPBOX .blogspot.com

SOA from Web Services to the Service Economy. Analysis of service-oriented business and service-oriented technology. by Richard Veryard

Why Buy The Cow

Webex (along with Unyte and a few others) provides a facility for meeting over the internet. Since Cisco acquired Webex, it has saved nearly a third of its travel and expense budget …

Real-Time Events

Opher reports a car accident and concludes that people need to process events in real-time and not in batch …

Technological Perfecta

There are several technologies that might work well together, indeed they certainly should work well together …

Case Studies

There is a significant demand for SOA case studies, from would-be adopters and practitioners of SOA. There is also a considerable supply of SOA case studies, mostly from vendors. But I don't see the supply meeting the demand …

Flight From Quality

This week TIBCO shares have fallen to a 52-week low, following a Sell advisory from Goldman Sachs. Goldman Sachs analyst Derek Bingham predicts a flight from quality …

Independent Guidance for Service Architecture and Engineering www.cbdiforum.com www.everware-cbdi.com