2009.10.22 S308460 Cloud Data Services

Cloud Data Services - S308460
Jeff Pollock
Senior Director, Fusion Middleware Product Management

The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.


“I believe, over time, more and more
software will be delivered as a
service. I totally believe that... We
have to be good at this, or we have a
problem”

- Larry Ellison


Agenda

• Data Services <Insert Picture Here>

• Cloud Computing
• Data Services in the Private Cloud
• Pragmatic First Steps
– Pre-Built On-Demand Data Integration
– Service-based ETL Architectures
– Canonical Data Access Services
• Lessons Learned
– Unify and Rationalize Tools
– Build Dedicated Competency Centers


What are Data Services?


A Bit of Data Services History

• Reality Check About “Data Services”
– This new hype is about an old idea – reusable data is a good thing
– 1968 – formation of EDI document translation standards for banks
– 1986 – Design by Contract: Precondition and Postcondition driven services
– Early 1990’s – tech roots of Informatica, IBM DataStage and Ab Initio
– 1994 – Design Patterns: Factory, Adapter, Façade, Proxy, Mediator…
– Late 1990’s – the application server data services (Kiva, Net Dynamics…)

• Long Before Java (and Before EAI or SOA or Cloud Computing)
– Data interchange among: banks, railways, airlines, militaries, etc.
– Metered software access and computing services from Mainframes
– Enterprise data warehouses for analytic purposes
– Object-oriented design patterns for decoupled data access

• So What’s Different About Data Services Today?
– Modern (new and different) standards & protocols
– Business scale, complexity, and expectations
– Near-infinite elasticity


Java Programmer’s View of Data Services
Objects & Components in my JEE and JSE infrastructure

JEE BUSINESS SERVICES
• SCA
– Service Component Architecture – Key framework spec for Java Business Services

JEE DATA SERVICES
• DAS, DTO & JDO
– Data Access Service – Java service for accessing RDB’s and other Source Types
– Data Transfer Object – Java object for moving data (w/in container)
– Java Data Object – Java object for data containment (POJO-oriented)
• JPA & SDO
– Java Persistence API – EJB 3.0 spec for accessing external data (typically relational)
– Service Data Object – Entity objects targeted for SOA data use
• ORM
– Object Relational Mapping – A generic term typically applied to some solution approach to handling
“impedance mismatch”
• Oracle Toplink – A proven industrial strength data services layer for managing object persistence
• JAXB / OXM
– Java Architecture for XML Binding – Standard set of APIs for XML
– Object to XML – Toplink extended implementation of JAXB


A Classification Taxonomy for Data Services
JAVA DATA SERVICE IMPLEMENTATION PATTERNS
• DAS & DTO – Access and in-container data transfer
• JPA, JDO & SDO – Enterprise intra-container data entity transfer
• JAXB & OXM (Toplink) – Access and binding to XML data

INFRASTRUCTURE DATA SERVICE FUNCTIONAL PATTERNS
• Master Data Services – Golden Records, Hierarchies, & Policies
• Bulk Data Services – Bulk Refresh, CDC, Trickle Feeds, SCD…
• Data Access Services – Virtualization, Federated Query, ORM…
– Really Urgent Data Access – Data Grid Cache / Virtualization
– Real Time Data Access – Query Federation & Layered Data Services
– Right Time Data Access – Data Hubs & Warehouses
• Data Event Services – Low Latency CDC, Trigger-Based CDC…
• Data Quality Services – Cleansing, Matching, De-Duplication…

PHYSICAL DATA SERVICE DEPLOYMENT PATTERNS
• Data Hub – Centralized cache (variation of Data Virtualization) or repository
• Data Grid – Distributed RAM-based data partitions with decentralized access
• Data Federation – Late-binding of query-time access to source data


Enterprise Data Service Functional Patterns


Example: Service-based Data Integration
Best of Breed Data Integration as a SOA Service

Oracle Data Integration
• Best Performing E-LT Architecture
• Works with any Data Warehouse
• 100% Java & SOA components

Oracle Data Replication
• Changed Data Capture (CDC)
• Query Offloading / DB Tiering

Example Use Cases
• Bulk Data Transformation (any2any)
High Performance • XML/EDI Large File Handling
ETL & Replication

• SOA-driven Business Intelligence
Data Warehouse
• Load DW from SOA
Any Data Source & OLAP
• Unified Data Steward Workflow
(ETL Error Hospital w/BPEL PM)
Oracle Data Integrator EE is the standard for:
• Oracle Fusion Applications • Oracle Business Intelligence
• ERP Migration, Replication / Loading
• Oracle Fusion AIA • Oracle Performance Management • Query Offloading & Zero Downtime
• Oracle Fusion Middleware • Oracle Database, Essbase & Tools


So What Are Data Services?
Casting a Wide Technical Net…

• A General Software Pattern?
– Using contract-based development patterns for data distribution…

• A Java Software Pattern?
– Pick your favorite TLA: DTO, DAS, SDO, JPA, ORM, JAXB, OXM…

• A Web Services Stereotype?
– Dedicated SOAP services for reusable data manipulation and access…

• Shared Services for Enterprise Class Data Processing
– Shared – common for a group of consumers/clients
– Services – contract-driven interfaces to functional behaviors
– Enterprise Class – exceptionally demanding SLA’s and KPI’s
– Data Processing – the heart-beat for all big businesses


What is Cloud Computing?


Everyone Is Talking About Cloud


What Is Cloud Computing?
*

Cloud Computing is often characterized by:

• Virtualized computing resources • Multi-tenancy
• Seemingly limitless capacity/scalability • Self-service
• Dynamic provisioning • Pay-for-use pricing
* Source: Wikipedia.org


Haven’t we Heard About this Before?
*

Grid Cloud

Cloud Grid Computing is often characterized by:

• Virtualized computing resources • Multi-tenancy
• Seemingly limitless capacity/scalability • Self-service
• Dynamic/elastic provisioning • Pay-for-use pricing
* Source: Wikipedia.org


Cloud Computing Benefits are Speed & Cost-Driven

Speed

Cost


Cloud Layers: SaaS, PaaS, IaaS

Applications delivered as a service
Software as a Service
to end-users over the Internet

App development & deployment
Platform as a Service
platform delivered as a service

Server, storage and network
Infrastructure as a Service hardware and associated software
delivered as a service


Public Clouds and Private Clouds
Public Clouds Private Cloud

I SaaS
SaaS I N
N T
R PaaS
T A
PaaS E N IaaS
R E
N T
IaaS E
T
Users
Both offer:
Public Clouds: • High efficiency Private Cloud:
• Lower upfront costs • High availability • Lower total costs
• Economies of scale • Elastic capacity • Greater control over security,
• Simpler to manage compliance & quality of service
• OpEx • Easier integration
• CapEx & OpEx


Private Clouds are Majority of IT Spend on Cloud

Public Cloud
vs.
On-Premise


Data Services for the Private Cloud


Cloud Layers: Where’s the Data?

Software as a Service


Infrastructure as a Service


Cloud Layers: Data at Every Strata!
Public Clouds Private Cloud

Corporate
Software as a Service Cloud
Services

Data as a Service

Hubs, ETL and Access Services

Infrastructure as a Service

Storage Clusters


Important Challenges For Data Owners Today

Access and
Distribute Data
with agility

Scale data access
while preserving Do it all
quality of service efficiently


Technology that Starts to Address the Challenges

Shared Data Services Management/
Automation

Grid/Dynamic Resourcing

Virtualization


Data Integration: Reusable Data Components
Department
Dept App App Owner
Dept App
IT Dept App build app
Svc Proc
Svc Proc
Svc Svc
Proc Proc include
create Svc Proc data
data services Svc Proc find data
create services
processes

define data
integration
scenarios

Svc Svc Svc Svc Svc Proc Proc Proc Self Svc

Data
Data Data
Oracle Data Integration Suite
Service Oracle SOA Suite
Integrator Quality
Integrator Enterprise
Manager

Oracle WebLogic Suite-based Application Grid

DB Integration Legacy


Kinds of Enterprise Data Integration Services
Oracle Fusion MDM Business Activity SOA
CLIENTS
Applications Applications Applications Intelligence Monitoring Platforms
FUNCTIONAL
SERVICES

Master ETL Data Data Data Data SOA SOA
Data Data Access Event Quality Grid Registry Metadata
Service Service Service Service Service Service Service Service

Data Movement & Delivery Data Integration Designer
TECHNICAL
PLATFORM

Data Integration Foundation

Data Connectivity
SOURCES

Oracle or 3rd Party: Applications | Analytics | Identity | SOA Platforms | Data Grid | Content Management | Search
DATA


Oracle Data Integration Suite
Oracle Fusion MDM Business Activity SOA
Applications Applications Applications Intelligence Monitoring Platforms

Data Distribution & Delivery Services
Bulk Data API Data Replication Data Quality API Process-Oriented
Event-Driven (CDC) Data Virtualization Java SDO Message-Oriented

Data Integration Foundation

Bulk Data Core Data Federation Core Data Relationship Core Data Quality Core
Bulk Acquisition Change Data Capture Realtime Query Data Classification Cleanse/Parse

Trickle Feeds Event-Based Data Caching Lifecycle Mgmt Matching/Dedupe’s

Complex Transforms Integrity Constraints Query Federation Data Reconciliation Cluster Analysis

Metadata Services Models Relationships Lineage Object Cache Exchange APIs

Data Connectivity
Relational Databases Non-Relational DBs Various File Formats XML Data

Packaged Applications Standard Msg Formats Message Queues Semi-Structured Data

Oracle or 3rd Party: Applications | Analytics | Identity | SOA Platforms | Data Grid | Content Management | Search


Data Integration, SOA, BPM & IdM: Putting it Together
Department
Dept App App Owner
IT build app
UI UI
Svc Proc Include
create components
set policies
reusable
DATA register
components components discover
authorized
components
authenticate
Svc Svc Proc Proc UI UI
Svc Svc Proc Proc UI UI
Svc Svc Proc Proc UI UI Self-Service Interface

policies

Oracle Data
Oracle SOA Oracle BPM Oracle Identity
Integration Oracle
Suite Suite Mgt
Suite Enterprise
Manager



Cloud and Fusion Middleware Data Services

Shared Components Self-Service Interface

Oracle Oracle Oracle
ODI Suite Oracle
SOA Suite BPM Suite Identity Mgt
Enterprise
Manager

Key Benefits
Cloud Enabling Capabilities
• Development efficiency
• Basis for reusable data service
components • Deployment agility
• Simple and consistent data • Elastic Scale-out
integration framework Why Oracle
• Modular and heterogeneous • Most integrated
• Unified Management • Easiest to use and manage


Take-Aways
Cloud Data Services is an architecture for centralized,
shared, elastic data resources internal to an enterprise that
allows departments to rapidly deploy and easily manage
application and analytic data.

• Fundamental Enablers:
• Application server • Key Benefits:
• Data Integration • Efficiency
• SOA/BPM • Agility
• Identity Management • Quality of Service
• Enterprise Management

• Oracle:
• Most complete, comprehensive offering
• Easiest to set up, integrate, and operate
• Best performance, automation, and self-service


Pragmatic First Steps


Leverage Pre-Packaged Integration Solutions
Direct Pre-Built Integrations”- Data Integration made simple
Oracle CRM On Demand Integration to Siebel CRM
Siebel Life Sciences Integration for Oracle Adverse Event Reporting System
Demantra Integration Pack for Siebel CRM Consumer Goods
Oracle Transportation Management (Glog) Integration to E-Business Suite

Cross Industry Process Integration Packs- Design, Sell, Plan and Execute
►Design to Release Agile Product Lifecycle Management integration Pack for Oracle E-Business Suite
►Opportunity to Quote Oracle CRM On Demand Integration Pack for Oracle E-Business Suite
►Order to Cash Siebel CRM Integration Pack for Oracle EBS Order Management
►Trade Promotion Mgmt Siebel CRM Integration Pack for Trade Promotion Management

Industry Process Integration Packs- Transform key business processes
►Comms Order to Bill Siebel CRM Integration Pack for Oracle Comms Billing and Revenue Management: Order to Bill

►Comms Customer care Siebel CRM Integration Pack for Oracle Comms Billing & Revenue Management: Agent
Assisted Billing Care
►Comms Revenue Accntg Oracle Comms Billing and Revenue Management Integration Pack for Oracle E-Business
Suite: Revenue Accounting
►Banking Acct Originations Siebel CRM Integration Pack for i-flex FLEXCUBE Account Originations
►Banking Acct Originations Siebel CRM Integration Pack for Banking Account Originations


Commit to a Service-based ETL Architecture
Running Oracle Data Integrator ETL as a managed Java
process enables CONSISTENT management and
monitoring – only Oracle can do this! Sense
demand spike

Dept
Dept App 1 Dept
App 1 App 2

Data Data
Shared
Service Service
Service Enterprise
Elastic ETL Manager
Services

WebLogic
Server Cluser
WebLogic Suite-based Application Grid
of Nodes
Adjust
capacity


Consider a Canonical Data Services Architecture

Service Clients Canonical Data Services Physical Sources

Data Service Data Service Customer
APIs Addresses Profile
Internal
Java, Web Service, XQuery, SQL, JMS

Mgmt
JDBC Orders
Dashboard
Pending
Customer Payments
Web Srvcs
History
Credited
ESB Order Payments
Adapters
Enterprise Data
Customer Payment
Custom
Portal

Repository
BPM

• Data services layer provides data access capabilities
• Data services modeling organizes services for use and reuse


Lessons Learned


Create Data Integration Competency Centers
People Process Technology
Data
Governance
Data Profiling
and Quality
Data Integration Shared Services / SOA

Data Stewards ETL Tools

Data Architects Data Quality Tools

ETL Developers Data Profiling

Data Service Modelers Data Federation

Database Administrators Data Replication

Compliance Officers Data Archiving

Data Masking

End-to-End Lifecycle Governance


Unify and Rationalize Different Vendor Tools
Solution Areas Key Buying Attributes
Data Modeling Relational, object and service models.
ETL / Bulk Data Integration Apps, DB and Java integration. Flexible
ETL and ELT architectures.
Data Quality, Matching and Rule-based and statistical learning. Fast
Cleansing bulk and realtime match.

Data Profiling In place and out-of-place profiling.
Data Federation Canonical modeling and data redaction.
Data Archiving Data masking, lifecycle management
Data Replication / High Log-based capture with sub-second,
Availability transaction-safe data apply
Data Grid Multi-platform limitless object scale-out.
Management and Monitoring Common metrics, logging, and charts.


For More Information

Quote Attribution
Title, Company

Get Started Resources
• Visit the Oracle Fusion Middleware 11g • Datasheet:
web site at http://www.oracle.com/products/middlewar
http://www.oracle.com/goto/fmw11g/index. e/odi/docs/odiee-datasheet.pdf
html • Blog:
• Oracle Data Integration on oracle.com http://blogs.oracle.com/dataintegration
www.oracle.com/goto/odi • Technical information available at:
• Oracle Fusion Middleware on OTN http://www.oracle.com/technology/product
http://otn.oracle.com/middleware s/oracle-data-integrator/index.html
• Information on GoldenGate: • Data Integration Events
http://www.oracle.com/goldengate http://www.oracle.com/events


Developing in the Cloud @ Middleware Lounge
At the Marriott Hotel

• Free Amazon Web Services access
• $35 credit for development time Workshops Daily
• Daily workshops: “Developing in the Cloud” In the Middleware Lounge
• Q&A with Amazon representatives and other experts • Daily, 11:30 AM
Introduction to Amazon Web
Services
• Monday 2:00 PM
• Internet access Developing with WebCenter and
Oracle Content Management in
• Wireless access Amazon Web Services
• SunRay machines also provided • Tuesday 2:00 PM Developing with
WebCenter and Oracle Content
• Recharging stations for your phone or laptop Management in Amazon Web
Services
• Wednesday 2:15 PM Developing
• Free food and beverages with Oracle SOA Suite in Amazon
Web Services
• Live Twitter feeds and blog updates
• Thursday 2:30 PM Developing
• Watch keynotes and featured sessions while relaxing, with Oracle SOA Suite in Amazon
recharging, and checking email Web Services


OpenWorld Activities for Oracle Data Integration
Monday 10/12
11:30am Introducing Oracle GoldenGate Products Marriott Golden Gate B1 Oracle GoldenGate &
1:00 pm Event-Driven BI with Oracle Data Integrator Marriott Salon 1 Oracle Streams: The
2:30 pm Real-time BI Using Oracle GoldenGate + ODI Marriott Golden Gate B1 Future of Oracle
4:00 pm RIM Case Study: Using Oracle GoldenGate Marriott Golden Gate B1 Replication and Data
5:30 pm Integrate Oracle BI Solutions with ODI Moscone Room 307
Integration
Tuesday 10/13 Panel With Hasan Rizvi and
Juan Loaiza, Sachin
11:30am Oracle GoldenGate for Zero-Downtime Migrations, Marriot Golden Gate B1 Chawla, and Ali Kutay
11:30am Enterprise Data Services in the Cloud Marriott Hotel Salon 7
1:00pm Oracle GoldenGate Deep Dive: Architecture Marriott Hotel Golden Gate B1 Tuesday, 2:30 - 3:30 PM
1:00pm Deep Dive on Real-World Use Cases for ODI Hilton Hotel Golden Gate 3
Moscone South Room 270
4:00 pm Bringing BPM and Data Integration Together Marriott Hotel Nob Hill CD

Wednesday 10/14
11:45am Ensure a Successful Siebel CRM Upgrade Moscone West L2 Room 2001 DemoGrounds
1:00pm ELT, Federation, and Replication: Overstock.com Moscone West L3 Room 3014
Moscone West
Thursday 10/15 ODI, OWB, W-093, W-094
Oracle Information Framework: The Power of the Oracle GoldenGate, 3709
9:00am Combined ODI and MDM Moscone South Room 304

Hands-on Labs Marriott Hotel Golden Gate A2
Monday 11:30am, Wed 1:15pm: Introduction to ODI-EE Tuesday 4:00pm, Thurs 10:30am: BI + ODI-EE
Monday 1:00pm, Wed 5:00pm: Data Services using ODI-EE Tuesday 2:30pm, Thurs 9:00am: Advanced ODI-EE


The preceding is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.


For More Information

search.oracle.com

or
oracle.com


2009.10.22 S308460 Cloud Data Services

More Related Content

What's hot

Similar to 2009.10.22 S308460 Cloud Data Services

More from Jeffrey T. Pollock

2009.10.22 S308460 Cloud Data Services