• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
2009.10.22 S308460  Cloud Data Services
 

2009.10.22 S308460 Cloud Data Services

on

  • 2,039 views

Presentation describes how Oracle E-LT and data integration services can be deployed within a Private Cloud for use as Enterprise Shared Services

Presentation describes how Oracle E-LT and data integration services can be deployed within a Private Cloud for use as Enterprise Shared Services

Statistics

Views

Total Views
2,039
Views on SlideShare
2,032
Embed Views
7

Actions

Likes
3
Downloads
119
Comments
0

4 Embeds 7

http://www.lmodules.com 2
http://www.linkedin.com 2
https://www.linkedin.com 2
http://www.slideshare.net 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    2009.10.22 S308460  Cloud Data Services 2009.10.22 S308460 Cloud Data Services Presentation Transcript

    • © 2009 Oracle Corporation – Proprietary and Confidential 1
    • Cloud Data Services - S308460 Jeff Pollock Senior Director, Fusion Middleware Product Management
    • The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. © 2009 Oracle Corporation – Proprietary and Confidential 3
    • “I believe, over time, more and more software will be delivered as a service. I totally believe that... We have to be good at this, or we have a problem” - Larry Ellison © 2009 Oracle Corporation – Proprietary and Confidential 4
    • Agenda • Data Services <Insert Picture Here> • Cloud Computing • Data Services in the Private Cloud • Pragmatic First Steps – Pre-Built On-Demand Data Integration – Service-based ETL Architectures – Canonical Data Access Services • Lessons Learned – Unify and Rationalize Tools – Build Dedicated Competency Centers © 2009 Oracle Corporation – Proprietary and Confidential 5
    • What are Data Services? © 2009 Oracle Corporation – Proprietary and Confidential 6
    • A Bit of Data Services History • Reality Check About “Data Services” – This new hype is about an old idea – reusable data is a good thing – 1968 – formation of EDI document translation standards for banks – 1986 – Design by Contract: Precondition and Postcondition driven services – Early 1990’s – tech roots of Informatica, IBM DataStage and Ab Initio – 1994 – Design Patterns: Factory, Adapter, Façade, Proxy, Mediator… – Late 1990’s – the application server data services (Kiva, Net Dynamics…) • Long Before Java (and Before EAI or SOA or Cloud Computing) – Data interchange among: banks, railways, airlines, militaries, etc. – Metered software access and computing services from Mainframes – Enterprise data warehouses for analytic purposes – Object-oriented design patterns for decoupled data access • So What’s Different About Data Services Today? – Modern (new and different) standards & protocols – Business scale, complexity, and expectations – Near-infinite elasticity © 2009 Oracle Corporation – Proprietary and Confidential 7
    • Java Programmer’s View of Data Services Objects & Components in my JEE and JSE infrastructure JEE BUSINESS SERVICES • SCA – Service Component Architecture – Key framework spec for Java Business Services JEE DATA SERVICES • DAS, DTO & JDO – Data Access Service – Java service for accessing RDB’s and other Source Types – Data Transfer Object – Java object for moving data (w/in container) – Java Data Object – Java object for data containment (POJO-oriented) • JPA & SDO – Java Persistence API – EJB 3.0 spec for accessing external data (typically relational) – Service Data Object – Entity objects targeted for SOA data use • ORM – Object Relational Mapping – A generic term typically applied to some solution approach to handling “impedance mismatch” • Oracle Toplink – A proven industrial strength data services layer for managing object persistence • JAXB / OXM – Java Architecture for XML Binding – Standard set of APIs for XML – Object to XML – Toplink extended implementation of JAXB © 2009 Oracle Corporation – Proprietary and Confidential 8
    • A Classification Taxonomy for Data Services JAVA DATA SERVICE IMPLEMENTATION PATTERNS • DAS & DTO – Access and in-container data transfer • JPA, JDO & SDO – Enterprise intra-container data entity transfer • JAXB & OXM (Toplink) – Access and binding to XML data INFRASTRUCTURE DATA SERVICE FUNCTIONAL PATTERNS • Master Data Services – Golden Records, Hierarchies, & Policies • Bulk Data Services – Bulk Refresh, CDC, Trickle Feeds, SCD… • Data Access Services – Virtualization, Federated Query, ORM… – Really Urgent Data Access – Data Grid Cache / Virtualization – Real Time Data Access – Query Federation & Layered Data Services – Right Time Data Access – Data Hubs & Warehouses • Data Event Services – Low Latency CDC, Trigger-Based CDC… • Data Quality Services – Cleansing, Matching, De-Duplication… PHYSICAL DATA SERVICE DEPLOYMENT PATTERNS • Data Hub – Centralized cache (variation of Data Virtualization) or repository • Data Grid – Distributed RAM-based data partitions with decentralized access • Data Federation – Late-binding of query-time access to source data © 2009 Oracle Corporation – Proprietary and Confidential 9
    • Enterprise Data Service Functional Patterns © 2009 Oracle Corporation – Proprietary and Confidential 10
    • Example: Service-based Data Integration Best of Breed Data Integration as a SOA Service Oracle Data Integration • Best Performing E-LT Architecture • Works with any Data Warehouse • 100% Java & SOA components Oracle Data Replication • Changed Data Capture (CDC) • Query Offloading / DB Tiering Example Use Cases • Bulk Data Transformation (any2any) High Performance • XML/EDI Large File Handling ETL & Replication • SOA-driven Business Intelligence Data Warehouse • Load DW from SOA Any Data Source & OLAP • Unified Data Steward Workflow (ETL Error Hospital w/BPEL PM) Oracle Data Integrator EE is the standard for: • Oracle Fusion Applications • Oracle Business Intelligence • ERP Migration, Replication / Loading • Oracle Fusion AIA • Oracle Performance Management • Query Offloading & Zero Downtime • Oracle Fusion Middleware • Oracle Database, Essbase & Tools © 2009 Oracle Corporation – Proprietary and Confidential 11
    • So What Are Data Services? Casting a Wide Technical Net… • A General Software Pattern? – Using contract-based development patterns for data distribution… • A Java Software Pattern? – Pick your favorite TLA: DTO, DAS, SDO, JPA, ORM, JAXB, OXM… • A Web Services Stereotype? – Dedicated SOAP services for reusable data manipulation and access… • Shared Services for Enterprise Class Data Processing – Shared – common for a group of consumers/clients – Services – contract-driven interfaces to functional behaviors – Enterprise Class – exceptionally demanding SLA’s and KPI’s – Data Processing – the heart-beat for all big businesses © 2009 Oracle Corporation – Proprietary and Confidential 12
    • What is Cloud Computing? © 2009 Oracle Corporation – Proprietary and Confidential 13
    • Everyone Is Talking About Cloud © 2009 Oracle Corporation – Proprietary and Confidential 14
    • © 2009 Oracle Corporation – Proprietary and Confidential 15
    • What Is Cloud Computing? * Cloud Computing is often characterized by: • Virtualized computing resources • Multi-tenancy • Seemingly limitless capacity/scalability • Self-service • Dynamic provisioning • Pay-for-use pricing * Source: Wikipedia.org © 2009 Oracle Corporation – Proprietary and Confidential 16
    • Haven’t we Heard About this Before? * Grid Cloud Cloud Grid Computing is often characterized by: • Virtualized computing resources • Multi-tenancy • Seemingly limitless capacity/scalability • Self-service • Dynamic/elastic provisioning • Pay-for-use pricing * Source: Wikipedia.org © 2009 Oracle Corporation – Proprietary and Confidential 17
    • Cloud Computing Benefits are Speed & Cost-Driven Speed Cost © 2009 Oracle Corporation – Proprietary and Confidential 18
    • Cloud Layers: SaaS, PaaS, IaaS Applications delivered as a service Software as a Service to end-users over the Internet App development & deployment Platform as a Service platform delivered as a service Server, storage and network Infrastructure as a Service hardware and associated software delivered as a service © 2009 Oracle Corporation – Proprietary and Confidential 19
    • Public Clouds and Private Clouds Public Clouds Private Cloud I SaaS SaaS I N N T R PaaS T A PaaS E N IaaS R E N T IaaS E T Users Both offer: Public Clouds: • High efficiency Private Cloud: • Lower upfront costs • High availability • Lower total costs • Economies of scale • Elastic capacity • Greater control over security, • Simpler to manage compliance & quality of service • OpEx • Easier integration • CapEx & OpEx © 2009 Oracle Corporation – Proprietary and Confidential 20
    • Private Clouds are Majority of IT Spend on Cloud Public Cloud vs. On-Premise © 2009 Oracle Corporation – Proprietary and Confidential 21
    • Data Services for the Private Cloud © 2009 Oracle Corporation – Proprietary and Confidential 22
    • Cloud Layers: Where’s the Data? Software as a Service Platform as a Service Infrastructure as a Service © 2009 Oracle Corporation – Proprietary and Confidential 23
    • Cloud Layers: Data at Every Strata! Public Clouds Private Cloud Corporate Software as a Service Cloud Services Data as a Service Platform as a Service Hubs, ETL and Access Services Infrastructure as a Service Storage Clusters © 2009 Oracle Corporation – Proprietary and Confidential 24
    • Important Challenges For Data Owners Today Access and Distribute Data with agility Scale data access while preserving Do it all quality of service efficiently © 2009 Oracle Corporation – Proprietary and Confidential 25
    • Technology that Starts to Address the Challenges Shared Data Services Management/ Automation Grid/Dynamic Resourcing Virtualization © 2009 Oracle Corporation – Proprietary and Confidential 26
    • Data Integration: Reusable Data Components Department Dept App App Owner Dept App IT Dept App build app Svc Proc Svc Proc Svc Svc Proc Proc include create Svc Proc data data services Svc Proc find data create services processes define data integration scenarios Svc Svc Svc Svc Svc Proc Proc Proc Self Svc Data Data Data Oracle Data Integration Suite Service Oracle SOA Suite Integrator Quality Integrator Enterprise Manager Oracle WebLogic Suite-based Application Grid DB Integration Legacy © 2009 Oracle Corporation – Proprietary and Confidential 27
    • Kinds of Enterprise Data Integration Services Oracle Fusion MDM Business Activity SOA CLIENTS Applications Applications Applications Intelligence Monitoring Platforms FUNCTIONAL SERVICES Master ETL Data Data Data Data SOA SOA Data Data Access Event Quality Grid Registry Metadata Service Service Service Service Service Service Service Service Data Movement & Delivery Data Integration Designer TECHNICAL PLATFORM Data Integration Foundation Data Connectivity SOURCES Oracle or 3rd Party: Applications | Analytics | Identity | SOA Platforms | Data Grid | Content Management | Search DATA © 2009 Oracle Corporation – Proprietary and Confidential 28
    • Oracle Data Integration Suite Oracle Fusion MDM Business Activity SOA Applications Applications Applications Intelligence Monitoring Platforms Data Distribution & Delivery Services Bulk Data API Data Replication Data Quality API Process-Oriented Event-Driven (CDC) Data Virtualization Java SDO Message-Oriented Data Integration Foundation Bulk Data Core Data Federation Core Data Relationship Core Data Quality Core Bulk Acquisition Change Data Capture Realtime Query Data Classification Cleanse/Parse Trickle Feeds Event-Based Data Caching Lifecycle Mgmt Matching/Dedupe’s Complex Transforms Integrity Constraints Query Federation Data Reconciliation Cluster Analysis Metadata Services Models Relationships Lineage Object Cache Exchange APIs Data Connectivity Relational Databases Non-Relational DBs Various File Formats XML Data Packaged Applications Standard Msg Formats Message Queues Semi-Structured Data Oracle or 3rd Party: Applications | Analytics | Identity | SOA Platforms | Data Grid | Content Management | Search © 2009 Oracle Corporation – Proprietary and Confidential 29
    • Data Integration, SOA, BPM & IdM: Putting it Together Department Dept App App Owner IT build app UI UI Svc Proc Include create components set policies reusable DATA register components components discover authorized components authenticate Svc Svc Proc Proc UI UI Svc Svc Proc Proc UI UI Svc Svc Proc Proc UI UI Self-Service Interface policies Oracle Data Oracle SOA Oracle BPM Oracle Identity Integration Oracle Suite Suite Mgt Suite Enterprise Manager Oracle WebLogic Suite-based Application Grid © 2009 Oracle Corporation – Proprietary and Confidential 30
    • Cloud and Fusion Middleware Data Services Shared Components Self-Service Interface Oracle Oracle Oracle ODI Suite Oracle SOA Suite BPM Suite Identity Mgt Enterprise Manager Oracle WebLogic Suite-based Application Grid Key Benefits Cloud Enabling Capabilities • Development efficiency • Basis for reusable data service components • Deployment agility • Simple and consistent data • Elastic Scale-out integration framework Why Oracle • Modular and heterogeneous • Most integrated • Unified Management • Easiest to use and manage © 2009 Oracle Corporation – Proprietary and Confidential 31
    • Take-Aways Cloud Data Services is an architecture for centralized, shared, elastic data resources internal to an enterprise that allows departments to rapidly deploy and easily manage application and analytic data. • Fundamental Enablers: • Application server • Key Benefits: • Data Integration • Efficiency • SOA/BPM • Agility • Identity Management • Quality of Service • Enterprise Management • Oracle: • Most complete, comprehensive offering • Easiest to set up, integrate, and operate • Best performance, automation, and self-service © 2009 Oracle Corporation – Proprietary and Confidential 32
    • Pragmatic First Steps © 2009 Oracle Corporation – Proprietary and Confidential 33
    • Leverage Pre-Packaged Integration Solutions Direct Pre-Built Integrations”- Data Integration made simple Oracle CRM On Demand Integration to Siebel CRM Siebel Life Sciences Integration for Oracle Adverse Event Reporting System Demantra Integration Pack for Siebel CRM Consumer Goods Oracle Transportation Management (Glog) Integration to E-Business Suite Cross Industry Process Integration Packs- Design, Sell, Plan and Execute ►Design to Release Agile Product Lifecycle Management integration Pack for Oracle E-Business Suite ►Opportunity to Quote Oracle CRM On Demand Integration Pack for Oracle E-Business Suite ►Order to Cash Siebel CRM Integration Pack for Oracle EBS Order Management ►Trade Promotion Mgmt Siebel CRM Integration Pack for Trade Promotion Management Industry Process Integration Packs- Transform key business processes ►Comms Order to Bill Siebel CRM Integration Pack for Oracle Comms Billing and Revenue Management: Order to Bill ►Comms Customer care Siebel CRM Integration Pack for Oracle Comms Billing & Revenue Management: Agent Assisted Billing Care ►Comms Revenue Accntg Oracle Comms Billing and Revenue Management Integration Pack for Oracle E-Business Suite: Revenue Accounting ►Banking Acct Originations Siebel CRM Integration Pack for i-flex FLEXCUBE Account Originations ►Banking Acct Originations Siebel CRM Integration Pack for Banking Account Originations © 2009 Oracle Corporation – Proprietary and Confidential 34
    • Commit to a Service-based ETL Architecture Running Oracle Data Integrator ETL as a managed Java process enables CONSISTENT management and monitoring – only Oracle can do this! Sense demand spike Dept Dept App 1 Dept App 1 App 2 Data Data Shared Service Service Service Enterprise Elastic ETL Manager Services WebLogic Server Cluser WebLogic Suite-based Application Grid of Nodes Adjust capacity © 2009 Oracle Corporation – Proprietary and Confidential 35
    • Consider a Canonical Data Services Architecture Service Clients Canonical Data Services Physical Sources Data Service Data Service Customer APIs Addresses Profile Internal Java, Web Service, XQuery, SQL, JMS Mgmt JDBC Orders Dashboard Pending Customer Payments Web Srvcs History Credited ESB Order Payments Adapters Enterprise Data Customer Payment Custom Portal Repository BPM • Data services layer provides data access capabilities • Data services modeling organizes services for use and reuse © 2009 Oracle Corporation – Proprietary and Confidential 36
    • Lessons Learned © 2009 Oracle Corporation – Proprietary and Confidential 37
    • Create Data Integration Competency Centers People Process Technology Data Governance Data Profiling and Quality Data Integration Shared Services / SOA Data Stewards ETL Tools Data Architects Data Quality Tools ETL Developers Data Profiling Data Service Modelers Data Federation Database Administrators Data Replication Compliance Officers Data Archiving Data Masking End-to-End Lifecycle Governance © 2009 Oracle Corporation – Proprietary and Confidential 38
    • Unify and Rationalize Different Vendor Tools Solution Areas Key Buying Attributes Data Modeling Relational, object and service models. ETL / Bulk Data Integration Apps, DB and Java integration. Flexible ETL and ELT architectures. Data Quality, Matching and Rule-based and statistical learning. Fast Cleansing bulk and realtime match. Data Profiling In place and out-of-place profiling. Data Federation Canonical modeling and data redaction. Data Archiving Data masking, lifecycle management Data Replication / High Log-based capture with sub-second, Availability transaction-safe data apply Data Grid Multi-platform limitless object scale-out. Management and Monitoring Common metrics, logging, and charts. © 2009 Oracle Corporation – Proprietary and Confidential 39
    • For More Information Quote Attribution Title, Company Get Started Resources • Visit the Oracle Fusion Middleware 11g • Datasheet: web site at http://www.oracle.com/products/middlewar http://www.oracle.com/goto/fmw11g/index. e/odi/docs/odiee-datasheet.pdf html • Blog: • Oracle Data Integration on oracle.com http://blogs.oracle.com/dataintegration www.oracle.com/goto/odi • Technical information available at: • Oracle Fusion Middleware on OTN http://www.oracle.com/technology/product http://otn.oracle.com/middleware s/oracle-data-integrator/index.html • Information on GoldenGate: • Data Integration Events http://www.oracle.com/goldengate http://www.oracle.com/events © 2009 Oracle Corporation – Proprietary and Confidential 40
    • Developing in the Cloud @ Middleware Lounge At the Marriott Hotel • Free Amazon Web Services access • $35 credit for development time Workshops Daily • Daily workshops: “Developing in the Cloud” In the Middleware Lounge • Q&A with Amazon representatives and other experts • Daily, 11:30 AM Introduction to Amazon Web Services • Monday 2:00 PM • Internet access Developing with WebCenter and Oracle Content Management in • Wireless access Amazon Web Services • SunRay machines also provided • Tuesday 2:00 PM Developing with WebCenter and Oracle Content • Recharging stations for your phone or laptop Management in Amazon Web Services • Wednesday 2:15 PM Developing • Free food and beverages with Oracle SOA Suite in Amazon Web Services • Live Twitter feeds and blog updates • Thursday 2:30 PM Developing • Watch keynotes and featured sessions while relaxing, with Oracle SOA Suite in Amazon recharging, and checking email Web Services © 2009 Oracle Corporation – Proprietary and Confidential 41
    • OpenWorld Activities for Oracle Data Integration Monday 10/12 11:30am Introducing Oracle GoldenGate Products Marriott Golden Gate B1 Oracle GoldenGate & 1:00 pm Event-Driven BI with Oracle Data Integrator Marriott Salon 1 Oracle Streams: The 2:30 pm Real-time BI Using Oracle GoldenGate + ODI Marriott Golden Gate B1 Future of Oracle 4:00 pm RIM Case Study: Using Oracle GoldenGate Marriott Golden Gate B1 Replication and Data 5:30 pm Integrate Oracle BI Solutions with ODI Moscone Room 307 Integration Tuesday 10/13 Panel With Hasan Rizvi and Juan Loaiza, Sachin 11:30am Oracle GoldenGate for Zero-Downtime Migrations, Marriot Golden Gate B1 Chawla, and Ali Kutay 11:30am Enterprise Data Services in the Cloud Marriott Hotel Salon 7 1:00pm Oracle GoldenGate Deep Dive: Architecture Marriott Hotel Golden Gate B1 Tuesday, 2:30 - 3:30 PM 1:00pm Deep Dive on Real-World Use Cases for ODI Hilton Hotel Golden Gate 3 Moscone South Room 270 4:00 pm Bringing BPM and Data Integration Together Marriott Hotel Nob Hill CD Wednesday 10/14 11:45am Ensure a Successful Siebel CRM Upgrade Moscone West L2 Room 2001 DemoGrounds 1:00pm ELT, Federation, and Replication: Overstock.com Moscone West L3 Room 3014 Moscone West Thursday 10/15 ODI, OWB, W-093, W-094 Oracle Information Framework: The Power of the Oracle GoldenGate, 3709 9:00am Combined ODI and MDM Moscone South Room 304 Hands-on Labs Marriott Hotel Golden Gate A2 Monday 11:30am, Wed 1:15pm: Introduction to ODI-EE Tuesday 4:00pm, Thurs 10:30am: BI + ODI-EE Monday 1:00pm, Wed 5:00pm: Data Services using ODI-EE Tuesday 2:30pm, Thurs 9:00am: Advanced ODI-EE © 2009 Oracle Corporation – Proprietary and Confidential 42
    • © 2009 Oracle Corporation – Proprietary and Confidential 43
    • The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. © 2009 Oracle Corporation – Proprietary and Confidential 44
    • © 2009 Oracle Corporation – Proprietary and Confidential 45
    • For More Information search.oracle.com or oracle.com © 2009 Oracle Corporation – Proprietary and Confidential 46
    • © 2009 Oracle Corporation – Proprietary and Confidential 47