• Save
Extracting strategic insights from business data with oracle data integrator
Upcoming SlideShare
Loading in...5
×
 

Extracting strategic insights from business data with oracle data integrator

on

  • 298 views

Extracting strategic insights from business data with oracle data integrator

Extracting strategic insights from business data with oracle data integrator

Statistics

Views

Total Views
298
Views on SlideShare
293
Embed Views
5

Actions

Likes
0
Downloads
0
Comments
0

2 Embeds 5

https://twitter.com 4
http://www.slideee.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Extracting strategic insights from business data with oracle data integrator Extracting strategic insights from business data with oracle data integrator Presentation Transcript

  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 121
  • Extracting Strategic Insights from Business Data with Oracle Data Integrator (CON8516) Jayant Mahto Product Manager, Oracle Data Integrator Christophe Dupupet Director FMW Architects Team: The A-Team
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 123 The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. View slide
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 124 Program Agenda  Oracle Data Integration Market Overview  Oracle Data Integrator Technical Overview  BI Applications 11.1.1.7.1  BI Applications architecture with ODI as DI platform  Specific ODI features used in BI Applications  Advantages of ODI as Data Integration platform View slide
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 125 Oracle Data Integration Market Overview
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 126 Market Overview Exponential Growth in Data Volumes 45 PB+ Maintained by Large Orgs 45%+ Annual Growth 15 out of 17 Industry Sectors in the U.S. Have More Data Than the U.S. Library of Congress
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 127 More Data leads to More Data Challenges Market Overview Exponential Growth in Data Volumes
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 128 Market Overview Data Integration and Data Quality Markets estimates the DI market will reach $2.8 billion estimates the DQ market will reach $1.75 billion by 2016 with an average growth rate of 18.2%
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 129 Oracle Data Integration Technical Overview
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1210 D at a Qualit yD at a Integration Profiling Standardization Match/Merge ETL/E-LT Replication Virtualization Big Data Heterogeneous Oracle Data Integration (DIS) Breadth Enables Leverage and Agility
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1211 Delivering Real-Time Integration for Big Data and Cloud • Real-time replication; optimized for Database 12c and Oracle Exadata • End-to-end integrated with simplified deployment • Unified tooling for both structured data sources and Hadoop / NoSQL • Flexible deployment on-premise or in the Cloud for heterogeneous systems • Expanded support for 3rd party systems and Oracle Applications in real-time data integration and continuous availability solutions Oracle Data Integration 12c Oracle Data Integrator Oracle GoldenGate Oracle Enterprise Data Quality Oracle Data Service IntegratorBig Data Database Apps Cloud
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1212 Oracle Data Integrator Bulk Data Processing and Data Transformation  Certified for leading technologies to deliver fast time to value  High-performance, low cost of ownership E-LT architecture  Lightweight deployment  Flexible, easy to enrich functionality Oracle Data Integrator High Performance E-LT Declarative Design CEP Data Services Extensible Knowledge Modules Capable of Integrating Structured & Unstructured Data Big Data Database Apps Cloud
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1213 E-LT provides a flexible architecture for optimized performance Benefits  Leverages set-based transformations  Improves performance for loading, no network hop  Takes advantage of existing hardware Conventional ETL Architecture Extract LoadTransform Next Generation Architecture “E-LT” Load TransformTransform Extract Industry Leading Performance Extremely Fast Execution and Reduced Cost
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1214 Declarative Design  Easy for moderate use cases  Universal for big and complex use cases  Quick to define and refactor maps  Extensible model for any data integration mechanism  Benefits – Significantly reduces the learning curve – Shortens implementation times – Simpler maintenance Improved Developer Productivity and Lower Maintenance Costs
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1215 Reverse Engineer Metadata Journalize (CDC) Load from Source to Staging Check Constrains Integrate, Transform Data Service Pluggable Knowledge Modules Architecture SAP/R3 Siebel GoldenGate DB2 Journals SQL Server Triggers Oracle DBLink DB2 Exp/Imp JMS Queues Check MS Excel Check Sybase Oracle SQL*Loader TPump/ Multiload Type II SCD Oracle Merge Siebel EIM Schema Oracle Web Services DB2 Web Services Sample Out-of-the-Box Knowledge Modules Key Architecture Benefits:  Ease of maintenance,  Flexibility, Leverage existing and new best practices,  Reduces cost of ownership Knowledge Modules Pluggable Architecture for Superior Flexibility
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1216 • Big Data: Hadoop support • Best for Oracle: Merge, Spatial, Multi- Table Insert, Optimizer Hints and more • Real-Time: CDC with GoldenGate • Applications: E-Business Suite, Siebel, PeopleSoft, JD Edwards Enterprise One, JD Edwards World, SAP ERP and SAP BW • Heterogeneous: Optimizations for all major RDBMS: IBM DB2, Microsoft SQL Server, Teradata, Netezza etc. Broad Heterogenous Connectivity Leverages Existing IT, Faster Implementation Databases Applications Legacy Unstructured JMS
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1217  Support Any Legacy Data Feeds  Non-Invasive Source Capture  Support traditional use cases; Data Warehousing, Reporting, Data Distribution, etc.  Most Cost-Effective and High-Performance Exadata Data Loading Best Data Integration for Exadata Top Performance, Integrated & “Red Optimized” DIM FACT DIM DIMDIM DEPT Batch Feeds Oracle GoldenGate Oracle Data Integrator DEPTEMP EMP Non-Invasive Real Time Transaction Feeds
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1218 Data Integration for BI and Data Warehousing High Performance E-LT, Real-Time Analytics, Fast Data Solution • Oracle Data Integrator and Oracle GoldenGate to capture data (structured or unstructured) and immediately move information where it is needed. • Enterprise Data Quality to cleanse and standardize data • Real-time and bulk data movement, data synchronization, data quality, and data services • Big Data transformation, real-time capture for Fast Data Benefits • No resource / performance impact to source systems • Live data, 100% change detection, available for better informed decision making • Get double-duty from database investment by using it for transformations • Maximizes availability of source systems and DW due to smaller batch windows.
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1219 BI Applications 11.1.1.7.1
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1220 Pre-Built Analytic Warehouse1. • Business Analytics Warehouse • Over 300 star schemas • Designed for analysis and reporting 2. Role-Based DashboardsBest Practice Metrics3. 4. • Over 10,000 metrics • Additional pre-defined calculations • Based on best practices • Pre-mapped integration • Fusion, EBS, PSFT, SEBL , JDE, IBM • Role-based Security • Over 500 Dashboards and Pages • Over 3,000 reports • Across Lines of Business Certified Application Integration Oracle BI Apps: Deeper than Dashboards
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1221 BI Applications 11.1.1.7.1  Most significant BI Applications release in three years.  Significant expansion of content and new products  Completely re-architected solution leveraging the power of ODI  Released on the latest version of OBIEE 11.1.1.7 Summary of Features
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1222 BI Applications 11.1.1.7.1  Number of new out-of-the-box tools to increase productivity and drive down TCO  Golden Gate option available for customers that have significant ETL time pressures  Localized in 28 languages Summary of Features Continued
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1223 Summary of Release BI Applications 11.1.1.7.1 New Content Enhancements New Data Integration New TCO Tools New Applications & Adapters New OBIEE 11.1.1.7 Oracle Data Integrator Oracle GoldenGate Student Information Analytics Price Analytics for EBS  GUI Based Configuration  Functional Setup Tool  Financials: Fixed Assets, Budgetary Analysis  HR: Time & Labor, Payroll Analysis  Projects: Resource Management, GL reconciliation  CRM: Service Contracts, Price Analytics for EBS  Procurement & Spend :Sourcing  Supply Chan: Costing, Inventory Aging & Cycle Counts
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1224 Next Generation Data Integration Oracle Data Integrator provides  In-database E-LT Transformation vs. E-T-L  Best in class performance, scalability, availability  Lightweight deployment for lower TCO  Faster time-to-value through declarative design Oracle Golden Gate option for BI Apps  Reduce load on source system by streaming data continuously into persistent store in the DW  More reliable change data capture and delete support  Enables near real time DW refresh BI Apps 11.1.1.7.1 with Oracle Data Integrator and Golden Gate
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1225 Oracle BI Applications Planning Current Releases and Roadmap • For Applications Unlimited customers • ETL with Informatica • New Manufacturing Analytics • New Enterprise Asset Management Analytics • New SLA support for EBS R12 (patch) • For SAP customers • ETL with ODI • Fin, Proc & Spend, Supply Chain Analytics • For Application Unlimited customers • ETL with ODI • New Student Information Analytics • New Golden Gate option • New content in all major products • Fusion & AU: release alignment • ODI and Informatica : release alignment • New content: Talent Management, PLM Analytics integration, EAM enhancements, Student Analytics enhancements, EVM • New adapters: Procurement & Spend Analytics for JDE, Manufacturing Analytics for JDE, Supply Chain & Order Management Analytics for PeopleSoft • New cloud adapters: Adapters to Fusion CRM, HCM & ERP Cloud Services, Taleo adapter • Cost of Ownership Improvements: Data Lineage, ETL Validation, platform support • Endeca Extensions • BI Applications as Oracle Cloud Service • New content/modules: Continue to fill key content gaps based on customer demand • New cloud adapters: RightNow adapter, Eloqua adapter • Unstructured/big data analytic applications e.g. Customer 360 • Continue user experience redesign by leveraging BI Foundation Suite platform developments incl Mobile App Designer • Additional cost of ownership improvements BI Apps 7.9.6.4 January 2013 What’s Next 0-12 month planning cycle Future Directions Post 12 month planning cycle BI Apps 7.9.7.2 September 2012 BI Apps 11.1.1.7.1 May 2013
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1226 BI Applications Architecture with ODI as DI platform
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1227 BI Applications Architecture 11.1.1.7.1
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1228 Default ETL Architecture for DW
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1229 BI Apps DW ETL Architecture + SDS Optimized ETL for local SDSOptimized for Incremental ETL Generated based on a customers BI Apps deployment
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1230 Specific ODI features used in BI Applications
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1231 ODI 11g features used by BI Applications 11.1.1.7.1  Shortcuts – Release tags – Materialization  Variables – Tracking variables and sequences – Enhanced variable handling in the load plan  Enhanced Session Logging  Load Plan
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1232  Used in development for • Datastores • Integration interfaces • Packages • Procedures. ODI 11g features Shortcuts
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1233 • Release tags • Materialization ODI 11g features Shortcuts continued
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1234 • Tracking variables and sequences used in executed session. • Hiding unused variables in Load Plan to improve readability. ODI 11g features Variable Enhancements
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1235 • Parallel • Sequential • Conditional execution • Restartability • Exception handling. ODI 11g features Load Plan
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1236 Manage Load Plans Load Plan Administration
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1237 Manage Load Plans Defining a Load Plan
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1238 Manage Load Plans Fact Groups Selection
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1239 Manage Load Plans Generating a Load Plan
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1240 Manage Load Plans Executing a Load Plan
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1241 Advantages of ODI as Data Integration platform
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1242 Oracle BI Applications with ODI Why is it Better? ODI is Faster Fastest E-LT Bulk/Batch Performance Faster Real Time integration (sub-second) with CDC, Replication, and SOA Faster Project Setup, Design and Delivery ODI is Simpler Simpler Setup, Configuration, Management, and Monitoring Simpler way to do Mapping using Declarative SQL Interfaces Simpler Deployment with Fewer Hardware Devices Simpler extensibility with Knowledge Module code templates ODI Saves Money (Lower TCO, Higher ROI) Less Hardware & Energy Costs with E-LT Architecture Less Time Wasted on Unnecessary ETL Mappings, Scripting, and Training Less Integration Overhead Integrating with Applications, SOA, and Management
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1243 ODI is Faster 7.5TB per Hour of Real World Data Loading and Transformations ODI ELT w/ Exadata  ODI scales with Exadata  ODI runs on Exadata – no ETL hardware required  No new hardware required as data sets grow  ODI processes used only during integration runs  Exadata continually available for OLTP, BI, DW, etc  Common administration, monitoring and management  All the benefits of rapid tool-based ETL development Conventional ETL  Additional hardware ($$) needed to scale  ETL parallel optimization and design ($$$) is heavily dependent on resources available to the ETL environment  ETL engine hardware resources only used for ETL   Different management, monitoring and administration from database and BI infrastructure ($$)
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1244 ODI and Exadata – Real World Example A Disruptive Improvement in Performance  A complex branch of the customer’s tax allocation process runs 5 hrs 11 mins during quarter close  Exadata and ODI (E-LT) combined is able to execute the process 42X faster (7mins 20 secs) 0 50 100 150 200 250 300 350 ODI on Exadata Conventional ETL Jobexecutiontimeinminutes 5hrs 11mins 7min 20sec 42XIMPROVEMENT
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1245 ODI is Simpler Speed Project Delivery and Time to Value with ODI Development Productivity • 40% Efficiency Gains Environment Setup (ex: BI Apps) • 33-50% Less Complex Number of Setup Steps 10 Number of Servers 3 Number of connections 7 Number of Setup Steps 7 Number of Servers 1 Number of connections 3
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1246 ODI Declarative Design Conventional ETL Design Better Developer Productivity and Lower Maintenance ODI-EE Declarative Design ETL Data Flow Graph - Laborious • Developer must define every step of Complex ETL Flow Logic • Traditional approach requires specialized ETL skills • And significant development and maintenance efforts ODI - Declarative Set-based Design • Simplifies the number of steps • Automatically generates the Data Flow whatever the sources and target DB Benefits  Significantly reduce the learning curve  Shorter implementation times  Streamline access to non-IT pros Define How: Built-in Templates Define What You Want Automatically Generate Dataflow 1 2 46
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1247 ODI Saves Money E-LT Runs on Existing Servers with Shared Administration Typical: Separate ETL Server  Proprietary ETL Engine  Expensive Manual Parallel Tuning  High Costs for Standalone Server ODI: No New Servers  Lower Cost: Leverage Compute Resources & Partition Workload efficiently  Efficient: Exploits Database Optimizer  Scalable: Scales as you add Processors to Source or Target  Manageability: Unified Enterprise Manager  Pricing: AST lower than Informatica OEM Benefits  Better Hardware Leverage  Easier to Manage & Lower Cost  Simple Tuning & Linear Scalability Conventional ETL Architecture Extract LoadTransform Next Generation Architecture “E-LT” Load TransformTransform Extract
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1248 Questions & Answers
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1249 Join the Data Integration Community Twitter twitter.com/ORCLGoldenGate Facebook facebook.com/OracleDataIntegration Data Integration YouTube channel youtube.com/oraclegoldengate Oracle.com/goto/dataintegration LinkedIn “Oracle Data Integration” Oracle’s Data Integration blog blogs.oracle.com/dataintegration Oracle Data Integrator Books http://www.packtpub.com/oracle-data-integrator-11g- getting-started/book http://www.packtpub.com/oracle-data-integrator-11g- cookbook/book
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1250 Oracle OpenWorld – Key DIS Sessions Monday Tuesday Wednesday Thursday CON8513 Oracle Data Integrator Product Updated and Future Strategy 1:45 PM Moscone West 2024 HOL10130 Introduction to Oracle Data Integrator 12:00 PM Marrriott Marquis Nob Hill AB CON8515 Customers Perspectives: Oracle Data Integrator 1:15 PM Moscone West 2012 HOL10144 Combining Oracle Data Integrator and Oracle GoldenGate 3:45PM Marriott Marquis Nob Hill AB CON8544 Making the Move to Oracle Data Integrator 3:30 PM Moscone West 2012 CON8514 Key Patterns Converge: Data Integration and Data Virtualization for SOA 5:15 PM Moscone West 2024 CON8516 Extracting Strategic Insights from Business Data wit Oracle Data Integrator 5:15 PM Moscone 2012 Oracle Data Integrator
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1251 Graphic Section Divider
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1252
  • Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 1253