Oracle Data Integration Strategy - Kulvinder Hari, Oracle

2,539 views

Published on

Published in: Technology, News & Politics
0 Comments
6 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,539
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
0
Comments
0
Likes
6
Embeds 0
No embeds

No notes for slide

Oracle Data Integration Strategy - Kulvinder Hari, Oracle

  1. 1. ORACLE PRODUCT LOGO Oracle Data Integration Strategy Dom Polski, Warsaw, Poland - April 2012 Kulvinder Hari, Senior Product Manager, Fusion Middleware EMEA1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  2. 2. The following is intended to outline our general productdirection. It is intended for information purposes only,and may not be incorporated into any contract. It is not acommitment to deliver any material, code, orfunctionality, and should not be relied upon in makingpurchasing decisions.The development, release, and timing of any features orfunctionality described for Oracle’s products remains atthe sole discretion of Oracle.2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  3. 3. Agenda• Data Integration Overview & Product Strategy• Data Integration Business Solutions• Overview Key Products• Next Generation Data Integration • Big Data• Summary 3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  4. 4. Factors of ProductionAccording to the McKinsey Global Institute study… "Youre hearing a lot about big data and Labour Cost analytics around big data," "To do that kind of stuff youve got to collect the data that you want to analyze + DATA and put it somewhere. [That] in effect is a job for data integration tools." * McKinsey Global Institute: Big Data – The next frontier for innovation, competition and productivity (May 2011)4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  5. 5. 5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  6. 6. Demand on Your Data Center Growing Exponentially demand Gartner Survey (June 2010) Shows Data Growth as the Biggest Data Center Hardware Infrastructure Challenge Data Growth • eCommerce (B2B, B2C) • Social Media • Collaboration • Rich Content Graphic created by Oracle based on Gartner data time6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. 6
  7. 7. Oracle Fusion MiddlewareComplete, Best in Class, Integrated, Open• Leader in Market Share Web Social Mobile Cloud User Engagement• Leader in Performance Business Process Content Business Management Management Intelligence• Leader in Innovation Service Integration Data Integration• Largest Developer Community Identity Management & Security• Largest Partner Ecosystem Development Cloud Application Enterprise Tools Foundation Management 7 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  8. 8. Oracle’s Information Management Strategy Oracle Watchlist Oracle 3rd Party Custom BI/EPM Screening Applications Applications Applications Transaction Processing Business Intelligence Content Management CollaborationData Services Services Services Services ServicesInformationManagement Customer Hub Product Hub Supplier Hub Financial Hub Site Hub Oracle Enterprise Data Quality MDM Oracle Profiling Standardization Match/Merge Data Integration ETL/E-LT Data Federation Replication Transformation Synchronization Storage Data Warehouse/ OLTP OLAP Cube Web and Event Data Mart System Services, SOA8 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  9. 9. Oracle’s Data Integration Strategy Unique Advantage: Pervasive Data Integration• Provide Complete, Open, Integrated, Best-of-Breed Data Integration • Complete: Complete Data Integration Technology Platform • Open: Heterogeneous and Optimized for Standalone Sale • Integrated: Integrated with Oracle Technology Stack • Best-of-Breed: Strong Technical Differentiation• Pre-integrate with Oracle Apps, Middleware, Database, Hardware • Make Data Integration Pervasively Available with All Oracle “Endpoints” • Dramatically Lower Total Cost of Ownership for Integration • Pre-packaged Technology and Pre-built Integration Content • Pre-integrated and Optimized for Oracle Database and Exadata • Pre-integrated with Fusion Middleware for Design, Management & More • Pre-integrated with Shared Metadata for Oracle Business Intelligence 9 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  10. 10. Oracle’s Data Integration Strategy Mutually Reinforcing Two Part Strategy Embedded Best of Breed Technology & Standalone Content Platform • Unique value proposition: apps include pre-built integration content • Only possible for a leading infrastructure and application company • Dramatically lowers the cost of adding & integrating an application • Examples: Oracle BI Applications, Oracle Governance Risk & Compliance, Application Integration Architecture (AIA), many more…10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  11. 11. Agenda• Data Integration Overview & Product Strategy• Data Integration Business Solutions• Overview Key Products• Next Generation Data Integration • Big Data• Summary 11 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  12. 12. The Data Integration Business Problem Application Screen Fragmented, Inaccurate, Stale Data Scrape Download Application Message File Application Queue Screen Application Scrape HighSocketsof Integration, OperationalTransaction Cost Transaction Screen Scrape Impact File File Application Sockets Download CICS Gateway RPC File ORB APPC Data Explosion , Increased batch windows, Poor Application Message ORB performing ETL Application Message Application Transaction Queue File Application Message Queue Migration, Uptime, Synchronization across Transaction Screen CICS Gateway Distributed,Scrape File Replicated Systems APPC Application Message Download RPC File12 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  13. 13. Oracle Data Integration Next Generation Data Integration for the Enterprise Oracle GoldenGate • Data in any latency Real Time • Resilient architecture Oracle Data Integrator • Highest performance Simpler, Faster, Lower TCO ETL/ELT • Fast, simple development Oracle Enterprise Data Quality Trusted Data for the Enterprise • Cleansing & matching forCertified for Certified for any data 100s of 100s of Sources Targets 13 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  14. 14. Oracle Data Integration Solutions ODI OGG EDQ ADG Compete with Oracle Data Integrator • Fastest E-LT bulk/batch performance Faster • Leverage underlying system parallelism • Faster project setup, design and delivery • Simpler to setup, configure, manage, & monitor Simpler • Map using declarative SQL interfaces • Deploy with fewer hardware devices • Extend with knowledge module & code templates • Less HW & Energy Costs with E-LT Architecture Saves Money • Vastly reduces implementation and configuration times of (Lower TCO, Higher ROI) ETL Mappings, Scripting, and required Training • Less Integration Overhead Integrating with Applications, SOA, and Management Software14 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  15. 15. Oracle Data Integration Solutions ODI OGG EDQ Compete with Oracle GoldenGate • Sub-second latency for data movement Performance • Low-impact capture, routing, transformation, and delivery of transactional data • Open, modular architecture Flexible & Extendable • Supports heterogeneous sources and targets • Agile and adaptable to modern data integration architectures Reliable • Maintains transactional integrity • Resilient against interruptions and failures • Fast Recovery after process interruptions.15 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  16. 16. Oracle Data Integration Solutions ODI OGG EDQ ADG Compete with Oracle Data Quality • Built-in capabilities for profiling, cleansing, Integrated matching & reporting • Team collaboration and management • Easy to configure and integrate ‘DQ Services’ Modern • Modern, open architecture (Java, SOA, etc.) • Collaborative, multi-user project support • Engineered for business users Business User Oriented • Pre-built Watch List Screening solution for data compliance • Built-in specialized domain knowledge & expertise for rapid deployment16 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  17. 17. Oracle Data Integration Solutions Enterprise-Wide Solutions OGG ADG Zero Downtime Migrations & Upgrades New DB/HW/OS/APP Heterogeneous Disaster Recovery Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB OGG ADG ADG Query Off-Loading OGG Reporting Database ODI OGG ADG ODS OGG ODI Data Warehouse Real-Time & Batch BI OGG ODI Data Distribution Global Data Centers BPM OGG ODI BPM SOA/EDA CEP17 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  18. 18. Agenda• Data Integration Overview & Product Strategy• Data Integration Business Solutions• Overview Key Products• Next Generation Data Integration • Big Data • Data Warehousing • Cloud Data Services• Summary 18 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  19. 19. Oracle GoldenGate The Solution for Enterprise-wide Real Time Data Needs Mission Critical Database and Applications & Data,applications, Mixed Real-time information Business Intelligence,sources, distributed Reporting for systems, legacy, Customers, Partners OLTP, OLAP & Employees Real-time Access Oracle GoldenGate delivers real-time access of real-time information, enabling companies to dramatically improve the availability, reliability, and performance of critical data across enterprise systems. 19 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  20. 20. GoldenGate is Oracle’s Strategic Real-Time Solution • Best-in-class leader in real-time data integration solutions • Complements existing Oracle products • Continuous Availability for heterogeneous systems • Zero-downtime migrations / upgrades to Oracle Database, Hardware, and Applications • Real-time data access for Reporting & BI/EPM • Over 1200 customers including Fortune 500 companies, representing Financial Services, Communications, Healthcare, Public Sector, Retail, Utilities industries  4 of top 5 largest commercial banks  3 of top 3 busiest ATM networks  5 of top 5 financial data services companies  5 of top 5 telecommunications providers  3 of top 5 largest food & drug stores20 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  21. 21. How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity, transforming the data as required.Source TargetOracle & Non-Oracle Oracle & Non-OracleDatabase(s) Bi-directional Database(s) 21 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  22. 22. Oracle GoldenGate TopologiesUnidirectional Query Bi-Directional Peer-to-PeerOffloading Live Standby or Load Balancing, Active-Active for HA Multi-MasterBroadcast Integration/Consolidation CascadingData Distribution Data Warehouse Data Marts22 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  23. 23. Agenda• Data Integration Overview & Product Strategy• Data Integration Business Solutions• Overview Key Products• Next Generation Data Integration • Big Data• Summary 23 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  24. 24. Oracle Data Integrator 11g Fastest ETL/E-LT, Simpler Time-to-Value, Lowest TCO Oracle Data Integrator Enterprise Edition Legacy Sources Best in class performance, scalability Any Data Lowered TCO, lightweight deployment WarehouseApplication Sources Improved usability and manageability Heterogeneous Any Planning OLTP DB System Sources Open, standards-based 24 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  25. 25. ODI – Oracle’s Strategic ELT/ETL ODI is Faster • Fastest E-LT Bulk/Batch Performance • Faster Real Time integration (sub-second) with CDC, Replication, and SOA • Faster Project Setup, Design and Delivery ODI is Simpler • Simpler Setup, Configuration, Management, and Monitoring • Simpler way to do Mapping using Declarative SQL Interfaces • Simpler Deployment with Fewer Hardware Devices • Simpler extensibility with Knowledge Module code templates ODI is Saves Money (Lower TCO, Higher ROI) • Less Hardware & Energy Costs with E-LT Architecture • Less Time Wasted on Unnecessary ETL Mappings, Scripting, and Training • Less Integration Overhead Integrating with Applications, SOA, and Management25 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  26. 26. Problem - Shrinking ETL Batch Windows 3 2 LOAD TRANSFORM 1 EXTRACT Older dataChallenge• ETL Processing Exceeds Business Batch windows due to increased data volumes 26 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  27. 27. Optimized Data Loading through E-LT • The key to improved performance and reduced costs Conventional ETL Architecture Extract Transform Load • E-LT provides flexible architecture for optimized performance • Benefits • Leverage Set-based transformations Next Generation Architecture • Improved performance for “E-LT” loading, no network hop • Takes advantage of existing Extract Load hardware Transform Transform27 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  28. 28. ODI-EE Declarative Design • Improved Developer Productivity and Lower Maintenance CostsSpecify ETL Data Flow Graph Conventional ETL Design• Developer must define every step of Complex ETL Flow Logic• And significant development and maintenance effortsDeclarative Set-based Design• Simplifies the number of steps• Automatically generates the Data Flow ODI Declarative Design whatever the sources and target DB 1 2Benefits Define Automatically Significantly reduce the learning curve What Generate Shorter implementation times You Want Dataflow Streamline access to non-IT pros Define How: Built-in Templates 28 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  29. 29. Agenda• Data Integration Overview & Product Strategy• Data Integration Business Solutions• Overview Key Products• Next Generation Data Integration • Big Data• Summary 29
  30. 30. ORACLE PRODUCT LOGOBig Data 30
  31. 31. Real World Use Cases for Big Data Industry New Data What’s Possible Why? Healthcare Practitioner’s notes; Best practices, reduced Increase industry value byImprove Quality and Efficiency machine statistics hospitalization $300 B per year Retail Micro-segmentation, Weblog, click streams Increase net margin by 60% One size fits all marketing recommendations Banking Weblogs, transaction Semantic discovery; Billions of Dollars lost inFraud detection; risk analysis systems, fraud reports pattern detection bank fraud annually Location-Based Services Geo-advertising, traffic, Increase revenue for Personal location data Based on home zip code local search, more. providers by $100B+ Utilities Smart meter reading, call Real-time and predictive Energy use expected to grow Resilient and adaptable grid center data utilization analysis by 22 percent by 2030 31
  32. 32. Big Data: Challenge to Opportunity Harness Big Data to Increase Business Value Business → Deep Analytics Value Big Data → High Agility Platform → Massive Scalability → Real Time Tomorrow → High Variety → High Volume Challenges Big Data → High Complexity → High Velocity Today Time32 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  33. 33. Big Data Appliance Usage Model Oracle Oracle Big Data Appliance Oracle Exadata Exalytics Loads Oracle Loader for Hadoop InfiniBand InfiniBand Oracle Data Activates Integrator Transforms Via MapReduce(HIVE) Stream Acquire Organize Analyze & Visualize33 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  34. 34. Oracle Data Integration for Big Data Improving Productivity and Efficiency for Big Data Benefits • Improves productivity for transforming Big Data • Reduce complexities of Hadoop through graphical tooling • Optimizes the loading of Big Data Oracle Data Integrator • Minimizes the size of data results • Consistent tooling across BI/DW,non-relational SOA, Integration and Big Data data Oracle Big Data Appliance 34 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  35. 35. ORACLE PRODUCT LOGOSummary 35
  36. 36. Data Integration in the Marketplace Sorted by Vertical Markets (sample customers only) Communications Finance / Banking Media Services Energy/Industrial Insurance / Health Retail Other36 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  37. 37. Benefits of Data Integrationwith Oracle Cut Costs, Reduce Risk, and Revolutionize Business Insight Cut Costs and Improve Efficiencies. • Move only the changed data from redo logs and reduce source and network overhead • Shorten implementation times from months to weeks using pre-packaged integrations to well-known applications, sources and targets. Reduce Risk, Ensure Continuity • Eliminate performance impact on source systems • Reduce the risk of missed orders, poor customer interactions, missed opportunities through improved recoverability, data quality Improve Business Insight • Enable near real-time decision making with real-time data flows • Combine real-time data with historical context for better insights37 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  38. 38. The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.38 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  39. 39. 39 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  40. 40. Quote Attribution Title, Company Get Started Resources • Visit the Oracle Fusion Middleware 11g web site • Oracle GoldenGate Resource Kit: at oracle.com/goto/fmw11g/index.html oracle.com/goto/goldengate • Oracle Data Integration on oracle.com • Blog: http://blogs.oracle.com/dataintegration oracle.com/goto/odi • Technical information available at: • Oracle GoldenGate on oracle.com oracle.com/technology/products/oracle-data- oracle.com/goto/goldengate integrator/goldengate/index.html • Oracle BI/EPM on oracle.com • Data Integration Events oracle.com/solutions/business_intelligence/index. http://www.oracle.com/events html40 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  41. 41. 41 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.

×