Accelerate your business with oracle data integration

  • 1,195 views
Uploaded on

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
1,195
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
0
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Let me give a bit more information on Oracle GoldenGate’s architecture and the related benefits:The key components of Oracle GoldenGate platform are its Capture and Delivery modules and the Trail Files that store changed data. The software operates at the database level and the capture component is typically installed on the source database server outside of the DBMS. GoldenGate’s CAPTURE reads native transaction logs and captures transactions as soon as they commit and takes outside of the database system to be queued. It only moves changed, committed transactional data. It allows filtering at table, column and/or row level and.  ClickAfter the capture GoldenGate converts the committed transactions into a universal data format in “trail” files. Using source and target trail files, it eliminates any single point of failure and ensures data integrity is maintained – even in the event of a system error or outage. ClickFrom the Trail files the data is routed via TCP/IP to the target systems. A second Capture component called here Pump, can be used for routing to multiple targets for further decoupling. During routing Data compression and encryption can be applied and thousands of transactions can be moved per second, without any distance limitations. ClickThe other key component of GoldenGate is the Delivery module that is installed on the target database server. Queued Transactions that are stored in the trail files are applied to target using native SQL callsClickThis data movement can be done bidrectionally. The same platform can be used for heterogeneous data integration and multi-master database replication across the globe. ClickGoldenGate has modular architecture that is designed for performance and reliability. It has low-impact data capture supporting subsecond latency in even very high data volume systems. It supports heterogeneous sources and targets and provides guaranteed data delivery with transactional integrity. It is completely resilient against process interruptions and failures. These capabilities make it a great fit for mission-critical, high-throughput systems.
  • Checkpoints are used during online change synchronization to store the current read and write position of a process. Checkpoints ensure that data changes marked for synchronization are extracted, and they prevent redundant extractions. They provide fault tolerance by preventing the loss of data should the system, the network, or a GoldenGate process need to be restarted.

Transcript

  • 1. 1 Copyright © 2011, Oracle and/or its affiliates. All rights Insert Information Protection Policy Classification from Slide 7 reserved.
  • 2. Accelerate your business with Oracle Data Integration Milomir Vojvodic, Business Development Manager, Oracle EMEA Data Integration Solutions2 Copyright © 2011, Oracle and/or its affiliates. All rights Insert Information Protection Policy Classification from Slide 7 reserved.
  • 3. Oracle Data Integration Solutions Oracle GoldenGate • Data in any latency Real Time Data Movement • Resilient architecture Oracle Data Integrator • Highest performance Large Volume ETL/ELT and Data Transformation ETL/ELT • Fast, simple Oracle Enterprise Data development Customer Quality Product Data Data • Cleansing & matching for any dataCertified for Certified for 100s of 100s of Sources Targets
  • 4. DIS products vs. “out of the box”… DIS OracleOracle OOTB Difference? strategic products - HeterogeneousStreams Oracle GoldenGate - Scalability, performance, reliability Maintenance - Best Productivity Mode - Increased ROIOWB Oracle Data Integrator - Broader support/heterogenity - Best productivity & scalability Maintenance Mode
  • 5. Oracle – “Excellent Product Viability” Weight IBM Oracle Inform- iWay SAP SAS Micro- -ing atica soft Bulk data movement 55% 5.0 4.5 5.0 4.1 4.6 4.3 4.3 Federated views 15% 3.9 3.0 3.9 3.7 4.2 3.4 2.2 Message-oriented movement 10% 4.5 3.7 3.3 4.1 3.2 2.0 3.7 Oracle GoldenGate Data replication and Gartner 5.0 out of 5.0 synchronization 20% 4.6 5.0 4.5 2.9 Clearly the Industry Leader 2.9 4.0 3.0 in Data Replication and Synchronization Total Rating 18 16.2 16.7 14.8 16 12.7 13.1 Weighted Rating 4.705 4.295 4.565 3.8 4.28 3.675 3.645Source: Gartner Critical Capabilities for Data Integration Tools: Common Data Delivery Styles, Dec 2010(showing top 7 of 11 vendors in chart above)
  • 6. Oracle GoldenGate’s Modular Architecture Trail Trail Capture Pump Delivery Source TargetOracle & Non-Oracle Bi-directional Oracle & Non-Oracle Database(s) Database(s) Benefits: • Non-intrusive, low-impact, sub-second latency • Supports heterogeneous sources and targets • Maintains transactional integrity - Resilient against interruptions and failures
  • 7. Data Integration Needs ORTIME REQUIRED FOR THE END NO OF CPUs REQUIRED FOR ESTIMATED COSTS FOROF DAY PROCEDURE Daily load time can SAME PERFORMANCE* SERVER AND LICENSE** reach 5 days withHours No Of Required CPUs Required No. Estimated Cost of Purchase in USD the current HW CPUs can be Costs can be140 120 $3 doubled Oracle License doubled Millions120 Disaster Recovery Test Costs 100 $2100 and Development Hardware Costs 80 80 $2 Primary Site 60 60 $1 40 40 $1 20 20 0 $- Year1 Year2 Year3 Year4 Year5 0 Year1 Year2 Year3 Year4 Year5 Year1 Year2 Year3 Year4 Year5Currently during the End Of Dayutilizes the Server CPU by 40-50%and the IO by 90%. Probably the IOis the bottleneck.
  • 8. Oracle GoldenGate 11g Supported PlatformsDatabases O/S and PlatformsOracle GoldenGate Capture:  Oracle Linux  DB2 LUW Sun Solaris  DB2 z/OS  Microsoft SQL Server Windows  Sybase ASE HP NonStop  Teradata HP-UX  Enscribe IBM AIX  SQL/MP & SQL/MX  MySQL IBM z Series  JMS message queues zLinux C-tree AS/400Oracle GoldenGate Delivery: iSeries  All listed above, plus:  TimesTen, IBM System I, Netezza & Greenplum  ETL product 8
  • 9. Oracle GoldenGate’s Transaction Integrity• Capture, Pump, and Delivery save positions to a checkpoint file so they can recover in case of failure Start of Oldest Open (Uncommitted) Transaction Begin, TX 1 Insert, TX 1 Begin, TX 2 Begin, TX 2 Pump Delivery Begin, TX 2 Checkpoint Checkpoint Update, TX 1 Insert, TX 2 Insert, TX 2 Insert, TX 2 Commit, TX 2 Commit, TX 2 Commit, TX 2 Capture Current Current Current Begin, TX 3 Checkpoint Read Write Read Begin, TX 3 Insert, TX 3 Position Position Position Insert, TX 3 Commit, TX 3 Current Begin, TX 4 Write Commit, TX 3 Position Delete, TX 4 Current Read Position Commit Ordered Commit Ordered Delivery Capture Pump Target Trail Source TrailSource TargetDatabase Database
  • 10. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG CEP Solutions/Apps Integration
  • 11. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG CEP Solutions/Apps Integration
  • 12. Benefits of Query Offloading using Oracle GoldenGateReduce the workload on production• Annual amortization of HW purchase 250 000 USD (1 000 000 USD per 4 years)• Annual HW maintanence 100 000 USD• Annual SW maintance 200 000 USD• Energy, floor space 200 000 USD• Overall 800 000 USD• As there are 36 CPUs, Annual cost 22 000 USD per CPU• Overhead 8% with other solution• Overhead 3% with GoldenGate• Cost of overhead 64 000 USD vs 24 000 USD• Savings 40 000 USD per yearAlternative option for target server• DB software first option 100 000 USD, DB software second option 50 000 USD,• Annual DB software support 22 000 USD vs 11 000 USD
  • 13. Operational Reporting for Oracle Applications• Certified for Operational Reporting using Oracle GoldenGate • Oracle E-Business Suite v12.x and higher • Oracle JD Edwards v9.x and higher • Oracle PeopleSoft Enterprise v8.51 and higher • Oracle Siebel CRM v8.x and higher• Knowledge Documents on Oracle Support • Detailed Overview, Key Features, and Limitations• Ongoing Enhancements and Further Integration
  • 14. GoldenGate and Physical ReplicationUsing GoldenGate for data replication offers substantial advantages over thetraditional physical replication approaches: Physical Replication TDM Like-to-like databases and platforms Heterogeneous databases and platforms One-to-one topology with all-or- Many-to-many topology with selective and nothing data replication optimized data movement No transaction integrity Guaranteed transaction integrity Data corruption propagated to target Data corruption is isolated at source No rollback or point-in-time recovery Selective and dynamic rollback with advanced point-in-time recovery Target system unavailable for data Both source and target systems are available processing No data transformation capability Data transformation and enrichment Geographic distance limitation No distance limitations between data source and target
  • 15. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG CEP Solutions/Apps Integration
  • 16. Maximum Availability + Computing Capacity at the same time APPS ONLY REPORTING APPS APPS
  • 17. Maximum Availability + Computing Capacity at the same time ONLY APPS APPS REPORTING APPS APPS
  • 18. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG CEP Solutions/Apps Integration
  • 19. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG CEP Solutions/Apps Integration
  • 20. Reusability of licenses Available – no issues• Planned outage • Semi-available • Upgrade • Performance • Migration issues • Maintenance • Unplanned outage • System failure • Data failure
  • 21. Reusability of licenses Available – no issues• Planned outage • Semi-available • Upgrade • Performance • Migration issues • Maintenance • Unplanned outage • System failure • Data failure
  • 22. Reusability of licenses
  • 23. Reusability of licenses
  • 24. Reusability of licenses
  • 25. Oracle GoldenGate 11g for Oracle Applications• Oracle GoldenGate for Application Upgrades & Migrations • Siebel CRM (V6 – V8 upgrading to V8.x) • All platforms (Oracle, DB2(LUW & z/OS) & MSSQL) • Also available to support Siebel Remote and incremental application repository zero downtime releases. • JDE (all versions) • Low downtime (not zero) upgrade solution • All platforms except iSeries are supported. (iSeries is on the roadmap) • SAP (Oracle to Oracle Online Migrations aka “Triple-O”)
  • 26. Reduced risk for SAP migrations SAP Note 1508271 GoldenGate process can continue running for as long as needed to ensure that target system is optimized for use – Migration scripts are created to no time limits create new DB, table-space and implement GoldenGate and allow verification Migration scripts are executed against the target/new implementation and large tables are transferred directly to new DB Existing SAP New SAP implementation implementation Analysis and script generation using Capture PL/SQL Source Trail Target Trail Delivery Oracle 9i or above Oracle 11g GoldenGate delivery Existing Platform Installation and commencement commences into new database New Platform of real-time GoldenGate transactional data capture does with optimization to support not require system downtime migration needs and has limited impact on production system performance (“remote capture” Final switch over takes place – can be used if needed) SAP tasks are undertaken and production users move to migrated system• Minimum Oracle database version for the production system is 9.2.0.8• Oracle version on the target can be 10.2 or 11.2 and any UNIX, Linux or Windows platform is supported• All SAP products and solutions where Oracle database is certified are supported (such as R/3, BW, CRM or XI)• Supplemental Logging must be enabled on the source database prior to Oracle GoldenGate implementation• The source Oracle database cannot contain any OLTP compressed tables
  • 27. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG CEP Solutions/Apps Integration
  • 28. Which value does solution like GoldenGate bring? But if customer already sees this value, and if we compete here• with someone, as such solution GG is unbeatable :-70% Reduce downtime (end user productivity and -70% -80% customer satisfaction ) by 70%• Reduce migration and recovery effort by 80% Performance• Reduce source system overhead (and costs for stronger HW) by at least 70%• Decrease TCO because of report server by GoldenGate as a 80% platform for all use cases• Communication Cost Savings by 10% No such solution Flexible & Extendable• Global optimization of resources as having real time insight in regional capacities• Avoiding data loss• Consolidating and modernizing into more efficient systems Reliable
  • 29. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG CEP Solutions/Apps Integration
  • 30. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations ODI OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading Reporting Database OGG ODI ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG ODI CEP Solutions/Apps Integration
  • 31. Data Integration Needs Analytics Business Custom Packaged IntelligenceReporting Applications Enterprise Performance Data Replication Data Data Migration Warehousing Data Data Silos Data Marts Federation Data Hubs Data Access Batch Scripts SQL Custom Java OLTP & ODS Oracle Files Systems Data PeopleSoft, Siebel, SAP Excel OLAP Warehouse, Data Mart Custom Apps XML
  • 32. Oracle Data Integrator How it works ODI Data Services ODI Declarative Design Data Access Transformation Batch Data ODI Declarative Design Service Service Service ODI Agent 1 2 Data Flow Conductor Define Automatically What Generate You Want Dataflow ODI Knowledge Modules Define How: Built-in Templates Reverse Journalize Load Check Integrate Service Engineer Read from From Constraints Transform Expose Data Metadata CDC Source Sources to before Load and Move to and Staging Targets Transformati ODI E-LT Reverse on Services W W W S S S Staging Tables Load Integrate Services CDC Journal Check Target Tables Sources ize Error Tables Transform Transform Extract LoadSample out-of-the-box Knowledge Modules SQL Oracle Oracle JMS Check MS TPump/ Oracle SAP/R3 Log Miner Server Web DBLink Queues Excel Multiload Merge Triggers Services Oracle DB2 DB2 Check Type II Siebel EIM DB2 Web Siebel SQL*Load Journals Exp/Imp Sybase SCD Schema Services erBenefits
  • 33. Differentiator: Broad Connectivity Variety of Different Kinds of Systems • Ariba •DB & Application KMs • AXIOM mx/open • IDAPI IMS/DB(*) Content Adapters • IDS-II • IMS/TM (*) • Generic SQL DB • Baan • • ImageSQL • Software AG Natural DEC WPS Plus • Oracle DB 9i • BroadVision • • Informix(*) • Tuxedo(*) Display Write 2, 3, 4 & 5 • Oracle DB 10g • Clarify • • Ingres • Unisys DMS 1100/2200 Enable (Writer & Spreadsheet) • Oracle DB 11g • Commerce One • • MicroFocus Cobol • VSAM(*) First Choice • IBM DB2/400 • Hogan Financials • Framework • IBM DB2/UDB • Microsoft Access • i2 Technologies • Microsoft SQL Server(*) Tech Adapters • IBM Writing Assistant • IBM Informix SE • Lawson • Lotus Manuscript • IBM LDAP Server • MUMPS • ActiveX • Livelink • Navision Financials • Lotus AMI/AMI Professional • MS SQL Server 2000 • • AQ(*) LotusNotes • Nucleus • Microsoft Word & Works • MS SQL Server 2005 • • COM / DCOM Manugistics • OpenIngres • MultiMate • MS SQL Server 2005 SE • • CORBA Microsoft CRM • Oracle(*) • Novell WordPerfect • MS Office Access 2000 • • Email Vantive • Paradox • Office Writer • MS Office Excel 2000 • • Flat Files(*) Walker Interactive • Pointbase • PFS: Write • MS Active Directory • • FTP(*) Remedy • PostgreSQL • Total Word • Sybase ASA 8.x & 9.x • • HTTP / HTTPS Sales Force • Progress • Wang PC (IWP) • Sybase IQ 12.x • IBM MQSeries(native) • • WordMARC • Sonic MQ v7.0 Data Adapters Quattro Pro Windows v5 • JMS(*) • WordStar • Teradata V2R5.x • AccountMate S • Rbase (ODBC 3.x) • Microsoft DTS • • Rdb • JustSystems Ichitaro • Teradata V2R6.x ALLBASE/SQL • MS MQ (Native) • Alpha Four • Red Brick • JustWrite • Teradata v12 • NET • Apache Common Logfile • RMS • Adobe FrameMaker • Netezza PerformanceServer 2.2.1 • Oracle Advanced Queues • BizTalk XML • Statistica • Lotus Word Pro • Hyperion Essbase • RPG • Btrieve DDF • SUPRA • Microsoft Write • PostgresSQL 8.1 • Socket • Clarion • Sybase(*) • Microsoft Word • MySQL 4.0 • Telnet • Clipper • Teradata • Microsoft WordPad • MySQL 5.0 • Tibco Rendezvous (Native) • Cloudscape • UniVerse • Microsoft Works • Oracle BI Suite 10g • MacWrite II • Oracle BAM 10g • Data Junction Logfile • Velocis (ODBC 3.x) • DataEase • Visual dBase 5.5 B2B Standards • Microsoft Word (Mac) • Oracle Internet Directory 9i • Novell Perfect Works • OpenLDAP 2.3 • DataFlex (ODBC 3.x) • Visual FoxPro • EDI • IBM DB2 • XDB • OpenOffice Writer • Siebel CRM 7.8 • UCCNet • DB2/400 • Professional Write Plus • JD Edwards • RosettaNet • DBASE • StartOffice Writer • PeopleSoft • CIDX • Dialog • WordStart • SAP R/3 Legacy Adapters • PIDX • Dodge Bidders • Lotus 1-2-3 • Oracle EBusiness Suite • VICS • Enable • Adabas • Lotus Symphony • Oracle AQ 10g • ebXML • DB2 (*) • Bull TDS • Microsoft Excel (all versions) • Oracle SOA Suite • UBL • ERWIN • Bull TP8 • Mosaic Twin • Oracle ESB 10g • UN/EDIFACT • Essbase • CA-Datacom • Novell Perfect Works (SS) • SalesForce.com App Exchange • X12 • Excel • CA-IDMS/DB • OpenOffice Calc • Any JMS Standard Implementation • X12, Property & Casualty • eXcelon • CA-IDMS/SQL • PFS: Professional Plan • X12, HIPPA • FOCUS Data Access • • Quattro Pro (DOS)Application Adapters C-ISAM (Informix) • X12N, Life & Annuity • Folio Flat File T • • Quattro Pro (Win) C-ISAM (Microfocus) • X12N, Healthcare • Oracle Applications (*) • Foxbase+ • • SmartWare II C-ISAM ACCUCORP • NCPDP SCRIPT • SAP(*) • FoxPro • • StarOffice Calc CICS(*) • HL7 • Peoplesoft(*) • GoldMine • • SuperCalc 5 D-ISAM • OAG • J.D.Edwards(*) • Great Plains • • VP Planner 3D Hitachi HiRDB (ODBC) • cXML • Siebel(*) • Hitachi HiRDB (ODBC) • xCBL
  • 34. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations ODI OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading Reporting Database OGG ODI ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG ODI CEP Solutions/Apps Integration
  • 35. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations ODI OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading Reporting Database OGG ODI ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG ODI CEP Solutions/Apps Integration
  • 36. ODI Outperforms Informatica for Less • Run ODI Directly on Exadata • Complex Data Transformations ODI • Linear ETL Scalability E L T 7tb/hr • Fully Leverages 7.5 TB /hr $0 ETL H/W DBFS/Infiniband, Smart Storage, and Advanced 4:1 $5m 3yr 1 Exadata X2-8 Compression advantage* savings** Informatica 1.8 TB /hr $5m ETL H/W E T 1.8 tb/hr L* TPC-H data sets with transformations** Production hardware savings (not including Dev + Test environments, management costs or HP Superdome 64 + software savings) XP24000 w/ Flash Copyright © 2011, Oracle Corporation and/or its affiliates
  • 37. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations ODI OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading Reporting Database OGG ODI ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG ODI CEP Solutions/Apps Integration
  • 38. ODI EE and SAPConnection to SAP SAP Versions Availability Support Level NotesOracle SAP Adapter ERP 3.1h – ECC 6.0 Available Oracle Certified & May use with SOA Suite(iWay) SAP Certified or ODI-EE; optimal for Transaction style i/o.ODI KMs for Files BW 3.5 – BW 7.0 Available Oracle Certified Use with OpenHub while integrating using filesODI Web Services ECC 6.0 and higher Available Oracle Certified Confirmed to work with SAP Web ServicesODI Tools for iDocs ERP 4.6c – ECC 6.0 Available Oracle Certified Read & Write to iDocODI KMs for ERP SAP 4.6c – ECC 6.0 Available Oracle Certified Best for high-perf dataABAP extraction (read-only). Used with BI Apps.ODI KMs for BW BW 3.5 – BW 7.0 Available Oracle Certified Best for data extractionABAP from SAP BWOWB Connector – SAP 4.6c – ECC 7.0 Available Oracle Certified Best for OWB, may alsouse with OWB or ODI be used with ODI for staging to Oracle DBODI KMs for SAP ERP 4.6c & 4.7 Available Unsupported Best performance forDBMS data extraction, but may violate some SAP Licenses. Use with caution.
  • 39. Understanding Performance Choices Less than 10MB XML File DBDepends on whether anintermediary XML format XML ESB ESB ESBis useful for otherprocessing (use ESB), orif joining File data to File ESB ESB dependstabular RDB data isrequired (use ODI) DB ESB depends ODI Between 10-50MB XML File DBDepends on ho muchcross-referencing XML ESB depends ODIamong the data valuesand rows is requiredduring transformation – File depends ODI ODIthe more there is, thefaster ODI will perform DB ODI ODI ODIrelative to ESB Greater than 50MB XML File DBIf the source and targetare both XML, and there XML depends ODI ODIis no cross-referencingof data amongrows, then a streaming- File ODI ODI ODItype or parallel-engine-type approach mightscale DB ODI ODI ODI
  • 40. Which value does solution like Oracle Data Integrator bring? But if customer already sees this value, and if we compete here +50%• with someone, as such solution, ODI is : Reduce development and maintianice costs -30% -70% by at least 30%• Improve the speed of handling data by at least 50% Faster• Improve business process execution times by at least 70%• Decrease the cost o of ETL HW by 100% ODI as platform for• Decrease TCO (because of unified platform all use cases and single vendor) by 80% Simpler No such solution• Agility, enable rapid response to business needs• Customer Intimacy• Consolidating and modernizing into more Saves Money efficient systems (Lower TCO, Higher ROI)
  • 41. Oracle Data Integration SolutionsUse Cases Migrations&Consolidations EDQ ODI OGG ADG Zero Downtime Migrations & Upgrades Heterogeneous Disaster Recovery New DB/HW/OS/APP Source Systems OGG ADG Active/Active High Availability Fully Active Distributed DB ADG OGG ADG Query Off-Loading And Disaster Recovery Reporting Database OGG ODI EDQ ADG BI&DW Synchronization and Loading Data Warehouse OGG ODI Data Distribution Global Data Centers Batch Int. EDA/SOA Int. BPM OGG ODI CEP Solutions/Apps Integration
  • 42. Typical Customer Data Problems Missing, inconsistent, unstructured, mis-classified Abbreviations Attributes non-standard, Inconsistent formats (often ambiguous) missing or invalidCustomer ID Customer Name Address 1 Address 2 City State Zip Country Birth Date GenderAD23298 Mr Peter Mayhew 9407 Main St Fairfax VA 22031-4001 USA 02/23/61 MVS38611 Dr Ellen Van Der Heijde 144 E Grove St Kingston PA 18704 US 07/12/57DC18223 Jalila Abdul-Alim (Do Not Call) 4548 Pennsylvania Ave Apt 205 Kansas City MO 64111-3349 USA 02/23/63 F WidespreadCO9387A Tayside Computers Inc. 4912 E 41st N Idaho Falls ID 83401 USA 31/03/2007 N/A duplicationTZ35019 Mr Zachary P Jahn 98-1731 Ipuala Loop Aiea Hawaii 96701 1710 United States 06/12/86 Male (often hardCB27843 Mrs Edith Y Baba Junior Baba Real Est. Corp. 209 Stony Point Trl Webster NY USA 11/17/1971 M to spot)OX80306 Andrew & Mary Baxter 14 Oxbridge Way Milfrod NH 03055-4614 US 05/28/67 FJP70210 Mr RJ & Mrs FB MacDonald 57 Hadleigh Close Westlea Swindon SN5 9BZ MA - USA - YRD48107 Mr Andy Baxter 14 Oxbridge Wy Milford NH 3056 USA 01/01/01 M Compound Names Mis-Fielded Data Embedded Additional Information Erroneous Data Mixed Business & Personal Names International Date Formats Multiple Names Default or Dummy Data
  • 43. The Product Data Problem – Unstructured & Non-Standard What is this? 10hp motor 115V Yoke mount MOT-10,115V, 48YZ,YOKE mtr, ac(115) 10 horsepower 115volts Item Motor Classification 26101600 This 10hp yoke mounted motor is rated for Power 10 horsepower 115V with a 5 year warranty Voltage 115 Mounting Yoke 10 Caballos, Motor, 115 Voltios TEAO HP = 10.0 1725RPM 115V 48YZ YOKE MTR Product data is much more variable and unpredictable than other data types Motor, TEAO, 1725 RPM, 48YZ, 15 Voltios, Montaje de Yugo, hp = 1043
  • 44. Value to key industries • Single view of high quality customer data drives accurate customer insight Financial and improved marketing effectiveness Services • Supports compliance and reporting KYC requirements • Harmonizes customer data from multiple channels to improve sales and Retail marketing effectiveness • Enhances opportunity and customer lifetime value identification • Improves customer insight for revenue optimization and targeted customer Telco retention • Effective compliance and risk mitigation for next generation services • Expands understanding of network assets and customer delivery points UtilitiesEnergy & Utilities • Improves management of regulatory compliance and reporting requirements • Delivers a comprehensive view of patient for care and billing Healthcare • Manages patient, epidemiology, diagnosis and treatment data quality across systems and organizations • Single view of citizen for better internal information sharing, service Government delivery, licensing, provision of child care, and fraud detection • Reduce costs through system rationalisation 44
  • 45. Key features• Comprehensive DQ Functionality with a single UI and Repository
  • 46. Oracle Enterprise Data Quality – ProfileInteractive exploration of data, identifying distribution and outlying values with drill-downs
  • 47. Oracle Enterprise Data Quality – CleanName: Dr Ellen Van Der Heijde Name: Mr RJ & Mrs FB MacDonald Name: Jalila Abdul-Alim (Do Not Call) Title: Dr First: Jalila First: Ellen Title: Mr Title: Mrs Last: Abdul-Alim Last: Van Der Heijde First: R First: F Gender: Female Gender: Female Middle: J Middle: B Note: Do Not Call Last: MacDonald Last: MacDonald Gender: Male Gender: Female Name: Ms April James DBA AJ Designs •Standardize, Transform and Parse •Split names and name Title: Ms First: April Company: AJ Designs elements Last: James Gender: Female •Identify individuals and businesses •Derive additional attributes Not just names but any data such as addresses, dates & phone numbers
  • 48. Oracle Enterprise Data Quality – Match First: Bob Last: Fulmar Gender: Male Email: chem291_rjf@barker.edu Title: Mr Title: Dr First: Robert First: R Last: Fulmar Last: Fulmer Gender: Male DoB: 01/01/1978 DoB: 12/05/1978 Email: chem291_rjf@barker.edu Phone: 555-120-1329 Address: Address: 9407 Main Street 9405 Main St Fairfax Fairfax VA Virginia 22031-4001 22030 Title: Dr First: Robert Last: FulmarMatch & Merge data Gender: Male DoB: 12/05/1978 from disparate Email: chem291_rjf@barker.edu Phone: 555-120-1329 Match Individuals sources Address: Match Households 9407 Main St Create the ‘best’ Fairfax Match Businesses record VA 22031-4001
  • 49. Transformations• Fully configurable data transformation rules• Operates in both Batch and Real-Time• Full control over data updates• Original data always preserved (and all steps in between)• Source data may either be staged and processed or „streamed‟ through the processUse profiling results to create Use provided processors for your own data improvement common tasks such as rules address standardization
  • 50. Reporting• Results Browser
  • 51. Q&A51 Copyright © 2011, Oracle and/or its affiliates. All rights Insert Information Protection Policy Classification from Slide 7 reserved.
  • 52. 52 Copyright © 2011, Oracle and/or its affiliates. All rights Insert Information Protection Policy Classification from Slide 7 reserved.
  • 53. 53 Copyright © 2011, Oracle and/or its affiliates. All rights Insert Information Protection Policy Classification from Slide 7 reserved.