Partner webcast - Oracle Data Integration Solutions for Partner Business - 23 May 2013
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Partner webcast - Oracle Data Integration Solutions for Partner Business - 23 May 2013

on

  • 641 views

As there is such a fast growth of planned data integration projects, estimation of the available and free market share is more than 80% at the moment. Adoption of both, Oracle Data Integrator and ...

As there is such a fast growth of planned data integration projects, estimation of the available and free market share is more than 80% at the moment. Adoption of both, Oracle Data Integrator and Oracle GoldenGate, continues to grow rapidly within the Oracle DBMS and applications customer base. This gives significant services and license resale opportunity for Oracle partners.
And finally, after placing significant engineering investments in these products we are preparing launch of new, consolidated and updated Oracle Data Integration specialization!


Both through our webcasts and the EMEA-wide DIS Community @ oracle.com/partners/goto/dis-emea,
we would like to prepare you for quick start. Participating in specialization beta testing you can be in the first group to reach this strategic Oracle specialization between all worldwide experts. Oracle has ready official recognition for such achievement!

Read More https://blogs.oracle.com/imc/entry/partner_webcast_oracle_data_integration1

Statistics

Views

Total Views
641
Views on SlideShare
639
Embed Views
2

Actions

Likes
0
Downloads
23
Comments
0

2 Embeds 2

http://digg.com 1
http://cloud.feedly.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Partner webcast - Oracle Data Integration Solutions for Partner Business - 23 May 2013 Presentation Transcript

  • 1. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.1CUSTOMER LOGO“This slide format serves to call attention to aquote from a prominent customer, executive, orthought leader in regards to a particular topic.” Name Title, Company Nameblogs.oracle.com/IMC
  • 2. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.2
  • 3. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.3Why Oracle Data IntegrationSolutions?Milomir VojvodicSenior Business Development Manager
  • 4. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.4Agenda Data Infrastructure Evolution AndOracle Response Oracle GoldenGate Oracle Data Integrator Enterprise Data Quality
  • 5. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.5EMEA DIS Partner Communitywww.oracle.com/partners/goto/dis-emeaJoin Us!
  • 6. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.6New DB/HW/OS/APPFully Active DBReporting Database and/or DR databaseData WarehouseOGGOGGOGG ADGOGGZero DowntimeMigrations & UpgradesActive/Active HighAvailabilityQuery Off-Loadingand Disaster RecoveryBI&DWSynchronization and LoadingMigrations & ConsolidationsODIODI4 Products Of Oracle Data Integration SolutionsEDQEDQOracle GoldenGateReal Time Replica Between AnyDatabasesOracle Data IntegratorETL PlatformActive Data GuardDisaster Recovery Of Oracle DB EEEnterprise Data QualityData Quality Platform
  • 7. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.7# of integration scenariosPoint-to-point integrationarchitectures cannotkeep up with businessgrowthand represent weak linksin mission criticalintegration scenarios. 0501001502002503002 Apps 4 Apps 6 Apps 8 Apps 10 Apps 12 Apps 14 Apps 16 Apps 18 Apps 20AppsP2P Integration DI ToolingExponential Chaos
  • 8. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.8 IBM DB2 UDB IBM DB2 z Series IBM DB2 i Series Enscribe SQL/MP SQL/MX MySQL Sybase ASE Informix JMS Teradata NetezzaSample list of Sources and Targets Oracle Database Oracle Exadata Oracle Big Data Appliance Enterprise Data Quality Oracle E-Business Suite JD Edwards Enterprise One Oracle Enterprise Service Bus Oracle Hyperion Oracle OLAP Oracle PeopleSoft Oracle Siebel CRM Oracle Communications BRM Hadoop Sybase IQ TimesTen, PostgreSQL Greenplum, HP Neoview SAS SalesForce SAP ERP & BW Generic SQL Hypersonic SQL Microsoft SQL Microsoft Access Oracle BI EE Oracle BI Apps Linux Sun Solaris Windows 2000,2003, XP HP NonStop HP-UX IBM AIX zLinux …Oracle Data Integration Solutions
  • 9. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.9Oracle (Source) Oracle (Target)ApplyASMRedo/Archive LogsCaptureLGWR126745 8TrailCapture DeliveryNative TCP/IP1 2 33ASMRedo/Archive LLOGMINER LGWR91045Source Server(CPU %)Through-put(ops/sec)Streams Latency(secs)GGS Latency(secs)~80% 8,000 6 2.7~45% 5,000 2.7 1.5~20% 2,500 2 1.3Features OWB basic ODI-EEOracle DB Targets Y YNon-Oracle Sources Oracle Gateways YSlowly Changing Dimensions (type 1) Y YOLAP Targets (Oracle + Essbase) Oracle OLAP only YBuilt-in Scheduler Oracle DBMS only YNon-Oracle DB Targets - YChanged Data Capture (including OGG integration) - YWeb Services (API & Src/Trgt) & XML Targets - YData Lineage / Impact Analysis - YDeclarative Design Environment - YSlowly Changing Dimensions (2 & 3) - YLoad Plans, Parallel Execution and Restartability - YJEE Deployment , Clustering and High Availability - YJava based SDK for full Programmatic Control - YUnified Management and Administration with OEM - YPre-built Integration with OBI-EE, Hyperion, SOA/AIA, etc. - YOWB missing thesefunctionalities. ODIhas them!Streams 8000 throughput in 6seconds. OGG 2.7 seconds!Streams 9 steps configuration.OGG 5 steps!Roadmap For Streams & OWB
  • 10. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.10Working with dimensional objectsAre you creating Slowly changing dimensions type 2 or 3? Y/NAre you storing data in OLAP cube-organized materialized views? Y/NAre you defining orphan management policies? Y/NIntegrating with other productsAre you deploying metadata directly to Oracle Discoverer End User Layer? Y/NAre you deriving and deploying metadata to Oracle Business Intelligence Enterprise Edition? Y/NAdministering Warehouse Builder and its metadata repositoryAre you managing environments, including promoting from development to test to production, using the multiple configurations functionality? Y/NAre you interactively analyzing metadata lineage and impact and automatically propagating metadata change using the Metadata Dependency Manager? Y/NAre you extending the metadata repository using the following: user-defined objects, user-defined associations, user-defined modules, creating icon sets and custom icons Y/NAre you hosting the OWB design repository in an Oracle Real Application Clusters (Oracle RAC) environment (executing in an Oracle RAC does not require this license)? Y/NAccessing sources and targetsDo you use native support for heterogeneous databases, including the definition of new platform types, JDBC connectivity, knowledge modules, and code templates? Y/NDo you use Change Data Capture mappings in ETL? Y/NAre you Publishing and consuming web services, including integrating with process orchestration technologies such as Oracle BPEL Process Manager? Y/NAre you Importing Cobol copybooks using the built-in wizard? Y/NAre you Targeting XML files? Y/NDesigning and executing ETL jobsAre you utilizing right-time data warehousing queues and real-time mappings? Y/NAre you reusing and embedding mapping code with pluggable mappings? Y/NAre you specifying the load order of multiple targets in a single mapping? Y/NAre you partitioning and parallelizing updates to tables by utilizing the data chunking feature? Y/NAre you scheduling ETL jobs using the built-in Schedule interface? <<-- note: use of other schedulers with OWB is supported and does not require the ODI-EE license Y/NAre you using advanced process flows features (activity templates, Assign, Set Status, For Loop, While Loop, Route, Notification, EJB, Java Class, and Webservice)? Y/NAre you designing mappings to handle complex types using the following operators: array iterator, construct object, and expand object? Y/NAre you rapidly moving large amounts of data with transportable modules? Y/NAre you using spatial transformations and streams transformations? Y/NRoadmap For Streams & OWB
  • 11. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.11Oracle GoldenGatehttp://www.oracle.com/us/products/middleware/data-integration/goldengate/
  • 12. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.12• Leader in real-time data integration solutions• Over 2100 customers as of 2012 includingFortune 500 companies, representing FinancialServices, Communications, Healthcare, PublicSector, Retail, Utilities industries• 4 of top 5 largest commercial banks• 3 of top 3 busiest ATM networks• 5 of top 5 financial data services companies• 5 of top 5 telecommunications providers• 3 of top 5 largest food & drug storesOracle GoldenGate – World Wide Success
  • 13. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.13Target DBOGGSource DBWhat is OGG?
  • 14. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.14New DB/HW/OS/APPFully Active DBReporting Database and/or DR databaseData WarehouseOGGOGGOGG ADGOGGZero DowntimeMigrations & UpgradesActive/Active HighAvailabilityQuery Off-Loadingand Disaster RecoveryBI&DWSynchronization and LoadingMigrations & ConsolidationsUse Cases Of OGG
  • 15. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.15Target DBOGGSource DBFirst OGG DifferentiatorAccessing directly transactionlogsSecond OGG Differentiator Movingonly committed transactionsWhy Is OGG Different?
  • 16. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.16TIME REQUIRED FOR THE END OF DAYPROCEDUREHoursNO OF CPUs REQUIRED FOR SAMEPERFORMANCE*No Of Required CPUsESTIMATED COSTS FOR SERVER ANDLICENSE**Estimated Cost of Purchase in USD050100150Year1 Year2 Year3 Year4 Year5Currently during the End Of Dayutilizes the Server CPU by 40-50%and the IO by 90%. Probably the IOis the bottleneck.020406080100120Year1 Year2 Year3 Year4 Year5Disaster Recovery Testand DevelopmentPrimary Site$-$1$1$2$2$3MillionsOracleLicenseCostsHardwareCostsDaily load time canreach 5 days withthe current HWORAlternative To Batch WindowFirst OGG DifferentiatorAccessing directlytransaction logs
  • 17. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.17Physical Replication OGGLike-to-like databases and platforms Heterogeneous databases and platformsOne-to-one topology with all-or-nothing data replication Many-to-many topology with selective and optimized data movementNo transaction integrity Guaranteed transaction integrityData corruption propagated to target Data corruption is isolated at sourceNo rollback or point-in-time recovery Selective and dynamic rollback with advanced point-in-time recoveryTarget system unavailable for data processing Both source and target systems are availableNo data transformation capability Data transformation and enrichmentGeographic distance limitation between data source and target No distance limitationsORSecond OGGDifferentiatorMoving onlycommittedtransactionsAlternative To Storage ReplicaBegin, TX 1Insert, TX 1Begin, TX 2Update, TX 1Insert, TX 2Commit, TX 2Begin, TX 3Insert, TX 3Begin, TX 4Commit, TX 3Delete, TX 4Begin, TX 2Insert, TX 2Commit, TX 2Begin, TX 3Insert, TX 3Commit, TX 3Begin, TX 2Insert, TX 2Commit, TX 2CaptureCheckpointPumpCheckpointDeliveryCheckpoint
  • 18. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.18Databases O/S and PlatformsOracle GoldenGate Capture: Oracle DB2 for v 9.7 DB2 for v 10 on z/OS Microsoft SQL Server for 2008 R1, R2 Sybase ASE, 15.5 Teradata Enscribe SQL/MP SQL/MX MySQL JMS message queuesOracle GoldenGate Delivery: All listed above, plus: TimesTen, IBM System I, Netezza & Greenplum ETL productLinuxSun SolarisWindows 2000, 2003, XP, 2008HP NonStopHP-UXIBM AIXIBM z SerieszLinuxNew in Oracle GoldenGate 11g Release 2 IBM i Series Postgres MySQL v 5.5 IBM AIX v7.1 Sun Solaris v11Oracle GoldenGate Supported Platforms
  • 19. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.19UnidirectionalQuery OffloadingZero-Downtime MigrationBi-DirectionalHot Standby orActive-Active for HAPeer-to-PeerLoad BalancingMulti-MasterBroadcastData DistributionIntegration/ConsolidationData WarehouseBPMBAMCEPData Distributionvia MessagingDirections
  • 20. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.20New DB/HW/OS/APPFully Active DBReporting Database and/or DR databaseData WarehouseOGGOGGOGG ADGOGGZero DowntimeMigrations & UpgradesActive/Active HighAvailabilityQuery Off-Loadingand Disaster RecoveryBI&DWSynchronization and LoadingMigrations & ConsolidationsUse Cases Of OGG
  • 21. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.21Product Needs To Be Available – No Issues• Need Planned Outage• Upgrade• Migration• Maintenance• Protect From Unplanned Outage• System Failure• Data Failure• Need Additional Computing Resources• Performance issues• GrowthReusability Of DIS Licenses
  • 22. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.22Reusability Of DIS Licenses
  • 23. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.23CustomerPlaceOrderTelephoneNetworkBillCustomerCustomerCareBillingCollectUsageSelf Care CRMCallCenterCustomersODIEDQBillingRRSR ODSODIOGGOGG OGG OGGRExample Of Telco DI Health CheckOGG
  • 24. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.24CreditCardsLoans,MortgagesFunds,AssetsBusiness UnitA MarketingSystemBusiness UnitB AccountingSystemGroup RiskManagementGroup RiskManagementCRMRegulatoryreportingStatutoryreportingManagementInformationSystemsCustomersAccounts…ODIEDQCore Banking(PaymentProcessing,Accounts)ODIRFraudDetectionOGG OGG OGGOGGOGGOGGOGGOGGOGGExample Of Bank DI Health Check
  • 25. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.25Analysisand scriptgenerationusingPL/SQLNew SAPimplementationExisting SAPimplementationCaptureSource TrailDeliveryTarget TrailMigration scripts are created tocreate new DB, table-space andimplement GoldenGate and allowverificationInstallation and commencement ofreal-time GoldenGate transactionaldata capture does not requiresystem downtime and has limitedimpact on production systemperformance (“remote capture” canbe used if needed)• Minimum Oracle database version for the production system is 9.2.0.8• Oracle version on the target can be 10.2 or 11.2 and any UNIX, Linux or Windows platform is supported• All SAP products and solutions where Oracle database is certified are supported (such as R/3, BW, CRM or XI)• Supplemental Logging must be enabled on the source database prior to Oracle GoldenGate implementation• The source Oracle database cannot contain any OLTP compressed tablesOracle 9i or aboveExisting PlatformOracle 11gNew PlatformMigration scripts are executedagainst the target/newimplementation and large tablesare transferred directly to new DBGoldenGate delivery commencesinto new database withoptimization to support migrationneedsFinal switch over takes place –SAP tasks are undertaken andproduction users move to migratedsystemGoldenGate process can continuerunning for as long as needed toensure that target system isoptimized for use – no time limitsSAP Note 1508271
  • 26. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.26Oracle Data Integratorhttp://www.oracle.com/us/products/middleware/data-integration/enterprise-edition/
  • 27. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.27New DB/HW/OS/APPFully Active DBReporting Database and/or DR databaseData WarehouseOGGOGGOGG ADGOGGZero DowntimeMigrations & UpgradesActive/Active HighAvailabilityQuery Off-Loadingand Disaster RecoveryBI&DWSynchronization and LoadingMigrations & ConsolidationsODIODIUse Cases Of ODI
  • 28. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.28OLTP & ODSSystems DataWarehouse, Data MartOraclePeopleSoft, Siebel, SAPCustom AppsFilesExcelXMLEnterprisePerformanceCustom Reporting PackagedApplicationsBusinessIntelligenceAnalyticsDataFederationDataWarehousingCustomData MartsData AccessData SilosSQLJavaBatch ScriptsData HubsDataMigrationDataReplicationOLAPReplacing Manual Coding
  • 29. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.29OLTP & ODSSystems DataWarehouse, Data MartOraclePeopleSoft, Siebel, SAPCustom AppsFilesExcelXMLEnterprisePerformanceCustom Reporting PackagedApplicationsBusinessIntelligenceAnalyticsOLAPOracle Data IntegratorReplacing Manual Coding
  • 30. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.30JournalizeRead from CDCSourceLoadFrom Sources toStagingCheckConstraintsbefore LoadIntegrateTransform andMove to TargetsServiceExpose Data andTransformationServicesReverseEngineerMetadataReverseJournalizeLoadCheckIntegrateServicesCDCSourcesStaging TablesError TablesTarget TablesWSWSWSSAP/R3SiebelLog MinerDB2JournalsSQLServerTriggersOracleDBLinkDB2Exp/ImpJMSQueuesCheck MSExcelCheckSybaseOracleSQL*LoaderTPump/MultiloadType IISCDOracleMergeSiebel EIMSchemaOracleWebServicesDB2 WebServicesSample out-of-the-box Knowledge ModulesBenefitsODI Knowledge ModulesODI Declarative DesignODI Declarative DesignDefine How : Built -in TemplatesDefineWhatYou WantAutomaticallyGenerateDataflow11 22Define How : Built -in TemplatesDefineWhatYou WantAutomaticallyGenerateDataflow11 22Define How : Built -in TemplatesDefineWhatYou WantAutomaticallyGenerateDataflow11 22DefineWhatYou WantAutomaticallyGenerateDataflow11 2211 22ODI E-LTStaging ServerData WarehouseOGG ODISecond ODI DifferentiatorODI Declarative Designand ODI KnowledgeModules for reusingalready written down levelSQL codeFirst ODIDifferentiatorTransformationsusing the power ofthe Target Database– no staging serverWhy Is ODI Different?
  • 31. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.31ODI Integrated ODI Embedded Pre-built ContentE-Business Suite 11i10 and higher   E-Business Suite Financials Integration   PeopleSoft 8.x and higher Siebel CRM 7.7 and higher Oracle CRM OnDemand   JD Edwards EnterpriseOne 8.x+ JD Edwards World A7.3 and higher Fusion CRM & CDI   Fusion Financials   Fusion Human Capital Management   Fusion Supply Chain Management   Fusion Application Migrations   Fusion GRC Controls   Fusion AIA (Demantra to Siebel)   Fusion AIA (LSH to Reporting)   Fusion AIA (CRM to On-Demand)   Fusion AIA (EBS to GLog)   Fusion AIA (Retek to EBS)   Retail Apps- Merchandise Fin. Planning   Retail Apps- Item Planning   Retail Apps- Assortment Planning   Retail Apps- Size Profile Optimization   Retail Apps- Planogram Importer   Retail Apps- Macro Space Management   Retail Apps- Retail Analytics   Agile Business Intelligence   Agile Data Warehouse   Agile PLM for Process   Agile Dataload   iFlex FlexCUBE   iFlex Mantas   Hyperion Planning  Hyperion Financial Management  Hyperion Profitability Mgmt  Hyperion Essbase Hyperion EPMA   BI EE Server  BI Applications (7.9.5.2 & 7.9.7)   BI Applications (11g PS1)   SOA - Business Activity Monitor  SOA - Complex Event Processor  SOA - Service Bus, Mediator & ESB SOA - BPEL Process Manager Oracle GoldenGate Oracle Internet Directory & OVD Oracle WebLogic JEE App Server Oracle Coherence Oracle MySQL Oracle Database SE & EE Oracle Exadata ODI Integrated ODI Embedded Pre-built ContentKey: ODI Integrated  ODI has special technical integrations or features to support the named Oracle Application / ComponentODI Embedded  ODI is included with the Oracle Application / Component with a special license type (eg: Restricted Use etc)Pre-built Content  the Oracle Application / Component is delivered with pre-built ETL mappings/content that run in ODI Generally Available RoadmapODI In Oracle Strategy
  • 32. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.32New DB/HW/OS/APPFully Active DBReporting Database and/or DR databaseData WarehouseOGGOGGOGG ADGOGGZero DowntimeMigrations & UpgradesActive/Active HighAvailabilityQuery Off-Loadingand Disaster RecoveryBI&DWSynchronization and LoadingMigrations & ConsolidationsODIODIUse Cases Of ODI
  • 33. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.33Build from Scratchwith Traditional BI ToolsBackBack--endendETL andETL andMappingMappingDW DesignDW DesignDefine MetricsDefine Metrics& Dashboards& DashboardsTraining &Training &RollRoll--outoutYears or quartersPrebuilt AnalyticApplicationsWeeks or monthsPrePre--built ETLbuilt ETLTailoringTailoringDW Design ModDW Design ModSpecific MetricsSpecific Metrics& Dashboards& DashboardsTraining & RolloutTraining & RolloutPrebuilt AnalyticApplicationsWeeks or monthsPrePre--built ETLbuilt ETLTailoringTailoringDW Design ModDW Design ModSpecific MetricsSpecific Metrics& Dashboards& DashboardsTraining & RolloutTraining & Rollout50%Number of Setup Steps 7Number of Servers 1Number of connections 3Number of Setup Steps 10Number of Servers 3Number of connections 7ODIINFAODI For Data Warehouse Projects
  • 34. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.34New DB/HW/OS/APPFully Active DBReporting Database and/or DR databaseData WarehouseOGGOGGOGG ADGOGGZero DowntimeMigrations & UpgradesActive/Active HighAvailabilityQuery Off-Loadingand Disaster RecoveryBI&DWSynchronization and LoadingMigrations & ConsolidationsODIODIUse Cases Of ODI
  • 35. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.351.8 TB /hr1 Exadata X2-87.5 TB /hr• Run ODI Directly on Exadata• Complex Data Transformations• Linear ETL Scalability• Fully Leverages DBFS/Infiniband, SmartStorage, and Advanced Compression4:1advantage** TPC-H data sets with transformations** Production hardware savings(not including Dev + Test environments,management costs or software savings)ODIInformatica7tb/hr1.8 tb/hrHP Superdome 64 +XP24000 w/ Flash$5m ETL H/W$0 ETL H/W$5m 3yrsavings**EE T LTLODI And Exadata
  • 36. 36 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.Source (MySQL)ORDERSLINESCORRECTIONSfileTarget (Oracle)SALESERRORSBusiness rules Filter- Take into account onlyORDERS marked as “closed.”Join- A row from LINES hasa matching ORDER_IDin ORDERS.Mapping- Target’s SALES is thesum of the order lines’AMOUNT grouped bysales rep. and thecorrections applied.Sales Rep = Sales RepID from ORDERSConstraints-ID cannot be null andmust be unique.The Sales Rep. IDshould exist in theTarget sales Rep table.A Business Problem
  • 37. 37 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.
  • 38. 38 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.Target (Oracle)SALESERRORSTransform andintegrateTEMP_SALESCheck constraints/Isolate errorsSource (MySQL)ORDERSLINESCORRECTIONSFileTEMP_1Extract/Join/TransformTEMP_2Extract/TransformJoin/Transform12345Process Details
  • 39. 39 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.
  • 40. 40 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.
  • 41. 41 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.
  • 42. 42 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.
  • 43. 43 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.Target (Oracle)SALESERRORSTransform andintegrateTEMP_SALESCheck constraints/Isolate errorsSource (MySQL)ORDERSLINESCORRECTIONSFileTEMP_1Extract/Join/TransformTEMP_2Extract/TransformJoin/Transform12345Process Details
  • 44. 44 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.Target (Oracle)SALESERRORSSource (MySQL)ORDERSLINESCORRECTIONSFileTEMP_1Extract/Join/TransformTEMP_2Extract/TransformJoin/TransformTransform andintegrateTEMP_SALESCheck constraints/Isolate errorsLKMLKMLKMCKMIKMProprietary Engine- Specific LanguageProcess Implementation
  • 45. 45 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.Generated codeTruncate Table SCOTT.EMPInsert into SCOTT.EMPSelect Round(Sum(Sal*Coeff)) …Begin … If .. Then … Elseftp ...Implemented rulesInc_net = Round(Sum(Inc * coeff))Knowledge moduleTruncate Table <%=odiRef.getTable(« »)%>Insert into <%=odiRef.getColList(…)%>Select <%=odiRef.getFrom()%> …Begin … If .. Then … Elseftp ...DesigntimeAgentRuntime Truncate Table SCOTT.EMPInsert into SCOTT.EMP…Other metadataTopologyModelsTechnology,and so onTargetsSourcesCode Generation
  • 46. 46 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.SQL filter expressionExecution locationExpression editorSave expressionCheck expression.Drag and drop a column on the background areaThen type the filter expressionFiltering Data
  • 47. 47 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.SQL join expression(technology dependant)Execution locationCreate temporary indexes forjoin columnsJoin order (ISO-92Syntax)Expression editorSave expressionValidate expressionAutomatically calculateorder• Joins can be defined across technologies (ie. database table and flat file)• The number of joins per interface is not limitedJoin typeInner/Outer, Left/Right.Cross, NaturalJoin
  • 48. 48 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.Target Columns (clickhere to open themapping field)Mapping expressions(read only)Type or edit yourmappingexpressions hereExpression EditorbuttonMappings
  • 49. 49 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.• Source and target systems are graphically represented in the Flow tab• This is where KM are chosen, and KM options are setGraphical Implementation Of The Flow
  • 50. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.50Oracle Enterprise DataQualityhttp://www.oracle.com/us/products/middleware/data-integration/enterprise-data-quality/
  • 51. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.51New DB/HW/OS/APPFully Active DBReporting Database and/or DR databaseData WarehouseOGGOGGOGG ADGOGGZero DowntimeMigrations & UpgradesActive/Active HighAvailabilityQuery Off-Loadingand Disaster RecoveryBI&DWSynchronization and LoadingMigrations & ConsolidationsODIODIUse Cases Of EDQEDQEDQ
  • 52. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.52Customer ID Customer Name Address 1 Address 2 City State Zip Country Birth Date GenderAD23298 Mr Peter Mayhew 9407 Main St Fairfax VA 22031-4001 USA 02/23/61 MVS38611 Dr Ellen Van Der Heijde 144 E Grove St Kingston PA 18704 US 07/12/57DC18223 Jalila Abdul-Alim (Do Not Call) 4548 Pennsylvania Ave Apt 205 Kansas City MO 64111-3349 USA 02/23/63 FCO9387A Tayside Computers Inc. 4912 E 41st N Idaho Falls ID 83401 USA 31/03/2007 N/ATZ35019 Mr Zachary P Jahn 98-1731 Ipuala Loop Aiea Hawaii 96701 1710 United States 06/12/86 MaleCB27843 Mrs Edith Y Baba Junior Baba Real Est. Corp. 209 Stony Point Trl Webster NY USA 11/17/1971 MOX80306 Andrew & Mary Baxter 14 Oxbridge Way Milfrod NH 03055-4614 US 05/28/67 FJP70210 Mr RJ & Mrs FB MacDonald 57 Hadleigh Close Westlea Swindon SN5 9BZ MA - USA - YRD48107 Mr Andy Baxter 14 Oxbridge Wy Milford NH 3056 USA 01/01/01 MInconsistent formatsAbbreviations(often ambiguous)Attributes non-standard,missing or invalidWidespreadduplication(often hardto spot)Compound NamesEmbedded Additional InformationMixed Business & Personal NamesMultiple NamesMis-Fielded DataErroneous DataInternational Date FormatsDefault or Dummy DataWhy EDQ?
  • 53. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.53Variation or Error Example Variation or Error ExampleSequence errors • Mark Douglas or Douglas MarkTranscriptionmistakes• Hannah, HamahInvoluntarycorrections• Browne – BrownMissing or extratokens• George W Smith, George Smith, SmithConcatenatednames• Mary Anne, MaryanneForeign sourceddata• Khader AL Ghamdi, Khadir A. AlGamdeyNicknames andaliases• Chris – Christine, Christopher, TinaUnpredictable useof initials• John Alan Smith, J A SmithNoise• Full stops, dashes, slashes, titles,apostrophesTransposedcharacters• Johnson, JhonsonAbbreviations • Wlm/William, Mfg/Manufacturing Localization • Stanislav Milosovich – Stan MiloTruncations • Credit Suisse First Bost Inaccurate dates• 12/10/1915, 21/10/1951, 10121951,00001951Prefix/suffix errors • MacDonald/McDonald/DonaldTransliterationdifferences• Gang, Kang, KwangSpelling & typingerrors• P0rter, Beht Phonetic errors • Graeme – GrahamWhy EDQ?
  • 54. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.54Product data are much more variableand unpredictable than other data types10hp motor 115V Yoke mountmtr, ac(115) 10 horsepower 115voltsMOT-10,115V, 48YZ,YOKEThis 10hp yoke mounted motor is rated for115V with a 5 year warranty10 Caballos, Motor, 115 VoltiosTEAO HP = 10.0 1725RPM 115V 48YZ YOKE MTRMotor, TEAO, 1725 RPM, 48YZ, 15 Voltios,Montaje de Yugo, hp = 10Item MotorClassification 26101600Power 10 horsepowerVoltage 115Mounting YokeWhy EDQ?
  • 55. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.55Identify and quantify issuesin dataEDQ Profiling
  • 56. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.56Entry Address :“300 Berry #1210 SF California”300Berry StUnit 1210San FranciscoCA94158-1670PremiseNumberThoroughfareNameSubPremiseLocalityAdministrativeAreaPostCode300Berry#1210SFCaliforniaParse ValidateEDQ Parsing (Standardization), MatchingTitle: MrFirst: RobertLast: FulmarGender: MaleDoB: 12/05/1978Phone: 555-120-1329Address:9405 Main StFairfaxVirginia22030First: BobLast: FulmarGender: MaleEmail: chem291_rjf@barker.eduTitle: DrFirst: RLast: FulmerDoB: 01/01/1978Email: chem291_rjf@barker.eduAddress:9407 Main StreetFairfaxVA22031-4001Title: DrFirst: RobertLast: FulmarGender: MaleDoB: 12/05/1978Email: chem291_rjf@barker.eduPhone: 555-120-1329Address:9407 Main StFairfaxVA22031-4001
  • 57. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.57
  • 58. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.58
  • 59. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.59SourcesTarget(s)E.g. DataWarehouse (Exadata)EDQOracleDataIntegratorOne-off ProfilingUnderstand data to buildODI transformationand mapping processes.Automated ProcessesMatching (de-duplication)and Parsing calledduring ODI data flow.Measure Ongoing DQAssess quality of datain target system. How wellis ETL working?ODI&EDQ
  • 60. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.60
  • 61. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.61
  • 62. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.62
  • 63. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.63
  • 64. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.64
  • 65. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.65
  • 66. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.66
  • 67. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.67
  • 68. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.68
  • 69. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.69
  • 70. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.70
  • 71. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.71
  • 72. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.72
  • 73. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.73
  • 74. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.74
  • 75. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.75
  • 76. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.76 A Match Rule is simply the combination of comparison results Rules are evaluated in order and if one hits, we stop Rules can be ‘negative’ to eliminate pairs that are too differentwith a ‘No Match’ rule Rules can easily be turned on & off during the tuning process
  • 77. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.77Clustering Avoids Unnecessary Work Only compare records with ‘some similarity’
  • 78. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.78DIS Specialization
  • 79. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.79DIS SpecializationNumber of Partners Reselling DIS Deal in Fy12New Consolidated And Complete DIS Specialization Criteriao DIS Sales Specialist Examo DIS Presales Specialist Examo ODI+EDQ Implementation Specialist ExamOROGG Implementation Specialist Examo ODI+EDQ Transaction OR OGG Transaction
  • 80. 80 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.Q&AJoin EMEA DIS Partner Community
  • 81. 81 Copyright © 2012, Oracle and/or its affiliates. All rightsreserved.
  • 82. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.82CUSTOMER LOGO“This slide format serves to call attention to aquote from a prominent customer, executive, orthought leader in regards to a particular topic.” Name Title, Company Namefacebook.com/OPN.PartnerHub.Migration.Centertwitter.com/oracleimc