• Save
NEOOUG 2010 Oracle Data Integrator Presentation
Upcoming SlideShare
Loading in...5
×
 

NEOOUG 2010 Oracle Data Integrator Presentation

on

  • 1,582 views

 

Statistics

Views

Total Views
1,582
Views on SlideShare
1,577
Embed Views
5

Actions

Likes
0
Downloads
0
Comments
0

4 Embeds 5

http://www.slideshare.net 2
http://www.lmodules.com 1
http://www.linkedin.com 1
https://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Oracle Data Integrator is the Oracle's new ETL tool, originally built by Sunopsis and now part of Oracle Fusion Middleware.
  • ODI supports ELT architecture Poor Performance due to the fact that it performs a row by row operation
  • Servers, schemas, filesystems, and agents. Information about the Infrastructure is stored in the Master Repository using this module.
  • http://john-goodwin.blogspot.com http://gerardnico.com/wiki/dit/odi/odi http://oraclebizint.wordpress.com/ http://www.business-intelligence-quotient.com/?cat=56 http://www.odiexperts.com http://www.rittmanmead.com/blog/ http://blogs.oracle.com/dataintegration/ http://askankit.blogspot.com

NEOOUG 2010 Oracle Data Integrator Presentation NEOOUG 2010 Oracle Data Integrator Presentation Presentation Transcript

  • Oracle Data Integrator NEOOUG May 21, 2010 Ankit Jain
  • Agenda ( Or how long do I have to stay here )
    • What is ODI ?
    • Why do I need ODI ?
    • Architecture (ELT and ODI)
    • ODI Modules
    • Peek into Knowledge Modules
    • Wrap Up
  • What is ODI ?
    • Java based Integration tool
    • Metadata driven
    • Support for heterogeneous technologies
    • Support for standard tools
    • Standard Data Integration functions
  • Why do I need ODI ?
    • I want a Unified view of Information
    • I want to focus on the Business Logic
    • I want to implement processes in a standard way
    Data Sources CRM Legacy ERP Custom Database Files / XML ESB Targets Custom DB Apps Data Warehouse Files / XML ESB Staging Area Any DB
  • E-LT Architecture
    • Conventional: Separate ETL Server
      • Proprietary ETL Engine
      • Poor Performance
      • High Costs for Separate Standalone Server
    • Oracle: No New Servers
      • Lower Cost: Leverage Compute Resources & Partition Workload efficiently
      • Efficient: Exploits Database Optimizer
      • Fast: Exploits Native Bulk Load & Other Database Interfaces
      • Scalable: Scales as you add Processors to Source or Target
    • Benefits
      • Optimal Performance & Scalability
      • Better Hardware Leverage
      • Easier to Manage & Lower Cost
    Conventional ETL Architecture E xtract L oad T ransform ODI ELT Architecture “ E-LT ” L oad E xtract Transform T ransform
  • ODI Architecture Repository
  • ODI – 4 Modules
  • Topology/Security Manager
    • Define the physical and logical architecture of the infrastructure
    • Specify user credentials and their access rights
    • All the above information is stored in the master repository
  • Topology (Continued)
  • Topology (Physical/Logical Architecture)
    • The logical view describes logical schemas that represent the physical schemas of the existing applications independently of their physical implementation. These logical schemas are then linked to the physical resources through contexts.
    • Designers always refer to the logical view defined in the Topology. All development done therefore becomes independent of the physical location of the resources.
  • Physical vs. Logical Architecture Contexts Boston Japan Physical Architecture Logical Architecture SALES DB_BOSTON SALES DB_TOKYO LG_SALES Visible Invisible Plumbing
  • Designer (Models)
    • Define the blueprint of the source and target datastores
    • Apply constraints on the columns (PK, FK or any condition)
    • Define SCD behavior of the columns
  • Designer (Projects)
  • Operator
  • Extensible Knowledge Modules
    • Provided out of the box and are user extensible
    • Written for specific source/target platforms
  • KMs -What’s below the surface ?
    • update <%=snpRef.getTable(&quot;L&quot;, &quot;INT_NAME&quot;, &quot;A&quot;)%>
    • set IND_UPDATE = 'N'
    • where exists (
    • select 'X'
    • from <%=snpRef.getTable(&quot;L&quot;, &quot;TARG_NAME&quot;, &quot;A&quot;)%> <%=snpRef.getInfo(&quot;DEST_TAB_ALIAS_WORD&quot;)%> T
    • where <%=snpRef.getColList(&quot;&quot;, snpRef.getTable(&quot;L&quot;, &quot;INT_NAME&quot;, &quot;A&quot;)+&quot;.[COL_NAME] = T.[COL_NAME]&quot;, &quot; and &quot;, &quot;&quot;, &quot;UK&quot;)%>
    • <%=snpRef.getColList(&quot;and &quot;, &quot;((&quot;+snpRef.getTable(&quot;L&quot;, &quot;INT_NAME&quot;, &quot;A&quot;)+&quot;.[COL_NAME] = T.[COL_NAME]) or (&quot;+snpRef.getTable(&quot;L&quot;, &quot;INT_NAME&quot;, &quot;A&quot;)+&quot;.[COL_NAME] IS NULL and T.[COL_NAME] IS NULL))&quot;, &quot; and &quot;, &quot;&quot;, &quot;((UPD and !TRG) and !UK)&quot;)%>
    • )
    update I$_TRG_CITY set IND_UPDATE = 'N' where exists ( select 'X' from TRG_CITY T where I$_TRG_CITY.CITY_ID = T.CITY_ID and ((I$_TRG_CITY.REGION_ID = T.REGION_ID) or (I$_TRG_CITY.REGION_ID IS NULL and T.REGION_ID IS NULL)) and ((I$_TRG_CITY.CITY = T.CITY) or (I$_TRG_CITY.CITY IS NULL and T.CITY IS NULL)) and ((I$_TRG_CITY.POPULATION = T.POPULATION) or (I$_TRG_CITY.POPULATION IS NULL and T.POPULATION IS NULL)) ) Built at runtime
  • More Features
    • Data Quality
    • Change Data Capture
    • Slowly Changing Dimensions
    • Bulk Load
    • Support for Functions, procedures, etc
    • Data Lineage
  • Best Practices
    • Define conventions early in the game
    • Define Security policy
    • Repository IDs should be unique
    • Create different contexts for different OS
    • Do NOT add business logic to the KM
    • Documentation
    • Documentation
    • Documentation
    • Documentation
  • ODI – Getting Started
    • Where to download
      • http://www.oracle.com/technology/software/products/odi/index.html
    • What to install
      • Current version 10.1.3.5
      • You can get a patch to upgrade to 10.1.3.6.2
  • OTN – Data Integration Forum
  • Q & A
    • Questions => Follow up via:
      • http://askankit.blogspot.com/
    • Contact Info :
      • [email_address]