SlideShare a Scribd company logo
Oracle Business Intelligence
Three Sides of the Coin with Oracle Data Integration – ODI, OGG, EDQ
Maria Gyurova, UKOUG, 8 Dec 20015,
• BI Specialist at Peak Indicators
• Oracle Consultant with ETL and DWH experience
• OCP DBA 9i, 10g, 11g
• Speaking at BGOUG, SIOUG, UKOUG
• Linkedin https://www.linkedin.com/in/mariagyurova
• Twitter @mgyurova
• Personal Blog https://oraclespot.wordpress.com/
• Salsa dancer having a tall husband and a lovely daughter
About me
© Peak Indicators Limited 2Three Sides of the Coin with Oracle Data Integration
• We are the largest Oracle BI specialist partner in Europe
• Our sole focus is on delivering value to our customers
• We are the only Specialized UK Oracle Partner that
currently offers and delivers hosted “private clouds” and
Managed Services for Oracle BI
About Peak Indicators
Introduction
© Peak Indicators Limited 3
• We serve some of the world's largest companies, including the UK's top Finance, Retail,
Consumer Goods, Public Sector and Telecoms organisations
Three Sides of the Coin with Oracle Data Integration
The purpose of this session is to show the integration of Oracle Data Integrator(ODI) 12c with Oracle
Golden Gate(OGG) 12c and Oracle Enterprise Data Quality(EDQ) 12c:
• ODI 12c and Real-Time Data Integration
• OGG 12c
• OGG Configuration
• Change Data Capture(CDC)
• EDQ 12c
• EDQ Configuration
• Use EDQ within ODI
• Live Demo
Agenda
Overview
© Peak Indicators Limited 4Three Sides of the Coin with Oracle Data Integration
• Use it only if required
• 10 Rules for Real-Time Data Integration at
http://www.tdwi.org
• RT DI with OGG
• Support for CDC
• ODI for Real-Time Data Warehousing
• Benefits
• Move only changed data
• Continuous feeds from operational systems
• Eliminate performance impact on source systems
• Enable near real-time decision making with
real-time data flows
ODI 12c
Real-Time Data Integration(RT DI)
© Peak Indicators Limited 5Three Sides of the Coin with Oracle Data Integration
Oracle Data Integration Solution
Oracle Data Integrator
ELT/ETL
Data Transformation
Oracle GoldenGate
Real-time CDC
Data Replication
Enterprise Data Quality
Data Cleansing
Data Profiling
Real-Time Data Integration
Data Source(s)
Operational BI /
Real-Time Reporting
Staging Area for
Operational BI
Real-Time
Data Warehouse
Periodical
ODI Load
GoldenGate
• Real-Time Data Integration
• Heterogeneous Database Replication Platform
• Can be used to support requirements below
OGG 12c
Introduction
© Peak Indicators Limited 6Three Sides of the Coin with Oracle Data Integration
Logical OGG Architecture
UNIDIRECTIONAL
Reporting Instance
BI-DIRECTIONAL
Instant Failover Active-Active
PEER-TO-PEER
High Availability
BROADCAST
Data Distribution
CONSOLIDATION
Data Warehouse/Mart
CASCADING
Scalability
Extract
Extract
Data source for
Initial Load
Data source for
Change synchronization
Replicat
Replicat
Initial Load
Change Synchronization
Manager Manager
Network
Data
Pump
Collector
Target DB
Trail
• Install OGG on the source and target to capture the source data and deliver to the target
• Oracle database configuration
• alter database add supplemental log data;
• alter system switch logfile;
• alter database force logging;
• enable archivelog mode of the database
• ODI integrates with OGG using GoldenGate JAgent – in Topology Navigator defined as a Data
Server
OGG Configuration
© Peak Indicators Limited 7Three Sides of the Coin with Oracle Data Integration
• Allows ODI to track changes in the source data
• Reduces the source data flow to only changed data and avoid processing unchanged data
• Oracle GoldenGate KMs enable ODI to leverage the power of OGG for real-time CDC
• Journalizing modes:
• Simple Journalizing – Track changes in individual datastores
• Consistent Set Journalizing – Track changes to a group of datastores taking into account the
referential integrity between the datastores
CDC
© Peak Indicators Limited 8Three Sides of the Coin with Oracle Data Integration
• Demo will show how to use CDC in Consistent Set Journalizing
CDC
© Peak Indicators Limited 9Three Sides of the Coin with Oracle Data Integration
• Capture and Delivery processes
• Remote trail files path of the Capture should be the Target trail file path
CDC
© Peak Indicators Limited 10Three Sides of the Coin with Oracle Data Integration
CDC
© Peak Indicators Limited 11Three Sides of the Coin with Oracle Data Integration
Set up Journalizing
1 2 3
• Journals: Where changes are recorded
• Capture processes: Journalizing captures the changes in the source datastores
• Subscribers: Processes that use the tracked changes. They subscribe to a model's CDC to have
the changes tracked for them. Changes are captured only if there is at least one subscriber to the
changes.
• Journalizing views: Provide access to the captured changes; used by integration processes to
retrieve the changed data
CDC
© Peak Indicators Limited 12Three Sides of the Coin with Oracle Data Integration
Journalizing Components
• Extend Window: The Consistency Window is a range of available table changes. The extend window
operation computes this window to take into account new changes captured since the latest Extend
• Lock Subscribers: Subscribers consume the changes separately. This operation performs a subscriber(s)
specific "snapshot" of the changes
• Mappings: Create mappings to process the changed data
• Unlock Subscribers: Commits the use of the changes
• Purge Journal: After all subscribers have consumed the changes all the entries are deleted
CDC
© Peak Indicators Limited 13Three Sides of the Coin with Oracle Data Integration
Use Changed Data
CDC
© Peak Indicators Limited 14Three Sides of the Coin with Oracle Data Integration
Use Changed Data
1
3 CDC Mappings
2
4
5
or automate in a package
• Data quality management environment
• Facilitates MDM, Data Governance, Data Integration, BI
EDQ 12c
© Peak Indicators Limited 15Three Sides of the Coin with Oracle Data Integration
understand,
improve,
protect data
govern data
govern data
improve,
protect data
govern data
Introduction
• Discards records containing ‘*’ in the product name
EDQ 12c
© Peak Indicators Limited 16Three Sides of the Coin with Oracle Data Integration
EDQ Processes and Jobs
EDQ 12c
© Peak Indicators Limited 17Three Sides of the Coin with Oracle Data Integration
EDQ Processes and Jobs
• EDQ augments ODI’s Data Quality capabilities
• Design Data Quality processes in EDQ and invoke them from a package in ODI
EDQ 12c
© Peak Indicators Limited 18Three Sides of the Coin with Oracle Data Integration
Use EDQ within ODI
Gold
Partners
Specialized
Oracle Business Intelligence
Foundation
Gold
Partners
Specialized
Oracle Data Integration 11g
www.peakindicators.com
enquiries@peakindicators.com
+44 (0) 124 638 9000
19
ODI, OGG and EDQ Integration
Use CDC, EDQ jobs from ODI
• How to use
• ODI with OGG
• CDC
• ODI with EDQ
• OGG enables ODI to leverage the power of:
• Real-Time Data Integration
• Real-Time Data Warehouse
• Real-Time Reporting
• EDQ leverages ODI’s Data Quality capabilities
• incorporate Data Quality within ETL process
Summary
© Peak Indicators Limited 20Three Sides of the Coin with Oracle Data Integration
OGG ODI EDQ
Source
Q & A
© Peak Indicators Limited 21Three Sides of the Coin with Oracle Data Integration
Helping your Business Intelligence Journey
Gold
Partners
Specialized
Oracle Business Intelligence
Foundation
Gold
Partners
Specialized
Oracle Data Integration 11g
www.peakindicators.com
enquiries@peakindicators.com
+44 (0) 124 638 9000

More Related Content

What's hot

Moving OBIEE to Oracle Analytics Cloud
Moving OBIEE to Oracle Analytics CloudMoving OBIEE to Oracle Analytics Cloud
Moving OBIEE to Oracle Analytics Cloud
Edelweiss Kammermann
 
Oracle GoldenGate for Disaster Recovery
Oracle GoldenGate for Disaster RecoveryOracle GoldenGate for Disaster Recovery
Oracle GoldenGate for Disaster Recovery
Fumiko Yamashita
 
Oracle Autonomous Data Warehouse Cloud and Data Visualization
Oracle Autonomous Data Warehouse Cloud and Data VisualizationOracle Autonomous Data Warehouse Cloud and Data Visualization
Oracle Autonomous Data Warehouse Cloud and Data Visualization
Edelweiss Kammermann
 
What’s New in Oracle Database 19c - Part 1
What’s New in Oracle Database 19c - Part 1What’s New in Oracle Database 19c - Part 1
What’s New in Oracle Database 19c - Part 1
Satishbabu Gunukula
 
2020 – A Decade of Change
2020 – A Decade of Change2020 – A Decade of Change
2020 – A Decade of Change
Markus Michalewicz
 
How To Leverage OBIEE Within A Big Data Architecture
How To Leverage OBIEE Within A Big Data ArchitectureHow To Leverage OBIEE Within A Big Data Architecture
How To Leverage OBIEE Within A Big Data Architecture
Kevin McGinley
 
Oracle data integrator 12c - getting started
Oracle data integrator 12c - getting startedOracle data integrator 12c - getting started
Oracle data integrator 12c - getting started
Michael Rainey
 
[❤PDF❤] Oracle 19c Database Administration Oracle Simplified
[❤PDF❤] Oracle 19c Database Administration Oracle Simplified [❤PDF❤] Oracle 19c Database Administration Oracle Simplified
[❤PDF❤] Oracle 19c Database Administration Oracle Simplified
ZanderHaney
 
Oracle data integrator (odi) online training
Oracle data integrator (odi) online trainingOracle data integrator (odi) online training
Oracle data integrator (odi) online training
Glory IT Technologies Pvt. Ltd.
 
GoldenGate Case Study - Enterprise IT
GoldenGate Case Study - Enterprise ITGoldenGate Case Study - Enterprise IT
GoldenGate Case Study - Enterprise ITPaul Steffensen
 
New Features in OBIEE 12c
New Features in OBIEE 12c New Features in OBIEE 12c
New Features in OBIEE 12c
Michelle Kolbe
 
Offload, Transform, and Present - the New World of Data Integration
Offload, Transform, and Present - the New World of Data IntegrationOffload, Transform, and Present - the New World of Data Integration
Offload, Transform, and Present - the New World of Data Integration
Michael Rainey
 
GoldenGate and ODI - A Perfect Match for Real-Time Data Warehousing
GoldenGate and ODI - A Perfect Match for Real-Time Data WarehousingGoldenGate and ODI - A Perfect Match for Real-Time Data Warehousing
GoldenGate and ODI - A Perfect Match for Real-Time Data Warehousing
Michael Rainey
 
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
Milomir Vojvodic
 
Tame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data IntegrationTame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data Integration
Michael Rainey
 
Oracle GoldenGate Performance Tuning
Oracle GoldenGate Performance TuningOracle GoldenGate Performance Tuning
Oracle GoldenGate Performance Tuning
Bobby Curtis
 
Oracle Database 19c - poslední z rodiny 12.2 a co přináší nového
Oracle Database 19c - poslední z rodiny 12.2 a co přináší novéhoOracle Database 19c - poslední z rodiny 12.2 a co přináší nového
Oracle Database 19c - poslední z rodiny 12.2 a co přináší nového
MarketingArrowECS_CZ
 
Performance Stability, Tips and Tricks and Underscores
Performance Stability, Tips and Tricks and UnderscoresPerformance Stability, Tips and Tricks and Underscores
Performance Stability, Tips and Tricks and Underscores
Jitendra Singh
 
plug-into-cloud-wp-12c-1896100
plug-into-cloud-wp-12c-1896100plug-into-cloud-wp-12c-1896100
plug-into-cloud-wp-12c-1896100Prithvi Rajkumar
 
Understanding Oracle GoldenGate 12c
Understanding Oracle GoldenGate 12cUnderstanding Oracle GoldenGate 12c
Understanding Oracle GoldenGate 12c
IT Help Desk Inc
 

What's hot (20)

Moving OBIEE to Oracle Analytics Cloud
Moving OBIEE to Oracle Analytics CloudMoving OBIEE to Oracle Analytics Cloud
Moving OBIEE to Oracle Analytics Cloud
 
Oracle GoldenGate for Disaster Recovery
Oracle GoldenGate for Disaster RecoveryOracle GoldenGate for Disaster Recovery
Oracle GoldenGate for Disaster Recovery
 
Oracle Autonomous Data Warehouse Cloud and Data Visualization
Oracle Autonomous Data Warehouse Cloud and Data VisualizationOracle Autonomous Data Warehouse Cloud and Data Visualization
Oracle Autonomous Data Warehouse Cloud and Data Visualization
 
What’s New in Oracle Database 19c - Part 1
What’s New in Oracle Database 19c - Part 1What’s New in Oracle Database 19c - Part 1
What’s New in Oracle Database 19c - Part 1
 
2020 – A Decade of Change
2020 – A Decade of Change2020 – A Decade of Change
2020 – A Decade of Change
 
How To Leverage OBIEE Within A Big Data Architecture
How To Leverage OBIEE Within A Big Data ArchitectureHow To Leverage OBIEE Within A Big Data Architecture
How To Leverage OBIEE Within A Big Data Architecture
 
Oracle data integrator 12c - getting started
Oracle data integrator 12c - getting startedOracle data integrator 12c - getting started
Oracle data integrator 12c - getting started
 
[❤PDF❤] Oracle 19c Database Administration Oracle Simplified
[❤PDF❤] Oracle 19c Database Administration Oracle Simplified [❤PDF❤] Oracle 19c Database Administration Oracle Simplified
[❤PDF❤] Oracle 19c Database Administration Oracle Simplified
 
Oracle data integrator (odi) online training
Oracle data integrator (odi) online trainingOracle data integrator (odi) online training
Oracle data integrator (odi) online training
 
GoldenGate Case Study - Enterprise IT
GoldenGate Case Study - Enterprise ITGoldenGate Case Study - Enterprise IT
GoldenGate Case Study - Enterprise IT
 
New Features in OBIEE 12c
New Features in OBIEE 12c New Features in OBIEE 12c
New Features in OBIEE 12c
 
Offload, Transform, and Present - the New World of Data Integration
Offload, Transform, and Present - the New World of Data IntegrationOffload, Transform, and Present - the New World of Data Integration
Offload, Transform, and Present - the New World of Data Integration
 
GoldenGate and ODI - A Perfect Match for Real-Time Data Warehousing
GoldenGate and ODI - A Perfect Match for Real-Time Data WarehousingGoldenGate and ODI - A Perfect Match for Real-Time Data Warehousing
GoldenGate and ODI - A Perfect Match for Real-Time Data Warehousing
 
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
 
Tame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data IntegrationTame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data Integration
 
Oracle GoldenGate Performance Tuning
Oracle GoldenGate Performance TuningOracle GoldenGate Performance Tuning
Oracle GoldenGate Performance Tuning
 
Oracle Database 19c - poslední z rodiny 12.2 a co přináší nového
Oracle Database 19c - poslední z rodiny 12.2 a co přináší novéhoOracle Database 19c - poslední z rodiny 12.2 a co přináší nového
Oracle Database 19c - poslední z rodiny 12.2 a co přináší nového
 
Performance Stability, Tips and Tricks and Underscores
Performance Stability, Tips and Tricks and UnderscoresPerformance Stability, Tips and Tricks and Underscores
Performance Stability, Tips and Tricks and Underscores
 
plug-into-cloud-wp-12c-1896100
plug-into-cloud-wp-12c-1896100plug-into-cloud-wp-12c-1896100
plug-into-cloud-wp-12c-1896100
 
Understanding Oracle GoldenGate 12c
Understanding Oracle GoldenGate 12cUnderstanding Oracle GoldenGate 12c
Understanding Oracle GoldenGate 12c
 

Similar to Three Sides of the Coin with Oracle Data Integration 12c - ODI, OGG, EDQ

Transform Your Data Integration Platform From Informatica To ODI
Transform Your Data Integration Platform From Informatica To ODI Transform Your Data Integration Platform From Informatica To ODI
Transform Your Data Integration Platform From Informatica To ODI
Jade Global
 
Oracle Data Integrator 11g Integration and Administration
Oracle Data Integrator 11g  Integration and AdministrationOracle Data Integrator 11g  Integration and Administration
Oracle Data Integrator 11g Integration and AdministrationMd. Noor Alam
 
Fusion Middleware Oracle Data Integrator
Fusion Middleware Oracle Data IntegratorFusion Middleware Oracle Data Integrator
Fusion Middleware Oracle Data Integrator
Mark Rabne
 
Optimize with Open Source
Optimize with Open SourceOptimize with Open Source
Optimize with Open Source
EDB
 
Epic Clarity Running on Exadata
Epic Clarity Running on ExadataEpic Clarity Running on Exadata
Epic Clarity Running on ExadataEnkitec
 
The Real Scoop on Migrating from Oracle Databases
The Real Scoop on Migrating from Oracle DatabasesThe Real Scoop on Migrating from Oracle Databases
The Real Scoop on Migrating from Oracle Databases
EDB
 
Logical Data Fabric and Data Mesh – Driving Business Outcomes
Logical Data Fabric and Data Mesh – Driving Business OutcomesLogical Data Fabric and Data Mesh – Driving Business Outcomes
Logical Data Fabric and Data Mesh – Driving Business Outcomes
Denodo
 
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
Insight Technology, Inc.
 
Oracle Data Integrator Administration and Development
Oracle Data Integrator Administration and DevelopmentOracle Data Integrator Administration and Development
Oracle Data Integrator Administration and DevelopmentMd. Noor Alam
 
Primavera vision & roadmap collaborate13 april 2013
Primavera vision & roadmap collaborate13 april 2013Primavera vision & roadmap collaborate13 april 2013
Primavera vision & roadmap collaborate13 april 2013
p6academy
 
Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...
Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...
Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...
KPIT
 
Replacing Oracle with EDB Postgres
Replacing Oracle with EDB PostgresReplacing Oracle with EDB Postgres
Replacing Oracle with EDB Postgres
EDB
 
Presentation cloud management
Presentation   cloud managementPresentation   cloud management
Presentation cloud management
xKinAnx
 
One database solution for your enterprise business - Oracle 12c
One database solution for your enterprise business - Oracle 12cOne database solution for your enterprise business - Oracle 12c
One database solution for your enterprise business - Oracle 12c
Satishbabu Gunukula
 
Oracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analyticsOracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analytics
jdijcks
 
Key Methodologies for Migrating from Oracle to Postgres
Key Methodologies for Migrating from Oracle to PostgresKey Methodologies for Migrating from Oracle to Postgres
Key Methodologies for Migrating from Oracle to Postgres
EDB
 
B7 accelerating your business with oracle data integration solutions
B7   accelerating your business with oracle data integration solutionsB7   accelerating your business with oracle data integration solutions
B7 accelerating your business with oracle data integration solutionsDr. Wilfred Lin (Ph.D.)
 
Data Virtualization Journey: How to Grow from Single Project and to Enterpris...
Data Virtualization Journey: How to Grow from Single Project and to Enterpris...Data Virtualization Journey: How to Grow from Single Project and to Enterpris...
Data Virtualization Journey: How to Grow from Single Project and to Enterpris...
Denodo
 
ODTUG NYC Meetup 2017 – PCMCS and ITFM
ODTUG NYC Meetup 2017 – PCMCS and ITFMODTUG NYC Meetup 2017 – PCMCS and ITFM
ODTUG NYC Meetup 2017 – PCMCS and ITFM
Joseph Alaimo Jr
 

Similar to Three Sides of the Coin with Oracle Data Integration 12c - ODI, OGG, EDQ (20)

Transform Your Data Integration Platform From Informatica To ODI
Transform Your Data Integration Platform From Informatica To ODI Transform Your Data Integration Platform From Informatica To ODI
Transform Your Data Integration Platform From Informatica To ODI
 
Oracle Data Integrator 11g Integration and Administration
Oracle Data Integrator 11g  Integration and AdministrationOracle Data Integrator 11g  Integration and Administration
Oracle Data Integrator 11g Integration and Administration
 
I one Service Offerings
I one Service OfferingsI one Service Offerings
I one Service Offerings
 
Fusion Middleware Oracle Data Integrator
Fusion Middleware Oracle Data IntegratorFusion Middleware Oracle Data Integrator
Fusion Middleware Oracle Data Integrator
 
Optimize with Open Source
Optimize with Open SourceOptimize with Open Source
Optimize with Open Source
 
Epic Clarity Running on Exadata
Epic Clarity Running on ExadataEpic Clarity Running on Exadata
Epic Clarity Running on Exadata
 
The Real Scoop on Migrating from Oracle Databases
The Real Scoop on Migrating from Oracle DatabasesThe Real Scoop on Migrating from Oracle Databases
The Real Scoop on Migrating from Oracle Databases
 
Logical Data Fabric and Data Mesh – Driving Business Outcomes
Logical Data Fabric and Data Mesh – Driving Business OutcomesLogical Data Fabric and Data Mesh – Driving Business Outcomes
Logical Data Fabric and Data Mesh – Driving Business Outcomes
 
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
[db tech showcase Tokyo 2018] #dbts2018 #B31 『1,2,3 and Done! 3 easy ways to ...
 
Oracle Data Integrator Administration and Development
Oracle Data Integrator Administration and DevelopmentOracle Data Integrator Administration and Development
Oracle Data Integrator Administration and Development
 
Primavera vision & roadmap collaborate13 april 2013
Primavera vision & roadmap collaborate13 april 2013Primavera vision & roadmap collaborate13 april 2013
Primavera vision & roadmap collaborate13 april 2013
 
Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...
Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...
Webinar: The Secret Sauce to a Widely Successful JD Edwards World to JD Edwar...
 
Replacing Oracle with EDB Postgres
Replacing Oracle with EDB PostgresReplacing Oracle with EDB Postgres
Replacing Oracle with EDB Postgres
 
Presentation cloud management
Presentation   cloud managementPresentation   cloud management
Presentation cloud management
 
One database solution for your enterprise business - Oracle 12c
One database solution for your enterprise business - Oracle 12cOne database solution for your enterprise business - Oracle 12c
One database solution for your enterprise business - Oracle 12c
 
Oracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analyticsOracle Big Data Appliance and Big Data SQL for advanced analytics
Oracle Big Data Appliance and Big Data SQL for advanced analytics
 
Key Methodologies for Migrating from Oracle to Postgres
Key Methodologies for Migrating from Oracle to PostgresKey Methodologies for Migrating from Oracle to Postgres
Key Methodologies for Migrating from Oracle to Postgres
 
B7 accelerating your business with oracle data integration solutions
B7   accelerating your business with oracle data integration solutionsB7   accelerating your business with oracle data integration solutions
B7 accelerating your business with oracle data integration solutions
 
Data Virtualization Journey: How to Grow from Single Project and to Enterpris...
Data Virtualization Journey: How to Grow from Single Project and to Enterpris...Data Virtualization Journey: How to Grow from Single Project and to Enterpris...
Data Virtualization Journey: How to Grow from Single Project and to Enterpris...
 
ODTUG NYC Meetup 2017 – PCMCS and ITFM
ODTUG NYC Meetup 2017 – PCMCS and ITFMODTUG NYC Meetup 2017 – PCMCS and ITFM
ODTUG NYC Meetup 2017 – PCMCS and ITFM
 

Recently uploaded

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
mbawufebxi
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
jerlynmaetalle
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
ocavb
 
Influence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business PlanInfluence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business Plan
jerlynmaetalle
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
ahzuo
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
axoqas
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
u86oixdj
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
Subhajit Sahu
 
Machine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptxMachine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptx
balafet
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
slg6lamcq
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
oz8q3jxlp
 
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
ukgaet
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
axoqas
 
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdfSample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Linda486226
 
一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单
ewymefz
 
Q1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year ReboundQ1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year Rebound
Oppotus
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Subhajit Sahu
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
John Andrews
 

Recently uploaded (20)

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
一比一原版(Bradford毕业证书)布拉德福德大学毕业证如何办理
 
The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...The affect of service quality and online reviews on customer loyalty in the E...
The affect of service quality and online reviews on customer loyalty in the E...
 
一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单一比一原版(TWU毕业证)西三一大学毕业证成绩单
一比一原版(TWU毕业证)西三一大学毕业证成绩单
 
Influence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business PlanInfluence of Marketing Strategy and Market Competition on Business Plan
Influence of Marketing Strategy and Market Competition on Business Plan
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
 
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
哪里卖(usq毕业证书)南昆士兰大学毕业证研究生文凭证书托福证书原版一模一样
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
 
Adjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTESAdjusting primitives for graph : SHORT REPORT / NOTES
Adjusting primitives for graph : SHORT REPORT / NOTES
 
Machine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptxMachine learning and optimization techniques for electrical drives.pptx
Machine learning and optimization techniques for electrical drives.pptx
 
Criminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdfCriminal IP - Threat Hunting Webinar.pdf
Criminal IP - Threat Hunting Webinar.pdf
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
 
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
一比一原版(Deakin毕业证书)迪肯大学毕业证如何办理
 
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
一比一原版(UVic毕业证)维多利亚大学毕业证成绩单
 
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
做(mqu毕业证书)麦考瑞大学毕业证硕士文凭证书学费发票原版一模一样
 
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdfSample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
Sample_Global Non-invasive Prenatal Testing (NIPT) Market, 2019-2030.pdf
 
一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单一比一原版(BU毕业证)波士顿大学毕业证成绩单
一比一原版(BU毕业证)波士顿大学毕业证成绩单
 
Q1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year ReboundQ1’2024 Update: MYCI’s Leap Year Rebound
Q1’2024 Update: MYCI’s Leap Year Rebound
 
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...
 
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
 

Three Sides of the Coin with Oracle Data Integration 12c - ODI, OGG, EDQ

  • 1. Oracle Business Intelligence Three Sides of the Coin with Oracle Data Integration – ODI, OGG, EDQ Maria Gyurova, UKOUG, 8 Dec 20015,
  • 2. • BI Specialist at Peak Indicators • Oracle Consultant with ETL and DWH experience • OCP DBA 9i, 10g, 11g • Speaking at BGOUG, SIOUG, UKOUG • Linkedin https://www.linkedin.com/in/mariagyurova • Twitter @mgyurova • Personal Blog https://oraclespot.wordpress.com/ • Salsa dancer having a tall husband and a lovely daughter About me © Peak Indicators Limited 2Three Sides of the Coin with Oracle Data Integration
  • 3. • We are the largest Oracle BI specialist partner in Europe • Our sole focus is on delivering value to our customers • We are the only Specialized UK Oracle Partner that currently offers and delivers hosted “private clouds” and Managed Services for Oracle BI About Peak Indicators Introduction © Peak Indicators Limited 3 • We serve some of the world's largest companies, including the UK's top Finance, Retail, Consumer Goods, Public Sector and Telecoms organisations Three Sides of the Coin with Oracle Data Integration
  • 4. The purpose of this session is to show the integration of Oracle Data Integrator(ODI) 12c with Oracle Golden Gate(OGG) 12c and Oracle Enterprise Data Quality(EDQ) 12c: • ODI 12c and Real-Time Data Integration • OGG 12c • OGG Configuration • Change Data Capture(CDC) • EDQ 12c • EDQ Configuration • Use EDQ within ODI • Live Demo Agenda Overview © Peak Indicators Limited 4Three Sides of the Coin with Oracle Data Integration
  • 5. • Use it only if required • 10 Rules for Real-Time Data Integration at http://www.tdwi.org • RT DI with OGG • Support for CDC • ODI for Real-Time Data Warehousing • Benefits • Move only changed data • Continuous feeds from operational systems • Eliminate performance impact on source systems • Enable near real-time decision making with real-time data flows ODI 12c Real-Time Data Integration(RT DI) © Peak Indicators Limited 5Three Sides of the Coin with Oracle Data Integration Oracle Data Integration Solution Oracle Data Integrator ELT/ETL Data Transformation Oracle GoldenGate Real-time CDC Data Replication Enterprise Data Quality Data Cleansing Data Profiling Real-Time Data Integration Data Source(s) Operational BI / Real-Time Reporting Staging Area for Operational BI Real-Time Data Warehouse Periodical ODI Load GoldenGate
  • 6. • Real-Time Data Integration • Heterogeneous Database Replication Platform • Can be used to support requirements below OGG 12c Introduction © Peak Indicators Limited 6Three Sides of the Coin with Oracle Data Integration Logical OGG Architecture UNIDIRECTIONAL Reporting Instance BI-DIRECTIONAL Instant Failover Active-Active PEER-TO-PEER High Availability BROADCAST Data Distribution CONSOLIDATION Data Warehouse/Mart CASCADING Scalability Extract Extract Data source for Initial Load Data source for Change synchronization Replicat Replicat Initial Load Change Synchronization Manager Manager Network Data Pump Collector Target DB Trail
  • 7. • Install OGG on the source and target to capture the source data and deliver to the target • Oracle database configuration • alter database add supplemental log data; • alter system switch logfile; • alter database force logging; • enable archivelog mode of the database • ODI integrates with OGG using GoldenGate JAgent – in Topology Navigator defined as a Data Server OGG Configuration © Peak Indicators Limited 7Three Sides of the Coin with Oracle Data Integration
  • 8. • Allows ODI to track changes in the source data • Reduces the source data flow to only changed data and avoid processing unchanged data • Oracle GoldenGate KMs enable ODI to leverage the power of OGG for real-time CDC • Journalizing modes: • Simple Journalizing – Track changes in individual datastores • Consistent Set Journalizing – Track changes to a group of datastores taking into account the referential integrity between the datastores CDC © Peak Indicators Limited 8Three Sides of the Coin with Oracle Data Integration
  • 9. • Demo will show how to use CDC in Consistent Set Journalizing CDC © Peak Indicators Limited 9Three Sides of the Coin with Oracle Data Integration
  • 10. • Capture and Delivery processes • Remote trail files path of the Capture should be the Target trail file path CDC © Peak Indicators Limited 10Three Sides of the Coin with Oracle Data Integration
  • 11. CDC © Peak Indicators Limited 11Three Sides of the Coin with Oracle Data Integration Set up Journalizing 1 2 3
  • 12. • Journals: Where changes are recorded • Capture processes: Journalizing captures the changes in the source datastores • Subscribers: Processes that use the tracked changes. They subscribe to a model's CDC to have the changes tracked for them. Changes are captured only if there is at least one subscriber to the changes. • Journalizing views: Provide access to the captured changes; used by integration processes to retrieve the changed data CDC © Peak Indicators Limited 12Three Sides of the Coin with Oracle Data Integration Journalizing Components
  • 13. • Extend Window: The Consistency Window is a range of available table changes. The extend window operation computes this window to take into account new changes captured since the latest Extend • Lock Subscribers: Subscribers consume the changes separately. This operation performs a subscriber(s) specific "snapshot" of the changes • Mappings: Create mappings to process the changed data • Unlock Subscribers: Commits the use of the changes • Purge Journal: After all subscribers have consumed the changes all the entries are deleted CDC © Peak Indicators Limited 13Three Sides of the Coin with Oracle Data Integration Use Changed Data
  • 14. CDC © Peak Indicators Limited 14Three Sides of the Coin with Oracle Data Integration Use Changed Data 1 3 CDC Mappings 2 4 5 or automate in a package
  • 15. • Data quality management environment • Facilitates MDM, Data Governance, Data Integration, BI EDQ 12c © Peak Indicators Limited 15Three Sides of the Coin with Oracle Data Integration understand, improve, protect data govern data govern data improve, protect data govern data Introduction
  • 16. • Discards records containing ‘*’ in the product name EDQ 12c © Peak Indicators Limited 16Three Sides of the Coin with Oracle Data Integration EDQ Processes and Jobs
  • 17. EDQ 12c © Peak Indicators Limited 17Three Sides of the Coin with Oracle Data Integration EDQ Processes and Jobs
  • 18. • EDQ augments ODI’s Data Quality capabilities • Design Data Quality processes in EDQ and invoke them from a package in ODI EDQ 12c © Peak Indicators Limited 18Three Sides of the Coin with Oracle Data Integration Use EDQ within ODI
  • 19. Gold Partners Specialized Oracle Business Intelligence Foundation Gold Partners Specialized Oracle Data Integration 11g www.peakindicators.com enquiries@peakindicators.com +44 (0) 124 638 9000 19 ODI, OGG and EDQ Integration Use CDC, EDQ jobs from ODI
  • 20. • How to use • ODI with OGG • CDC • ODI with EDQ • OGG enables ODI to leverage the power of: • Real-Time Data Integration • Real-Time Data Warehouse • Real-Time Reporting • EDQ leverages ODI’s Data Quality capabilities • incorporate Data Quality within ETL process Summary © Peak Indicators Limited 20Three Sides of the Coin with Oracle Data Integration OGG ODI EDQ Source
  • 21. Q & A © Peak Indicators Limited 21Three Sides of the Coin with Oracle Data Integration
  • 22. Helping your Business Intelligence Journey Gold Partners Specialized Oracle Business Intelligence Foundation Gold Partners Specialized Oracle Data Integration 11g www.peakindicators.com enquiries@peakindicators.com +44 (0) 124 638 9000