SlideShare a Scribd company logo
1 of 6
Download to read offline
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Staging
Oracle Big Data Integration and Lambda/Kappa Architecture
1Oracle Big Data Integration and Governance
Sqoop
HDFS
Hive
Flume
Capture
Trail
Route
Deliver
Pump
Transformation
Model First
Analytics
• Oracle BIEE
• SAS, Cognos / SPSS
• Business Objects
• Microstrategy
Data Streaming
Discovery Sandbox/s
Kafka (MPP Pub/Sub)
Storm and Trident
Spark Streaming
Data First
Analytics
• Oracle Endeca
• Tableau
• Cliq
• Spotfire
In-Motion Analytics
& Data Services
• Vertical specific
• Internet of Things
/ Telematics
• Data monetization
HBase
R
Oracle GoldenGate
Oracle Data Integrator
Oracle Data Governance
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Comprehensive Oracle Data Integration & Governance
Oracle Company Confidential 2
Fast
Load
Speed Layer
Batch Layer
Oracle Data Integrator
(Transform)
Oracle GoldenGate
(Move)
Data Service Integrator
(Federate)
Data
Governance
Foundation
Enterprise Data Quality
(Profile & Cleanse)
Enterprise Metadata Management & Business Glossary
(Business Glossary, Data Lineage, Impact Analysis and Data Provenance)
Veridata
(Verify)
Data Enrichment
(Prepare)
Real-Time Data Movement
– Low impact capture, stage in Hadoop
– Continuous data availability
Data Transformation
– Bulk data movement
– Pushdown data processing
Data Federation
– Virtualized Data Services
Data Governance
– Prepare unstructured data
– Profile data with sampling
– Clean data in real time or batch
– Verify data for consistency
– Trace lineage of all data
– Define glossary of business terms
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
4 Business Patterns of Big Data Reservoir Success
Oracle Company Confidential 3
Sandbox
ETL Offload
Staging
Deep Data
Storage
Data First
Analytics
Model First
Analytics
In-Motion
Analytics
Data
Services
New Data Services:
– Stakeholder: Line of Business (LoB)
– Core Value: Monetizing data by reselling services
– Innovation: Streaming platforms correlate and
analyze realtime data from devices and apps
Faster Analytics:
– Stakeholders: Line of Business (LoB) with IT
– Core Value: Faster access to business data, Faster
time to value on Analytics
– Innovation: Schema-on-read empowers rapid
data staging and true Data Discovery
ETL Offload:
– Stakeholder: Information Technology (IT)
– Core Value: Cost avoidance on DW/Marts
– Innovation: YARN/Hadoop empowers lower cost
compute and lower cost storage
Deep Data Storage:
– Stakeholder: Risk / Compliance (LoB)
– Core Value: High fidelity aged data
– Innovation: SQL on Hadoop engines enable very
low cost, queryable data access
Streaming
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Approach to Big Data Integration is Superior
Oracle Company Confidential 4
Sandbox
ETL Offload
Staging
Deep Data
Storage
Data First
Analytics
Model First
Analytics
In-Motion
Analytics
Data
Services
Oracle GoldenGate:
– Non-invasive data capture
– Low-latency data movement
– Full or partial records staging
– Most proven integration tool worldwide
Oracle Data Integrator:
– No ETL engine is required
– Logical design is separate from physical
– Deploys in Hadoop or off cluster
– Many options for movement
Data Governance:
– Data Preparation and Enrichment
– Data Profiling and Cleansing
– Data Verification
– Metadata Management
– Business Glossary
Streaming
Oracle Data Integrator
(Transform)
Oracle GoldenGate
(Move)
Data Service Integrator
(Federate)
Data
Governance
Foundation
Enterprise Data Quality
(Profile & Cleanse)
Enterprise Metadata Management & Business Glossary
(Business Glossary, Data Lineage, Impact Analysis and Data Provenance)
Veridata
(Verify)
Data Enrichment
(Prepare)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Does Big Data Better: Dynamic Data Movement
5Oracle Confidential, under Non-Disclosure
HDFS (Files)
HBase (NoSQL)
Hive / Hive Streaming (SQL)
Flume & Storm (Streaming)
Kafka (MPP Pub/Sub)
Spark Streaming (Machine Learning)
Capture Database Transactions and
Deliver to Big Data in Real-Time
Capture
Trail
Route
Deliver
Pump
GoldenGate
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Does Big Data Better: Invented Pushdown Processing
6
ORCLInvestmentsinELT/PushdownTech
Scripted
SQL
Stored
Procs
Warehouse
Builder
Data
Integrator
(Heterogeneous)
ODI for
Columnar
DBs
ODI for
In-Memory
DBs
ODI for
Engineered
Systems
ODI for
Hadoop
NoSQL
ODI for
Hadoop
Pig & Oozie
ODI for
Spark
ODI for …
1990’s
Eon of Scripts and PL-SQL Era of Native SQL Big Data Revolution
 Oracle’s tool maturity and operational know-how for E-LT is unmatched
 10x bigger footprint with E-LT than next closest competitor using “pushdown”
 Simple and easy way to blend Hadoop and SQL E-LT execution from one tool
ODI for
Hadoop
Hive
Oracle Confidential, under Non-Disclosure

More Related Content

What's hot

Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to Mesh
Jeffrey T. Pollock
 
The Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data HubThe Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data Hub
Cloudera, Inc.
 
2012 10 bigdata_overview
2012 10 bigdata_overview2012 10 bigdata_overview
2012 10 bigdata_overview
jdijcks
 
Hybrid Data Architecture: Integrating Hadoop with a Data Warehouse
Hybrid Data Architecture: Integrating Hadoop with a Data WarehouseHybrid Data Architecture: Integrating Hadoop with a Data Warehouse
Hybrid Data Architecture: Integrating Hadoop with a Data Warehouse
DataWorks Summit
 
Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data Virtualization
Denodo
 

What's hot (20)

Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to Mesh
 
Data Mesh at CMC Markets: Past, Present and Future
Data Mesh at CMC Markets: Past, Present and FutureData Mesh at CMC Markets: Past, Present and Future
Data Mesh at CMC Markets: Past, Present and Future
 
Flash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lonFlash session -streaming--ses1243-lon
Flash session -streaming--ses1243-lon
 
Data Governance, Compliance and Security in Hadoop with Cloudera
Data Governance, Compliance and Security in Hadoop with ClouderaData Governance, Compliance and Security in Hadoop with Cloudera
Data Governance, Compliance and Security in Hadoop with Cloudera
 
Oracle's BigData solutions
Oracle's BigData solutionsOracle's BigData solutions
Oracle's BigData solutions
 
Big data and its impact on SOA
Big data and its impact on SOABig data and its impact on SOA
Big data and its impact on SOA
 
Information Virtualization: Query Federation on Data Lakes
Information Virtualization: Query Federation on Data LakesInformation Virtualization: Query Federation on Data Lakes
Information Virtualization: Query Federation on Data Lakes
 
Developing a Strategy for Data Lake Governance
Developing a Strategy for Data Lake GovernanceDeveloping a Strategy for Data Lake Governance
Developing a Strategy for Data Lake Governance
 
Data Governance Initiative
Data Governance InitiativeData Governance Initiative
Data Governance Initiative
 
Data Lakes - The Key to a Scalable Data Architecture
Data Lakes - The Key to a Scalable Data ArchitectureData Lakes - The Key to a Scalable Data Architecture
Data Lakes - The Key to a Scalable Data Architecture
 
The Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data HubThe Future of Data Management: The Enterprise Data Hub
The Future of Data Management: The Enterprise Data Hub
 
2012 10 bigdata_overview
2012 10 bigdata_overview2012 10 bigdata_overview
2012 10 bigdata_overview
 
Hybrid Data Architecture: Integrating Hadoop with a Data Warehouse
Hybrid Data Architecture: Integrating Hadoop with a Data WarehouseHybrid Data Architecture: Integrating Hadoop with a Data Warehouse
Hybrid Data Architecture: Integrating Hadoop with a Data Warehouse
 
GoldenGate and Stream Processing with Special Guest Rakuten
GoldenGate and Stream Processing with Special Guest RakutenGoldenGate and Stream Processing with Special Guest Rakuten
GoldenGate and Stream Processing with Special Guest Rakuten
 
Big Data Discovery
Big Data DiscoveryBig Data Discovery
Big Data Discovery
 
Hadoop India Summit, Feb 2011 - Informatica
Hadoop India Summit, Feb 2011 - InformaticaHadoop India Summit, Feb 2011 - Informatica
Hadoop India Summit, Feb 2011 - Informatica
 
Hadoop in the Enterprise - Dr. Amr Awadallah @ Microstrategy World 2011
Hadoop in the Enterprise - Dr. Amr Awadallah @ Microstrategy World 2011Hadoop in the Enterprise - Dr. Amr Awadallah @ Microstrategy World 2011
Hadoop in the Enterprise - Dr. Amr Awadallah @ Microstrategy World 2011
 
Oil and gas big data edition
Oil and gas  big data editionOil and gas  big data edition
Oil and gas big data edition
 
Data Lake, Virtual Database, or Data Hub - How to Choose?
Data Lake, Virtual Database, or Data Hub - How to Choose?Data Lake, Virtual Database, or Data Hub - How to Choose?
Data Lake, Virtual Database, or Data Hub - How to Choose?
 
Enabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data VirtualizationEnabling a Data Mesh Architecture with Data Virtualization
Enabling a Data Mesh Architecture with Data Virtualization
 

Viewers also liked (7)

Oracle Big Data Governance Webcast Charts
Oracle Big Data Governance Webcast ChartsOracle Big Data Governance Webcast Charts
Oracle Big Data Governance Webcast Charts
 
Tapping into the Big Data Reservoir (CON7934)
Tapping into the Big Data Reservoir (CON7934)Tapping into the Big Data Reservoir (CON7934)
Tapping into the Big Data Reservoir (CON7934)
 
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
 
Intelligent Integration OOW2017 - Jeff Pollock
Intelligent Integration OOW2017 - Jeff PollockIntelligent Integration OOW2017 - Jeff Pollock
Intelligent Integration OOW2017 - Jeff Pollock
 
CDO - Chief Data Officer Momentum and Trends
CDO - Chief Data Officer Momentum and TrendsCDO - Chief Data Officer Momentum and Trends
CDO - Chief Data Officer Momentum and Trends
 
Brief lessons from the greatest product managers
Brief lessons from the greatest product managersBrief lessons from the greatest product managers
Brief lessons from the greatest product managers
 
Oracle Data Integration CON9737 at OpenWorld
Oracle Data Integration CON9737 at OpenWorldOracle Data Integration CON9737 at OpenWorld
Oracle Data Integration CON9737 at OpenWorld
 

Similar to One Slide Overview: ORCL Big Data Integration and Governance

Webinar future dataintegration-datamesh-and-goldengatekafka
Webinar future dataintegration-datamesh-and-goldengatekafkaWebinar future dataintegration-datamesh-and-goldengatekafka
Webinar future dataintegration-datamesh-and-goldengatekafka
Jeffrey T. Pollock
 
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
DataWorks Summit
 

Similar to One Slide Overview: ORCL Big Data Integration and Governance (20)

Hortonworks Oracle Big Data Integration
Hortonworks Oracle Big Data Integration Hortonworks Oracle Big Data Integration
Hortonworks Oracle Big Data Integration
 
Tame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data IntegrationTame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data Integration
 
2017 OpenWorld Keynote for Data Integration
2017 OpenWorld Keynote for Data Integration2017 OpenWorld Keynote for Data Integration
2017 OpenWorld Keynote for Data Integration
 
Data Integration for Big Data (OOW 2016, Co-Presented With Oracle)
Data Integration for Big Data (OOW 2016, Co-Presented With Oracle)Data Integration for Big Data (OOW 2016, Co-Presented With Oracle)
Data Integration for Big Data (OOW 2016, Co-Presented With Oracle)
 
Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...
Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...
Oracle’s Advanced Analytics & Machine Learning 12.2c New Features & Road Map;...
 
Enterprise Hadoop is Here to Stay: Plan Your Evolution Strategy
Enterprise Hadoop is Here to Stay: Plan Your Evolution StrategyEnterprise Hadoop is Here to Stay: Plan Your Evolution Strategy
Enterprise Hadoop is Here to Stay: Plan Your Evolution Strategy
 
Turning Relational Database Tables into Hadoop Datasources by Kuassi Mensah
Turning Relational Database Tables into Hadoop Datasources by Kuassi MensahTurning Relational Database Tables into Hadoop Datasources by Kuassi Mensah
Turning Relational Database Tables into Hadoop Datasources by Kuassi Mensah
 
Teradata - Presentation at Hortonworks Booth - Strata 2014
Teradata - Presentation at Hortonworks Booth - Strata 2014Teradata - Presentation at Hortonworks Booth - Strata 2014
Teradata - Presentation at Hortonworks Booth - Strata 2014
 
Oracle big data discovery 994294
Oracle big data discovery   994294Oracle big data discovery   994294
Oracle big data discovery 994294
 
Webinar future dataintegration-datamesh-and-goldengatekafka
Webinar future dataintegration-datamesh-and-goldengatekafkaWebinar future dataintegration-datamesh-and-goldengatekafka
Webinar future dataintegration-datamesh-and-goldengatekafka
 
Analytics and Lakehouse Integration Options for Oracle Applications
Analytics and Lakehouse Integration Options for Oracle ApplicationsAnalytics and Lakehouse Integration Options for Oracle Applications
Analytics and Lakehouse Integration Options for Oracle Applications
 
Big Data
Big DataBig Data
Big Data
 
Oracle Unified Information Architeture + Analytics by Example
Oracle Unified Information Architeture + Analytics by ExampleOracle Unified Information Architeture + Analytics by Example
Oracle Unified Information Architeture + Analytics by Example
 
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
Big Data Management System: Smart SQL Processing Across Hadoop and your Data ...
 
Apache Hadoop and its role in Big Data architecture - Himanshu Bari
Apache Hadoop and its role in Big Data architecture - Himanshu BariApache Hadoop and its role in Big Data architecture - Himanshu Bari
Apache Hadoop and its role in Big Data architecture - Himanshu Bari
 
Combine Apache Hadoop and Elasticsearch to Get the Most of Your Big Data
Combine Apache Hadoop and Elasticsearch to Get the Most of Your Big DataCombine Apache Hadoop and Elasticsearch to Get the Most of Your Big Data
Combine Apache Hadoop and Elasticsearch to Get the Most of Your Big Data
 
HDP Next: Governance
HDP Next: GovernanceHDP Next: Governance
HDP Next: Governance
 
Data Governance - Atlas 7.12.2015
Data Governance - Atlas 7.12.2015Data Governance - Atlas 7.12.2015
Data Governance - Atlas 7.12.2015
 
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
Oracle Openworld Presentation with Paul Kent (SAS) on Big Data Appliance and ...
 
Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data
Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data
Meetup Oracle Database MAD: 2.1 Data Management Trends: SQL, NoSQL y Big Data
 

Recently uploaded

Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...
Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...
Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...
Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg
 

Recently uploaded (20)

UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaUNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
 
Automate your OpenSIPS config tests - OpenSIPS Summit 2024
Automate your OpenSIPS config tests - OpenSIPS Summit 2024Automate your OpenSIPS config tests - OpenSIPS Summit 2024
Automate your OpenSIPS config tests - OpenSIPS Summit 2024
 
Test Automation Design Patterns_ A Comprehensive Guide.pdf
Test Automation Design Patterns_ A Comprehensive Guide.pdfTest Automation Design Patterns_ A Comprehensive Guide.pdf
Test Automation Design Patterns_ A Comprehensive Guide.pdf
 
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
 
A Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdfA Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdf
 
AzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdf
AzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdfAzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdf
AzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdf
 
Transformer Neural Network Use Cases with Links
Transformer Neural Network Use Cases with LinksTransformer Neural Network Use Cases with Links
Transformer Neural Network Use Cases with Links
 
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCAOpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
 
From Theory to Practice: Utilizing SpiraPlan's REST API
From Theory to Practice: Utilizing SpiraPlan's REST APIFrom Theory to Practice: Utilizing SpiraPlan's REST API
From Theory to Practice: Utilizing SpiraPlan's REST API
 
Effective Strategies for Wix's Scaling challenges - GeeCon
Effective Strategies for Wix's Scaling challenges - GeeConEffective Strategies for Wix's Scaling challenges - GeeCon
Effective Strategies for Wix's Scaling challenges - GeeCon
 
Abortion Pill Prices Mthatha (@](+27832195400*)[ 🏥 Women's Abortion Clinic In...
Abortion Pill Prices Mthatha (@](+27832195400*)[ 🏥 Women's Abortion Clinic In...Abortion Pill Prices Mthatha (@](+27832195400*)[ 🏥 Women's Abortion Clinic In...
Abortion Pill Prices Mthatha (@](+27832195400*)[ 🏥 Women's Abortion Clinic In...
 
Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...
Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...
Abortion Pill Prices Germiston ](+27832195400*)[ 🏥 Women's Abortion Clinic in...
 
Evolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI EraEvolving Data Governance for the Real-time Streaming and AI Era
Evolving Data Governance for the Real-time Streaming and AI Era
 
Abortion Clinic In Pongola ](+27832195400*)[ 🏥 Safe Abortion Pills In Pongola...
Abortion Clinic In Pongola ](+27832195400*)[ 🏥 Safe Abortion Pills In Pongola...Abortion Clinic In Pongola ](+27832195400*)[ 🏥 Safe Abortion Pills In Pongola...
Abortion Clinic In Pongola ](+27832195400*)[ 🏥 Safe Abortion Pills In Pongola...
 
Abortion Clinic in Bloemfontein [(+27832195400*)]🏥Safe Abortion Pills In Bloe...
Abortion Clinic in Bloemfontein [(+27832195400*)]🏥Safe Abortion Pills In Bloe...Abortion Clinic in Bloemfontein [(+27832195400*)]🏥Safe Abortion Pills In Bloe...
Abortion Clinic in Bloemfontein [(+27832195400*)]🏥Safe Abortion Pills In Bloe...
 
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
Workshop -  Architecting Innovative Graph Applications- GraphSummit MilanWorkshop -  Architecting Innovative Graph Applications- GraphSummit Milan
Workshop - Architecting Innovative Graph Applications- GraphSummit Milan
 
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
 
Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...
Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...
Abortion Pill Prices Jane Furse ](+27832195400*)[🏥Women's Abortion Clinic in ...
 
BusinessGPT - Security and Governance for Generative AI
BusinessGPT  - Security and Governance for Generative AIBusinessGPT  - Security and Governance for Generative AI
BusinessGPT - Security and Governance for Generative AI
 
Abortion Pill Prices Aliwal North ](+27832195400*)[ 🏥 Women's Abortion Clinic...
Abortion Pill Prices Aliwal North ](+27832195400*)[ 🏥 Women's Abortion Clinic...Abortion Pill Prices Aliwal North ](+27832195400*)[ 🏥 Women's Abortion Clinic...
Abortion Pill Prices Aliwal North ](+27832195400*)[ 🏥 Women's Abortion Clinic...
 

One Slide Overview: ORCL Big Data Integration and Governance

  • 1. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Staging Oracle Big Data Integration and Lambda/Kappa Architecture 1Oracle Big Data Integration and Governance Sqoop HDFS Hive Flume Capture Trail Route Deliver Pump Transformation Model First Analytics • Oracle BIEE • SAS, Cognos / SPSS • Business Objects • Microstrategy Data Streaming Discovery Sandbox/s Kafka (MPP Pub/Sub) Storm and Trident Spark Streaming Data First Analytics • Oracle Endeca • Tableau • Cliq • Spotfire In-Motion Analytics & Data Services • Vertical specific • Internet of Things / Telematics • Data monetization HBase R Oracle GoldenGate Oracle Data Integrator Oracle Data Governance
  • 2. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Comprehensive Oracle Data Integration & Governance Oracle Company Confidential 2 Fast Load Speed Layer Batch Layer Oracle Data Integrator (Transform) Oracle GoldenGate (Move) Data Service Integrator (Federate) Data Governance Foundation Enterprise Data Quality (Profile & Cleanse) Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance) Veridata (Verify) Data Enrichment (Prepare) Real-Time Data Movement – Low impact capture, stage in Hadoop – Continuous data availability Data Transformation – Bulk data movement – Pushdown data processing Data Federation – Virtualized Data Services Data Governance – Prepare unstructured data – Profile data with sampling – Clean data in real time or batch – Verify data for consistency – Trace lineage of all data – Define glossary of business terms
  • 3. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 4 Business Patterns of Big Data Reservoir Success Oracle Company Confidential 3 Sandbox ETL Offload Staging Deep Data Storage Data First Analytics Model First Analytics In-Motion Analytics Data Services New Data Services: – Stakeholder: Line of Business (LoB) – Core Value: Monetizing data by reselling services – Innovation: Streaming platforms correlate and analyze realtime data from devices and apps Faster Analytics: – Stakeholders: Line of Business (LoB) with IT – Core Value: Faster access to business data, Faster time to value on Analytics – Innovation: Schema-on-read empowers rapid data staging and true Data Discovery ETL Offload: – Stakeholder: Information Technology (IT) – Core Value: Cost avoidance on DW/Marts – Innovation: YARN/Hadoop empowers lower cost compute and lower cost storage Deep Data Storage: – Stakeholder: Risk / Compliance (LoB) – Core Value: High fidelity aged data – Innovation: SQL on Hadoop engines enable very low cost, queryable data access Streaming
  • 4. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Approach to Big Data Integration is Superior Oracle Company Confidential 4 Sandbox ETL Offload Staging Deep Data Storage Data First Analytics Model First Analytics In-Motion Analytics Data Services Oracle GoldenGate: – Non-invasive data capture – Low-latency data movement – Full or partial records staging – Most proven integration tool worldwide Oracle Data Integrator: – No ETL engine is required – Logical design is separate from physical – Deploys in Hadoop or off cluster – Many options for movement Data Governance: – Data Preparation and Enrichment – Data Profiling and Cleansing – Data Verification – Metadata Management – Business Glossary Streaming Oracle Data Integrator (Transform) Oracle GoldenGate (Move) Data Service Integrator (Federate) Data Governance Foundation Enterprise Data Quality (Profile & Cleanse) Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance) Veridata (Verify) Data Enrichment (Prepare)
  • 5. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Does Big Data Better: Dynamic Data Movement 5Oracle Confidential, under Non-Disclosure HDFS (Files) HBase (NoSQL) Hive / Hive Streaming (SQL) Flume & Storm (Streaming) Kafka (MPP Pub/Sub) Spark Streaming (Machine Learning) Capture Database Transactions and Deliver to Big Data in Real-Time Capture Trail Route Deliver Pump GoldenGate
  • 6. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Does Big Data Better: Invented Pushdown Processing 6 ORCLInvestmentsinELT/PushdownTech Scripted SQL Stored Procs Warehouse Builder Data Integrator (Heterogeneous) ODI for Columnar DBs ODI for In-Memory DBs ODI for Engineered Systems ODI for Hadoop NoSQL ODI for Hadoop Pig & Oozie ODI for Spark ODI for … 1990’s Eon of Scripts and PL-SQL Era of Native SQL Big Data Revolution  Oracle’s tool maturity and operational know-how for E-LT is unmatched  10x bigger footprint with E-LT than next closest competitor using “pushdown”  Simple and easy way to blend Hadoop and SQL E-LT execution from one tool ODI for Hadoop Hive Oracle Confidential, under Non-Disclosure