The document provides an agenda and overview for an Oracle event on GoldenGate. It discusses GoldenGate use cases, features for databases and big data, and streaming analytics. It also summarizes new capabilities in GoldenGate 19.1 like improved performance, security and manageability for microservices, and support for Oracle Database 19c. The document outlines Oracle's vision of GoldenGate as a real-time data fabric ecosystem enabling streaming, databases, cloud, and big data use cases.
Oracle GoldenGate is the leading real-time data integration software provider in the industry - customers include 3 of the top 5 commercial banks, 3 of the top 3 busiest ATM networks, and 4 of the top 5 telecommunications providers.
Oracle GoldenGate moves transactional data in real-time across heterogeneous database, hardware and operating systems with minimal impact. The software platform captures, routes, and delivers data in real time, enabling organizations to maintain continuous uptime for critical applications during planned and unplanned outages.
Additionally, it moves data from transaction processing environments to read-only reporting databases and analytical applications for accurate, timely reporting and improved business intelligence for the enterprise.
Best Practices for the Most Impactful Oracle Database 18c and 19c FeaturesMarkus Michalewicz
This presentation answers the question, “What’s new in Oracle Database 19c ?” in a slightly different way: by providing best practices and a deep dive into the most impactful high availability (HA), scalability, and lifecycle management features in Oracle Database 12c, 18c and 19c, including a short roadmap of features yet to come in the next generation Oracle Database.
This deck was first presented during OOW19 together with Mauricio Feria, who reported on two of his customers and how they have used Oracle Database HA features and Maximum Availability Architecture (MAA) to improve their businesses.
Oracle Real Application Clusters (RAC) Roadmap for New Features describes and discusses best practices for new features introduced with Oracle RAC 12c as well as Oracle RAC 18c and provides a short outlook of the road ahead.
The Top 5 Reasons to Deploy Your Applications on Oracle RACMarkus Michalewicz
A presentation for developers, DBAs, and managers. This presentation was first presented in course of the AIOUG Maximum Availability Architecture (MAA)-focus month August 2021. The first reason might surprise you!
This version of "Oracle Real Application Clusters (RAC) 19c & Later – Best Practices" was first presented in Oracle Open World (OOW) London 2020 and includes content from the OOW 2019 version of the deck. The deck has been updated with the latest information regarding ORAchk as well as upgrade tips & tricks.
Oracle GoldenGate is the leading real-time data integration software provider in the industry - customers include 3 of the top 5 commercial banks, 3 of the top 3 busiest ATM networks, and 4 of the top 5 telecommunications providers.
Oracle GoldenGate moves transactional data in real-time across heterogeneous database, hardware and operating systems with minimal impact. The software platform captures, routes, and delivers data in real time, enabling organizations to maintain continuous uptime for critical applications during planned and unplanned outages.
Additionally, it moves data from transaction processing environments to read-only reporting databases and analytical applications for accurate, timely reporting and improved business intelligence for the enterprise.
Best Practices for the Most Impactful Oracle Database 18c and 19c FeaturesMarkus Michalewicz
This presentation answers the question, “What’s new in Oracle Database 19c ?” in a slightly different way: by providing best practices and a deep dive into the most impactful high availability (HA), scalability, and lifecycle management features in Oracle Database 12c, 18c and 19c, including a short roadmap of features yet to come in the next generation Oracle Database.
This deck was first presented during OOW19 together with Mauricio Feria, who reported on two of his customers and how they have used Oracle Database HA features and Maximum Availability Architecture (MAA) to improve their businesses.
Oracle Real Application Clusters (RAC) Roadmap for New Features describes and discusses best practices for new features introduced with Oracle RAC 12c as well as Oracle RAC 18c and provides a short outlook of the road ahead.
The Top 5 Reasons to Deploy Your Applications on Oracle RACMarkus Michalewicz
A presentation for developers, DBAs, and managers. This presentation was first presented in course of the AIOUG Maximum Availability Architecture (MAA)-focus month August 2021. The first reason might surprise you!
This version of "Oracle Real Application Clusters (RAC) 19c & Later – Best Practices" was first presented in Oracle Open World (OOW) London 2020 and includes content from the OOW 2019 version of the deck. The deck has been updated with the latest information regarding ORAchk as well as upgrade tips & tricks.
Make Your Application “Oracle RAC Ready” & Test For ItMarkus Michalewicz
This presentation talks about the secrets behind Oracle RAC’s horizontal scaling algorithm, Cache Fusion, and how you can ensure that your application is “Oracle RAC ready.”. It discusses do's and don'ts and how to test your application for "Oracle RAC readiness". This version was first presented in Sangam19.
What to Expect From Oracle database 19cMaria Colgan
The Oracle Database has recently switched to an annual release model. Oracle Database 19c is only the second release in this new model. So what can you expect from the latest version of the Oracle Database? This presentation explains how Oracle Database 19c is really 12.2.0.3 the terminal release of the 12.2 family and the new features you can find in this release.
Building Lakehouses on Delta Lake with SQL Analytics PrimerDatabricks
You’ve heard the marketing buzz, maybe you have been to a workshop and worked with some Spark, Delta, SQL, Python, or R, but you still need some help putting all the pieces together? Join us as we review some common techniques to build a lakehouse using Delta Lake, use SQL Analytics to perform exploratory analysis, and build connectivity for BI applications.
This presentation discusses the top 5 reasons as well as various technology updates to provide a reasonable answer to the rather common question: "Why should one use an Oracle Database?". This "2020 "C-Edition" was first presented during the IOUG / Quest Forum Digital Event: Database & tech Week in June 2020 and subsequently updated based on feedback received.
Standard Edition High Availability (SEHA) - The Why, What & HowMarkus Michalewicz
Standard Edition High Availability (SEHA) is the latest addition to Oracle’s high availability solutions. This presentation explains the motivation for Standard Edition High Availability, how it is implemented and the way it works currently as well as what is planned for future improvements. It was first presented during Oracle Groundbreakers Yatra (OGYatra) Online in July 2020.
"Maximum Availability Architecture (MAA) for Oracle Database, Exadata and the Cloud" was first presented during Oracle Open World (OOW) 2019. This version of the deck has been updated for OOW London 2020 including the latest information regarding patching and upgrading the Oracle Database with Zero Downtime.
ODA Backup Restore Utility & ODA Rescue Live DiskRuggero Citton
When applying maintenance to Oracle Database Appliance, it's best practice to back up the ODA system environment (local system boot disk). DBAs have procedures to backup and recover the database but it is also important that you are able to backup and recover the environment that runs the database. This is especially useful if you encounter an issue during patching; you can quickly restore the system disk back to the pre-patch state.
The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse.
Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today.
Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow.
This is an educational event.
Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.
Webinar future dataintegration-datamesh-and-goldengatekafkaJeffrey T. Pollock
The Future of Data Integration: Data Mesh, and a Special Deep Dive into Stream Processing with GoldenGate, Apache Kafka and Apache Spark. This video is a replay of a Live Webinar hosted on 03/19/2020.
Join us for a timely 45min webinar to see our take on the future of Data Integration. As the global industry shift towards the “Fourth Industrial Revolution” continues, outmoded styles of centralized batch processing and ETL tooling continue to be replaced by realtime, streaming, microservices and distributed data architecture patterns.
This webinar will start with a brief look at the macro-trends happening around distributed data management and how that affects Data Integration. Next, we’ll discuss the event-driven integrations provided by GoldenGate Big Data, and continue with a deep-dive into some essential patterns we see when replicating Database change events into Apache Kafka. In this deep-dive we will explain how to effectively deal with issues like Transaction Consistency, Table/Topic Mappings, managing the DB Change Stream, and various Deployment Topologies to consider. Finally, we’ll wrap up with a brief look into how Stream Processing will help to empower modern Data Integration by supplying realtime data transformations, time-series analytics, and embedded Machine Learning from within data pipelines.
GoldenGate: https://www.oracle.com/middleware/tec...
Webinar Speaker: Jeff Pollock, VP Product (https://www.linkedin.com/in/jtpollock/)
Prezentace z webináře dne 10.3.2022
Prezentovali:
Jaroslav Malina - Senior Channel Sales Manager, Oracle
Josef Krejčí - Technology Sales Consultant, Oracle
Josef Šlahůnek - Cloud Systems sales Consultant, Oracle
Make Your Application “Oracle RAC Ready” & Test For ItMarkus Michalewicz
This presentation talks about the secrets behind Oracle RAC’s horizontal scaling algorithm, Cache Fusion, and how you can ensure that your application is “Oracle RAC ready.”. It discusses do's and don'ts and how to test your application for "Oracle RAC readiness". This version was first presented in Sangam19.
What to Expect From Oracle database 19cMaria Colgan
The Oracle Database has recently switched to an annual release model. Oracle Database 19c is only the second release in this new model. So what can you expect from the latest version of the Oracle Database? This presentation explains how Oracle Database 19c is really 12.2.0.3 the terminal release of the 12.2 family and the new features you can find in this release.
Building Lakehouses on Delta Lake with SQL Analytics PrimerDatabricks
You’ve heard the marketing buzz, maybe you have been to a workshop and worked with some Spark, Delta, SQL, Python, or R, but you still need some help putting all the pieces together? Join us as we review some common techniques to build a lakehouse using Delta Lake, use SQL Analytics to perform exploratory analysis, and build connectivity for BI applications.
This presentation discusses the top 5 reasons as well as various technology updates to provide a reasonable answer to the rather common question: "Why should one use an Oracle Database?". This "2020 "C-Edition" was first presented during the IOUG / Quest Forum Digital Event: Database & tech Week in June 2020 and subsequently updated based on feedback received.
Standard Edition High Availability (SEHA) - The Why, What & HowMarkus Michalewicz
Standard Edition High Availability (SEHA) is the latest addition to Oracle’s high availability solutions. This presentation explains the motivation for Standard Edition High Availability, how it is implemented and the way it works currently as well as what is planned for future improvements. It was first presented during Oracle Groundbreakers Yatra (OGYatra) Online in July 2020.
"Maximum Availability Architecture (MAA) for Oracle Database, Exadata and the Cloud" was first presented during Oracle Open World (OOW) 2019. This version of the deck has been updated for OOW London 2020 including the latest information regarding patching and upgrading the Oracle Database with Zero Downtime.
ODA Backup Restore Utility & ODA Rescue Live DiskRuggero Citton
When applying maintenance to Oracle Database Appliance, it's best practice to back up the ODA system environment (local system boot disk). DBAs have procedures to backup and recover the database but it is also important that you are able to backup and recover the environment that runs the database. This is especially useful if you encounter an issue during patching; you can quickly restore the system disk back to the pre-patch state.
The world of data architecture began with applications. Next came data warehouses. Then text was organized into a data warehouse.
Then one day the world discovered a whole new kind of data that was being generated by organizations. The world found that machines generated data that could be transformed into valuable insights. This was the origin of what is today called the data lakehouse. The evolution of data architecture continues today.
Come listen to industry experts describe this transformation of ordinary data into a data architecture that is invaluable to business. Simply put, organizations that take data architecture seriously are going to be at the forefront of business tomorrow.
This is an educational event.
Several of the authors of the book Building the Data Lakehouse will be presenting at this symposium.
Webinar future dataintegration-datamesh-and-goldengatekafkaJeffrey T. Pollock
The Future of Data Integration: Data Mesh, and a Special Deep Dive into Stream Processing with GoldenGate, Apache Kafka and Apache Spark. This video is a replay of a Live Webinar hosted on 03/19/2020.
Join us for a timely 45min webinar to see our take on the future of Data Integration. As the global industry shift towards the “Fourth Industrial Revolution” continues, outmoded styles of centralized batch processing and ETL tooling continue to be replaced by realtime, streaming, microservices and distributed data architecture patterns.
This webinar will start with a brief look at the macro-trends happening around distributed data management and how that affects Data Integration. Next, we’ll discuss the event-driven integrations provided by GoldenGate Big Data, and continue with a deep-dive into some essential patterns we see when replicating Database change events into Apache Kafka. In this deep-dive we will explain how to effectively deal with issues like Transaction Consistency, Table/Topic Mappings, managing the DB Change Stream, and various Deployment Topologies to consider. Finally, we’ll wrap up with a brief look into how Stream Processing will help to empower modern Data Integration by supplying realtime data transformations, time-series analytics, and embedded Machine Learning from within data pipelines.
GoldenGate: https://www.oracle.com/middleware/tec...
Webinar Speaker: Jeff Pollock, VP Product (https://www.linkedin.com/in/jtpollock/)
Prezentace z webináře dne 10.3.2022
Prezentovali:
Jaroslav Malina - Senior Channel Sales Manager, Oracle
Josef Krejčí - Technology Sales Consultant, Oracle
Josef Šlahůnek - Cloud Systems sales Consultant, Oracle
Oracle GoldenGate Cloud Service OverviewJinyu Wang
The new PaaS solution in Oracle Public Cloud extends the real-time data replication from on-premises to cloud, and leads the innovation of real-time data movement with the powerful data streaming capability for enterprise solutions.
GoldenGate and Stream Processing with Special Guest RakutenJeffrey T. Pollock
Oracle OpenWorld roadmap presentation for GoldenGate, stream processing, analytics and big data use cases with special guest presenters from Rakuten Travel.
Oracle Database Migration to Oracle Cloud InfrastructureSinanPetrusToma
This slide deck highlights the benefits of Oracle Cloud, describes the different Oracle database cloud services and their characteristics, which one to choose and what to consider, and more than 20 methods and solutions Oracle offers to migrate Oracle databases across platforms.
Fluentd – Making Logging Easy & Effective in a Multi-cloud & Hybrid Environme...Phil Wilkins
Presentation I gave to Developer Week Europe 2022 on the use of Fluentd in Hybrid and distributed use cases.
This builds on previous Fluentd presentations
OOW13: Next Generation Optimized Directory (CON9024)GregOracle
With new computing technologies to transform business, is your underlying directory infrastructure ready to support mobile, cloud and social networking? How can I simplify my directory architecture but deliver high scalability, availability and performance? How to leverage directory to easily make your applications location aware and social relationship aware? How do I migrate existing directories to OUD? How to optimize OUD performance on T5/ T4 hardware? Come to learn Oracle Unified Directory and customer case studies.
Data Integration for Big Data (OOW 2016, Co-Presented With Oracle)Rittman Analytics
Set of product roadmap + capabilities slides from Oracle Data Integration Product Management, and thoughts on data integration on big data implementations by Mark Rittman (Independent Analyst)
Delivering Data Democratization in the Cloud with SnowflakeKent Graziano
This is a brief introduction to Snowflake Cloud Data Platform and our revolutionary architecture. It contains a discussion of some of our unique features along with some real world metrics from our global customer base.
Maximum Availability Architecture - Best Practices for Oracle Database 19cGlen Hawkins
Provides the latest updates on high availability (HA) best practices in this well-established technical deep-dive session. Learn how to optimize all aspects of Oracle Active Data Guard 19c. See how to use session draining, transparent application continuity, Oracle RAC, and Oracle GoldenGate to mask outages and planned maintenance from users and to accelerate time to repair for single database or your fleet of databases. Hear about the latest HA best practices with Oracle Multitenant and understand how the new sharded architecture can achieve even higher levels of HA and fault isolation for OLTP applications. Find out how everything you know about Oracle Maximum Availability Architecture (MAA) on-premises can be deployed in the cloud.
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization Denodo
Watch here: https://bit.ly/2NGQD7R
In an era increasingly dominated by advancements in cloud computing, AI and advanced analytics it may come as a shock that many organizations still rely on data architectures built before the turn of the century. But that scenario is rapidly changing with the increasing adoption of real-time data virtualization - a paradigm shift in the approach that organizations take towards accessing, integrating, and provisioning data required to meet business goals.
As data analytics and data-driven intelligence takes centre stage in today’s digital economy, logical data integration across the widest variety of data sources, with proper security and governance structure in place has become mission-critical.
Attend this session to learn:
- Learn how you can meet cloud and data science challenges with data virtualization.
- Why data virtualization is increasingly finding enterprise-wide adoption
- Discover how customers are reducing costs and improving ROI with data virtualization
Advanced control scheme of doubly fed induction generator for wind turbine us...IJECEIAES
This paper describes a speed control device for generating electrical energy on an electricity network based on the doubly fed induction generator (DFIG) used for wind power conversion systems. At first, a double-fed induction generator model was constructed. A control law is formulated to govern the flow of energy between the stator of a DFIG and the energy network using three types of controllers: proportional integral (PI), sliding mode controller (SMC) and second order sliding mode controller (SOSMC). Their different results in terms of power reference tracking, reaction to unexpected speed fluctuations, sensitivity to perturbations, and resilience against machine parameter alterations are compared. MATLAB/Simulink was used to conduct the simulations for the preceding study. Multiple simulations have shown very satisfying results, and the investigations demonstrate the efficacy and power-enhancing capabilities of the suggested control system.
HEAP SORT ILLUSTRATED WITH HEAPIFY, BUILD HEAP FOR DYNAMIC ARRAYS.
Heap sort is a comparison-based sorting technique based on Binary Heap data structure. It is similar to the selection sort where we first find the minimum element and place the minimum element at the beginning. Repeat the same process for the remaining elements.
Introduction- e - waste – definition - sources of e-waste– hazardous substances in e-waste - effects of e-waste on environment and human health- need for e-waste management– e-waste handling rules - waste minimization techniques for managing e-waste – recycling of e-waste - disposal treatment methods of e- waste – mechanism of extraction of precious metal from leaching solution-global Scenario of E-waste – E-waste in India- case studies.
Using recycled concrete aggregates (RCA) for pavements is crucial to achieving sustainability. Implementing RCA for new pavement can minimize carbon footprint, conserve natural resources, reduce harmful emissions, and lower life cycle costs. Compared to natural aggregate (NA), RCA pavement has fewer comprehensive studies and sustainability assessments.
6th International Conference on Machine Learning & Applications (CMLA 2024)ClaraZara1
6th International Conference on Machine Learning & Applications (CMLA 2024) will provide an excellent international forum for sharing knowledge and results in theory, methodology and applications of on Machine Learning & Applications.
Low power architecture of logic gates using adiabatic techniquesnooriasukmaningtyas
The growing significance of portable systems to limit power consumption in ultra-large-scale-integration chips of very high density, has recently led to rapid and inventive progresses in low-power design. The most effective technique is adiabatic logic circuit design in energy-efficient hardware. This paper presents two adiabatic approaches for the design of low power circuits, modified positive feedback adiabatic logic (modified PFAL) and the other is direct current diode based positive feedback adiabatic logic (DC-DB PFAL). Logic gates are the preliminary components in any digital circuit design. By improving the performance of basic gates, one can improvise the whole system performance. In this paper proposed circuit design of the low power architecture of OR/NOR, AND/NAND, and XOR/XNOR gates are presented using the said approaches and their results are analyzed for powerdissipation, delay, power-delay-product and rise time and compared with the other adiabatic techniques along with the conventional complementary metal oxide semiconductor (CMOS) designs reported in the literature. It has been found that the designs with DC-DB PFAL technique outperform with the percentage improvement of 65% for NOR gate and 7% for NAND gate and 34% for XNOR gate over the modified PFAL techniques at 10 MHz respectively.
Understanding Inductive Bias in Machine LearningSUTEJAS
This presentation explores the concept of inductive bias in machine learning. It explains how algorithms come with built-in assumptions and preferences that guide the learning process. You'll learn about the different types of inductive bias and how they can impact the performance and generalizability of machine learning models.
The presentation also covers the positive and negative aspects of inductive bias, along with strategies for mitigating potential drawbacks. We'll explore examples of how bias manifests in algorithms like neural networks and decision trees.
By understanding inductive bias, you can gain valuable insights into how machine learning models work and make informed decisions when building and deploying them.
13. GoldenGate Microservices Architecture
13
Trail Files
Administration
Service
Metrics
Service
Service
Manager
>REST
Parallel
Replicat
Integrated Remote
Capture
network
DBA/Ops Proxy/Reverse Proxy API Automation
Micro-services Mid-Tier
* Oracle recommends to use Integrated Remote Capture, Micro-Services and Parallel Replicat
Distribution
Service
Receiver
Service
Shared
Storage
14. GoldenGate for Oracle
19.1 New Features
14
Performance and Scalability Improvements
Improved performance and scalability for Parallel Replicat.
Remote integrated capture performance tolerates high latency networks.
Security and Manageability Enhancements for Microservices
Integration with Key Management Systems, Support for DMZ environments.
Defaults changed to TLS1.2, Digest Auth, Strong Password Verifier
Managed profiles for AutoStart, AutoRestart, and Key Management.
Ease of use
Simplified software upgrade procedures. Enhanced heartbeats to simplify system recovery.
Simplify mid-tier & cloud deployments with remote cross-endian Integrated Extract.
Better smart defaults that eliminate need to set parameters for common use cases.
Support for Oracle Database 19.1
Long term support release. Final patchset update for Oracle GoldenGate 12.3 release.
OCI Marketplace Solution
GoldenGate 19.1 available from OCI Marketplace in both Classic and Microservices editions.
Cross endian remote Integrated Extract allows remote capture of all on-premises Oracle databases for easier migration to the cloud.
15. Run Anywhere - Remote Capture
15
*remote transaction capture with zero footprint on Source DB hosts
*heterogeneous support for Mainframe, SQL Server and Postgres *roadmap
*endian normalization inline to GG, Oracle DB 11.2.0.4 and higher
Windows
WAN
GG Mid-Tier Host
Remote Connect
Any GoldenGate
target system
16. Extreme Performance
16
Performance Data Points:
*Note: your experiences will vary
Oracle DB:
-- 4TB REDO/hr, raw performance
seen in Oracle lab setting
-- 1.5TB REDO/hr, actual perf at
large banking customer
-- 1m Tx/second, actual perf at
Fortune 200 manufacturing cust
Non-Oracle DB:
-- 4b Tx/day on DB2 active-active
at Fortune 200 retailer
-- 55k Tx/second on Mainframe to
data lake at APAC mega-bank
• Performance improvements in *every* release
• No other vendor can compare on Oracle Database
replication performance
– Purpose-built APIs for extract and apply
– Integrated (same DB code base) and highly parallel (external
dependency checking)
– Remote capture is network-optimized so that any network faster
than 100ms latency performs similar to local extracts
• Non-Oracle DB performance highly competitive, regularly
win bake-offs w/DB2, Mainframe, SQL Server and other non-
Oracle databases
• Eg: For GoldenGate Big Data, have worked directly with
LinkedIn and Confluent to optimize GGàKafka performance
17. GoldenGate for Big Data
19.1 New Features
17
Transactional Support for MongoDB
MongoDB 4.0+ onwards supports transactions
Stage and Merge to Cloud Data warehouses*
AWS S3 to Redshift
Improvements
Kafka Interceptor support in Kafka Connect Handler *
Before and After Images for Delimited Text Formatter
MAPINVISIBLECOLUMNS functionality for Big Data Targets
Routing key for Elasticsearch shards
Command Event Handler
New event handler to Run external commands after writing a file locally.
Improves performance to DWH loads like Netezza, Greenplum etc
OCI Marketplace Solution
GoldenGate Big Data 19.1 available from OCI Marketplace
Heartbeat
GoldenGate Heartbeat feature
UpToDate Certifications
Hadoop 3.x, HBase 2.x, Elasticsearch 7.x, 6.6, DSE 6.x, Azure DataLake Gen 2, Confluent 5.x, NoSQL 18.1
.
18. • A high-speed, low impact data
comparison and repair solution
•identifies and reports data discrepancies
between heterogeneous databases
•without interrupting their availability
•Certified for integration with Oracle DBCS
• Benefits:
•Reduce financial/legal risk exposure
•Speed and simplify IT work in comparing
data sources
•No disruption to business systems
•Confident decision-making and
reporting
Oracle GoldenGate Veridata
Oracle GoldenGate Veridata
19. • Oracle Preferred monitoring tool,
covers entire Oracle stack – Database,
Storage, FMW etc
• For customers, who prefers to drill into
DB sessions, OS stats, etc, apart from
monitoring GoldenGate process
• Certified for integration with Oracle
DBCS
• Certified with latest OEM 13c
• Certified with GoldenGate
Microservices
Management Pack for Oracle GoldenGate
Enterprise Manager Plug-in
21. 21
Why Stream Analytics?
Streaming Data Automated Decisions
Batch ETL
Decision
Maker Action
DecisionReports
Traditional
AnalyticsData Warehouse
Data Lake
Queries
Event Producers
Business Data
Stream Analytics
Stream Analytics
Batch Analytics
Elapsed time
23. RESTful API for Producers and Subscribers (events are pushed)
Databus
Raw Data
Topics
Schema Event
Topics
Stream
Processing
(ETL)
Prepared
Data Topics
Master Data
Topics
Stream
Processing
(ETL)
10,000’s 100’s 10’s
Lambda/Kappa: Large Batch Mode is Impractical
23
App
DB
App
DB
App
DB
ERP
Operational
Data Store
EDW
Staging Prod
ETL
ETL
ETL
ETL
ETL
Mart
Mart
Mart
ETL
Enterprise BI
Mart
Mart
Mart
ETL
Departmental BIDiscovery
App
DB
App
DB
App
DB
ERP
WebApps
Mobile
EDW
NoSQL
Hadoop / Spark Marts Marts Marts Mobile
Less Governed --------------------------------------------------------------- More Governed
Enterprise BI Departmental BIDiscovery WebApps
Old: Hub and Spoke
• Invasive on Sources
• 24hr+ Latency
• Limited views on data
• Heavy IT process overhead
New: Databus/Kappa
• Low impact on Sources
• ~1 Second Latency
• Access raw or prepared data
• Supports more Agile process
GoldenGate
MDM
Hub
• ODS & ETL Hubs
• EDW/Mart Hubs
• MDM/RDM Hubs
• Big Data Lake Hubs
• Pub/Sub for Staging
• ETL in Pipelines
• Analytics/CEP in Stream
• Static data in “Lake”
26. Oracle Stream Analytics Architecture
26Confidential – Oracle Internal/Restricted/Highly Restricted
OSA Components
OSA Web Application
(Embedded Jetty App Server)
Reference
Input
Oracle DB
Coherence
Oracle DB or MySQL
(Used for Metadata Store)
Apache Hadoop
or Spark
Apache Kafka
Kafka
JMS
GoldenGate
Streaming
Input
Kafka
JMS
REST
Streaming
Output
Analytics
Output
Apache Druid
Oracle DB
File
)In-Memory Cache
(Used for reference data)
27. 6 Differentiators for Oracle Stream Analytics
27
CQL
Interactive
Designer UI
Rich Set of Streaming
Patterns
Predictive Analysis and
Machine Learning
Location and Geospatial
Analysis
Integrated CDC with
Oracle GoldenGate
Robustness, Speed, and
Scalability
32. End State Vision for GoldenGate Offerings
On Premise
World-class Enterprise Software for
Any Data Center
Customer-managed Cloud
Oracle-provided IaaS, World-class
Enterprise Software
Oracle-managed Cloud
Native, Fully-managed Cloud PaaS
Capabilities
Data Replication
àMulti-Active DBs for High Availability
àOracle/Non-Oracle Data Capture
àStreaming Ingest to Data Lakes
ü
- GoldenGate is the most
successful enterprise
integration tool in history
ü
- GoldenGate is provided
with 5 distinct listings
inside Oracle Cloud
Marketplace; providing
automation for 5-minute
provisioning times
ü
- GoldenGate Service will be
a fully managed solution for
customers who do not want
the overhead of admin for
their own Patching,
Upgrades and basic Ops
- All core GoldenGate use
cases will be covered
- All Stream Processing use
cases will come from the
same service (OSA use
cases)
Stream Data Processing
àDataOps on Real-time Event Streams
àETL for Data in Motion (non-batch)
àEvent Correlation across Moving Time Windows
àSpatial and Time-Series Analysis
àSimple plug-in for Machine Learning Scoring
Models
ü
- Oracle Stream Analytics has
10yr history and over 70
patents on core stream
processing technology
ü
- Stream Analytics is
provided in OCI
Marketplace for fast
provisioning and a
simplified Image that is pre-
configured with Kafka,
Spark & MySQL… it is a
turn-key solution
Active investments in leadership across full range of Data Integration capabilities:
35. Additional Information
GoldenGate
OGG-Product Home Page
OGG 19c- Data Sheet
OGG 19c-BD Data Sheet
OGG-Certification Matrix
OGG-Product Download
OGG-BD Demo Image – Big Data Lite VM
OGG-BD 19.1 Documentation
Oracle Stream Analytics
OSA Product Home Page
OSA Data Sheet
OSA Certification Matrix
OSA Product Download
OSA 19.1 Documentation
35
38. About Petroleum Development Oman
Petroleum Development Oman (PDO) is the
leading exploration and production company
in the Sultanate of Oman.
We deliver the majority of the country’s
crude oil production and natural gas supply,
but above all we focus on delivering
excellence, growth and sustainable value
creation within and well beyond our
industry.
39. Background
Petroleum Development Oman (PDO):
PDO Dimensions
•Number of producing oil fields: 209
•Number of producing gas fields: 55
•Number of active wells: 8,000+
•Number of staff: 8,500+
IT Dimensions
• Number of DC: 3 (Main, HA & DR)
• Number of voice lines: 16,000
• Number of Servers: 2,000
• Storage Size: 10 Petabyte
• Number of Applications: 565
• Number of Telecom Rooms:10
40. Health and
Safety
PDO Aspirations
“Comprehensive, robust and reliable technical Data is one of the critical pillars for managing a complex company like PDO; without a healthy Data set it is not
possible to deliver accurate field development plans and/or execute safe and effective operations.”
Raoul Restucci
PDO Managing Director
• Maintain continuous oversight on potential operational risks through access to real time information on hazards, in
order to lower safety incidents and harm to assets and people.
• Accelerate the growth by improving operational performance, reducing the TCO, eliminating operational wastes and
redundancies, increasing throughput from existing assets and maintain equipment integrity.
• Reduce the downtime by improving efficiencies and asset productivity
• Reduce the WE overhead activity
• Reduce the e2e new oil / gas delivery time.
Improved
Production
• Increased collaboration and Integration across businesses and seamless transparent transfer of information across PDO to
take real-time decisions to Improve people productivity.
Operational
Excellence
Integrated
Business
PDO’s high level strategy consists of the following areas of improvements and objectives:
40
41. PDO Data Management Strategy
• Improve decision-making by providing relevant, reliable and up-to-date data to PDO
personnel with Data Profiling and Data Quality technologies
• Batch and real time Data Integration with ELT and Replication technologies
• Optimise Business Processes by introducing Data Governance
• Provide single version of the truth with the support of Master Data Management
technologies
• Enable digitalisation initiatives ML and AI by introducing Data Lake and Advanced
Analytics technologies
42. 42
Data and Analytics as Core Capability
Digitalisation of Support Functions
Mobile Devices IoT Platforms Cloud Computing
Location Detection
Technologies
3D Printing
Digital Oilfield Digital Twin Plant Smart Sensors
Advanced
Human-Machine
Interfaces
IT/Technology
Architecture
Digital Capabilities and
Culture
Partnership and
Alliances
Information Risk
Management
Key Enablers
Data Management,
Governance, Processes
Digitalisation Journey
43. Corporate Information Factory
The PDO Corporate Information Factory programme is an enterprise-wide initiative designed to address and solve the challenges faced by the
business around Data. (Data Governance, Master Data Management, Data Lake, Data Integration,Advanced Analytics Platform, Data Quality)
Corporate Information Factory (CIF)
Business Intelligence
Services
Integration
DataGovernance
DataSecurity
KPI
Hierarchy
Dashboard
and Visual
Self Service
Exception
Based Alerts
Advance
Analytics
Data
Discovery
Analytics
API Manager
Semantic Data
Layer
Batch Transfer Big Data Analytics Automation
Data Platform
Low Latency Data
Store
Enterprise
DW
Data Lake
Data
Discovery
Data Platform
Master Data
Management
Source Systems Production
Applications
Enterprise
Applications
Engineering
Applications
Operation
Applications
External
Applications
Subsurface
Applications
43
Streaming
44. Data Management Journey
ETL Mappings
Implementation
with ODI
Database
Consolidation
Exadata
Enterprise Data
Quality (EDQ)
Implementation
Data
Governance
Data
Integration
Self Service
Analytics
Data Management Road Map
Metadata
Management
Data Lake /
Data Streaming
Advanced
Analytics
Master Data
Management
Not Started
Completed
In Progress
Digitalisation