This document summarizes a session on tuning Oracle GoldenGate performance between an Oracle source and target database. It discusses tools for monitoring GoldenGate performance such as lag reports, process statistics, and database views. It also provides a case study example configuration and recommendations for tuning integrated extract and replicat parameters such as parallelism settings.
What to Expect From Oracle database 19cMaria Colgan
The Oracle Database has recently switched to an annual release model. Oracle Database 19c is only the second release in this new model. So what can you expect from the latest version of the Oracle Database? This presentation explains how Oracle Database 19c is really 12.2.0.3 the terminal release of the 12.2 family and the new features you can find in this release.
Understanding SQL Trace, TKPROF and Execution Plan for beginnersCarlos Sierra
The three fundamental steps of SQL Tuning are: 1) Diagnostics Collection; 2) Root Cause Analysis (RCA); and 3) Remediation. This introductory session on SQL Tuning is for novice DBAs and Developers that are required to investigate a piece of an application performing poorly.
On this session participants will learn about producing a SQL Trace then a summary TKPROF report. A sample TKPROF is navigated with the audience, where the trivial and the no so trivial is exposed and explain. Execution Plans are also navigated and explained, so participants can later untangle complex Execution Plans and start diagnosing SQL performing badly.
This session encourages participants to ask all kind of questions that could be potential road-blocks for deeper understanding of how to address a SQL performing poorly.
"Structured Streaming was a new streaming API introduced to Spark over 2 years ago in Spark 2.0, and was announced GA as of Spark 2.2. Databricks customers have processed over a hundred trillion rows in production using Structured Streaming. We received dozens of questions on how to best develop, monitor, test, deploy and upgrade these jobs. In this talk, we aim to share best practices around what has worked and what hasn't across our customer base.
We will tackle questions around how to plan ahead, what kind of code changes are safe for structured streaming jobs, how to architect streaming pipelines which can give you the most flexibility without sacrificing performance by using tools like Databricks Delta, how to best monitor your streaming jobs and alert if your streams are falling behind or are actually failing, as well as how to best test your code."
What to Expect From Oracle database 19cMaria Colgan
The Oracle Database has recently switched to an annual release model. Oracle Database 19c is only the second release in this new model. So what can you expect from the latest version of the Oracle Database? This presentation explains how Oracle Database 19c is really 12.2.0.3 the terminal release of the 12.2 family and the new features you can find in this release.
Understanding SQL Trace, TKPROF and Execution Plan for beginnersCarlos Sierra
The three fundamental steps of SQL Tuning are: 1) Diagnostics Collection; 2) Root Cause Analysis (RCA); and 3) Remediation. This introductory session on SQL Tuning is for novice DBAs and Developers that are required to investigate a piece of an application performing poorly.
On this session participants will learn about producing a SQL Trace then a summary TKPROF report. A sample TKPROF is navigated with the audience, where the trivial and the no so trivial is exposed and explain. Execution Plans are also navigated and explained, so participants can later untangle complex Execution Plans and start diagnosing SQL performing badly.
This session encourages participants to ask all kind of questions that could be potential road-blocks for deeper understanding of how to address a SQL performing poorly.
"Structured Streaming was a new streaming API introduced to Spark over 2 years ago in Spark 2.0, and was announced GA as of Spark 2.2. Databricks customers have processed over a hundred trillion rows in production using Structured Streaming. We received dozens of questions on how to best develop, monitor, test, deploy and upgrade these jobs. In this talk, we aim to share best practices around what has worked and what hasn't across our customer base.
We will tackle questions around how to plan ahead, what kind of code changes are safe for structured streaming jobs, how to architect streaming pipelines which can give you the most flexibility without sacrificing performance by using tools like Databricks Delta, how to best monitor your streaming jobs and alert if your streams are falling behind or are actually failing, as well as how to best test your code."
The biggest headine at the 2009 Oracle OpenWorld was when Larry Ellison announced that Oracle was entering the hardware business with a pre-built database machine, engineered by Oracle. Since then businesses around the world have started to use these engineered systems. This beginner/intermediate-level session will take you through my first 100 days of starting to administer an Exadata machine and all the roadblocks and all the success I had along this new path.
LAD - GroundBreakers - Jul 2019 - Using Oracle Autonomous Health Framework to...Sandesh Rao
This session will focus on the best practice use of the Oracle Autonomous Health Framework (AHF) with an emphasis on troubleshooting private cloud database deployments. It will cover the troubleshooting tips and tricks which DBA's need on a daily basis using tools like Trace file Analyzer (TFA) , Exachk (Best Practices) , Cluster Health Advisor.. Additionally, use cases focusing on best practices for targeted diagnosis and rapid recovery to preserve availability will be covered. This will also cover the new troubleshooting tips for Oracle Database 19c
This is the presentation delivered by Karthik.P.R at MySQL User Camp Bangalore on 09th June 2017. ProxySQL is a high performance MySQL Load Balancer Designed to scale database servers.
FOSSASIA - MySQL Cookbook 4e Journey APR 2023.pdfAlkin Tezuysal
Presenting the newly released MySQL Cookbook 4th edition to help developers and administrators to understand simple to complex recipes.
MySQL Cookbook 4th edition was released this summer. We are the book's authors and will show you how to "cook" MySQL. We will show you a few tasks with different priorities, such as JSON in MySQL for those who need flexibility, modern SQL for analytics, and Group Replication for high availability. We will also show how to write programs using JavaScript and Python languages, X DevAPI, and MySQL Shell. We will touch on some of the exciting features of MySQL Spatial Indexes and Geographical Data, Using a Full-Text Search, and more. We're hoping this talk will interest developers and administrators of MySQL.
I'd like to share my authoring experience e and knowledge about an open-source database product MySQL. I also want to touch on this journey's technical and non-technical aspects giving vision and inspiration to future authors. At the end of the talk, I will give away one printed copy of the MySQL Cookbook 4e to an audience after a trivia question.
Oracle RAC 12c Practical Performance Management and Tuning as presented during Oracle Open World 2013 with Michael Zoll.
This is part three of the Oracle RAC 12c "reindeer series" used for OOW13 Oracle RAC-related presentations.
This part concludes the main part of the "reindeer series" except for one bonus track "Oracle Multitenant meets Oracle RAC 12c" (available via SlidesShare, too).
Oracle Active Data Guard 12c: Far Sync Instance, Real-Time Cascade and Other ...Ludovico Caldara
Slides used for my Oracle Open World 2014 #OOW14 session.
The new release of Oracle Database has come with many new exciting enhancements for high availability. The aim of this presentation is to introduce some new Oracle Active Data Guard features through practical examples and live demos. Among the various enhancements, the new Far Sync Instance and Real-Time Cascade Standby features receive special attention in the session.
Oracle Database 19c, builds upon key architectural, distributed data and performance innovations established in earlier versions Oracle Database 12c and 18c releases. Oracle 19c has many new features, in this presentation we have covered below areas
Automated Installation, Configuration and Patching
AutoUpgrade and Database Utilities
Get answers to the real time Oracle Golden gate interview questions!
Here is the link for full article: https://www.support.dbagenesis.com/post/oracle-golden-gate-interview-questions
This presentation covers all aspects of PostgreSQL administration, including installation, security, file structure, configuration, reporting, backup, daily maintenance, monitoring activity, disk space computations, and disaster recovery. It shows how to control host connectivity, configure the server, find the query being run by each session, and find the disk space used by each database.
Oracle 19c Database AdministrationOracle Database 19c is the final, and therefore 'long term support' releaseof the Oracle Database 12c family of products (which includes Oracle Database 18c). Oracle Database 19c builds upon the innovations of previous releases such as Multitenant, In-Memory, JSON support, Sharding and many other features that enable Oracle✔8217;s Autonomous Database Cloud Services. This latest release of the world✔8217;s most popular database also introduces new functionality, providing customers with a multi-model enterprise-class database for all their typical use cases.This Book provides detailed information on the architecture of an Oracle Database instance and database, enabling you to effectively manage your database resources. You learn how to create database storage structures appropriate for the business applications supported by your database. In addition, you learn how to create users and administer database security to meet your business requirements. Basic information on backup and recovery techniques is presented in this course. To provide an acceptable response time to users and manage resources effectively, you learn how to monitor your database and manage performance.
Best Practices for the Most Impactful Oracle Database 18c and 19c FeaturesMarkus Michalewicz
This presentation answers the question, “What’s new in Oracle Database 19c ?” in a slightly different way: by providing best practices and a deep dive into the most impactful high availability (HA), scalability, and lifecycle management features in Oracle Database 12c, 18c and 19c, including a short roadmap of features yet to come in the next generation Oracle Database.
This deck was first presented during OOW19 together with Mauricio Feria, who reported on two of his customers and how they have used Oracle Database HA features and Maximum Availability Architecture (MAA) to improve their businesses.
Before version 9i of the Oracle database, more and more Oracle components stored their tables in the SYSTEM tablespace. This lead to a high space consumption in this important tablespace. In Oracle database 10g introduced the SYSAUX tablespace and moved everything which is not part of the data dictionary from the SYSTEM tablespace to SYSAUX. Since then, more and more database components populate the SYSAUX tablespace and it keeps growing ... - and if the DBA is not careful, the tablespace SYSAUX tablespace can become really huge
The presentation shows how to analyze and reduce the occupancy of the SYSAUX tablespace and how to avoid it in advance by suitable settings.
The biggest headine at the 2009 Oracle OpenWorld was when Larry Ellison announced that Oracle was entering the hardware business with a pre-built database machine, engineered by Oracle. Since then businesses around the world have started to use these engineered systems. This beginner/intermediate-level session will take you through my first 100 days of starting to administer an Exadata machine and all the roadblocks and all the success I had along this new path.
LAD - GroundBreakers - Jul 2019 - Using Oracle Autonomous Health Framework to...Sandesh Rao
This session will focus on the best practice use of the Oracle Autonomous Health Framework (AHF) with an emphasis on troubleshooting private cloud database deployments. It will cover the troubleshooting tips and tricks which DBA's need on a daily basis using tools like Trace file Analyzer (TFA) , Exachk (Best Practices) , Cluster Health Advisor.. Additionally, use cases focusing on best practices for targeted diagnosis and rapid recovery to preserve availability will be covered. This will also cover the new troubleshooting tips for Oracle Database 19c
This is the presentation delivered by Karthik.P.R at MySQL User Camp Bangalore on 09th June 2017. ProxySQL is a high performance MySQL Load Balancer Designed to scale database servers.
FOSSASIA - MySQL Cookbook 4e Journey APR 2023.pdfAlkin Tezuysal
Presenting the newly released MySQL Cookbook 4th edition to help developers and administrators to understand simple to complex recipes.
MySQL Cookbook 4th edition was released this summer. We are the book's authors and will show you how to "cook" MySQL. We will show you a few tasks with different priorities, such as JSON in MySQL for those who need flexibility, modern SQL for analytics, and Group Replication for high availability. We will also show how to write programs using JavaScript and Python languages, X DevAPI, and MySQL Shell. We will touch on some of the exciting features of MySQL Spatial Indexes and Geographical Data, Using a Full-Text Search, and more. We're hoping this talk will interest developers and administrators of MySQL.
I'd like to share my authoring experience e and knowledge about an open-source database product MySQL. I also want to touch on this journey's technical and non-technical aspects giving vision and inspiration to future authors. At the end of the talk, I will give away one printed copy of the MySQL Cookbook 4e to an audience after a trivia question.
Oracle RAC 12c Practical Performance Management and Tuning as presented during Oracle Open World 2013 with Michael Zoll.
This is part three of the Oracle RAC 12c "reindeer series" used for OOW13 Oracle RAC-related presentations.
This part concludes the main part of the "reindeer series" except for one bonus track "Oracle Multitenant meets Oracle RAC 12c" (available via SlidesShare, too).
Oracle Active Data Guard 12c: Far Sync Instance, Real-Time Cascade and Other ...Ludovico Caldara
Slides used for my Oracle Open World 2014 #OOW14 session.
The new release of Oracle Database has come with many new exciting enhancements for high availability. The aim of this presentation is to introduce some new Oracle Active Data Guard features through practical examples and live demos. Among the various enhancements, the new Far Sync Instance and Real-Time Cascade Standby features receive special attention in the session.
Oracle Database 19c, builds upon key architectural, distributed data and performance innovations established in earlier versions Oracle Database 12c and 18c releases. Oracle 19c has many new features, in this presentation we have covered below areas
Automated Installation, Configuration and Patching
AutoUpgrade and Database Utilities
Get answers to the real time Oracle Golden gate interview questions!
Here is the link for full article: https://www.support.dbagenesis.com/post/oracle-golden-gate-interview-questions
This presentation covers all aspects of PostgreSQL administration, including installation, security, file structure, configuration, reporting, backup, daily maintenance, monitoring activity, disk space computations, and disaster recovery. It shows how to control host connectivity, configure the server, find the query being run by each session, and find the disk space used by each database.
Oracle 19c Database AdministrationOracle Database 19c is the final, and therefore 'long term support' releaseof the Oracle Database 12c family of products (which includes Oracle Database 18c). Oracle Database 19c builds upon the innovations of previous releases such as Multitenant, In-Memory, JSON support, Sharding and many other features that enable Oracle✔8217;s Autonomous Database Cloud Services. This latest release of the world✔8217;s most popular database also introduces new functionality, providing customers with a multi-model enterprise-class database for all their typical use cases.This Book provides detailed information on the architecture of an Oracle Database instance and database, enabling you to effectively manage your database resources. You learn how to create database storage structures appropriate for the business applications supported by your database. In addition, you learn how to create users and administer database security to meet your business requirements. Basic information on backup and recovery techniques is presented in this course. To provide an acceptable response time to users and manage resources effectively, you learn how to monitor your database and manage performance.
Best Practices for the Most Impactful Oracle Database 18c and 19c FeaturesMarkus Michalewicz
This presentation answers the question, “What’s new in Oracle Database 19c ?” in a slightly different way: by providing best practices and a deep dive into the most impactful high availability (HA), scalability, and lifecycle management features in Oracle Database 12c, 18c and 19c, including a short roadmap of features yet to come in the next generation Oracle Database.
This deck was first presented during OOW19 together with Mauricio Feria, who reported on two of his customers and how they have used Oracle Database HA features and Maximum Availability Architecture (MAA) to improve their businesses.
Before version 9i of the Oracle database, more and more Oracle components stored their tables in the SYSTEM tablespace. This lead to a high space consumption in this important tablespace. In Oracle database 10g introduced the SYSAUX tablespace and moved everything which is not part of the data dictionary from the SYSTEM tablespace to SYSAUX. Since then, more and more database components populate the SYSAUX tablespace and it keeps growing ... - and if the DBA is not careful, the tablespace SYSAUX tablespace can become really huge
The presentation shows how to analyze and reduce the occupancy of the SYSAUX tablespace and how to avoid it in advance by suitable settings.
The Oracle GoldenGate software package delivers low-impact, real-time data integration and transactional data replication across heterogeneous systems for continuous availability, zero-downtime migration, and business intelligence.
Join the Webinar to learn Golden Gate 12c New Features
• Expanded heterogeneous Support
• Multitenant Container Database (CDB) Support
• Oracle Universal Installer (OUI) Support
• Support for Public and Private Clouds
• Integrated Replicat
• Security
• Coordinated Replicat
• New 32K VARCHAR2 Support
• High Availability (HA) enhancements
• Support for Other Oracle products
• Improvements to feature Functionality
This is the presentation I delivered on Hadoop User Group Ireland meetup in Dublin on Nov 28 2015. It covers at glance the architecture of GPDB and most important its features. Sorry for the colors - Slideshare is crappy with PDFs
Today, many businesses around the world are using an Oracle product and in many of these at the core there is an Oracle Database. Many of us who started as a Database administrator where put in this position because we were good PL/SQL programmers or good Sysadmins, but knew very little of what it took to be a DBA. In this session you will learn the core architecture of an Oracle Database in 12c as well as what it takes to administer and apply this new knowledge the day you go back to your office.
Application High Availability and Upgrades Using Oracle GoldenGateShane Borden
This presentation will discuss the techniques and methods used to deploy a High Availability Active / Active configuration using Oracle GoldenGate. Discussion will surround deploying GoldenGate utilizing the built in Conflict Detection and Resolution (CDR) functionality as well as the other configuration items needed for a true active / active system. Focus will also be given to the other IT resources that must be involved in order to achieve a successful deployment.
Running E-Business Suite Database on Oracle Database ApplianceMaris Elsins
This is my Collaborate 13 presentation.
ODA is a pre-configured, simple setup, high performance engineered system running 11gR2 cluster. It is a great choice for small to medium sized DBs and if you wish it can be used for Oracle EBS DB too. This paper will show you how the standardized configuration of ODA can be adjusted to comply with the specific requirements of e-Business Suite without sacrificing ODA’s flexibility and supportability. The paper will also share author’s experience migrating, running and maintaining R12 database tier on ODA.
Improve PostgreSQL replication with Oracle GoldenGateBobby Curtis
PostgreSQL databases use the Write-Ahead Logging approach for the replication of data. At the same time, customers worldwide have asked for Oracle GoldenGate to support replication to and from PostgreSQL databases. The wait is over! This session will introduce Oracle GoldenGate for PostgreSQL and highlight what needs to be looked at to ensure successful replication for any PostgreSQL environment.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
3. Part of Accenture’s Infrastructure Services:
- 52,000 Oracle professionals
- 17,000 Infrastructure Services professionals
Oracle Database & Engineered Systems Solutions:
- Database Migrations
- Oracle Applications on Engineered Systems
- Cloud-based solutions leveraging Engineered Systems
Oracle “Specialized” in the following areas:
- Oracle Database, Oracle Database Security, Oracle Real Application Cluster (RAC),
Oracle Data Warehouse, Oracle Database Performance Turning, Oracle Linux
- Egineered Systems: Oracle Exadata, Oracle Exalogic, Oracle Exalytics
Accenture Enkitec Group
4. Accenture Enkitec Group
• Our Accenture Enkitec Group resources are members of several Oracle
Database groups such as Oak Table, Oracle ACE, etc and speak frequently
at events across the globe (Oracle Use Groups (OUG), Oracle Open World
(OOW), etc..
• Our team have authored several widely used books specific to Oracle
Database topics ranging from Exadata, performance & tuning to best
practices.
5. Accenture Enkitec
Group
E4
The only conference with a focus
on the Oracle Exadata platform
REGISTER TODAY
June 1–2, 2015
Dallas, Texas
www.enkitec.com/e4/register
6. ① Oracle GoldenGate Overview
② Tuning Areas and Tools
③ Case Study
④ Recommendations
⑤ Improvements?
⑥ Q&A
11. How Oracle GoldenGate Works
Capture
Trail
Files
Pump
Delivery
Trail
Files
Capture (extract): committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of
V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction integrity. New with
GoldenGate 12c, Integrated Delivery (replicat).
MGRMGR
12. How Oracle GoldenGate Works
Capture
Trail
Files
Pump
Delivery
Trail
Files
Capture (extract): committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of
V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture
Trail: stages and queues data for routing.
Pump: distributes data for routing to target(s).
Route: data is compressed, encrypted for routing to target(s).
Delivery: applies data with transaction integrity. New with
GoldenGate 12c, Integrated Delivery (replicat).
Trail
Files
Trail
FilesDelivery Pump Capture
13. Integrated Extract
• Introduced in GoldenGate 11.2.0.2
• Integrated Extract for Oracle source databases only
• Database release: 11.2.0.3 and later
• Works with Logminer
• Register Extract (capture) with database/logminer required
Example: GGSCI> register extract [ name ] database container [ (PDB) ]
Trail
Files
Capture
Oracle Database
14. Logmining Server
Logmining Server
• Reader: Reads logfile and splits into regions
• Preparer: Scans regions of logfiles and prefilters
based on extract parameters
• Builder: Merges prepared records in SCN order
• Capture: Formats LCR and passes to GG Extract
Trail
Files
CaptureReader Builder Capture
Preparer
1Preparer
2Preparer
N
Extract
• Requests LCRs from logmining server
• Performs mapping and
transformations
• Writes trail file
Oracle Database
15. Integrated Replicat
• Introduced in GoldenGate 12.1.2
• Integrated Replicat for Oracle databases only
• Database release: 11.2.0.4, 12.1 and later
• Leverages database parallel apply servers
• Min. changes to replicat configuration
• Single Replicat, no partitioning needed (via @RANGE/THREAD or manual
partitioning)
Trail
Files
Delivery
Oracle Database
16. Integrated Replicat
Trail
Files
Lightweight Streaming
API
Delivery
Inbound Server
• Receiver: Reads LCR
• Preparer: Computes dependencies between
transactions (PK, FK, UK)
• Coordinator: Maintains the order between
transactions
• Applier: Applies transactions in order, including CDR
and error handling
Replicat
• Reads the trail file(s)
• Constructs logical change records
(LCR)
• Uses a lightweight streaming API to
transmit LCR to Oracle database
Receiver Preparer Coordinator
Apply
1Apply
2Apply
N
Oracle Database
17. Parallel Apply Processing
• Dependency scheduling based on PK, UI and FKs at
target (Oracle)
• COMMIT_SERIALIZATION
- DEPENDENT_TRANSACTIONS (default) – commit dependent
transactions in correct dependency
- Full – commited transactions in same order as source
22. GoldenGate Performance Tools
LAG Information
• Monitor latency from the Manager process (mgr.prm)
- LAGINFO [ SECONDS | MINUTES | HOURS ]
- LAGREPORT [ MINUTES | HOURS ]
- LAGCRITICAL [ SECONDS | MINUTES | HOURS]
EXAMPLE:
LAGINFOSECONDS 1
LAGREPORTMINUTES 1
LAGCRITICALSECONDS 2
• Information output to ggserr.log
23. GoldenGate Performance Tools
Report Files
• Parameters currently running
• Table/Column Mappings
• Runtime messages and errors
• Runtime statistics
• REPORTCOUNT
- REPORTCOUNT EVERY [ # ] [ SECONDS | MINUTES |
HOURS ], RATE
Example: REPORTCOUNT EVERY 15 MINUTES, RATE
• Files located in $OGG_HOME/dirrpt
24. Database Performance Tools
Automatic Workload Repository (AWR)
• Good starting point within the database
• Help determine potiential bottlenecks
• Extract/Replicat are given unique SQL Module IDs
- Used in both AWR and ASH
• Use Active Session History (ASH) for more details on
identified session
25. AWR Output – Replication Stats
Oracle 12c Database (12.1.0.1 and later)
Note: Will not be in 11.2.x AWR reports
26. Database Performance Tools
Streams Performance Advisor (Integrated Extract/Replicat Only)
• Used to provide information on the performance of integrated
processes
• Both Extract and Replicat
• Provides real-time statistics
• Has to be installed
- Installed under GoldenGate User
- $ORACLE_HOME/rdbms/admin/utlspadv.sql
28. Health Checks
• SQL based scripts that create HTML output
- Different scripts for database releases
- MOS:1448324.1
• Summary
- Overview of environment
- Advice/Warnings of potential issues of configuration
• Analysis
- Compare configurations
- Performance Recommendations
- Detail information for diagnostic purposes
• Statistics
- Runtime information of Streams (GoldenGate) processing
29. Host Performance Tools
CPU Performance (mpstat/top)
• Looking to see if there are any processes limited by CPU (top)
• Looking to see what average cpu spike is (mpstat)
I/O Performance (iostat)
• Gather for database disks and trail file locations
• Critical before increasing parallelism
Memory Performance (vmstat)
• Not needed for integrated processes
• Needed if tuning classic or coordinated processes
34. Lag Information
• ggserr.log
- Reported by Manager Process (mgr.prm)
- Extract (Source)
2015-02-11 15:32:12 INFO OGG-00948 Oracle GoldenGate
Manager for Oracle, mgr.prm: Lag for EXTRACT EXTI is 00:00:01
(checkpoint updated 00:00:07 ago).
- Replicat (Target)
2015-02-11 15:24:14 WARNING OGG-00947 Oracle GoldenGate
Manager for Oracle, mgr.prm: Lag for REPLICAT REPI is 01:18:50
(checkpoint updated 00:00:00 ago).
35. Process Statistics
EXTI.rpt
1068208 records processed as of 2015-02-11 15:30:25 (rate 57,delta 299)
PMPI.rpt
545130 records processed as of 2015-02-11 15:35:28 (rate 109,delta 281)
REPI.rpt
108483 records processed as of 2015-02-11 15:28:05 (rate 116,delta 120)
• Monitor throughput for each process
- REPORTCOUNT EVERY [ SECOND | MINUTES | HOURS ], RATE
- Can impact throughput with aggressive monitoring
Total records
processed this session
Throughput for session Changes since last
report count
36. Streams Performance Advisor
Extract
PATH 1 RUN_ID 1 RUN_TIME 2015-JAN-12 15:17:31 CCA Y
|<C> OGG$CAP_EXTI 31 31 0 LMR 99.7% 0% 0.3% "" LMP (2) 199.7% 0%
0.3% "" LMB 99.3% 0% 0.3% "" CAP 99.7% 0% 0.3% "" |<Q>
"GGATE"."OGG$Q_EXTI" 0.01 0.01 0 |<A> OGG$EXTI 0.01 0.01 0 |<B>
NO BOTTLENECK IDENTIFIED
Logminer Reader (LMR): 99.7% idle, no flow control, no top event
Logminer Preparer (LMP): 2, 199.7% idle, no flow control, no top event
Logminer Builder (LMB): 99.3% idle, no flow control, no top event
Capture (CAP): 99.3% idle, no flow control, no top event
43. Integrated Extract Parameters
• LOGALLSUPCOLS
- Instructs extract to write supplemental logged columns to trail file
• UPDATERECORDFORMAT
- Single Logical Change Record (LCR) with BEFORE and AFTER
images
- COMPACT
- reduces the amount of data sent with LCR
44. Integrated Extract Parameters
Continued
• PARALLELISM
- Controls number of preparers for processing logs
- Increase parallelism if preparers are CPU bound
- EE allows parallelism of preparers (default = 2)
- SE does not allow parallelism of preparers (default = 1)
• MAX_SGA_SIZE
- Controls amount of streams pool configured extract
- Min: 1024 (1G)/Max: 3584 (3.5G)
45. Integrated Replicat Parameters
• COMMIT_SERIALIZATION
- Default = DEPENDENT_TRANSACTIONS
- Set to FULL, if apply in source commit order is required
• EAGER_SIZE
- Threshold to begin apply of large transactions (default = 9500)
- Serializes apply processing
- Make sure streams_pool_size is configured correctly to avoid
Waiting for Memory issues
• MAX_SGA_SIZE
- Controls memory resource for IR
- Default is INFINITE
46. Integrated Replicat Parameters
Continued
• PARALLELISM
- Controls number of appliers (default = 4, actually 50)
- Setting to 1 disables parallism
• MAX_PARALLELISM
- Controls maximum number of appliers
- Default is 50 in OGG 12.1.2.1 (30 in OGG 12.1.2.0)
Note: Auto Tuning (parallelism)
- Enabled by default
- Computed over range of 5 intervals (5 seconds)
- Unneeded processes marked INACTIVE, removed after 5 minutes
- MAX_PARALLISM=PARALLELISM, disables auto turning
47. Integrated Replicat Parameters
Continued
• BATCHSQL
- Controls number of appliers (default = 4)
- Setting to 1 disables parallelism
- Use with caution
- Degradation can be seen in some cases.
48. Database Configurations
• ENABLE_GOLDENGATE_REPLICATION
- New in DB 11.2.0.4/12.1.0.2
- Boolean value. Default to False, set to True to activate
• STREAMS_POOL_SIZE
- Size appropriately for number of concurrent IE & IR processes
- Min. 1G per IE/IR then add 25%
- If using MAX_SGA_SIZE
- sum of (MAX_SGA_SIZE * IR) * 25%
49. Sizing Streams Pool
(MAX_SGA_SIZE * PARALLELISM) * 25%
(1024M * 2) * 25% = 2560M (2.5G)
Note: Max size of streams_pool_size should not exceed 3.5G
Note: May have to increase SGA size to allocate enough
memory
50. Database Object Tuning
• GoldeGate uses SQL to apply changes
• AWR highlights SQL and SEGMENT issues
• ADDM recommendations as needed
• Redo Logs, ensure they are large enough for expected
workload
• Gather statistics regularly, especially after initial initialization
• Target side: Indexes can cause slowness in apply process as
well.
51. Network Tuning
• TCPBUFSIZE and TCPFLUSHBYTES
• Use ping to find average round trip time (RTT)
[oracle@oel dirrpt]$ ping fred.acme.com
PING fred.acme.com (192.168.65.68) 56(84) bytes of data.
64 bytes from fred.acme.com (192.168.65.68): icmp_seq=1 ttl=64 time=0.180 ms
64 bytes from fred.acme.com (192.168.65.68): icmp_seq=2 ttl=64 time=0.173 ms
64 bytes from fred.acme.com (192.168.65.68): icmp_seq=3 ttl=64 time=0.199 ms
64 bytes from fred.acme.com (192.168.65.68): icmp_seq=4 ttl=64 time=0.203 ms
^C
--- fred.acme.com ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 3807ms
rtt min/avg/max/mdev = 0.173/0.188/0.203/0.021 ms
52. Network Tuning
(megabits / gigabits) * RTT = Bandwidth-Delay Product (BDP in bytes)
BDP * 3 = TCPBUFSIZE/TCPFLUSHBYTES
(8192 / 8) * 0.021 = 21.5 bytes
21.5 bytes * 3 = 64.5 bytes
Since BDP result is less than 1MB, no need to set TCPBUFSIZE or TCPFLUSHBYTES
*Default is 1MB
57. Report Counts
EXTI.rpt
1015083 records processed as of 2015-02-14 01:49:21 (rate 90,delta 301)
1034022 records processed as of 2015-02-14 01:50:22 (rate 91,delta 310)
1052135 records processed as of 2015-02-14 01:51:22 (rate 92,delta 301)
PMPI.rpt
1033398 records processed as of 2015-02-14 01:50:20 (rate 91,delta 304)
1052112 records processed as of 2015-02-14 01:51:21 (rate 92,delta 310)
1069906 records processed as of 2015-02-14 01:52:21 (rate 93,delta 294)
REPI.rpt
122370 records processed as of 2015-02-14 01:40:33 (rate 502,delta 884)
188385 records processed as of 2015-02-14 01:41:34 (rate 620,delta 1099)
317619 records processed as of 2015-02-14 01:42:35 (rate 872,delta 2143)
Changes since last
report count
60. Further Reading
• MOS Note: 1557031.1 – patches for integrated capture and replicat
• MOS Note: 1448324.1 – OGG Integrated Healthcheck Script
• MOS Note: 1485620.1 – Best Practices for Downstream Capture
• MOS Note: 1488668.1 – GoldenGate Performance Data Gathering
• Oracle GoldenGate Best Practices:
http://www.oracle.com/technetwork/database/availability/maa-gg-performance-
1969630.pdf
61. ((RUN 2 REP – RUN 1 REP) / RUN 2 REP) * 100
((2143 - 120) / 2143) * 100 = 94.40%
Replicat Improvement Ratio
Editor's Notes
Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.