Bobby Curtis, profile picture
Uploaded byBobby Curtis
PPTX, PDF2,049 views

Extreme replication at IOUG Collaborate 15

This document summarizes a session on tuning Oracle GoldenGate performance between an Oracle source and target database. It discusses tools for monitoring GoldenGate performance such as lag reports, process statistics, and database views. It also provides a case study example configuration and recommendations for tuning integrated extract and replicat parameters such as parallelism settings.

Embed presentation

Downloaded 37 times
IOUG Collaborate 2015 Session: 206 Date: 4/15/2015 @ 10:45 am Room: Palm D Extreme Replication: Performance Tuning Oracle GoldenGate (Oracle to Oracle Integrated Replication)
@dbasolved http://dbasolved.com Work: bobby.l.curtis@accenture.com Personal: curtisbl@gmail.com Bobby Curtis Douglasville, Georgia Infrastructure Principle IOUG (RACSIG/DI SIG), RMOUG, GAOUG
Part of Accenture’s Infrastructure Services: - 52,000 Oracle professionals - 17,000 Infrastructure Services professionals Oracle Database & Engineered Systems Solutions: - Database Migrations - Oracle Applications on Engineered Systems - Cloud-based solutions leveraging Engineered Systems Oracle “Specialized” in the following areas: - Oracle Database, Oracle Database Security, Oracle Real Application Cluster (RAC), Oracle Data Warehouse, Oracle Database Performance Turning, Oracle Linux - Egineered Systems: Oracle Exadata, Oracle Exalogic, Oracle Exalytics Accenture Enkitec Group
Accenture Enkitec Group • Our Accenture Enkitec Group resources are members of several Oracle Database groups such as Oak Table, Oracle ACE, etc and speak frequently at events across the globe (Oracle Use Groups (OUG), Oracle Open World (OOW), etc.. • Our team have authored several widely used books specific to Oracle Database topics ranging from Exadata, performance & tuning to best practices.
Accenture Enkitec Group E4 The only conference with a focus on the Oracle Exadata platform REGISTER TODAY June 1–2, 2015 Dallas, Texas www.enkitec.com/e4/register
① Oracle GoldenGate Overview ② Tuning Areas and Tools ③ Case Study ④ Recommendations ⑤ Improvements? ⑥ Q&A
Oracle GoldenGate Overview
Change Data Capture (CDC) Oracle Advance Replication Oracle Streams Oracle GoldenGate • Multi-Master Replication • MV Replication • Hybrid Replication • Synchronous • Asynchronus • Capture Messages • Staging Messages • Consumption • Heterogeneous • Multiple Architectures • Multiple Use Cases Quick History
What is GoldenGate?
How does GoldenGate work?
How Oracle GoldenGate Works Capture Trail Files Pump Delivery Trail Files Capture (extract): committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity. New with GoldenGate 12c, Integrated Delivery (replicat). MGRMGR
How Oracle GoldenGate Works Capture Trail Files Pump Delivery Trail Files Capture (extract): committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity. New with GoldenGate 12c, Integrated Delivery (replicat). Trail Files Trail FilesDelivery Pump Capture
Integrated Extract • Introduced in GoldenGate 11.2.0.2 • Integrated Extract for Oracle source databases only • Database release: 11.2.0.3 and later • Works with Logminer • Register Extract (capture) with database/logminer required Example: GGSCI> register extract [ name ] database container [ (PDB) ] Trail Files Capture Oracle Database
Logmining Server Logmining Server • Reader: Reads logfile and splits into regions • Preparer: Scans regions of logfiles and prefilters based on extract parameters • Builder: Merges prepared records in SCN order • Capture: Formats LCR and passes to GG Extract Trail Files CaptureReader Builder Capture Preparer 1Preparer 2Preparer N Extract • Requests LCRs from logmining server • Performs mapping and transformations • Writes trail file Oracle Database
Integrated Replicat • Introduced in GoldenGate 12.1.2 • Integrated Replicat for Oracle databases only • Database release: 11.2.0.4, 12.1 and later • Leverages database parallel apply servers • Min. changes to replicat configuration • Single Replicat, no partitioning needed (via @RANGE/THREAD or manual partitioning) Trail Files Delivery Oracle Database
Integrated Replicat Trail Files Lightweight Streaming API Delivery Inbound Server • Receiver: Reads LCR • Preparer: Computes dependencies between transactions (PK, FK, UK) • Coordinator: Maintains the order between transactions • Applier: Applies transactions in order, including CDR and error handling Replicat • Reads the trail file(s) • Constructs logical change records (LCR) • Uses a lightweight streaming API to transmit LCR to Oracle database Receiver Preparer Coordinator Apply 1Apply 2Apply N Oracle Database
Parallel Apply Processing • Dependency scheduling based on PK, UI and FKs at target (Oracle) • COMMIT_SERIALIZATION - DEPENDENT_TRANSACTIONS (default) – commit dependent transactions in correct dependency - Full – commited transactions in same order as source
Tuning Areas and Tools
Why should I care about performance?
What tools are available for performance tuning?
Oracle GoldenGate Performance Areas Capture Trail Files Pump Trail Files Delivery Host Host Database Database GoldenGate GoldenGate - MPSTAT, VMSTAT, IOSTAT, STRACE, TOP - AWR, ASH, UTL_SPADV, TRACE GG tools: LAG, REPORTCOUNT
GoldenGate Performance Tools LAG Information • Monitor latency from the Manager process (mgr.prm) - LAGINFO [ SECONDS | MINUTES | HOURS ] - LAGREPORT [ MINUTES | HOURS ] - LAGCRITICAL [ SECONDS | MINUTES | HOURS] EXAMPLE: LAGINFOSECONDS 1 LAGREPORTMINUTES 1 LAGCRITICALSECONDS 2 • Information output to ggserr.log
GoldenGate Performance Tools Report Files • Parameters currently running • Table/Column Mappings • Runtime messages and errors • Runtime statistics • REPORTCOUNT - REPORTCOUNT EVERY [ # ] [ SECONDS | MINUTES | HOURS ], RATE Example: REPORTCOUNT EVERY 15 MINUTES, RATE • Files located in $OGG_HOME/dirrpt
Database Performance Tools Automatic Workload Repository (AWR) • Good starting point within the database • Help determine potiential bottlenecks • Extract/Replicat are given unique SQL Module IDs - Used in both AWR and ASH • Use Active Session History (ASH) for more details on identified session
AWR Output – Replication Stats Oracle 12c Database (12.1.0.1 and later) Note: Will not be in 11.2.x AWR reports
Database Performance Tools Streams Performance Advisor (Integrated Extract/Replicat Only) • Used to provide information on the performance of integrated processes • Both Extract and Replicat • Provides real-time statistics • Has to be installed - Installed under GoldenGate User - $ORACLE_HOME/rdbms/admin/utlspadv.sql
Database Performance Tools (Views) Run Time Views • V$GOLDENGATE_CAPTURE • V$GG_APPLY_RECEIVER • V$GG_APPLY_READER • V$GG_APPLY_COORDINATOR • V$GG_APPLY_SERVER • V$GOLDENGATE_TABLE_STATS • V$GOLDENGATE_CAPABILITIES • V$DBA_APPLY_ERRORS Configuration Views • DBA_GOLDENGATE_PRIVILEGES • DBA_GOLDENGATE_SUPPORT_MODE • DBA_CAPUTRE • DBA_CAPTURE_PARAMETERS • DBA_GOLDENGATE_INBOUND • DBA_GG_INBOUND_PROGRESS • DBA_APPLY • DBA_APPLY_PARAMETERS • DBA_APPLY_REPERROR_HANDLERS • DBA_APPLY_HANDLE_COLLISIONS • DBA_APPLY_DML_CONF_HANDLERS Associated GoldenGate Monitoring Scripts
Health Checks • SQL based scripts that create HTML output - Different scripts for database releases - MOS:1448324.1 • Summary - Overview of environment - Advice/Warnings of potential issues of configuration • Analysis - Compare configurations - Performance Recommendations - Detail information for diagnostic purposes • Statistics - Runtime information of Streams (GoldenGate) processing
Host Performance Tools CPU Performance (mpstat/top) • Looking to see if there are any processes limited by CPU (top) • Looking to see what average cpu spike is (mpstat) I/O Performance (iostat) • Gather for database disks and trail file locations • Critical before increasing parallelism Memory Performance (vmstat) • Not needed for integrated processes • Needed if tuning classic or coordinated processes
Case Study
Capture Pump Delivery Trail Files Trail Files Server/Database Configs Dell PowerEdge T110 Intel Core Duo 16G DRAM Database: SGA: 6GB Dell PowerEdge T110 II Intel i3 8G DRAM Database: SGA: 6GB
Oracle GoldenGate Performance Areas Capture Trail Files Pump Trail Files Delivery Host Host Database Database GoldenGate GoldenGate - MPSTAT, VMSTAT, IOSTAT, STRACE - AWR, ASH, UTL_SPADV, TRACE GG tools: LAG, REPORTCOUNT
Lag Information (OEM) Approx. 1 hr. 20 min. behind JAGENT 12.1.3/GG Plugin 12.1.0.2 is required
Lag Information • ggserr.log - Reported by Manager Process (mgr.prm) - Extract (Source) 2015-02-11 15:32:12 INFO OGG-00948 Oracle GoldenGate Manager for Oracle, mgr.prm: Lag for EXTRACT EXTI is 00:00:01 (checkpoint updated 00:00:07 ago). - Replicat (Target) 2015-02-11 15:24:14 WARNING OGG-00947 Oracle GoldenGate Manager for Oracle, mgr.prm: Lag for REPLICAT REPI is 01:18:50 (checkpoint updated 00:00:00 ago).
Process Statistics EXTI.rpt 1068208 records processed as of 2015-02-11 15:30:25 (rate 57,delta 299) PMPI.rpt 545130 records processed as of 2015-02-11 15:35:28 (rate 109,delta 281) REPI.rpt 108483 records processed as of 2015-02-11 15:28:05 (rate 116,delta 120) • Monitor throughput for each process - REPORTCOUNT EVERY [ SECOND | MINUTES | HOURS ], RATE - Can impact throughput with aggressive monitoring Total records processed this session Throughput for session Changes since last report count
Streams Performance Advisor Extract PATH 1 RUN_ID 1 RUN_TIME 2015-JAN-12 15:17:31 CCA Y |<C> OGG$CAP_EXTI 31 31 0 LMR 99.7% 0% 0.3% "" LMP (2) 199.7% 0% 0.3% "" LMB 99.3% 0% 0.3% "" CAP 99.7% 0% 0.3% "" |<Q> "GGATE"."OGG$Q_EXTI" 0.01 0.01 0 |<A> OGG$EXTI 0.01 0.01 0 |<B> NO BOTTLENECK IDENTIFIED Logminer Reader (LMR): 99.7% idle, no flow control, no top event Logminer Preparer (LMP): 2, 199.7% idle, no flow control, no top event Logminer Builder (LMB): 99.3% idle, no flow control, no top event Capture (CAP): 99.3% idle, no flow control, no top event
Streams Performance Advisor Replicat PL/SQL procedure successfully completed. SQL> Advisor couldn’t gather required statistics
Performance (OEM View) Capture Pump Delivery Trail Files Trail Files
GoldenGate Configuration Capture Pump Delivery Trail Files Trail Files --CHECKPARAMS EXTRACT EXTI SETENV (ORACLE_HOME="/oracle/app/product/11.2.0.4/d bhome_1") SETENV (ORACLE_SID="bc11g") USERID ggate, PASSWORD ggate WARNLONGTRANS 15m, CHECKINTERVAL 5m REPORTCOUNT EVERY 5 MINUTES, RATE EXTTRAIL ./dirdat/li TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; TABLE SOE.INVENTORIES; TABLE SOE.LOGON; TABLE SOE.ORDER_ITEMS; TABLE SOE.ORDERENTRY_METADATA; TABLE SOE.ORDERS; TABLE SOE.PRODUCT_DESCRIPTIONS; TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; --CHECKPARAMS EXTRACT PMPI userid ggate password ggate PASSTHRU RMTHOST 192.168.65.68, MGRPORT 15000, COMPRESS RMTTRAIL ./dirdat/ri REPORTCOUNT EVERY 1 MINUTES, RATE TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; TABLE SOE.INVENTORIES; TABLE SOE.LOGON; TABLE SOE.ORDER_ITEMS; TABLE SOE.ORDERENTRY_METADATA; TABLE SOE.ORDERS; TABLE SOE.PRODUCT_DESCRIPTIONS; TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; --CHECKPARAMS REPLICAT REPI SETENV (ORACLE_HOME="/opt/oracle/app/product/12.1.0. 1/dbhome_1") SETENV (ORACLE_SID="oemrep") USERID ggate, PASSWORD ggate ALLOWDUPTARGETMAP ASSUMETARGETDEFS REPORTCOUNT EVERY 5 MINUTES, RATE DISCARDFILE ./dirrpt/REPCI.dsc, append, megabytes 200 REPERROR(default, discard) REPERROR(default2, discard) MAP SOE.ADDRESSES, TARGET SOE.ADDRESSES; MAP SOE.CARD_DETAILS, TARGET ….. MAP SOE.WAREHOUSES, TARGET SOE.WAREHOUSES;
AWR Output – Replication Stats LAG: 12.9 Minutes
Database Views select capture_name, 86400 * (available_message_create_time - capture_message_create_time) latency_in_seconds from gv$goldengate_capture; select r.apply_name, 86400 * (r.dequeue_time - c.lwm_message_create_time) latency_in_seconds from gv$gg_apply_reader r, gv$gg_apply_coordinator c where r.apply# = c.apply# and r.apply_name = c.apply_name;
Recommendations
Integrated Extract Parameters • LOGALLSUPCOLS - Instructs extract to write supplemental logged columns to trail file • UPDATERECORDFORMAT - Single Logical Change Record (LCR) with BEFORE and AFTER images - COMPACT - reduces the amount of data sent with LCR
Integrated Extract Parameters Continued • PARALLELISM - Controls number of preparers for processing logs - Increase parallelism if preparers are CPU bound - EE allows parallelism of preparers (default = 2) - SE does not allow parallelism of preparers (default = 1) • MAX_SGA_SIZE - Controls amount of streams pool configured extract - Min: 1024 (1G)/Max: 3584 (3.5G)
Integrated Replicat Parameters • COMMIT_SERIALIZATION - Default = DEPENDENT_TRANSACTIONS - Set to FULL, if apply in source commit order is required • EAGER_SIZE - Threshold to begin apply of large transactions (default = 9500) - Serializes apply processing - Make sure streams_pool_size is configured correctly to avoid Waiting for Memory issues • MAX_SGA_SIZE - Controls memory resource for IR - Default is INFINITE
Integrated Replicat Parameters Continued • PARALLELISM - Controls number of appliers (default = 4, actually 50) - Setting to 1 disables parallism • MAX_PARALLELISM - Controls maximum number of appliers - Default is 50 in OGG 12.1.2.1 (30 in OGG 12.1.2.0) Note: Auto Tuning (parallelism) - Enabled by default - Computed over range of 5 intervals (5 seconds) - Unneeded processes marked INACTIVE, removed after 5 minutes - MAX_PARALLISM=PARALLELISM, disables auto turning
Integrated Replicat Parameters Continued • BATCHSQL - Controls number of appliers (default = 4) - Setting to 1 disables parallelism - Use with caution - Degradation can be seen in some cases.
Database Configurations • ENABLE_GOLDENGATE_REPLICATION - New in DB 11.2.0.4/12.1.0.2 - Boolean value. Default to False, set to True to activate • STREAMS_POOL_SIZE - Size appropriately for number of concurrent IE & IR processes - Min. 1G per IE/IR then add 25% - If using MAX_SGA_SIZE - sum of (MAX_SGA_SIZE * IR) * 25%
Sizing Streams Pool (MAX_SGA_SIZE * PARALLELISM) * 25% (1024M * 2) * 25% = 2560M (2.5G) Note: Max size of streams_pool_size should not exceed 3.5G Note: May have to increase SGA size to allocate enough memory
Database Object Tuning • GoldeGate uses SQL to apply changes • AWR highlights SQL and SEGMENT issues • ADDM recommendations as needed • Redo Logs, ensure they are large enough for expected workload • Gather statistics regularly, especially after initial initialization • Target side: Indexes can cause slowness in apply process as well.
Network Tuning • TCPBUFSIZE and TCPFLUSHBYTES • Use ping to find average round trip time (RTT) [oracle@oel dirrpt]$ ping fred.acme.com PING fred.acme.com (192.168.65.68) 56(84) bytes of data. 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=1 ttl=64 time=0.180 ms 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=2 ttl=64 time=0.173 ms 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=3 ttl=64 time=0.199 ms 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=4 ttl=64 time=0.203 ms ^C --- fred.acme.com ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3807ms rtt min/avg/max/mdev = 0.173/0.188/0.203/0.021 ms
Network Tuning (megabits / gigabits) * RTT = Bandwidth-Delay Product (BDP in bytes) BDP * 3 = TCPBUFSIZE/TCPFLUSHBYTES (8192 / 8) * 0.021 = 21.5 bytes 21.5 bytes * 3 = 64.5 bytes Since BDP result is less than 1MB, no need to set TCPBUFSIZE or TCPFLUSHBYTES *Default is 1MB
Host Evaluate if you need bigger/newer hardware if needed!
Improvements
Configuration Capture Pump Delivery Trail Files Trail Files EXTRACT EXTI SETENV (ORACLE_HOME="/oracle/app/product/11.2.0.4/d bhome_1") SETENV (ORACLE_SID="bc11g") USERID ggate, PASSWORD ggate WARNLONGTRANS 15m, CHECKINTERVAL 5m REPORTCOUNT EVERY 1 MINUTES, RATE EXTTRAIL ./dirdat/li TRANLOGOPTIONS EXCLUDEUSER GGATE TRANLOGOPTIONS INTEGRATEDPARAMS (MAX_SGA_SIZE 2560 PARALLELISM 4) LOGALLSUPCOLS UPDATERECORDFORMAT COMPACT TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; ….. TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; --CHECKPARAMS EXTRACT PMPI userid ggate password ggate PASSTHRU RMTHOST 192.168.65.68, MGRPORT 15000, COMPRESS RMTTRAIL ./dirdat/ri REPORTCOUNT EVERY 1 MINUTES, RATE TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; TABLE SOE.INVENTORIES; TABLE SOE.LOGON; TABLE SOE.ORDER_ITEMS; TABLE SOE.ORDERENTRY_METADATA; TABLE SOE.ORDERS; TABLE SOE.PRODUCT_DESCRIPTIONS; TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; REPLICAT REPI SETENV (ORACLE_HOME="/opt/oracle/app/product/12.1.0. 1/dbhome_1") SETENV (ORACLE_SID="oemrep") USERID ggate, PASSWORD ggate ALLOWDUPTARGETMAP ASSUMETARGETDEFS REPORTCOUNT EVERY 1 MINUTES, RATE DISCARDFILE ./dirrpt/REPCI.dsc, append, megabytes 200 REPERROR(default, discard) REPERROR(default2, discard) DBOPTIONS INTEGRATEDPARAMS (MAX_SGA_SIZE 2560, PARALLELISM 4, MAX_PARALLELISM 6, COMMIT_SERIALIZATION FULL) BATCHSQL MAP SOE.ADDRESSES, TARGET SOE.ADDRESSES; ……; MAP SOE.WAREHOUSES, TARGET
Performance (OEM View) Capture Pump Delivery Trail Files Trail Files
Report Counts EXTI.rpt 1015083 records processed as of 2015-02-14 01:49:21 (rate 90,delta 301) 1034022 records processed as of 2015-02-14 01:50:22 (rate 91,delta 310) 1052135 records processed as of 2015-02-14 01:51:22 (rate 92,delta 301) PMPI.rpt 1033398 records processed as of 2015-02-14 01:50:20 (rate 91,delta 304) 1052112 records processed as of 2015-02-14 01:51:21 (rate 92,delta 310) 1069906 records processed as of 2015-02-14 01:52:21 (rate 93,delta 294) REPI.rpt 122370 records processed as of 2015-02-14 01:40:33 (rate 502,delta 884) 188385 records processed as of 2015-02-14 01:41:34 (rate 620,delta 1099) 317619 records processed as of 2015-02-14 01:42:35 (rate 872,delta 2143) Changes since last report count
0 500 1000 1500 2000 2500 EXTI REPI 299 120 301 2143 Series1 Series2 Comparison 94.4% increase in replicat performance
STOP
Further Reading • MOS Note: 1557031.1 – patches for integrated capture and replicat • MOS Note: 1448324.1 – OGG Integrated Healthcheck Script • MOS Note: 1485620.1 – Best Practices for Downstream Capture • MOS Note: 1488668.1 – GoldenGate Performance Data Gathering • Oracle GoldenGate Best Practices: http://www.oracle.com/technetwork/database/availability/maa-gg-performance- 1969630.pdf
((RUN 2 REP – RUN 1 REP) / RUN 2 REP) * 100 ((2143 - 120) / 2143) * 100 = 94.40% Replicat Improvement Ratio

More Related Content

PDF
Oracle RAC 19c and Later - Best Practices #OOWLON
byMarkus Michalewicz
 
PDF
Oracle Active Data Guard and Global Data Services in Action!
byLudovico Caldara
 
PDF
Tanel Poder - Scripts and Tools short
byTanel Poder
 
PDF
Oracle RAC 19c: Best Practices and Secret Internals
byAnil Nair
 
PDF
New Generation Oracle RAC Performance
byAnil Nair
 
PPTX
Oracle GoldenGate Performance Tuning
byBobby Curtis
 
PDF
Oracle Multitenant meets Oracle RAC - IOUG 2014 Version
byMarkus Michalewicz
 
PPTX
AWR and ASH Deep Dive
byKellyn Pot'Vin-Gorman
 
Oracle RAC 19c and Later - Best Practices #OOWLON
byMarkus Michalewicz
 
Oracle Active Data Guard and Global Data Services in Action!
byLudovico Caldara
 
Tanel Poder - Scripts and Tools short
byTanel Poder
 
Oracle RAC 19c: Best Practices and Secret Internals
byAnil Nair
 
New Generation Oracle RAC Performance
byAnil Nair
 
Oracle GoldenGate Performance Tuning
byBobby Curtis
 
Oracle Multitenant meets Oracle RAC - IOUG 2014 Version
byMarkus Michalewicz
 
AWR and ASH Deep Dive
byKellyn Pot'Vin-Gorman
 

What's hot

PDF
Oracle Performance Tuning Fundamentals
byEnkitec
 
PDF
Oracle Real Application Clusters (RAC) 12c Rel. 2 - Operational Best Practices
byMarkus Michalewicz
 
PDF
Oracle Active Data Guard: Best Practices and New Features Deep Dive
byGlen Hawkins
 
PDF
Oracle 12c and its pluggable databases
byGustavo Rene Antunez
 
PDF
Oracle Enterprise Manager Cloud Control 13c for DBAs
byGokhan Atil
 
PPTX
Hit Refresh with Oracle GoldenGate Microservices
byBobby Curtis
 
PPTX
Extreme Replication - Performance Tuning Oracle GoldenGate
byBobby Curtis
 
PPT
Oracle GoldenGate
byoracleonthebrain
 
PPTX
Examining Oracle GoldenGate Trail Files
byBobby Curtis
 
PPTX
Database Consolidation using the Oracle Multitenant Architecture
byPini Dibask
 
PDF
Oracle Data Integrator 12c - Getting Started
byMichael Rainey
 
PPTX
Oracle GoldenGate 21c New Features and Best Practices
byBobby Curtis
 
PDF
Exadata master series_asm_2020
byAnil Nair
 
PPT
Oracle Architecture
byNeeraj Singh
 
PPT
Galera Cluster Best Practices for DBA's and DevOps Part 1
byCodership Oy - Creators of Galera Cluster
 
PDF
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
bySrirakshaSrinivasan2
 
PDF
Maa goldengate-rac-2007111
bypablitosax
 
PDF
Understanding oracle rac internals part 2 - slides
byMohamed Farouk
 
PPTX
Geneos Corporate Overview June 2010
byctom
 
PDF
Troubleshooting Complex Performance issues - Oracle SEG$ contention
byTanel Poder
 
Oracle Performance Tuning Fundamentals
byEnkitec
 
Oracle Real Application Clusters (RAC) 12c Rel. 2 - Operational Best Practices
byMarkus Michalewicz
 
Oracle Active Data Guard: Best Practices and New Features Deep Dive
byGlen Hawkins
 
Oracle 12c and its pluggable databases
byGustavo Rene Antunez
 
Oracle Enterprise Manager Cloud Control 13c for DBAs
byGokhan Atil
 
Hit Refresh with Oracle GoldenGate Microservices
byBobby Curtis
 
Extreme Replication - Performance Tuning Oracle GoldenGate
byBobby Curtis
 
Oracle GoldenGate
byoracleonthebrain
 
Examining Oracle GoldenGate Trail Files
byBobby Curtis
 
Database Consolidation using the Oracle Multitenant Architecture
byPini Dibask
 
Oracle Data Integrator 12c - Getting Started
byMichael Rainey
 
Oracle GoldenGate 21c New Features and Best Practices
byBobby Curtis
 
Exadata master series_asm_2020
byAnil Nair
 
Oracle Architecture
byNeeraj Singh
 
Galera Cluster Best Practices for DBA's and DevOps Part 1
byCodership Oy - Creators of Galera Cluster
 
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
bySrirakshaSrinivasan2
 
Maa goldengate-rac-2007111
bypablitosax
 
Understanding oracle rac internals part 2 - slides
byMohamed Farouk
 
Geneos Corporate Overview June 2010
byctom
 
Troubleshooting Complex Performance issues - Oracle SEG$ contention
byTanel Poder
 

Viewers also liked

PDF
IOUG Data Integration SIG w/ Oracle GoldenGate Solutions and Configuration
byBobby Curtis
 
PDF
Oracle virtualbox basic to rac attack
byBobby Curtis
 
PDF
Extreme Replication - RMOUG Presentation
byBobby Curtis
 
PPTX
Oracle GoldenGate and Baseball - 5 Keys for Moving to the Cloud
byBobby Curtis
 
PDF
How many ways to monitor oracle golden gate - OOW14
byBobby Curtis
 
PPTX
Enable GoldenGate Monitoring with OEM 12c/JAgent
byBobby Curtis
 
PPTX
Exachk and oem12c - IOUG C15LV
byBobby Curtis
 
PPTX
Database As A Service: OEM + ODA (OOW 15 Presentation)
byBobby Curtis
 
PDF
Oracle GoldenGate 12c CDR Presentation for ECO
byBobby Curtis
 
PDF
Oracle GoldenGate Studio Intro
byBobby Curtis
 
PDF
5 Keys to Oracle GoldenGate Implemenations
byBobby Curtis
 
IOUG Data Integration SIG w/ Oracle GoldenGate Solutions and Configuration
byBobby Curtis
 
Oracle virtualbox basic to rac attack
byBobby Curtis
 
Extreme Replication - RMOUG Presentation
byBobby Curtis
 
Oracle GoldenGate and Baseball - 5 Keys for Moving to the Cloud
byBobby Curtis
 
How many ways to monitor oracle golden gate - OOW14
byBobby Curtis
 
Enable GoldenGate Monitoring with OEM 12c/JAgent
byBobby Curtis
 
Exachk and oem12c - IOUG C15LV
byBobby Curtis
 
Database As A Service: OEM + ODA (OOW 15 Presentation)
byBobby Curtis
 
Oracle GoldenGate 12c CDR Presentation for ECO
byBobby Curtis
 
Oracle GoldenGate Studio Intro
byBobby Curtis
 
5 Keys to Oracle GoldenGate Implemenations
byBobby Curtis
 

Similar to Extreme replication at IOUG Collaborate 15

PDF
OGG Architecture Performance
byEnkitec
 
PPTX
Oracle Goldengate training by Vipin Mishra
byVipin Mishra
 
PDF
Oracle GoldenGate Presentation from OTN Virtual Technology Summit - 7/9/14 (PDF)
byBobby Curtis
 
PDF
Oracle GoldenGate Architecture Performance
byEnkitec
 
PDF
Oracle goldegate microservice
byMojtaba Khandan
 
PPTX
Insync10 goldengate
byInSync Conference
 
PDF
Replicate data between environments
byDLT Solutions
 
PPTX
How many ways to monitor oracle golden gate-Collaborate 14
byBobby Curtis
 
PDF
B7 accelerating your business with oracle data integration solutions
byDr. Wilfred Lin (Ph.D.)
 
PPTX
Doag data replication with oracle golden gate: Looking behind the scenes
byTrivadis
 
PDF
Oracle golden gateway_mat
bySuresh Kumar
 
PPTX
Ogg oracle goldengate-v3.0
byJos van den Oord [Oracle DBA,OCM,OCP,RAC,CLOUD]
 
PPTX
OOW19 - HOL5221
byBobby Curtis
 
PDF
Golden Gate - How to start such a project?
byTrivadis
 
PPTX
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
byMilomir Vojvodic
 
PDF
Oracle GoldenGate Roadmap Oracle OpenWorld 2020
byThomas Vengal
 
PDF
Oracle Golden Gate Interview Questions
byArun Sharma
 
PPTX
Understanding Oracle GoldenGate 12c
byIT Help Desk Inc
 
TXT
Gg steps
byHari Prasath
 
PPTX
Oracle golden gate 12c New Features
bySatishbabu Gunukula
 
OGG Architecture Performance
byEnkitec
 
Oracle Goldengate training by Vipin Mishra
byVipin Mishra
 
Oracle GoldenGate Presentation from OTN Virtual Technology Summit - 7/9/14 (PDF)
byBobby Curtis
 
Oracle GoldenGate Architecture Performance
byEnkitec
 
Oracle goldegate microservice
byMojtaba Khandan
 
Insync10 goldengate
byInSync Conference
 
Replicate data between environments
byDLT Solutions
 
How many ways to monitor oracle golden gate-Collaborate 14
byBobby Curtis
 
B7 accelerating your business with oracle data integration solutions
byDr. Wilfred Lin (Ph.D.)
 
Doag data replication with oracle golden gate: Looking behind the scenes
byTrivadis
 
Oracle golden gateway_mat
bySuresh Kumar
 
Ogg oracle goldengate-v3.0
byJos van den Oord [Oracle DBA,OCM,OCP,RAC,CLOUD]
 
OOW19 - HOL5221
byBobby Curtis
 
Golden Gate - How to start such a project?
byTrivadis
 
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI vertic...
byMilomir Vojvodic
 
Oracle GoldenGate Roadmap Oracle OpenWorld 2020
byThomas Vengal
 
Oracle Golden Gate Interview Questions
byArun Sharma
 
Understanding Oracle GoldenGate 12c
byIT Help Desk Inc
 
Gg steps
byHari Prasath
 
Oracle golden gate 12c New Features
bySatishbabu Gunukula
 

More from Bobby Curtis

PPTX
Leverage Restful APIs in Oracle GoldenGate
byBobby Curtis
 
PPTX
RheoData_OGG-Classic2Microservices_2024-UKOUG24.pptx
byBobby Curtis
 
PPTX
RheoData_23ai_Vector-Datatype-Webinar-2024.pptx
byBobby Curtis
 
PPTX
MySQLHeatwave-TheBasics.pptx
byBobby Curtis
 
PPTX
ECO 2022 - OCI and HashiCorp Terraform
byBobby Curtis
 
PPTX
Improve PostgreSQL replication with Oracle GoldenGate
byBobby Curtis
 
PPTX
Terraform & Oracle Cloud Infrastructure
byBobby Curtis
 
PPTX
Oracle GoldenGate on Docker
byBobby Curtis
 
PPTX
Oracle GoldenGate 18c - REST API Examples
byBobby Curtis
 
PPTX
GoldenGate CDR from UKOUG 2017
byBobby Curtis
 
PDF
Exachk and oem12c
byBobby Curtis
 
PPTX
GoldenGate Monitoring - GOUSER - 4/2014
byBobby Curtis
 
Leverage Restful APIs in Oracle GoldenGate
byBobby Curtis
 
RheoData_OGG-Classic2Microservices_2024-UKOUG24.pptx
byBobby Curtis
 
RheoData_23ai_Vector-Datatype-Webinar-2024.pptx
byBobby Curtis
 
MySQLHeatwave-TheBasics.pptx
byBobby Curtis
 
ECO 2022 - OCI and HashiCorp Terraform
byBobby Curtis
 
Improve PostgreSQL replication with Oracle GoldenGate
byBobby Curtis
 
Terraform & Oracle Cloud Infrastructure
byBobby Curtis
 
Oracle GoldenGate on Docker
byBobby Curtis
 
Oracle GoldenGate 18c - REST API Examples
byBobby Curtis
 
GoldenGate CDR from UKOUG 2017
byBobby Curtis
 
Exachk and oem12c
byBobby Curtis
 
GoldenGate Monitoring - GOUSER - 4/2014
byBobby Curtis
 

Recently uploaded

PDF
Higgsfield AI: The New Way to Create Cinematic Video
bytechnologyupside
 
PPTX
Unit 1 Introduction of Computer Networks
bySuvarnaSharma5
 
PDF
Effective Ai powered mock interview .pdf
byamazingnishusingh766
 
PDF
Best Bank Statement Converter Software - A Documentation-Based Meta-Analysis ...
bylewisconrada
 
PDF
Saga: The new era of transactions in a microservices architecture
byGiovanni Marigi
 
PDF
splunk-peak-threat-hunting-framework.pdf
bylobster6719
 
PPTX
DATALIVA-Presentation-EN_2026 Budgeting SAP Odoo ERP
byMustafa Kuğu
 
PPTX
IBM_NEXA_DAC2021 NEXA, a cloud-native platform for collaborative hardware log...
byArun Joseph
 
PDF
Requestly or Postman: What’s the Right API Tool for Your Team?
byhenrycavill30521
 
PDF
Best-Travel-Portal-Development-Solutions-for-Online-Growth
bykashishnagarrajput
 
PDF
DevOps GenAI_ How Generative AI Is Changing Software Delivery.pdf
byDevseccops.ai
 
PPTX
DVCON24-IBM ai/ml driven hardware verification
byArun Joseph
 
PDF
Scott M. Graffius' Phases of Team Development - Applied to Human Teams and Hu...
byScott M. Graffius
 
PDF
DataLiva-LivaGRC- Business Software for Governance, Risk, and Compliance
byMustafa Kuğu
 
PDF
The Cost of Missing Critical Connections in Data - Suspicious Behavior Detect...
byEnterprise Knowledge
 
PDF
threat-hunters-cookbook for cybersecurity
bylobster6719
 
DOCX
Quercus semecarpifolia is widely recognized as a keystone species in alpine a...
byMadan Bhandari university and St. Xavier's college , Maitighar
 
PDF
A "Kill Switch" (Emergency Off Switch) for AI?
byScott M. Graffius
 
PDF
Taxonomy Principles to Support Knowledge Management at a Not-for-Profit
byEnterprise Knowledge
 
PPTX
KTU-PEMET413 -MODULE 2-POLYMER MATRIX COMPOSITES - LECTURE 1.pptx
byVINAY B
 
Higgsfield AI: The New Way to Create Cinematic Video
bytechnologyupside
 
Unit 1 Introduction of Computer Networks
bySuvarnaSharma5
 
Effective Ai powered mock interview .pdf
byamazingnishusingh766
 
Best Bank Statement Converter Software - A Documentation-Based Meta-Analysis ...
bylewisconrada
 
Saga: The new era of transactions in a microservices architecture
byGiovanni Marigi
 
splunk-peak-threat-hunting-framework.pdf
bylobster6719
 
DATALIVA-Presentation-EN_2026 Budgeting SAP Odoo ERP
byMustafa Kuğu
 
IBM_NEXA_DAC2021 NEXA, a cloud-native platform for collaborative hardware log...
byArun Joseph
 
Requestly or Postman: What’s the Right API Tool for Your Team?
byhenrycavill30521
 
Best-Travel-Portal-Development-Solutions-for-Online-Growth
bykashishnagarrajput
 
DevOps GenAI_ How Generative AI Is Changing Software Delivery.pdf
byDevseccops.ai
 
DVCON24-IBM ai/ml driven hardware verification
byArun Joseph
 
Scott M. Graffius' Phases of Team Development - Applied to Human Teams and Hu...
byScott M. Graffius
 
DataLiva-LivaGRC- Business Software for Governance, Risk, and Compliance
byMustafa Kuğu
 
The Cost of Missing Critical Connections in Data - Suspicious Behavior Detect...
byEnterprise Knowledge
 
threat-hunters-cookbook for cybersecurity
bylobster6719
 
Quercus semecarpifolia is widely recognized as a keystone species in alpine a...
byMadan Bhandari university and St. Xavier's college , Maitighar
 
A "Kill Switch" (Emergency Off Switch) for AI?
byScott M. Graffius
 
Taxonomy Principles to Support Knowledge Management at a Not-for-Profit
byEnterprise Knowledge
 
KTU-PEMET413 -MODULE 2-POLYMER MATRIX COMPOSITES - LECTURE 1.pptx
byVINAY B
 

Extreme replication at IOUG Collaborate 15

  • 1.
    IOUG Collaborate 2015 Session:206 Date: 4/15/2015 @ 10:45 am Room: Palm D Extreme Replication: Performance Tuning Oracle GoldenGate (Oracle to Oracle Integrated Replication)
  • 2.
    @dbasolved http://dbasolved.com Work: bobby.l.curtis@accenture.com Personal: curtisbl@gmail.com BobbyCurtis Douglasville, Georgia Infrastructure Principle IOUG (RACSIG/DI SIG), RMOUG, GAOUG
  • 3.
    Part of Accenture’sInfrastructure Services: - 52,000 Oracle professionals - 17,000 Infrastructure Services professionals Oracle Database & Engineered Systems Solutions: - Database Migrations - Oracle Applications on Engineered Systems - Cloud-based solutions leveraging Engineered Systems Oracle “Specialized” in the following areas: - Oracle Database, Oracle Database Security, Oracle Real Application Cluster (RAC), Oracle Data Warehouse, Oracle Database Performance Turning, Oracle Linux - Egineered Systems: Oracle Exadata, Oracle Exalogic, Oracle Exalytics Accenture Enkitec Group
  • 4.
    Accenture Enkitec Group •Our Accenture Enkitec Group resources are members of several Oracle Database groups such as Oak Table, Oracle ACE, etc and speak frequently at events across the globe (Oracle Use Groups (OUG), Oracle Open World (OOW), etc.. • Our team have authored several widely used books specific to Oracle Database topics ranging from Exadata, performance & tuning to best practices.
  • 5.
    Accenture Enkitec Group E4 The onlyconference with a focus on the Oracle Exadata platform REGISTER TODAY June 1–2, 2015 Dallas, Texas www.enkitec.com/e4/register
  • 6.
    ① Oracle GoldenGateOverview ② Tuning Areas and Tools ③ Case Study ④ Recommendations ⑤ Improvements? ⑥ Q&A
  • 7.
  • 8.
    Change Data Capture (CDC) OracleAdvance Replication Oracle Streams Oracle GoldenGate • Multi-Master Replication • MV Replication • Hybrid Replication • Synchronous • Asynchronus • Capture Messages • Staging Messages • Consumption • Heterogeneous • Multiple Architectures • Multiple Use Cases Quick History
  • 9.
  • 10.
  • 11.
    How Oracle GoldenGateWorks Capture Trail Files Pump Delivery Trail Files Capture (extract): committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity. New with GoldenGate 12c, Integrated Delivery (replicat). MGRMGR
  • 12.
    How Oracle GoldenGateWorks Capture Trail Files Pump Delivery Trail Files Capture (extract): committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. As of V.11.2.1, GoldenGate offers two options for capture for Oracle; Classic & Integrated Capture Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity. New with GoldenGate 12c, Integrated Delivery (replicat). Trail Files Trail FilesDelivery Pump Capture
  • 13.
    Integrated Extract • Introducedin GoldenGate 11.2.0.2 • Integrated Extract for Oracle source databases only • Database release: 11.2.0.3 and later • Works with Logminer • Register Extract (capture) with database/logminer required Example: GGSCI> register extract [ name ] database container [ (PDB) ] Trail Files Capture Oracle Database
  • 14.
    Logmining Server Logmining Server •Reader: Reads logfile and splits into regions • Preparer: Scans regions of logfiles and prefilters based on extract parameters • Builder: Merges prepared records in SCN order • Capture: Formats LCR and passes to GG Extract Trail Files CaptureReader Builder Capture Preparer 1Preparer 2Preparer N Extract • Requests LCRs from logmining server • Performs mapping and transformations • Writes trail file Oracle Database
  • 15.
    Integrated Replicat • Introducedin GoldenGate 12.1.2 • Integrated Replicat for Oracle databases only • Database release: 11.2.0.4, 12.1 and later • Leverages database parallel apply servers • Min. changes to replicat configuration • Single Replicat, no partitioning needed (via @RANGE/THREAD or manual partitioning) Trail Files Delivery Oracle Database
  • 16.
    Integrated Replicat Trail Files Lightweight Streaming API Delivery InboundServer • Receiver: Reads LCR • Preparer: Computes dependencies between transactions (PK, FK, UK) • Coordinator: Maintains the order between transactions • Applier: Applies transactions in order, including CDR and error handling Replicat • Reads the trail file(s) • Constructs logical change records (LCR) • Uses a lightweight streaming API to transmit LCR to Oracle database Receiver Preparer Coordinator Apply 1Apply 2Apply N Oracle Database
  • 17.
    Parallel Apply Processing •Dependency scheduling based on PK, UI and FKs at target (Oracle) • COMMIT_SERIALIZATION - DEPENDENT_TRANSACTIONS (default) – commit dependent transactions in correct dependency - Full – commited transactions in same order as source
  • 18.
  • 19.
    Why should Icare about performance?
  • 20.
    What tools areavailable for performance tuning?
  • 21.
    Oracle GoldenGate PerformanceAreas Capture Trail Files Pump Trail Files Delivery Host Host Database Database GoldenGate GoldenGate - MPSTAT, VMSTAT, IOSTAT, STRACE, TOP - AWR, ASH, UTL_SPADV, TRACE GG tools: LAG, REPORTCOUNT
  • 22.
    GoldenGate Performance Tools LAGInformation • Monitor latency from the Manager process (mgr.prm) - LAGINFO [ SECONDS | MINUTES | HOURS ] - LAGREPORT [ MINUTES | HOURS ] - LAGCRITICAL [ SECONDS | MINUTES | HOURS] EXAMPLE: LAGINFOSECONDS 1 LAGREPORTMINUTES 1 LAGCRITICALSECONDS 2 • Information output to ggserr.log
  • 23.
    GoldenGate Performance Tools ReportFiles • Parameters currently running • Table/Column Mappings • Runtime messages and errors • Runtime statistics • REPORTCOUNT - REPORTCOUNT EVERY [ # ] [ SECONDS | MINUTES | HOURS ], RATE Example: REPORTCOUNT EVERY 15 MINUTES, RATE • Files located in $OGG_HOME/dirrpt
  • 24.
    Database Performance Tools AutomaticWorkload Repository (AWR) • Good starting point within the database • Help determine potiential bottlenecks • Extract/Replicat are given unique SQL Module IDs - Used in both AWR and ASH • Use Active Session History (ASH) for more details on identified session
  • 25.
    AWR Output –Replication Stats Oracle 12c Database (12.1.0.1 and later) Note: Will not be in 11.2.x AWR reports
  • 26.
    Database Performance Tools StreamsPerformance Advisor (Integrated Extract/Replicat Only) • Used to provide information on the performance of integrated processes • Both Extract and Replicat • Provides real-time statistics • Has to be installed - Installed under GoldenGate User - $ORACLE_HOME/rdbms/admin/utlspadv.sql
  • 27.
    Database Performance Tools(Views) Run Time Views • V$GOLDENGATE_CAPTURE • V$GG_APPLY_RECEIVER • V$GG_APPLY_READER • V$GG_APPLY_COORDINATOR • V$GG_APPLY_SERVER • V$GOLDENGATE_TABLE_STATS • V$GOLDENGATE_CAPABILITIES • V$DBA_APPLY_ERRORS Configuration Views • DBA_GOLDENGATE_PRIVILEGES • DBA_GOLDENGATE_SUPPORT_MODE • DBA_CAPUTRE • DBA_CAPTURE_PARAMETERS • DBA_GOLDENGATE_INBOUND • DBA_GG_INBOUND_PROGRESS • DBA_APPLY • DBA_APPLY_PARAMETERS • DBA_APPLY_REPERROR_HANDLERS • DBA_APPLY_HANDLE_COLLISIONS • DBA_APPLY_DML_CONF_HANDLERS Associated GoldenGate Monitoring Scripts
  • 28.
    Health Checks • SQLbased scripts that create HTML output - Different scripts for database releases - MOS:1448324.1 • Summary - Overview of environment - Advice/Warnings of potential issues of configuration • Analysis - Compare configurations - Performance Recommendations - Detail information for diagnostic purposes • Statistics - Runtime information of Streams (GoldenGate) processing
  • 29.
    Host Performance Tools CPUPerformance (mpstat/top) • Looking to see if there are any processes limited by CPU (top) • Looking to see what average cpu spike is (mpstat) I/O Performance (iostat) • Gather for database disks and trail file locations • Critical before increasing parallelism Memory Performance (vmstat) • Not needed for integrated processes • Needed if tuning classic or coordinated processes
  • 30.
  • 31.
    Capture Pump Delivery Trail Files Trail Files Server/Database Configs DellPowerEdge T110 Intel Core Duo 16G DRAM Database: SGA: 6GB Dell PowerEdge T110 II Intel i3 8G DRAM Database: SGA: 6GB
  • 32.
    Oracle GoldenGate PerformanceAreas Capture Trail Files Pump Trail Files Delivery Host Host Database Database GoldenGate GoldenGate - MPSTAT, VMSTAT, IOSTAT, STRACE - AWR, ASH, UTL_SPADV, TRACE GG tools: LAG, REPORTCOUNT
  • 33.
    Lag Information (OEM) Approx.1 hr. 20 min. behind JAGENT 12.1.3/GG Plugin 12.1.0.2 is required
  • 34.
    Lag Information • ggserr.log -Reported by Manager Process (mgr.prm) - Extract (Source) 2015-02-11 15:32:12 INFO OGG-00948 Oracle GoldenGate Manager for Oracle, mgr.prm: Lag for EXTRACT EXTI is 00:00:01 (checkpoint updated 00:00:07 ago). - Replicat (Target) 2015-02-11 15:24:14 WARNING OGG-00947 Oracle GoldenGate Manager for Oracle, mgr.prm: Lag for REPLICAT REPI is 01:18:50 (checkpoint updated 00:00:00 ago).
  • 35.
    Process Statistics EXTI.rpt 1068208 recordsprocessed as of 2015-02-11 15:30:25 (rate 57,delta 299) PMPI.rpt 545130 records processed as of 2015-02-11 15:35:28 (rate 109,delta 281) REPI.rpt 108483 records processed as of 2015-02-11 15:28:05 (rate 116,delta 120) • Monitor throughput for each process - REPORTCOUNT EVERY [ SECOND | MINUTES | HOURS ], RATE - Can impact throughput with aggressive monitoring Total records processed this session Throughput for session Changes since last report count
  • 36.
    Streams Performance Advisor Extract PATH1 RUN_ID 1 RUN_TIME 2015-JAN-12 15:17:31 CCA Y |<C> OGG$CAP_EXTI 31 31 0 LMR 99.7% 0% 0.3% "" LMP (2) 199.7% 0% 0.3% "" LMB 99.3% 0% 0.3% "" CAP 99.7% 0% 0.3% "" |<Q> "GGATE"."OGG$Q_EXTI" 0.01 0.01 0 |<A> OGG$EXTI 0.01 0.01 0 |<B> NO BOTTLENECK IDENTIFIED Logminer Reader (LMR): 99.7% idle, no flow control, no top event Logminer Preparer (LMP): 2, 199.7% idle, no flow control, no top event Logminer Builder (LMB): 99.3% idle, no flow control, no top event Capture (CAP): 99.3% idle, no flow control, no top event
  • 37.
    Streams Performance Advisor Replicat PL/SQLprocedure successfully completed. SQL> Advisor couldn’t gather required statistics
  • 38.
    Performance (OEM View) CapturePump Delivery Trail Files Trail Files
  • 39.
    GoldenGate Configuration Capture Pump Delivery Trail Files Trail Files --CHECKPARAMS EXTRACTEXTI SETENV (ORACLE_HOME="/oracle/app/product/11.2.0.4/d bhome_1") SETENV (ORACLE_SID="bc11g") USERID ggate, PASSWORD ggate WARNLONGTRANS 15m, CHECKINTERVAL 5m REPORTCOUNT EVERY 5 MINUTES, RATE EXTTRAIL ./dirdat/li TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; TABLE SOE.INVENTORIES; TABLE SOE.LOGON; TABLE SOE.ORDER_ITEMS; TABLE SOE.ORDERENTRY_METADATA; TABLE SOE.ORDERS; TABLE SOE.PRODUCT_DESCRIPTIONS; TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; --CHECKPARAMS EXTRACT PMPI userid ggate password ggate PASSTHRU RMTHOST 192.168.65.68, MGRPORT 15000, COMPRESS RMTTRAIL ./dirdat/ri REPORTCOUNT EVERY 1 MINUTES, RATE TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; TABLE SOE.INVENTORIES; TABLE SOE.LOGON; TABLE SOE.ORDER_ITEMS; TABLE SOE.ORDERENTRY_METADATA; TABLE SOE.ORDERS; TABLE SOE.PRODUCT_DESCRIPTIONS; TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; --CHECKPARAMS REPLICAT REPI SETENV (ORACLE_HOME="/opt/oracle/app/product/12.1.0. 1/dbhome_1") SETENV (ORACLE_SID="oemrep") USERID ggate, PASSWORD ggate ALLOWDUPTARGETMAP ASSUMETARGETDEFS REPORTCOUNT EVERY 5 MINUTES, RATE DISCARDFILE ./dirrpt/REPCI.dsc, append, megabytes 200 REPERROR(default, discard) REPERROR(default2, discard) MAP SOE.ADDRESSES, TARGET SOE.ADDRESSES; MAP SOE.CARD_DETAILS, TARGET ….. MAP SOE.WAREHOUSES, TARGET SOE.WAREHOUSES;
  • 40.
    AWR Output –Replication Stats LAG: 12.9 Minutes
  • 41.
    Database Views select capture_name,86400 * (available_message_create_time - capture_message_create_time) latency_in_seconds from gv$goldengate_capture; select r.apply_name, 86400 * (r.dequeue_time - c.lwm_message_create_time) latency_in_seconds from gv$gg_apply_reader r, gv$gg_apply_coordinator c where r.apply# = c.apply# and r.apply_name = c.apply_name;
  • 42.
  • 43.
    Integrated Extract Parameters •LOGALLSUPCOLS - Instructs extract to write supplemental logged columns to trail file • UPDATERECORDFORMAT - Single Logical Change Record (LCR) with BEFORE and AFTER images - COMPACT - reduces the amount of data sent with LCR
  • 44.
    Integrated Extract Parameters Continued •PARALLELISM - Controls number of preparers for processing logs - Increase parallelism if preparers are CPU bound - EE allows parallelism of preparers (default = 2) - SE does not allow parallelism of preparers (default = 1) • MAX_SGA_SIZE - Controls amount of streams pool configured extract - Min: 1024 (1G)/Max: 3584 (3.5G)
  • 45.
    Integrated Replicat Parameters •COMMIT_SERIALIZATION - Default = DEPENDENT_TRANSACTIONS - Set to FULL, if apply in source commit order is required • EAGER_SIZE - Threshold to begin apply of large transactions (default = 9500) - Serializes apply processing - Make sure streams_pool_size is configured correctly to avoid Waiting for Memory issues • MAX_SGA_SIZE - Controls memory resource for IR - Default is INFINITE
  • 46.
    Integrated Replicat Parameters Continued •PARALLELISM - Controls number of appliers (default = 4, actually 50) - Setting to 1 disables parallism • MAX_PARALLELISM - Controls maximum number of appliers - Default is 50 in OGG 12.1.2.1 (30 in OGG 12.1.2.0) Note: Auto Tuning (parallelism) - Enabled by default - Computed over range of 5 intervals (5 seconds) - Unneeded processes marked INACTIVE, removed after 5 minutes - MAX_PARALLISM=PARALLELISM, disables auto turning
  • 47.
    Integrated Replicat Parameters Continued •BATCHSQL - Controls number of appliers (default = 4) - Setting to 1 disables parallelism - Use with caution - Degradation can be seen in some cases.
  • 48.
    Database Configurations • ENABLE_GOLDENGATE_REPLICATION -New in DB 11.2.0.4/12.1.0.2 - Boolean value. Default to False, set to True to activate • STREAMS_POOL_SIZE - Size appropriately for number of concurrent IE & IR processes - Min. 1G per IE/IR then add 25% - If using MAX_SGA_SIZE - sum of (MAX_SGA_SIZE * IR) * 25%
  • 49.
    Sizing Streams Pool (MAX_SGA_SIZE* PARALLELISM) * 25% (1024M * 2) * 25% = 2560M (2.5G) Note: Max size of streams_pool_size should not exceed 3.5G Note: May have to increase SGA size to allocate enough memory
  • 50.
    Database Object Tuning •GoldeGate uses SQL to apply changes • AWR highlights SQL and SEGMENT issues • ADDM recommendations as needed • Redo Logs, ensure they are large enough for expected workload • Gather statistics regularly, especially after initial initialization • Target side: Indexes can cause slowness in apply process as well.
  • 51.
    Network Tuning • TCPBUFSIZEand TCPFLUSHBYTES • Use ping to find average round trip time (RTT) [oracle@oel dirrpt]$ ping fred.acme.com PING fred.acme.com (192.168.65.68) 56(84) bytes of data. 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=1 ttl=64 time=0.180 ms 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=2 ttl=64 time=0.173 ms 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=3 ttl=64 time=0.199 ms 64 bytes from fred.acme.com (192.168.65.68): icmp_seq=4 ttl=64 time=0.203 ms ^C --- fred.acme.com ping statistics --- 4 packets transmitted, 4 received, 0% packet loss, time 3807ms rtt min/avg/max/mdev = 0.173/0.188/0.203/0.021 ms
  • 52.
    Network Tuning (megabits /gigabits) * RTT = Bandwidth-Delay Product (BDP in bytes) BDP * 3 = TCPBUFSIZE/TCPFLUSHBYTES (8192 / 8) * 0.021 = 21.5 bytes 21.5 bytes * 3 = 64.5 bytes Since BDP result is less than 1MB, no need to set TCPBUFSIZE or TCPFLUSHBYTES *Default is 1MB
  • 53.
    Host Evaluate if youneed bigger/newer hardware if needed!
  • 54.
  • 55.
    Configuration Capture Pump Delivery Trail Files Trail Files EXTRACT EXTI SETENV (ORACLE_HOME="/oracle/app/product/11.2.0.4/d bhome_1") SETENV(ORACLE_SID="bc11g") USERID ggate, PASSWORD ggate WARNLONGTRANS 15m, CHECKINTERVAL 5m REPORTCOUNT EVERY 1 MINUTES, RATE EXTTRAIL ./dirdat/li TRANLOGOPTIONS EXCLUDEUSER GGATE TRANLOGOPTIONS INTEGRATEDPARAMS (MAX_SGA_SIZE 2560 PARALLELISM 4) LOGALLSUPCOLS UPDATERECORDFORMAT COMPACT TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; ….. TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; --CHECKPARAMS EXTRACT PMPI userid ggate password ggate PASSTHRU RMTHOST 192.168.65.68, MGRPORT 15000, COMPRESS RMTTRAIL ./dirdat/ri REPORTCOUNT EVERY 1 MINUTES, RATE TABLE SOE.ADDRESSES; TABLE SOE.CARD_DETAILS; TABLE SOE.CUSTOMERS; TABLE SOE.INVENTORIES; TABLE SOE.LOGON; TABLE SOE.ORDER_ITEMS; TABLE SOE.ORDERENTRY_METADATA; TABLE SOE.ORDERS; TABLE SOE.PRODUCT_DESCRIPTIONS; TABLE SOE.PRODUCT_INFORMATION; TABLE SOE.WAREHOUSES; REPLICAT REPI SETENV (ORACLE_HOME="/opt/oracle/app/product/12.1.0. 1/dbhome_1") SETENV (ORACLE_SID="oemrep") USERID ggate, PASSWORD ggate ALLOWDUPTARGETMAP ASSUMETARGETDEFS REPORTCOUNT EVERY 1 MINUTES, RATE DISCARDFILE ./dirrpt/REPCI.dsc, append, megabytes 200 REPERROR(default, discard) REPERROR(default2, discard) DBOPTIONS INTEGRATEDPARAMS (MAX_SGA_SIZE 2560, PARALLELISM 4, MAX_PARALLELISM 6, COMMIT_SERIALIZATION FULL) BATCHSQL MAP SOE.ADDRESSES, TARGET SOE.ADDRESSES; ……; MAP SOE.WAREHOUSES, TARGET
  • 56.
    Performance (OEM View) CapturePump Delivery Trail Files Trail Files
  • 57.
    Report Counts EXTI.rpt 1015083 recordsprocessed as of 2015-02-14 01:49:21 (rate 90,delta 301) 1034022 records processed as of 2015-02-14 01:50:22 (rate 91,delta 310) 1052135 records processed as of 2015-02-14 01:51:22 (rate 92,delta 301) PMPI.rpt 1033398 records processed as of 2015-02-14 01:50:20 (rate 91,delta 304) 1052112 records processed as of 2015-02-14 01:51:21 (rate 92,delta 310) 1069906 records processed as of 2015-02-14 01:52:21 (rate 93,delta 294) REPI.rpt 122370 records processed as of 2015-02-14 01:40:33 (rate 502,delta 884) 188385 records processed as of 2015-02-14 01:41:34 (rate 620,delta 1099) 317619 records processed as of 2015-02-14 01:42:35 (rate 872,delta 2143) Changes since last report count
  • 58.
  • 59.
  • 60.
    Further Reading • MOSNote: 1557031.1 – patches for integrated capture and replicat • MOS Note: 1448324.1 – OGG Integrated Healthcheck Script • MOS Note: 1485620.1 – Best Practices for Downstream Capture • MOS Note: 1488668.1 – GoldenGate Performance Data Gathering • Oracle GoldenGate Best Practices: http://www.oracle.com/technetwork/database/availability/maa-gg-performance- 1969630.pdf
  • 61.
    ((RUN 2 REP– RUN 1 REP) / RUN 2 REP) * 100 ((2143 - 120) / 2143) * 100 = 94.40% Replicat Improvement Ratio

Editor's Notes

  • #22 Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
  • #23 Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
  • #24 Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
  • #25 Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
  • #27 Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
  • #33 Performance tuning of Oracle GoldenGate is built upon established approaches used for host systems and databases. Additional turning can be done directly upon Oracle GoldenGate by using tools like TRACE/TRACE2 and LAG reporting features. Keep in mind that some latency will be due to network traffice going from source to target. Most tuning will be done at the process level.
  • #42 19 minutes lag on replicat