Golden gate11g overview - Edgars Rungis
Upcoming SlideShare
Loading in...5
×
 

Golden gate11g overview - Edgars Rungis

on

  • 2,017 views

Event: Oracle Technology Day 2011

Event: Oracle Technology Day 2011
Date: 20.10.2011
Place: Nordic Hotel Forum
Country: ESTONIA

Statistics

Views

Total Views
2,017
Views on SlideShare
2,013
Embed Views
4

Actions

Likes
1
Downloads
303
Comments
0

2 Embeds 4

http://www.docshut.com 3
http://www.linkedin.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Golden gate11g overview - Edgars Rungis Golden gate11g overview - Edgars Rungis Presentation Transcript

  • Oracle GoldenGate 11g Overview Edgars Ruņģis Technology Consultant1 Oracle in Latvia Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Do You ... Business Intelligence/ DWH High Availability/Disaster Recovery Growing data volumes and shrinking batch Strict SLAs for high availability and windows for ETL? performance? Need fresh data 24X7 to optimize operations? Need single technology for heterogeneous Mission-critical OLTP with performance systems? impact? Leverage standby databases for transaction processing? Migration Data-based Application Integration Want to get onto more efficient and effective Integrating today via manual code? standard infrastructure? Looking ahead to SOA but concerned about Can’t afford downtime? the data? Why not fix data assets during an Need to handle large files and batch infrastructure move? processes? Support global operations with real-time data?2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Agenda • Introduction to Oracle GoldenGate • Technology Overview • Use Cases and Benefits • Summary • Q&A3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • What is Oracle GoldenGate ?Oracle GoldenGate provides low-impact capture, routing, transformation, anddelivery of database transactions across heterogeneous environments in realtime Replica/ Standby Log-based, changed data Distributed Systems Database Data Warehouse4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Oracle GoldenGate Differentiators • Sub-second latency for data movement Performance • Low-impact capture, routing, transformation, and delivery of transactional data • Open, modular architecture Flexible & Extendable • Supports heterogeneous sources and targets • Agile and adaptable to modern data integration architectures Reliable • Maintains transactional integrity • Resilient against interruptions and failures • Fast Recovery after process interruptions.5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Agenda • Introduction to Oracle GoldenGate • Technology Overview • Use Cases and Benefits • Summary • Q&A6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs.Source TargetOracle & Non-Oracle Oracle & Non-OracleDatabase(s) Database(s) 7 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing.Source TargetOracle & Non-Oracle Oracle & Non-OracleDatabase(s) Database(s) 8 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s).Source TargetOracle & Non-Oracle Oracle & Non-OracleDatabase(s) Database(s) 9 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s).Source TargetOracle & Non-Oracle Oracle & Non-OracleDatabase(s) Database(s) 10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity, transforming the data as required.Source TargetOracle & Non-Oracle Oracle & Non-OracleDatabase(s) Database(s) 11 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • How Oracle GoldenGate Works Capture: committed transactions are captured (and can be filtered) as they occur by reading the transaction logs. Trail: stages and queues data for routing. Pump: distributes data for routing to target(s). Route: data is compressed, encrypted for routing to target(s). Delivery: applies data with transaction integrity, transforming the data as required.Source TargetOracle & Non-Oracle Oracle & Non-OracleDatabase(s) Bi-directional Database(s) 12 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Oracle GoldenGate Differentiator: FlexibilityUnidirectional Bi-Directional Peer-to-PeerQuery Offloading Hot Standby or Load BalancingZero-Downtime Migration Active-Active for HA Multi-MasterBroadcast Integration/Consolidation Data DistributionData Distribution Data Warehouse via Messaging BPM BAM CEP13 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Differentiator: Performance and Scalability GoldenGate Capture • Log-based change data capture – High volume – Low overhead • Decoupled architecture – Multiple capture processes may be used to scale, but generally not required – Possible to split “hot” tables into a separate capture process • Filtering and compression – Unnecessary change data is discarded immediately – Updates and deletes are “compressed” by default14 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Differentiator: Performance and Scalability GoldenGate Delivery • Decoupled architecture – Multiple delivery processes may be used to scale – Possible to split “hot” tables into a separate delivery process – Possible for multiple delivery processes to split the work for a single table • Transaction grouping – Small transactions are grouped by default to reduce commit overhead15 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Differentiator: Transaction Integrity • Transaction boundaries – Recorded in GoldenGate trail file – Transactions ordered in commit sequence – Boundaries adjusted automatically due to record filtering or trail splits • Transaction integrity – Checkpointing and recovery are based on transaction boundaries – Original commit sequence is maintained by the delivery process16 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Differentiator: Reliability • Decoupled architecture – Individual processes can be restarted automatically – Tolerance to network outages (configurable) • Recovery – Recovery ensures that no operations are skipped or duplicated after failure of any kind – Recovery of the Capture process is more involved than recovery the Delivery process – Although GoldenGate processes are completely decoupled, the Delivery process must be aware of a recovery performed by the Capture process or pump17 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Oracle GoldenGate 11g Supported Platforms Databases O/S and Platforms Oracle GoldenGate Capture:  Oracle Linux  DB2 for v 9.7 Sun Solaris  DB2 for v 10 on z/OS  Microsoft SQL Server for 2008 R1, R2 Windows 2000, 2003, XP, 2008  Sybase ASE, 15.5 HP NonStop  Teradata HP-UX  Enscribe  SQL/MP IBM AIX  SQL/MX IBM z Series  MySQL zLinux  JMS message queues Oracle GoldenGate Delivery:  All listed above, plus:  TimesTen, IBM System I, Netezza & Greenplum  ETL product18 Copyright © 2011, Oracle and/or its affiliates. All rights 18 reserved.
  • Oracle GoldenGate Veridata – Data Comparison without Downtime • A high-speed, low impact data comparison solution • Identifies and reports data discrepancies between heterogeneous databases without interrupting their availability • Benefits: • Reduce financial/legal risk exposure • Speed and simplify IT work in comparing data sources • No disruption to business systems • Improved failover to backup systems • Confident decision-making and reporting19 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Oracle Management Pack for OGG Complete Visibility (1 / 2): Director 1. Oracle GoldenGate Director: Has basic configuration, management, monitoring, and alerting. Based on legacy pull infrastructure.20 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Oracle Management Pack for OGG Complete Visibility (2 / 2): Monitor 2. Oracle GoldenGate Monitor: Has advanced monitoring, alerting (SNMP support), lag graphs, and historical repository. Based on new agent infrastructure, which will be the foundation for all future integration projects. Supports OGG 11.1.1.1.1+21 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Agenda • Introduction to Oracle GoldenGate • Technology Overview • Use Cases and Benefits • Summary • Q&A22 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Oracle GoldenGate 11g use cases Low-Impact Real-Time Data Integration & Transactional Replication Zero Downtime Upgrade & Migration New DB/HW/OS/APP Highly Available / Disaster Recovery Legacy Fully Active Distributed DB Query Offloading, Disaster Recovery Log-based, Reporting Database changed data Real-time BI, Operational Reporting, MDM Database Data Integrator Data Warehouse ODS Data Synchronization across the Enterprise Global Data CentersMessage Bus Event Driven Architecture, SOA Message Bus 23 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Eliminate All Downtime for Continuous Availability Available – no issues Planned outage • Upgrade • Migration • Maintenance Unplanned outage • System failure • Data failure24 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Oracle GoldenGate for Continuous Availability • Zero Downtime Upgrades, Migrations and Maintenance – Migration from non-Oracle databases to Oracle 11gR2 & Exadata – Upgrade Oracle Database 8i, 9i, 10g to 11gR2 – Upgrade/Migrate Database Server/OS – Perform Database Maintenance – Application Upgrade (Siebel CRM and JD Edwards) • Disaster Recovery for Non-Oracle Databases and Cross- Oracle Database versions • Continuous Availability via Active-Active Databases26 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • What are Oracle Database Upgrade Options ? • Standard: – Database Upgrade Assistant • Alternatives – Export/Import – DataPump – Transportable Tablespaces – Streams – Logical Standby – Oracle GoldenGate (zero downtime)27 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Eliminate Downtime During Upgrades to Oracle 11g R2• Zero database downtime for Switchover upgrades from 8i, 9i, Application 10g to 11g• Leverage new features of Oracle Database 11g without impacting business Oracle Oracle operations Database Database Failback Data Flow• Minimize risks with 8i/9i/10g 11g Release 2 Compare & Verify failback option With Oracle GoldenGate Veridata 28 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • A Certified App Upgrade Solution for JD Edwards and Siebel CRM• Upgrade/migrate/main tain database, hardware, OS and/or Real-time changed data application Siebel / JDE Siebel / JDE Lower Version Higher Version• Minimize risk with failback option• Improve success with Non-Oracle Oracle Database Database phased user migration /Server Sun Server Failback Data Flow 31 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Eliminate unplanned downtime with Active Data Guard & GoldenGate• Active Data Guard for disaster recovery and Switchover data protection for: Application • Oracle-to-Oracle• Oracle GoldenGate for disaster recovery and data protection for: • Non-Oracle platforms Production Live Standby Post-Switchover Data Flow • Active-Active Compare & Verify • Cross-OS and Oracle With Oracle GoldenGate Can be used for reporting & database version Veridata testing requirements 32 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Improve Production System Performance and Lower Costs• Off-load queries from production systems in Transaction Processing Read-Only Activity Active-Active or Heterogeneous configurations Real-time changed data • E.g. different OS, database version, database • E.g. legacy system query off-load Production Oracle OLTP Database 33 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Increase ROI on Existing Servers & Synchronize Data Across Globe• Utilize secondary systems for transactions Application Application• Enable continuous availability during unplanned and planned outages Source & Source &• Synchronize data Target Target across data centers Region A Region B around the globe 34 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Drivers for Moving to Real-Time BI and Data Warehouse Traditional Data Warehouse Real-Time Data Warehouse Transformation ETL ELT Real-Time Legacy, Continuous Feeds Packaged Enterprise Data Legacy, Apps, OLTP Packaged Enterprise Data Warehouse Databases Warehouse Apps, OLTP• Day+ old data • Timely, relevant data – better decisions• Batch data extracts within specified • No batch windows on OLTP “off business hours” • Complete recoverability after• Process interruptions impact data interruptions recoverability 35 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Next Generation Data Warehousing: Enabling Real Time BI High Performance E-LT, Real-Time Data Warehousing • Solution • Using OGG for log-based capture of database Oracle Data transactions from source to minimize overhead Integrator • Load to target with sub-second latency • Transformation performed on the database DIM DIM using E-LT in mini-batchesOracle • Fast ETL/E-LT handled by database processingGoldenGate FACT EMP DEPT DIM DIM • Benefits • No resource / performance impact to OLTP • Live data available for better decision making ODS Schema DW Schema • Get double-duty from database investment by using it for transformations • Maximizes availability of source systems and DW due to smaller batch windows. 36 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Real Time vs. Right Time Capture in real time, consume in right time IT should not be a constraint for business: Invest in future-ready solutions Consider technical benefits: cost savings, reliability and performance improvements38 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Event Driven Architecture, SOA BPM BAM Message Bus SOA40 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Agenda • Introduction to Oracle GoldenGate • Technology Overview • Use Cases and Benefits • Summary • Q&A41 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Advantages of Oracle GoldenGate 11g Reduced Overhead and TCO • Captures once, delivers to many targets for different uses • Non-invasive, log-based capture • Moves only committed data, reduces bandwidth needs High Performance with Reliability • Subsecond latency even with high data volumes • Preserves transaction integrity • Ensures data recoverability Flexibility and Ease of Use • Provides decoupled, modular architecture • Supports heterogeneous sources and targets, and different latency needs • Coexists and integrates with ELT/ETL and messaging solutions42 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • GoldenGate is Oracle’s Strategic Replication Solution • Best-in-class leader in real-time data integration solutions • Complements existing Oracle products • Continuous Availability for heterogeneous systems • Real-time data access for Reporting & BI/EPM • Zero-downtime migrations / upgrades to Oracle Database, Hardware, and Applications • Over 1200 customers including Fortune 500 companies, representing Financial Services, Communications, Healthcare, Public Sector, Retail, Utilities industries • 4 of top 5 largest commercial banks • 3 of top 3 busiest ATM networks • 5 of top 5 financial data services companies • 5 of top 5 telecommunications providers • 3 of top 5 largest food & drug stores43 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • Q&A44 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • 45 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
  • 46 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.