<Insert Picture Here>Real Application Testing for Oracle Database 9i / 10g / 11gR1/R2Jan van TiggelenPrincipal Sales Consu...
Outline   Oracle’s Testing Lifecycle for Database and Applications   SQL Performance Analyzer (SPA): Overview   Database R...
Oracle Application Quality ManagementHigh quality testing for all tiers of application stack• Testing Application Changes•...
Oracle’s Testing Lifecycle        Production                        Test                              Production          ...
Real Application Testing Features    SPA and Database Replay                       End-to-end testing with real workloads ...
Outline   Oracle’s Testing Lifecycle for Database and Applications   SQL Performance Analyzer (SPA): Overview   Database R...
SQL Performance Regressions: ChallengesSQL performance regressions: #1 cause of poor system performanceSQL performance can...
Oracle Real Application Testing: SPA               SQL Plans + Run-time Stats               Pre-Change TrialSQL Workload  ...
SPA Report (Example)                       2                           3             1                               9
When to use SPA?• Testing database upgrades and patch-set releases*   – 9.2/10.1 10.2 or 11g releases   – 10.2.0.x 10.2....
Outline   Oracle’s Testing Lifecycle for Database and Applications   SQL Performance Analyzer (SPA): Overview   Database R...
Oracle Real Application Testing        Database Replay• Database load and performance            Production               ...
Workload Replay Architecture• Replay captured workload                                    Replay Clients  • Replayed opera...
Database Replay - Supported Changes                              Client      Client       Client                          ...
Outline   Oracle’s Testing Lifecycle for Database and Applications   SQL Performance Analyzer (SPA): Overview   Database R...
New Techniques for Avoiding SQL RegressionsCreate central “SPA System” for all testing• Many database releases• Test, prod...
New Techniques for Avoiding SQL Regressions                               Prod                          Standby DB    Cent...
Database Replay Enhancements   New in Oracle Database 11g Release 2Earlier restrictions removed with support for• Shared S...
Oracle Database Testing Accelerator     Leverage DB Workload captures• Create synthetic test scripts for  Oracle Database ...
Outline   Oracle’s Testing Lifecycle for Database and Applications   SQL Performance Analyzer (SPA): Overview   Database R...
David Mitchell                                                                                   Senior Vice President, OV...
Case Study   EM RAT Real Application TestingBUSINESS CHALLENGE                                             ORACLE SOLUTION...
Arup Nanda                                  Senior Director                        Starwood Hotels & Resorts              ...
Sean McCown                         Contributing Editor, Infoworld“Oracle Database 11g will be welcome relief to DBAsrespo...
Outline   Oracle’s Testing Lifecycle for Database and Applications   SQL Performance Analyzer (SPA): Overview   Database R...
Conclusion    • SPA enables businesses to      safely test and deploy system      changes using real workloads    • Real A...
Resources• Dedicated ½ day workshops for Oracle Customers and Partners   – Contact ruxandra.radulescu@oracle.com for more ...
29
Upcoming SlideShare
Loading in...5
×

Rat overall mar2011

2,025

Published on

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,025
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
52
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Rat overall mar2011

  1. 1. <Insert Picture Here>Real Application Testing for Oracle Database 9i / 10g / 11gR1/R2Jan van TiggelenPrincipal Sales Consultant Oracle EMEA
  2. 2. Outline Oracle’s Testing Lifecycle for Database and Applications SQL Performance Analyzer (SPA): Overview Database Replay (DBReplay): Overview New in 11g Release 2 and Best Practices Real-world Customer Case Studies Conclusion 2
  3. 3. Oracle Application Quality ManagementHigh quality testing for all tiers of application stack• Testing Application Changes• Application Testing Suite • Ensure quality and performance with end-to-end application testing• Testing Infrastructure Changes• Real Application Testing • Designed and optimized for testing database tier infrastructure changes• Test Data Management• Data Masking Pack • Achieve security & compliance objectives by obfuscating sensitive data in test environments 3
  4. 4. Oracle’s Testing Lifecycle Production Test Production Test Capture Load Testing Functional Testing Application Real Application Application Testing ComprehensiveApplication testing Replay Change Mask Clone Clone Data Masking Staging Application Logic Database Logic 4
  5. 5. Real Application Testing Features SPA and Database Replay End-to-end testing with real workloads Create Test System Capture Workload Replay Workload Deploy Replay Clients• SQL Performance Analyzer • Database Replay • SQL unit testing for response time • Load and performance testing for throughput • Identify and tune regressed SQL • Remediate application concurrency problems 5
  6. 6. Outline Oracle’s Testing Lifecycle for Database and Applications SQL Performance Analyzer (SPA): Overview Database Replay (DBReplay): Overview New in 11g Release 2 and Best Practices Real-world Customer Case Studies Conclusion 6
  7. 7. SQL Performance Regressions: ChallengesSQL performance regressions: #1 cause of poor system performanceSQL performance can regress due to many changes - DB upgrades, patch-sets, optimizer statistics refresh, schema, parameter, hardware, etc.Changes need to be tested thoroughly to avoid regressionsTraditional testing techniques suffer from many limitations: large workloads(100K SQL), expensive, partial workload capture & manual point solutionsAs a result, no testing or sometimes limited testing done in production SQL • Proactively detects ALL SQL regressions BEFORE deploying actual change Performance • Provides integrated, comprehensive, and end-to-endAnalyzer (SPA) solution 7
  8. 8. Oracle Real Application Testing: SPA SQL Plans + Run-time Stats Pre-Change TrialSQL Workload Compare SQL Analysis ReportSTS SQL Plans + Run-time Stats Performance Post-Change Trial • Test and predict impact of system changes on SQL query performance • Analyze performance changes for improvements and regressions • Comprehensive performance analysis and reporting • Re-execute SQL queries in the given environment • End-to-end solution: STS, SQL Plan Baselines, and SQL Tuning Advisor 8
  9. 9. SPA Report (Example) 2 3 1 9
  10. 10. When to use SPA?• Testing database upgrades and patch-set releases* – 9.2/10.1 10.2 or 11g releases – 10.2.0.x 10.2.0.y or 11g releases• SPA supports testing in Oracle Database Releases 10.2 and 11g – Optimizer statistics refresh – Database parameter changes – Database schema changes (e.g., add/drop indexes) – Implementation of tuning recommendations – I/O subsystem changes (e.g., ASM, Database Machine)• SPA handles trials in a manner that does not change database data – Hence can be used for testing in production/standby environments • Across many releases of Oracle and for upgrades SPA Provides • On test, standby, and production environments • Extended to home-grown scripts, third-party testing Broad Testing tools, etc. Coverage • Supports most applications - EBS, SAP, Siebel, home- grown, etc. *MOS Note: 560977.1 10
  11. 11. Outline Oracle’s Testing Lifecycle for Database and Applications SQL Performance Analyzer (SPA): Overview Database Replay (DBReplay): Overview New in 11g Release 2 and Best Practices Real-world Customer Case Studies Conclusion 11
  12. 12. Oracle Real Application Testing Database Replay• Database load and performance Production Test testing with real production Clients Replay Driver workloads – Production workload characteristics such as timing, transaction dependency, think time, etc., fully maintained• Test and measure transaction throughput improvements• Identify application scalability and concurrency problems with new features• Remediate issues pre-production Storage Storage for risk-free change Analysis &• Supports migrations from Oracle Capture Process Replay Reporting 9iR2 and 10gR2 • *MOS 560977.1: Real Application Testing for Earlier Releases 12
  13. 13. Workload Replay Architecture• Replay captured workload Replay Clients • Replayed operations see the same data and perform the same work … • Preserve timing and File 1 concurrency Timing Preservation characteristics Re-mapping • Same number of user File 2 connections• Replay Client … • Multithreaded OCI Client Server Server … Server • Drives multiple captured Commit Order Synchronization File N processes Sequence Replay • Scalable Architecture Background Metadata • Interprets capture into sequence of OCI calls Replay Files • Functional replay
  14. 14. Database Replay - Supported Changes Client Client Client … Changes Unsupported Middle Tier Changes Supported•Database Upgrades, Patches •Schema, Parameters Recording of External Client •RAC nodes, Interconnect Requests•OS Platforms, OS Upgrades Storage •CPU, Memory •Storage •Etc. 14
  15. 15. Outline Oracle’s Testing Lifecycle for Database and Applications SQL Performance Analyzer (SPA): Overview Database Replay (DBReplay): Overview New in 11g Release 2 and Best Practices Real-world Customer Case Studies Conclusion 15
  16. 16. New Techniques for Avoiding SQL RegressionsCreate central “SPA System” for all testing• Many database releases• Test, production, standby databasesMinimize production impact• Use scoped or private session testing where possibleLeverage Oracle Active Data Guard (Read-onlyPhysical Standby) for testing• Use idle standby resources for testing• Provides full and current dataset 16
  17. 17. New Techniques for Avoiding SQL Regressions Prod Standby DB Central SPA System Prod 1 Test 1 11g SPA System Prod N • SQL workload (STS) only Test N • No application schema/data necessaryWhat is SPA system? Benefits • Remote test executes SQL workload (STS) • Use latest software for analysis • Performs reporting/analysis • Can be used as repository, helps persist • Any 11g database, preferably latest release results across database refreshes • Not mandatory except for testing pre-11g upgrades or 10.2.0.x  10.2.0.y Tips • Same or higher version than the target • Use logon triggers to set environment or database being tested to make change on remote system 17
  18. 18. Database Replay Enhancements New in Oracle Database 11g Release 2Earlier restrictions removed with support for• Shared Server configuration• Streams “apply” workloadReplay filter support to target sub-set workload• Similar to existing capture filters – Include/Exclude• Service, Program, Action, Module, etc.• API support only in current releaseIntegration of SPA and Database Replay• Allows SQL-centric analysis when using Database Replay• Simultaneously captures SQL workload into two different STS during workload capture and replay• SPA Report built from the two STS captured helps understand workload drift• Uses STS Compare functionality to highlight new, missing, top SQL, changes in execution plans, #SQL executions etc. 19
  19. 19. Oracle Database Testing Accelerator Leverage DB Workload captures• Create synthetic test scripts for Oracle Database testing – Import transactions from DB Replay capture to create scripts – Import from custom SQL Script – Create DB test scripts manually• Extend scripts in OpenScript through GUI or Java Code view• Run scripts in Oracle Load Testing to emulate concurrent Virtual Users• Leverage integration with EM Diagnostics to analyze database performance under load 20
  20. 20. Outline Oracle’s Testing Lifecycle for Database and Applications SQL Performance Analyzer (SPA): Overview Database Replay (DBReplay): Overview New in 11g Release 2 and Best Practices Real-world Customer Case Studies Conclusion 21
  21. 21. David Mitchell Senior Vice President, OVUM “Oracle Real Application Testing reduces the time required to test changes by as much as 80%, lowers testing costs by as much as 70%, mitigates risks by reducing the number of unexpected outages, and improves the quality of service for their IT operations.”Source: Oracle Real Application Testing – business agility through superior testing, Jan 2008 22
  22. 22. Case Study EM RAT Real Application TestingBUSINESS CHALLENGE ORACLE SOLUTION • EM Enterprise Manager RAT Real Application• Leading oil company operating in 10 countries in Central and Eastern Europe Testing enabled:• Business drivers for RAT • More efficiency in Testing using RATs „db replay – Cost reduction in application testing via feature“ centralization in IT and less dependency on • Safeguarding mission critical business process via external developers via better testing and avoiding negative runtime – Less performance problems in version impact in production upgrades • Faster deployment on system enhancement – Accelerated db infrastructure requests implementation change • Planned additional usage of RATs „SQL• Oracle Partner Remedios supported implementation performance Analyzing feature“ to filter out SQL- of RAT level problems in an early stageprior to production runtime impactsRESULTS• 50% cost saving in Application Testing using Enterprise Manager RAT• Modernized Testing methods on less costs with higher reputation of IT team and best and stable support for missions critical business processes• „Oracle Real Application Testing provides a unique tool that enables us to significantly improve our speed in rolling out technology, and reduces our costs associated with critical testing.” – Erzsébet Szirjákné Birkás, MOL Expert of System Programming 23
  23. 23. Arup Nanda Senior Director Starwood Hotels & Resorts Worldwide“The Database Replay and SQL Plan Managementfeatures alone are worth upgrading to OracleDatabase 11g” 11g "
  24. 24. Sean McCown Contributing Editor, Infoworld“Oracle Database 11g will be welcome relief to DBAsresponsible for testing changes against a productionworkload. The way that Data Guard and Real ApplicationTesting work together is sheer poetry, and no doubt mostshops will quickly come to rely on the combination”
  25. 25. Outline Oracle’s Testing Lifecycle for Database and Applications SQL Performance Analyzer (SPA): Overview Database Replay (DBReplay): Overview New in 11g Release 2 and Best Practices Real-world Customer Case Studies Conclusion 26
  26. 26. Conclusion • SPA enables businesses to safely test and deploy system changes using real workloads • Real Application Testing is much more than only a one- time upgrade toolkit • 232% ROI over 4 years* • Increases staff productivity – • <12 months payback less firefighting period * • More focus on strategic planning and execution • Capital expenditure savings*Based on POC and business case from a Fortune 500 Insurance Company 27
  27. 27. Resources• Dedicated ½ day workshops for Oracle Customers and Partners – Contact ruxandra.radulescu@oracle.com for more information• Oracle Database 11g Manageability and Real Application Testing – http://www.oracle.com/technology/products/manageability/database/• Oracle 11g Education (http://education.oracle.com) – Oracle 11g: New features for Administrators – Oracle 11g: Administration Workshop I and II – Oracle 11g: Change Management Overview Seminar• Oracle-By-Example Series on Oracle 11g – http://www.oracle.com/technology/obe/11gr1_db/index.htm• Oracle Database 11g Documentation – http://www.oracle.com/pls/db111/homepage• Metalink Notes – 445116.1: Using the workload capture and replay in 11g – 443580.1: 11g New Feature Database Replay – 443720.1: 11g Using Snapshot Standby Database – 455889.1: SQL Performance Analyzer – 560977.1: Real Application Testing Now Available for Earlier Releases 28
  28. 28. 29
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×