Migration and consolidation at GE:All You ever wanted to know about Real           Application Testing         Földi Tamás...
GE Lighting EMEAData warehouse     Oracle 9i, HPUX     13 000 tables     ~1400 ETL jobs     ~8000 ETL mappingReporting...
BI Upgrade: project goals   Support   • Replace non-supported applications   New functions for Business   • Modern dashboa...
BI Upgrade: project objectives                                                        Advanced                  BusinessOb...
Oracle action planConsolidation   Merge Stage and DWH instances   Less license, more performanceUpgrade from 9i to 11g  ...
Oracle upgade risksSoftware errors   Bugs, incompatibilities   Data mismatchCannot reach the goals   The performance ga...
www.starschema.net
www.starschema.net
www.starschema.net
Real Application TestingReal workload• Executed SQLs• Timings• Network loadEvaluation• Reports• SQL tuning sets           ...
Testing process                  www.starschema.net
www.starschema.net
RAT preparationMake a plan   Merge instances   Rearrange table spaces   Tune parametersApply patches   Oracle 9.2.0.8 ...
Timing                                     Tuning setsProduction         RAT system                                       ...
RecordingRec files   Could be several gigabytesPerformance impact   ARCHIVE mode   Disable „direct path”   Etc. 10% pe...
www.starschema.net
Playback preparationConsistent state   All data are the same on prod and RAT   Reset system clock to same time as    pro...
Consolidation RAT officially does not support multiple   records playback on single instance.          But there is a work...
PlaybackIteration   Scenarios with different prameters or    environments   Workload playback   Go back to the starting...
ReportsDB Replay   • Data divergence   • Execution errors   • Performance impact (ADDM,   ASH, AWR)SQL Performance Analyze...
ResultsConsolidation   Two, merged database instances can ran on    the same hardware and instance   Reduced license and...
RAT vs. Without RATRequired resources (days)                            40                                           30   ...
SummaryEasy-to-useReal workload instead of syntheticMake backups before all stepsMust have for multiple instance  consolid...
Thank Youwww.starschema.net
Used pictures http://www.flickr.com/photos/govert1970/87971108/sizes/l/ http://www.flickr.com/photos/museeinformatique/3...
Upcoming SlideShare
Loading in …5
×

Oracle Real Application Testing at GE Hungary (English)

1,229 views
1,105 views

Published on

Oracle Real Application Testing experiences at GE Hungary. Presented at 5. Hungarian Oracle Users Group (HOUG) conference at 2011.

A magyar nyelvű változat is elérhető.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,229
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
33
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Oracle Real Application Testing at GE Hungary (English)

  1. 1. Migration and consolidation at GE:All You ever wanted to know about Real Application Testing Földi Tamás – Starschema Kft.
  2. 2. GE Lighting EMEAData warehouse  Oracle 9i, HPUX  13 000 tables  ~1400 ETL jobs  ~8000 ETL mappingReporting  BusinessObjects 6.5  180 standard, 860 ad-hoc report  1200 uses (average 60-80 concurent) www.starschema.net
  3. 3. BI Upgrade: project goals Support • Replace non-supported applications New functions for Business • Modern dashboards and reports Performance • Apply industry specific best practices Cost reduction • Standard, consolidated solutions www.starschema.net
  4. 4. BI Upgrade: project objectives Advanced BusinessObject PL/SAPOracle 11g Analysis XI 3.1 Connector (OLAP) Upgrade toMerge instances version XI 13.0 Supply Chain Efficient SAP interface Automatic Migrate reports Storage to WebI format Management Commercial Finance SQL Plan LiveOffice Management New staging system SQL Tuning, Metadata Sales Parallel Query Manager www.starschema.net
  5. 5. Oracle action planConsolidation  Merge Stage and DWH instances  Less license, more performanceUpgrade from 9i to 11g  SQL tuning (orainit, PX, SPM)  CompressionStorage  Reorganize table spaces (ASSM)  Automatic Storage Management (ASM)  Remove unused objects (based on audit) www.starschema.net
  6. 6. Oracle upgade risksSoftware errors  Bugs, incompatibilities  Data mismatchCannot reach the goals  The performance gain is less than expected www.starschema.net
  7. 7. www.starschema.net
  8. 8. www.starschema.net
  9. 9. www.starschema.net
  10. 10. Real Application TestingReal workload• Executed SQLs• Timings• Network loadEvaluation• Reports• SQL tuning sets www.starschema.net
  11. 11. Testing process www.starschema.net
  12. 12. www.starschema.net
  13. 13. RAT preparationMake a plan  Merge instances  Rearrange table spaces  Tune parametersApply patches  Oracle 9.2.0.8 + „one-off patch” 9373986  Oracle 11.2.0.2 + „one-off patch” 11691834Estimate storage  Do test recordingsDisable API loads (direct path) www.starschema.net
  14. 14. Timing Tuning setsProduction RAT system Reports Build new Install patches environment Full backup Full backup PreprocessRestart database recordings Start recording Playback Restore www.starschema.net
  15. 15. RecordingRec files  Could be several gigabytesPerformance impact  ARCHIVE mode  Disable „direct path”  Etc. 10% performance degradationSelect interesting period  Record 24 hour workload  Started in the same time on all instances www.starschema.net
  16. 16. www.starschema.net
  17. 17. Playback preparationConsistent state  All data are the same on prod and RAT  Reset system clock to same time as productionBackup  RMAN backup or Snapshot StandbyProcessing  Process one time, playback many timesFiltering  Non-used schemas (EM, AWR) www.starschema.net
  18. 18. Consolidation RAT officially does not support multiple records playback on single instance. But there is a workaround.Playing records from multiple instances on single node:  Sources must be captured in same time  All rec files must be copied into single folder, but with one header and footer  Only datetime based playback is supported, SCN based sync is not working www.starschema.net
  19. 19. PlaybackIteration  Scenarios with different prameters or environments  Workload playback  Go back to the starting state  Make AWR baselinesReplay clients  Client Calibration AdvisorSynchronization  When replaying from multiple instances, only timestamp based is working www.starschema.net
  20. 20. ReportsDB Replay • Data divergence • Execution errors • Performance impact (ADDM, ASH, AWR)SQL Performance Analyzer • Compare performance (CPU, IO, etc.) • Tune regressed SQL using SQL Tuning Advisor • Analysis results can be used to seed SQL Plan Management repository www.starschema.net
  21. 21. ResultsConsolidation  Two, merged database instances can ran on the same hardware and instance  Reduced license and maintenance feesData integrity  There was no data divergenceOptimization  Regressed SQL statements were isolated  10-15% performance gain www.starschema.net
  22. 22. RAT vs. Without RATRequired resources (days) 40 30 20 20 10 10 5 Wo DB Replay 4 0 2 5 0 DB Replay 0 Development/ Install Generating Run Test Evaluation RAT setup simulation Workload Reports, tuning environment sets Required time for testing DB Replay: 2 weeks Without DB Replay: 10 weeks www.starschema.net
  23. 23. SummaryEasy-to-useReal workload instead of syntheticMake backups before all stepsMust have for multiple instance consolidationEfficient with AWRNon-supported loads (direct path)Non-used schemas must be filtered outUse PL/SQL interface instead of EM www.starschema.net
  24. 24. Thank Youwww.starschema.net
  25. 25. Used pictures http://www.flickr.com/photos/govert1970/87971108/sizes/l/ http://www.flickr.com/photos/museeinformatique/3783304683/sizes/l/ http://www.flickr.com/photos/littledebbie11/3208631777/sizes/l/ http://theinspirationroom.com/daily/2008/mercedes-crash-test-for-breast- cancer/ http://www.flightsafety.com/html/pdf/0981_sim_bro_final.pdf http://tonguc.files.wordpress.com/2009/07/11g_real_application_testing.ppt www.starschema.net

×