Your SlideShare is downloading. ×
0
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Db2 tech talk optim workload replay for db change
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Db2 tech talk optim workload replay for db change

322

Published on

Db2 tech talk optim workload replay for db change

Db2 tech talk optim workload replay for db change

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
322
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. © 2013 IBM Corporation 1 Leverage InfoSphere Optim Workload Replay to Make DB Changes Faster and Less Risky January 23, 2014 Presented by: John Vonau, IBM Labs
  • 2. © 2013 IBM Corporation 2 Need webcast troubleshooting help? Click attachments 1. The presentation for this Tech Talk: http://bit.ly/ttfilejan14 2. Next steps and troubleshooting guide: click “Attachments“ in this webcast window A few details …. John Vonau Architect, InfoSphere Optim Workload Replay Today’s technical presenters . . . DB2 Tech Talk series host and today‟s presenter: Rick Swagerman, Host and Today’s Presenter DB2 Language Architect
  • 3. © 2013 IBM Corporation 3 Need webcast troubleshooting help? Click attachments Disclaimer The information contained in this presentation is provided for informational purposes only. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided “as is”, without warranty of any kind, express or implied. In addition, this information is based on IBM‟s current product plans and strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other documentation. Nothing contained in this presentation is intended to, or shall have the effect of: • Creating any warranty or representation from IBM (or its affiliates or its or their suppliers and/or licensors); or • Altering the terms and conditions of the applicable license agreement governing the use of IBM software. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
  • 4. © 2013 IBM Corporation Agenda  Problem Description  Solution Overview  Use Cases and Testing Methodology  Architecture  Capture Processing  Preparing for Replay  Replay  Reporting and Analysis  Examples 4 Need webcast troubleshooting help? Click attachments
  • 5. © 2013 IBM Corporation Managing Production Changes More Efficiently Need webcast troubleshooting help? Click attachments5
  • 6. © 2013 IBM Corporation InfoSphere Workload Replay Requirements Benefits Capture production workloads and replay them in testing environments • Minimize unexpected production problems • Shorten testing cycles • Develop more realistic database testing scenarios • Identify database problems sooner with validation reports and performance tuning • Use actual production workloads for testing rather than fabricated scenarios • Extend quality testing efforts to include the data layer Test Database Source DatabaseApplication InfoSphere Workload Replay Record Play Need webcast troubleshooting help? Click attachments6
  • 7. © 2013 IBM Corporation Proposed Solution – Use Cases  Migration: upgrade to a new version of database, OS, apply a new PTF or fixpack, hardware changes – Understand potential performance impacts, identify bottlenecks, etc.  New Application: run a new application along side „production‟ – Identify any response time impact, lock contention, or other bottlenecks  More Data: test impact of increased data volume, e.g. millions of rows of new sales data – Maintain stable performance as the data increases  More Users: speed up replay to simulate increased number of concurrent users – Continue to meet SLAs as the number of users increases  Tuning: change system configuration, e.g. config parameters, buffer pools – Experiment with different settings to find the best combination of settings  Tuning: physical database design changes, e.g. new indexes – Identify how a new index will impact existing access plans and overall performance Need webcast troubleshooting help? Click attachments7
  • 8. © 2013 IBM Corporation Solution Overview  Capture production application workloads and replay them in a test environment that simulates production – Capture all components needed for real-life workload simulation – Prepare the workload replay – Replay workload – Compare replay with original capture or subsequent replays • Validate correct SQL execution behavior • Identify performance regressions and/or improvements • Establish baseline or assess impact of changes Need webcast troubleshooting help? Click attachments8
  • 9. © 2013 IBM Corporation Example: Migrating to BLU Acceleration  Capture DB2 production activity  Prepare test data on the test system  Replay workload to a row organized database  Convert candidate tables to column organized  Replay workload with BLU Acceleration tables  Analyze results after converting to BLU Acceleration DB2 9.7 Production InfoSphere Optim Workload Replay DB2 10.5 Test Record Play Capture Prepare Replay Compare and Analyze Need webcast troubleshooting help? Click attachments9
  • 10. © 2013 IBM Corporation Example: Migration from Oracle DB to DB2  Capture Oracle production activity  Prepare test data on the DB2 system  Replay the production activity on DB2 test system running in Oracle compatibility mode  Compare Oracle production capture to DB2 replay Oracle Production InfoSphere Optim Workload Replay DB2 Test Record Play Capture Prepare Replay Compare and Analyze Need webcast troubleshooting help? Click attachments10
  • 11. © 2013 IBM CorporationNeed webcast troubleshooting help? Click attachments  S-TAP  Installed on database server  Intercepts incoming local and remote database traffic  Workload Replay server  Software component  Built on Guardium v9  Processes, replays and analyzes workloads  User interfaces  Web console  Command line interface Architecture InfoSphere Workload Replay server Local Applications Production Database Test Database SQL SQL SQL Remote Applications S-TAP S-TAP 11
  • 12. © 2013 IBM Corporation  S-TAP – Software tap captures local and remote inbound database traffic – Sends collected information to the Workload Replay server, where it is stored  Output: captured workload, metadata required to replay the workload and metrics  Not collected: statistics, catalog information, data Step 1: Capturing the Workload Record SQL SQL Remote Applications S-TAP Local Applications Production Database Workload Replay server Need webcast troubleshooting help? Click attachments12
  • 13. © 2013 IBM Corporation Capturing the Workload 13
  • 14. © 2013 IBM Corporation Capturing the Workload Need webcast troubleshooting help? Click attachments14
  • 15. © 2013 IBM Corporation Reviewing the Captured Workload  Capture report provides aggregated workload information: – SQL count, unique SQL statements, transaction count, metrics, …  Captured SQL can be exported to delimited text file for custom processing using other tools Need webcast troubleshooting help? Click attachments15
  • 16. © 2013 IBM Corporation  Workload replay requires – Workload transformation (to an optimized replay „format‟) – Replay environment setup  Workload transformation maps – Source to a target database – User credentials – Schema qualifiers  Setup target system such that it approximates the source system (how it was at the time of capture) – DB2 Advanced Recovery Feature Step 2: Preparing the Replay Production Database Workload Replay server Transform workload Clone/setup database environment Target database Need webcast troubleshooting help? Click attachments16
  • 17. © 2013 IBM Corporation Preparing the Replay  Specify replay target and replay user IDs  Schema mapping for dynamic SQL  User ID mapping Need webcast troubleshooting help? Click attachments17
  • 18. © 2013 IBM Corporation Reviewing the Replay-Ready Workload  Transform report provides aggregated information about the replay-ready workload – SQL count, unique SQL statements, transaction count, metrics, …  Transformed SQL can be exported as delimited text file Need webcast troubleshooting help? Click attachments18
  • 19. © 2013 IBM Corporation Step 3: Replaying the Workload  S-TAP captures incoming traffic and collects metrics  Collected information is used to compare workload executions  Workload is replayed by Workload Replay server, preserving original concurrency, timing and characteristics  Replay speed can be adjusted to simulate different throughput Target Database SQL S-TAP JDBC Workload Replay server Need webcast troubleshooting help? Click attachments19
  • 20. © 2013 IBM Corporation  Review Transform Settings  Schedule the Replay  Specify Replay Rate  Optional Data Reset Method Replaying the Workload Need webcast troubleshooting help? Click attachments20
  • 21. © 2013 IBM Corporation Replaying the Workload Need webcast troubleshooting help? Click attachments21
  • 22. © 2013 IBM CorporationNeed webcast troubleshooting help? Click attachments Logical Replay SQL Features  Replay reproduces the original application timing, order of execution, transaction boundaries, isolation levels, and other SQL and application characteristics. – Special Register Support (including set client support and others using EXCSQLSETT) – Transaction isolation level support (cursor stability etc). – Transaction commit/rollback support (multiple statements within a transaction) – Execute Immediate Support – Execute Support (with Full Data Types including LOBs/XML support/toleration) – Open Support (with Full Data Types including LOBs/XML support/toleration) – Forward only and scrollable cursor support/toleration (fetch, close, etc.) – Statement attribute support (fetch first n rows, etc.) – Positioned Update and Delete (including cursor name mapping) – Cursor operations interleaved with non-cursor operations – Call statements (with and without result sets) – Batching support (for example, multi row insert) – Statement results – sqlcodes, update counts, rows selected, etc. – All features include both Static and Dynamic SQL support 22
  • 23. © 2013 IBM Corporation Step 4: Analyzing Impact  Summary reports provide quick overview  Drill-through reports provide details  Analyze relevant differences and assess whether follow-up actions are necessary  Modify replay environment or exclude problematic transactions if needed  Repeat steps as necessary  Reports provide insights into how changes to the data server environment (or workload) impact workload replay accuracy and performance Need webcast troubleshooting help? Click attachments23
  • 24. © 2013 IBM Corporation Stage 1: Produce baseline in test environment – Compare production capture with first replay in test environment (capture vs. replay comparison) – Goal: validate that replay is accurate and representative of original capture before any changes are introduced in the test environment Accuracy Performance Step 4: Comparing and Analyzing Results Need webcast troubleshooting help? Click attachments24
  • 25. © 2013 IBM Corporation Stage 2: Analyze impact of changes in test environment – Compare baseline replay with another replay in test environment (replay vs. replay comparison) – Goal: Analyze impact that newly introduced changes have on workload execution Step 4: Comparing and Analyzing Results Accuracy Performance Need webcast troubleshooting help? Click attachments25
  • 26. © 2013 IBM Corporation  Summary report provides easy access to aggregated information Workload Analysis – Accuracy Report Need webcast troubleshooting help? Click attachments26
  • 27. © 2013 IBM Corporation  Drill-through reports provide more in-depth information Analyzing Accuracy Issues Need webcast troubleshooting help? Click attachments27
  • 28. © 2013 IBM Corporation Analyzing Performance (1)  Performance overview highlights SQL improvements or regressions Need webcast troubleshooting help? Click attachments28
  • 29. © 2013 IBM Corporation  Charts visualize key workload characteristics Analyzing Performance (2) Need webcast troubleshooting help? Click attachments29
  • 30. © 2013 IBM Corporation  Drill-through reports display aggregated information for each unique SQL that improved or regressed – Execution count, row count, total and average response time  Workload can be exported in InfoSphere Optim Query Workload Tuner compatible format for tuning and visualization – Statistics advise – Index advise – Table Organization advise (for analytical workloads) Analyzing Performance Need webcast troubleshooting help? Click attachments30
  • 31. © 2013 IBM Corporation  Additional summarized details are available for each unique SQL  In-depth information is available for TopN executions (regressions or improvements) Analyzing Performance – SQL Summary 31
  • 32. © 2013 IBM Corporation  SQL execution information provides additional details, such as host variable values, special registers, etc Analyzing Performance - SQL Details Need webcast troubleshooting help? Click attachments32
  • 33. © 2013 IBM Corporation Workload Comparison - Index Example  Comparison report after adding Index  Reduction in cumulative response time  Consistent elapsed time results Need webcast troubleshooting help? Click attachments33
  • 34. © 2013 IBM Corporation Workload Comparison - Index Example Need webcast troubleshooting help? Click attachments34
  • 35. © 2013 IBM Corporation Replay Comparison Report – Post-BLU Acceleration  When replay is finished, run report to compare the BLU Acceleration performance to 9.7 baseline  Better than expected, worth doing more tests and moving forward with next workload! 35 Need webcast troubleshooting help? Click attachments
  • 36. © 2013 IBM Corporation 36 Need webcast troubleshooting help? Click attachments DB2 Tech Talk: InfoSphere Optim Workload Replay Next Steps Roadmap Read the technical articles and best practices •Introduction to InfoSphere Optim Workload Replay ibm.biz/BdRiFy •Assessing database migration ibm.biz/BdRiEy •Roadmap and tutorial Roadmap:ibm.co/1mHgSa5 Tutorial: ibm.co/1mtodau Watch a demo of Workload Replay in Action! •Efficient and realistic workload testing with InfoSphere Workload Replay ibm.biz/BdRiFP Use the Information Center ibm.co/1dPOK2r Join the community! developerWorks Technical forum: ibm.co/1bi7V3H Twitter: #optim #InfoSphere and @IBM_DB2 Facebook: www.facebook.com/#!/DB2community Reference Call IBM to schedule a demo or learn more • 1 800 966-9875 (U.S) • 1-888-746-7426 (Canada) • 1800-425-3333 (India) • Or visit http://www.ibm.com/planetwide/ for contact information worldwide DB2 Tools product page ibm.co/1g15sNX DB2 product page www.ibm.com/db2 IBM Data Studio product page Ibm.co/ibmdsinfo Tech forum on developerWorks bit.ly/db2forumluw SQL Tips Blog: www.sqltips4db2.com Step Three Step Two Step One Step Four
  • 37. © 2013 IBM Corporation 37 Need webcast troubleshooting help? Click attachments Upcoming Tech Talks Don’t miss these in-depth DB2 feature talks! Dates and topics subject to change and modification. How to register : DB2 Tech Talks web site Next DB2 Tech Talk: Use InfoSphere Information Server with DB2 • February 27, 2014 at 12:30 PM • Sriram Padmanabhan, Chief Architect, InfoSphere Servers • Registration: http://bit.ly/tt2014feb IDUG DB2 Tech Conference North America • May 12 - 16, 2014 • In-person conference sponsored by IDUG • Phoenix, Arizona • Agenda and registration: www.idug.org, select events IBM Information on Demand is all new IBMInsight 2014! • October 26 – 30, 2014 • Las Vegas, Nevada • Save the date.
  • 38. © 2013 IBM Corporation DB2 Tech Talk 38 Need webcast troubleshooting help? Click attachments
  • 39. © 2013 IBM Corporation 39 Need webcast troubleshooting help? Click attachments Questions Listening in replay? Questions: www.sqltips4db2.com Click submit a question.
  • 40. © 2013 IBM Corporation 40 Need webcast troubleshooting help? Click attachments Thanks for attending! Please rate the session Presentation download: bit.ly/ttfilejan14 click Attachments in this webcast environment

×