0
Load Testing is Easy,  Good Load Testing is Not.  Preparation is the Difference.   Chris Lynn - Safeway, Inc. Dennis Sherm...
Disclaimers <ul><li>There will be no Greek letters in this presentation. </li></ul><ul><li>This is an INTRODUCTORY startin...
Who is the audience? <ul><li>How many of you have participated in load testing for 1, 3, 5, 10 years? </li></ul><ul><li>Ho...
How do you feel? <ul><li>Often surprised (the bad kind) by my production performance when a new application is released? <...
What is the Purpose of Testing? What do you want to learn? <ul><li>Performance Evaluation </li></ul><ul><li>Performance Tu...
Who Is Involved?  Roles/Responsibilities <ul><li>Test Manager </li></ul><ul><li>Load Tester </li></ul><ul><li>Application/...
Know The Business Requirements (not “Business Hopes”) <ul><li>SLA’s </li></ul><ul><li>Transaction Response Times </li></ul...
Define the Scope of Testing <ul><li>Time </li></ul><ul><li>Potential Liklihood of change </li></ul><ul><li>Sufficient Load...
Test Environment Considerations <ul><li>Hardware/Platform </li></ul><ul><ul><li>Size </li></ul></ul><ul><ul><li>Versions <...
Other Considerations <ul><li>Usage Patterns </li></ul><ul><li>Transaction Mix </li></ul><ul><li>Load Generation Limitation...
Test Tracking and Reporting <ul><li>Test Parameters (repeatability) </li></ul><ul><li>Test Results </li></ul><ul><ul><li>T...
Sample Test Tracking
Sample Results Tracking
LDAP Sample Log
It Can Get Very Complex
Templates Available <ul><li>Transaction Mix Identification </li></ul><ul><li>Test Plan Creation </li></ul><ul><li>Load Gen...
Sample Results
Conclusions <ul><li>Planning Makes All the Difference!!!   </li></ul><ul><li>Know Why You Are Testing </li></ul><ul><li>Un...
Upcoming SlideShare
Loading in...5
×

Load Testing is Easy. Good Load Testing is Not. Preparation ...

829

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
829
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
21
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Load Testing is Easy. Good Load Testing is Not. Preparation ..."

  1. 1. Load Testing is Easy, Good Load Testing is Not. Preparation is the Difference. Chris Lynn - Safeway, Inc. Dennis Sherman - Safeway, Inc.
  2. 2. Disclaimers <ul><li>There will be no Greek letters in this presentation. </li></ul><ul><li>This is an INTRODUCTORY starting point, not an all inclusive list of everything. </li></ul><ul><li>If you are an advanced load tester then this might be therapy for you to see the same problems in other organizations. </li></ul>
  3. 3. Who is the audience? <ul><li>How many of you have participated in load testing for 1, 3, 5, 10 years? </li></ul><ul><li>How many of you have used/use currently LoadRunner, QALoad, eTester, SLAMD, Load Copient, other? </li></ul><ul><li>What percentage of projects you have load tested passed all performance and throughput requirements without any rework of the application? (1%, 5%, 10%, 20%) </li></ul><ul><li>How Many are Load Testers, Capacity Planners, Other? </li></ul>
  4. 4. How do you feel? <ul><li>Often surprised (the bad kind) by my production performance when a new application is released? </li></ul><ul><li>I am missing something in my testing? </li></ul><ul><li>Production performance doesn’t match the performance in testing? </li></ul><ul><li>Do you feel lucky, punk? </li></ul>
  5. 5. What is the Purpose of Testing? What do you want to learn? <ul><li>Performance Evaluation </li></ul><ul><li>Performance Tuning </li></ul><ul><li>Stress </li></ul><ul><li>Stability </li></ul><ul><li>Availability </li></ul><ul><li>Avoid re-work and wasted work </li></ul>
  6. 6. Who Is Involved? Roles/Responsibilities <ul><li>Test Manager </li></ul><ul><li>Load Tester </li></ul><ul><li>Application/Business Representatives </li></ul><ul><li>Capacity Planner </li></ul><ul><li>Server Engineer </li></ul><ul><li>Network Engineer </li></ul>
  7. 7. Know The Business Requirements (not “Business Hopes”) <ul><li>SLA’s </li></ul><ul><li>Transaction Response Times </li></ul><ul><li>Throughput </li></ul><ul><li>Availability Requirements </li></ul><ul><li># real users </li></ul><ul><li>Concurrency (application/logged in, application active, transaction) </li></ul>
  8. 8. Define the Scope of Testing <ul><li>Time </li></ul><ul><li>Potential Liklihood of change </li></ul><ul><li>Sufficient Load Generation Capacity </li></ul><ul><li>Just the online application, or also the batch, reporting, ETL, middleware, annual processing, alternate clients (wireless, time clocks) etc. </li></ul><ul><li>LAN/WAN </li></ul>
  9. 9. Test Environment Considerations <ul><li>Hardware/Platform </li></ul><ul><ul><li>Size </li></ul></ul><ul><ul><li>Versions </li></ul></ul><ul><li>Load Balancing </li></ul><ul><li>Network Simulation </li></ul><ul><li>Software Infrastructure </li></ul><ul><li>Application Functionality </li></ul><ul><li>Monitoring Tools </li></ul>
  10. 10. Other Considerations <ul><li>Usage Patterns </li></ul><ul><li>Transaction Mix </li></ul><ul><li>Load Generation Limitations </li></ul><ul><ul><li>1000 real users doesn’t always require 1000 VU’s </li></ul></ul>
  11. 11. Test Tracking and Reporting <ul><li>Test Parameters (repeatability) </li></ul><ul><li>Test Results </li></ul><ul><ul><li>Throughput </li></ul></ul><ul><ul><li>Response times </li></ul></ul><ul><ul><li>System impacts </li></ul></ul>
  12. 12. Sample Test Tracking
  13. 13. Sample Results Tracking
  14. 14. LDAP Sample Log
  15. 15. It Can Get Very Complex
  16. 16. Templates Available <ul><li>Transaction Mix Identification </li></ul><ul><li>Test Plan Creation </li></ul><ul><li>Load Generator Identification/Installation/Operation </li></ul><ul><li>Initial/Validation Tests </li></ul><ul><li>Initial/Validation Report </li></ul><ul><li>Primary Load/Performance Tests </li></ul><ul><li>Primary Load/Performance Report </li></ul>
  17. 17. Sample Results
  18. 18. Conclusions <ul><li>Planning Makes All the Difference!!! </li></ul><ul><li>Know Why You Are Testing </li></ul><ul><li>Understand The Test Environment </li></ul><ul><li>Understand The Business/Customer Requirements </li></ul><ul><li>Know Who To Involve </li></ul><ul><li>Test Like The Wind </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×