The right way to manage your Load testing projects
Performance test main goals <ul><li>Validates system under load with KPI/SLA system requirements </li></ul><ul><li>Verify ...
Test Performance on What Level? <ul><li>Unit test </li></ul><ul><li>Sub system test </li></ul><ul><li>System test </li></u...
T esting  T ools  M anagement  Methodology
Performance projects  Step by Step   <ul><li>Analyze the system </li></ul><ul><li>Performance Test Plan & Detail design </...
Performance projects  Step by Step (Cont.)   <ul><li>Script Development </li></ul><ul><li>Scenario configuration </li></ul...
Load Testing <ul><li># of CSRs  </li></ul><ul><li># of transactions per peak hour </li></ul><ul><li>Runs this test for a l...
Volume Testing Verifies that the system complies with the volume requirements  (i.e. operates in a defined response time w...
Stress Testing <ul><li>Examples: </li></ul><ul><ul><li>Maximum data inflation  </li></ul></ul><ul><ul><li># of maximum  re...
First step Definition  – analyze the system
First step Definition  – Performance Test Plan <ul><li>Test Plan document include </li></ul><ul><ul><li>Environment archit...
First step Definition  – Define Load Testing tool Load Runner
First step Definition  – Define Load Testing tool JMeter  server types   (web-http,https SOAP DB via jdbc LDAP JMS mail PO...
First step Definition WebLoad  web load support
First step Definition Team System
First step Definition  – Monitor Tools Windows Performance monitor
First step Definition  – Monitor Tools Unix Performance monitor - Top
Preparation - Estimation module   A tool helps to calculate the exact dates will need in order to perform the performance ...
Preparation – Work Plan   After we got the number of working days required for the project will gather it on a calendar
Development & configuration   <ul><li>Test environment preparation and data inflation </li></ul><ul><li>Script Development...
Execution   <ul><li>Execute 30% 50% 100% </li></ul>
Analyze results & Recommendation   <ul><li>There is a problem   OR  the problem is here??? </li></ul><ul><li>Help the deve...
Load Testing reports –Templates
Load Testing reports –  Templates cont. Comparison XLS report table
Run & Analyze the scenario  Bottlenecks Statistics Example
Summary Report <ul><li>Activities summary </li></ul><ul><li>Performance tests problem and defects </li></ul><ul><li>Baseli...
Thank you All!!! Any Questions?
Upcoming SlideShare
Loading in...5
×

The right way to manage your load testing project

1,107

Published on

Load testing essentials, Lior Katz - TACT Testing

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,107
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
13
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • * 07/16/96 * ##
  • The right way to manage your load testing project

    1. 1. The right way to manage your Load testing projects
    2. 2. Performance test main goals <ul><li>Validates system under load with KPI/SLA system requirements </li></ul><ul><li>Verify system functionality under load </li></ul><ul><li>Help configure the system from performance aspects </li></ul><ul><li>Identify Performance system issues </li></ul>
    3. 3. Test Performance on What Level? <ul><li>Unit test </li></ul><ul><li>Sub system test </li></ul><ul><li>System test </li></ul><ul><li>Production </li></ul>The Cost of Fixing Software Defects: The later in the development cycle— the higher the cost $0 $100 $1,000 $10,000 Design Code Unit Integration System Release Maintenance
    4. 4. T esting T ools M anagement Methodology
    5. 5. Performance projects Step by Step <ul><li>Analyze the system </li></ul><ul><li>Performance Test Plan & Detail design </li></ul><ul><li>Define Load testing tools </li></ul><ul><li>Monitor tools </li></ul><ul><li>Estimation module </li></ul><ul><li>Work plan </li></ul><ul><li>Prepare the test environment and data preparation </li></ul>
    6. 6. Performance projects Step by Step (Cont.) <ul><li>Script Development </li></ul><ul><li>Scenario configuration </li></ul><ul><li>Execution 20% 50% 100% </li></ul><ul><li>Analyze test result and recommendation </li></ul><ul><li>Rerun solving issues </li></ul><ul><li>Summary report and conclusions </li></ul><ul><li>Lesson learn </li></ul>
    7. 7. Load Testing <ul><li># of CSRs </li></ul><ul><li># of transactions per peak hour </li></ul><ul><li>Runs this test for a long period of time without shutting down </li></ul><ul><li>Checks the transaction’s time in the application under load conditions </li></ul>Verifies that the system comply with the load requirements (i.e. operates according to a defined response time when maximum inputs are loaded into the system)
    8. 8. Volume Testing Verifies that the system complies with the volume requirements (i.e. operates in a defined response time when the system data bases are populated to maximum) # of data pool Load DB with Max data Test the system with Max data
    9. 9. Stress Testing <ul><li>Examples: </li></ul><ul><ul><li>Maximum data inflation </li></ul></ul><ul><ul><li># of maximum records </li></ul></ul><ul><ul><li># of maximum users </li></ul></ul>Evaluates the system behavior at or beyond the limits of its specified load and volume requirements
    10. 10. First step Definition – analyze the system
    11. 11. First step Definition – Performance Test Plan <ul><li>Test Plan document include </li></ul><ul><ul><li>Environment architecture </li></ul></ul><ul><ul><li>Testing tools </li></ul></ul><ul><ul><li>Performance Test scope </li></ul></ul><ul><ul><li>Running scenario </li></ul></ul><ul><ul><li>Entry/Exit Criteria </li></ul></ul><ul><ul><li>Time table </li></ul></ul><ul><ul><li>Defect Tracking </li></ul></ul><ul><ul><li>Roles & responsibilities </li></ul></ul><ul><ul><li>Measure of success </li></ul></ul><ul><ul><li>Risk assessment </li></ul></ul>
    12. 12. First step Definition – Define Load Testing tool Load Runner
    13. 13. First step Definition – Define Load Testing tool JMeter server types (web-http,https SOAP DB via jdbc LDAP JMS mail POP 3)
    14. 14. First step Definition WebLoad web load support
    15. 15. First step Definition Team System
    16. 16. First step Definition – Monitor Tools Windows Performance monitor
    17. 17. First step Definition – Monitor Tools Unix Performance monitor - Top
    18. 18. Preparation - Estimation module A tool helps to calculate the exact dates will need in order to perform the performance activities
    19. 19. Preparation – Work Plan After we got the number of working days required for the project will gather it on a calendar
    20. 20. Development & configuration <ul><li>Test environment preparation and data inflation </li></ul><ul><li>Script Development </li></ul><ul><li>Scenario configuration </li></ul>
    21. 21. Execution <ul><li>Execute 30% 50% 100% </li></ul>
    22. 22. Analyze results & Recommendation <ul><li>There is a problem OR the problem is here??? </li></ul><ul><li>Help the development team to find the problem </li></ul><ul><li>Configuration issues and recommendation </li></ul>
    23. 23. Load Testing reports –Templates
    24. 24. Load Testing reports – Templates cont. Comparison XLS report table
    25. 25. Run & Analyze the scenario Bottlenecks Statistics Example
    26. 26. Summary Report <ul><li>Activities summary </li></ul><ul><li>Performance tests problem and defects </li></ul><ul><li>Baseline scenario </li></ul><ul><li>After tuning and connection </li></ul><ul><li>Result comparison </li></ul><ul><li>Monitoring summary </li></ul><ul><li>Conclusion and recommendation </li></ul>
    27. 27. Thank you All!!! Any Questions?
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×