Webservice performance testing with SoapUI


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Webservice performance testing with SoapUI

  1. 1. Webservice Performance Testing with SoapUI (LoadUI) Nguyen Huu Phuoc, MEng. HCMC, 11/2013
  2. 2. Agenda • What is Performance Testing? • Performance Testing Kinds • Using LoadUI for Performance Testing • The advanced topics
  3. 3. Performance Testing • Creating or simulating artificially load. • Measuring how the system handle the load.
  4. 4. Performance Testing Kinds (1/2) • Baseline Testing – – • Load: Expected or normal load Goal: Find the metrics under normal load. Load Testing – – • Load: High load. Goal: Find the metrics under high load. Stress Testing – Load: High load. – Goal: Find the system breaking point
  5. 5. Performance Testing Kinds (2/2) • Soak Testing – – Time: Long period. – • Load: normal load or high load. Goal: Find unwanted behavior emerges over time . Scalability Testing – Load: Like Load test but increase the complexity or size of request. – Goal: Find the metrics under high volumes of data
  6. 6. Using LoadUI For LoadTest • What is LoadUI? • Quick Start: – Create a new LoadTest – Run the LoadTest – Add Assertions to a LoadTest
  7. 7. Using LoadUI For LoadTest • LoadUI: – LoadUI is a free load testing tool which is integrate into SoapUI – LoadUI provides the following features: • Distributed Load Testing: Allow user to distribute Load Tests to multiple LoadUI agents. • Run multiple Test Cases simultaneously. • Long-run tests. • Interactive load testing: Change parameter real time.
  8. 8. Using LoadUI For LoadTest • Create a new LoadTest: – In Navigator > Right click on a Test case >New Loa dTest – In New LoadTest dialog, enter your LoadTest nam e > Click on OK button.
  9. 9. Using LoadUI For LoadTest • Run the LoadTest – Modify pre-configured LoadTest with the desired values. – Run the LoadTest. – We will see the statistic table during the LoadTest running.
  10. 10. Using LoadUI For LoadTest • Add Assertions to a LoadTest: – In the LoadTest editor, select “LoadTest Assertion” ta b at the bottom of the editor. – Click LoadTest Assertion button in the LoadTest Assert ion menu bar. – In the Add Assertion dialog, select Step Maximum and click OK button. – In the TestStep Max Assertion window, modify anythi ng you want and click OK button. – The assertion is added successfully. – Run test again.
  11. 11. The Advanced Topics • Test Strategies. • Available Assertions. • Export Data & Statistics • Scripting.
  12. 12. Test Strategies • • • Simple Strategy  Baseline, Load and Soak Testing. Fixed-Rate Strategy  Guarantee the number of executions within a certain time. Variable Load Strategies: – Variance: varies the number of threads over time in a “sawtooth” manor. – Burst: Recovery testing, bursting thread in short duration and do baseline testing after that. – Thread: The linearly change in number of threads. – Grid: The relative change in number of threads. – Script: The number of thread is scripted.
  13. 13. Available Assertions • • • • • Step Average: Asserts that the average value d oesn't exceed the specified limit. Step TPS: Asserts the TPS (transaction per sec ond) value Step Minimum: Asserts the max value Step Status: Check that the underlying executi on status is successful. Max Errors: Check that the number of failures.
  14. 14. Export Data & Statistics • Export statistics to CSV. • Export Statistics Diagrams to CSV. • Export Data Continuously: Using Statistic Log
  15. 15. Scripting • LoadUI allow user make the following TestCas e-specific scripting hooks: – Setup and TearDown scripts – Access to LoadTest related objects in a TestCase sc ript – The objects we can use in the scripts: • context • log • loadTestRunner
  16. 16. THANK YOU ! Nguyen Huu Phuoc, MEng. Homepage: http://hữuphướcnguyễn.vn http://phuocnh.nghelong.com