Automating Software Testing - Myths, Benefits and Tools

2,768 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,768
On SlideShare
0
From Embeds
0
Number of Embeds
195
Actions
Shares
0
Downloads
41
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Automating Software Testing - Myths, Benefits and Tools

  1. 1. Automating Software Testing Myths, Benefits and Tools Phil Robinson LonsdaleSystems.comLonsdaleSystems.com 1
  2. 2. Mechanical Testing Test equipment System under testLonsdaleSystems.com 2
  3. 3. Electrical Testing System under test Test equipmentLonsdaleSystems.com 3
  4. 4. Electrical Test Automation • Benefits – Large volume of tests – Feasibility of manual tests – Test throughput – Accuracy of results • Costs – Equipment – Setup – MaintenanceLonsdaleSystems.com 4
  5. 5. Software TestingTest equipment System under testLonsdaleSystems.com 5
  6. 6. Software Test Automation • Magic • ExpensiveLonsdaleSystems.com 6
  7. 7. Benefits of Test Automation • Faster test throughput • After hours testing • Better use of testers time • Improved test accuracy • Reduced effort in some areasLonsdaleSystems.com 7
  8. 8. Cost of Test Automation• Tool selection, acquisition and implementation costs• Support and maintenance• Training costs• Increased effort in some areasLonsdaleSystems.com 8
  9. 9. Acquisition Costs www.opensourcetesting.orgLonsdaleSystems.com 9
  10. 10. Increase/Reduction in Effort• Labour intensive to specify tests• Less effort to execute tests• Less effort to repeat tests • Less effort to specify tests • Labour intensive Automated to execute tests • Labour intensive to repeat tests Manual • Some tests are impractical LonsdaleSystems.com 10
  11. 11. Two Compelling Drivers For Test Automation The need for repetitive test execution Manual execution of some tests is impracticalLonsdaleSystems.com 11
  12. 12. Test Automation as an Investment DecisionBenefitsCostsLonsdaleSystems.com 12
  13. 13. Test Automation Risks• Insufficient time and resources• Lack of skills• Volatile requirements• Requirements difficult to test• Changing technologyLonsdaleSystems.com 13
  14. 14. Test Automation Myths • Capture-replay – Automates testing – Replaces skilled testers • Testing can be fully automated • One test tool is suitable for all tasks • Tools are “easy to use” • Immediate reduction in effortLonsdaleSystems.com 14
  15. 15. Test Automation Tools www.autoitscript.comLonsdaleSystems.com 15
  16. 16. Test Automation Tools seleniumhq.org !!!!LonsdaleSystems.com 16
  17. 17. Test Automation Tools fit.c2.comLonsdaleSystems.com 17
  18. 18. Test Automation Strategies • Capture replay • Test scripts • Data driven • Keyword drivenLonsdaleSystems.com 18
  19. 19. Capture Replay DemoLonsdaleSystems.com 19
  20. 20. Capture Replay Issues • Test data hard-coded in script • Sensitive to changes in the user interface • No comparison of expected and actual results • Re-capture takes as long as the original capture • Hard to manage many small isolated scriptsLonsdaleSystems.com 20
  21. 21. Test Automation Strategies • Capture replay • Test scripts • Data driven • Keyword drivenLonsdaleSystems.com 21
  22. 22. Test Script DemoLonsdaleSystems.com 22
  23. 23. Test Script Issues • Test data hard-coded in script • Expected result hard-coded in script • Hard to manage many small isolated scripts • Format of the data is hard-coded • Each test requires a script • Need a control script to sequence and launch test scripts • Logging of test results embedded in every script • Lack of reuse in scriptsLonsdaleSystems.com 23
  24. 24. Test Automation Strategies • Capture replay • Test scripts • Data driven • Keyword drivenLonsdaleSystems.com 24
  25. 25. Data Driven DemoLonsdaleSystems.com 25
  26. 26. Data Driven Issues • Format of the data is hard-coded • Each data format requires a script • Comparison of expected and actual results split between test data and script • Need a control script to sequence and launch test scripts • Logging of test results embedded in every script • Dependency between test cases is hard-coded in the control script • Lack of reuse in scriptsLonsdaleSystems.com 26
  27. 27. Test Automation Strategies • Capture replay • Test scripts • Data driven • Keyword drivenLonsdaleSystems.com 27
  28. 28. Keyword Driven DemoLonsdaleSystems.com 28
  29. 29. Keyword Driven Issues • Need a control script to sequence and launch test scripts • Logging of test results embedded in every script • Dependency between test cases is hard-coded in the control scriptLonsdaleSystems.com 29
  30. 30. Automating Software Testing Myths, Benefits and Tools Questions LonsdaleSystems.com conference.lonsdalesystems.comLonsdaleSystems.com 30

×