Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Test AutomationA Roadmap For Success<br />Scott Armstrong<br />Belfast,  February 2010<br />
Agenda<br />Steps for Success<br />Automation Tool Selection<br />Test Selection and Prioritisation<br />Implementing the ...
Steps for Success<br />Approaching Test Automation<br />Planning the Framework<br />© SQS Group Ltd.  | Test Automation: A...
Approaching Test AutomationSteps for Success<br />© SQS Group Ltd.  | Test Automation: A Roadmap For Success | 16th Februa...
Planning the FrameworkSteps for Success<br />What are the Management Information Requirements<br />Contents<br />Format<br...
Automation Tool Selection<br />Selection Process<br />Identify Requirements<br />Buy, Open Source or Build<br />© SQS Grou...
Selection ProcessAutomation Tool Selection<br />Constraints<br />© SQS Group Ltd.  | Test Automation: A Roadmap For Succes...
Identify RequirementsAutomation Tool Selection<br />Start by evaluating your requirements, not by investigating the tool m...
Buy, Open Source or BuildAutomation Tool Selection<br />© SQS Group Ltd.  | Test Automation: A Roadmap For Success | 16th ...
Test Selection and Prioritisation<br />Test Selection<br />Test Prioritisation<br />© SQS Group Ltd.  | Test Automation: A...
Test SelectionTest Selection and Prioritisation<br />Some tests cannot be automated.<br />Some tests are not worth automat...
Test PrioritisationTest Selection and Prioritisation<br />Do not automate too much too soon.<br />Best practices take time...
Implementing the Strategy<br />Automation Team Fit<br />Maintenance Model<br />© SQS Group Ltd.  | Test Automation: A Road...
Automation Team FitImplementing the Strategy<br />© SQS Group Ltd.  | Test Automation: A Roadmap For Success | 16th Februa...
Maintenance ModelsImplementing the Strategy<br />© SQS Group Ltd.  | Test Automation: A Roadmap For Success | 16th Februar...
SQS Case Studies<br />Lloyds TSB Wholesale Banking<br />Local Utility Company<br />© SQS Group Ltd.  | Test Automation: A ...
Lloyds TSB Wholesale BankingSQS Case Studies<br />“Without automation, we would not have gone live”<br />“The automated re...
Local Utility CompanySQS Case Studies<br />© SQS Group Ltd.  | Test Automation: A Roadmap For Success | 16th February 2010...
SQS Group Limited<br />The Concourse | Northern Ireland Science Park<br />Queen‘s Road | Queen‘s Island | Belfast BT3 9DTP...
Upcoming SlideShare
Loading in …5
×

Test Automation Seminar Momentum

2,673 views

Published on

Test Automation: A Roadmap for Success

Scott Armstrong, SQS UK:

Presenation at Momentum SoftTest event - 16 February

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Test Automation Seminar Momentum

  1. 1. Test AutomationA Roadmap For Success<br />Scott Armstrong<br />Belfast, February 2010<br />
  2. 2. Agenda<br />Steps for Success<br />Automation Tool Selection<br />Test Selection and Prioritisation<br />Implementing the Strategy<br />SQS Case Studies<br />Questions<br />2<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  3. 3. Steps for Success<br />Approaching Test Automation<br />Planning the Framework<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  4. 4. Approaching Test AutomationSteps for Success<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  5. 5. Planning the FrameworkSteps for Success<br />What are the Management Information Requirements<br />Contents<br />Format<br />What are the Execution Requirements?<br />On-demand<br />Automated Nightly Builds<br />What technologies are we testing?<br />Embedded<br />Operating System<br />What resources are available?<br />Hardware<br />Technical Expertise<br />Are there cultural or organisational considerations?<br />Outsourced IT Management – no admin access<br />Current partnership with tool vendor<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  6. 6. Automation Tool Selection<br />Selection Process<br />Identify Requirements<br />Buy, Open Source or Build<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  7. 7. Selection ProcessAutomation Tool Selection<br />Constraints<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  8. 8. Identify RequirementsAutomation Tool Selection<br />Start by evaluating your requirements, not by investigating the tool market.<br />Look at the current problems – what has prompted the search for an automated solution:<br />Manual testing problems (e.g. too time consuming, error prone);<br />No time for regression testing when small changes are made to the software;<br />Set-up of test data or test cases is error prone;<br />Inadequate test documentation;<br />Don’t know how much of the software has been tested;<br />Testing is ineffective.<br />Not all of these problems are best solved by automation.<br />Rank your problems by importance or current cost to the organisation.<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  9. 9. Buy, Open Source or BuildAutomation Tool Selection<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  10. 10. Test Selection and Prioritisation<br />Test Selection<br />Test Prioritisation<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  11. 11. Test SelectionTest Selection and Prioritisation<br />Some tests cannot be automated.<br />Some tests are not worth automating.<br />May take more time to automate tests than to run them manually<br />You may not have to automate everything to get significant benefits<br />10% of the tests may be run 90% of the time.<br />Some types of tests are amenable to automation, some not:<br />Functional tests are often the most straightforward<br />Performance tests are notoriously difficult to carry out manually. These are a good candidate for automation.<br />Non-functional tests can cover maintainability, portablility, testability, usability, etc, and can be inappropriate for automation.<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  12. 12. Test PrioritisationTest Selection and Prioritisation<br />Do not automate too much too soon.<br />Best practices take time to develop.<br />Go for ‘quick wins’ – the areas where automation will have the largest impact most quickly.<br />Prioritisation factors:<br />A set of breadth tests (sample each system area);<br />Tests for the most important functions;<br />Tests that are easiest to automate;<br />Tests that will give the quickest payback;<br />Tests that are run the most often.<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  13. 13. Implementing the Strategy<br />Automation Team Fit<br />Maintenance Model<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  14. 14. Automation Team FitImplementing the Strategy<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  15. 15. Maintenance ModelsImplementing the Strategy<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  16. 16. SQS Case Studies<br />Lloyds TSB Wholesale Banking<br />Local Utility Company<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  17. 17. Lloyds TSB Wholesale BankingSQS Case Studies<br />“Without automation, we would not have gone live”<br />“The automated regression suite made my job more interesting”<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  18. 18. Local Utility CompanySQS Case Studies<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />
  19. 19. SQS Group Limited<br />The Concourse | Northern Ireland Science Park<br />Queen‘s Road | Queen‘s Island | Belfast BT3 9DTPhone: +44 (0) 2890 022 660 E-Mail: scott.armstrong@sqs-uk.comInternet: www.sqs-uk.com<br />© SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010<br />

×