Your SlideShare is downloading. ×
Test Automation Seminar Momentum
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Test Automation Seminar Momentum

2,174
views

Published on

Test Automation: A Roadmap for Success …

Test Automation: A Roadmap for Success

Scott Armstrong, SQS UK:

Presenation at Momentum SoftTest event - 16 February

Published in: Technology

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
2,174
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
47
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Test AutomationA Roadmap For Success
    Scott Armstrong
    Belfast, February 2010
  • 2. Agenda
    Steps for Success
    Automation Tool Selection
    Test Selection and Prioritisation
    Implementing the Strategy
    SQS Case Studies
    Questions
    2
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 3. Steps for Success
    Approaching Test Automation
    Planning the Framework
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 4. Approaching Test AutomationSteps for Success
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 5. Planning the FrameworkSteps for Success
    What are the Management Information Requirements
    Contents
    Format
    What are the Execution Requirements?
    On-demand
    Automated Nightly Builds
    What technologies are we testing?
    Embedded
    Operating System
    What resources are available?
    Hardware
    Technical Expertise
    Are there cultural or organisational considerations?
    Outsourced IT Management – no admin access
    Current partnership with tool vendor
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 6. Automation Tool Selection
    Selection Process
    Identify Requirements
    Buy, Open Source or Build
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 7. Selection ProcessAutomation Tool Selection
    Constraints
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 8. Identify RequirementsAutomation Tool Selection
    Start by evaluating your requirements, not by investigating the tool market.
    Look at the current problems – what has prompted the search for an automated solution:
    Manual testing problems (e.g. too time consuming, error prone);
    No time for regression testing when small changes are made to the software;
    Set-up of test data or test cases is error prone;
    Inadequate test documentation;
    Don’t know how much of the software has been tested;
    Testing is ineffective.
    Not all of these problems are best solved by automation.
    Rank your problems by importance or current cost to the organisation.
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 9. Buy, Open Source or BuildAutomation Tool Selection
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 10. Test Selection and Prioritisation
    Test Selection
    Test Prioritisation
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 11. Test SelectionTest Selection and Prioritisation
    Some tests cannot be automated.
    Some tests are not worth automating.
    May take more time to automate tests than to run them manually
    You may not have to automate everything to get significant benefits
    10% of the tests may be run 90% of the time.
    Some types of tests are amenable to automation, some not:
    Functional tests are often the most straightforward
    Performance tests are notoriously difficult to carry out manually. These are a good candidate for automation.
    Non-functional tests can cover maintainability, portablility, testability, usability, etc, and can be inappropriate for automation.
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 12. Test PrioritisationTest Selection and Prioritisation
    Do not automate too much too soon.
    Best practices take time to develop.
    Go for ‘quick wins’ – the areas where automation will have the largest impact most quickly.
    Prioritisation factors:
    A set of breadth tests (sample each system area);
    Tests for the most important functions;
    Tests that are easiest to automate;
    Tests that will give the quickest payback;
    Tests that are run the most often.
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 13. Implementing the Strategy
    Automation Team Fit
    Maintenance Model
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 14. Automation Team FitImplementing the Strategy
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 15. Maintenance ModelsImplementing the Strategy
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 16. SQS Case Studies
    Lloyds TSB Wholesale Banking
    Local Utility Company
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 17. Lloyds TSB Wholesale BankingSQS Case Studies
    “Without automation, we would not have gone live”
    “The automated regression suite made my job more interesting”
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 18. Local Utility CompanySQS Case Studies
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010
  • 19. SQS Group Limited
    The Concourse | Northern Ireland Science Park
    Queen‘s Road | Queen‘s Island | Belfast BT3 9DTPhone: +44 (0) 2890 022 660 E-Mail: scott.armstrong@sqs-uk.comInternet: www.sqs-uk.com
    © SQS Group Ltd. | Test Automation: A Roadmap For Success | 16th February 2010