Test Automation in the Cloud


Published on

TaaaS - Next Generation Testing Keynote

What is the future of test automation? The possibilities associated with cloud computing provide instant scalability, flexibility and availability for testing on demand with no up front investment. This provides the industry with a perfect opportunity to utilise powerful test automation solutions.
The global testing cloud marketplace will allow for the joint collaboration of leading test specialists following industry best practice. This enables firms of all sizes to access the latest test approaches and methodologies whilst providing a unified platform for domain experts to represent business processes and user story acceptance criteria in a natural language.

  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • POINT:Not much has changed in the test automation approach in its 30 years.
  • POINT:It should be, but generally isn't.QUOTE:“Incorporated test automation within a test process is. A standalone tool is often a liability.”
  • POINT:Test automation is prone to failure mainly due to resource or process failures.FiguresQUOTE:“Yes… it is… mainly due to resourcing and/or process failures. Process integration becomes easier with the cloud when you abstract away much of the specialist knowledge .”
  • POINT:Successful automation over time will save moneyFailed projects are inevitably expensive.Traditionally, automation initial investment costs are high - wouldn't it be great if they could be lowered?QUOTE:“Possibly. Whether something is expensive depends on the value you derive from it. Spending £1 on a tool that delivers no or negative value is expensive. Being able to more accurately see the value to cost figures is a real boon.”
  • POINT:Analysis of what can be automated is time consumingQUOTE:“Spending analysis time evaluating what is possible to automate and what is not is time consuming. This time is entirely wasted if the automation never happens!”"Implementing screen-scrapers and a universal testing language within the cloud allows more maintainable and portable solution."
  • POINT:Who wants to become a test automation engineer at the start of their career? Not many.Traditional companies aim for a low number of high skill labor instead of a high number of low skilled?
  • POINT:Don't fit square pegs into round holes.Put your best players in their best positions.Training times are lowered.
  • POINT:Businesses should focus on their core specialities. QUOTE:“Many firms do not have specialist test automation resource. Why not capture this knowledge and put it in the cloud for non-specialists to take advantage of?”
  • POINT:The cloud can address each of the preceeding problems.
  • POINT:Aside from test definition in a keyword format there is no upfront investmentDon't invest heavily upfront in something that may fail.Pay as you use means cost management is easier
  • POINT:Scalable testing - parallel executionPerformance testing - multi-location with ease
  • POINTS:FailoverTesters can initiate tests from wherever they are rather than being restricted to fixed seats
  • POINT:Abstract away the complexity of test automation into the cloud and allow it more easily to slot into your test process.Describe your tests in a similar way as you would anyway for a manual test, then use the cloud web interface to start the tests!
  • POINT:Firms focus on core business rather than test automation expertise
  • POINT:Smaller, possibly remote firms or individuals can now have easy PAYU access to automation expertise.QUOTE:“For many small-to-medium sized firms getting agent machines installed globally for performance test purposes is tricky to impossible. A highly scalable service to simply allow them to select a target location would add considerable value.”
  • POINT:Darren, with limited budget and technical resources, wouldn't have had the chance to test his site properly without TaaaS.
  • Security of customer dataDave to add stuff here…Dependency on the cloud provider restricting freedom???How do we control who has access to what????Continuity and DR??? Standard approaches?What if the cloud provider goes out of business? Data will be returned in a suitable format. All contracted firms have a right to a copy of the code in such an event.
  • Test Automation in the Cloud

    1. 1. Test Automation in the Cloud<br />Next Generation Testing: Innovations and Challenges (18th May 2011)<br />
    2. 2. Who are we?<br />TaaaS.net<br />
    3. 3. Three decades in Automation<br />
    4. 4. Automation is a Silver Bullet?<br />“The term has been adopted into a general metaphor, where ‘silver bullet’ refers to any straight forward solution perceived to have extreme effectiveness. The phrase typically appears with an expectation that some new technology or practice will easily cure a major prevailing problem.”<br />- Wikipedia<br />
    5. 5. Automation is prone to failure?<br />
    6. 6. Automation is expensive business?<br />TaaaS<br />“The cloud offers a low software maintenance cost, reusable test components lower tester's hardware specifications and moves away from expensive fixed-seat licensing.” Jonathon Wright<br />
    7. 7. Manual’mation is time consuming<br />“Implementing screen-scrapers and a universal testing language within the cloud promotes more maintainable and portable solutions.” David Fox<br />
    8. 8. Who wants to do Automation?<br />@Dunnhumby17th May 2011<br />Apprentice Marketing Graduates<br />Ambassadors of Business Data<br />
    9. 9. Testers are testers, not programmers<br />Developers are developers, not testers<br />“Many of the best testers are technically minded and can program but a testers real skill is applying domain knowledge to generate insightful test cases and avoid duplication. Put your players in their best positions.” - Gordon Marsh<br />
    10. 10. Market(i.e Tesco, Kroger or PAM)<br />5207<br />603<br />487<br />97<br />WorkStream(i.e UK, US or France)<br />Language(i.e en-GB or en-US)<br />867<br />1220<br />67<br />32<br />139<br />588<br />789<br />6150<br />Application(i.e Shop or ShelfReview)<br />Index - Executed - Supported - Out of Scope<br />Businesses should focus on business, not be automation framework experts <br />
    11. 11. Automation meets the Cloud<br />A match made in heaven?<br />
    12. 12. No upfront investment<br />Don't invest heavily upfront in something that may FAIL<br />Pay as you use means cost management is easier<br />
    13. 13. Instant scalability<br />Enabling realistic geo-performance testing <br />
    14. 14. 99.9% Availability (100% Web)<br />
    15. 15. Easier Process Integration<br />
    16. 16. Enabling 100% businesses focus<br />
    17. 17. Automation should be a Global Marketplace<br />“For many small-to-medium sized firms getting agent machines installed globally for performance test purposes is tricky /impossible. A highly scalable service to simply allow them to select a target location would add considerable value.” <br />
    18. 18. The future of testing?<br />“As founder of remind365, I had no idea the benefits that Testing in the Cloud could bring. TaaaS opened my eyes to the importance of performance and cross-browser testing” – Darren Halford, Entrepreneur. <br />
    19. 19. Possible Risks?<br />Cloud provider goes bust<br />Data Security<br />Cloud provider restricts freedom<br />Access/control<br />Continuity & DR<br />