Test Automation - Insights Into Frameworks by Anup Patnaik, QA InfoTech

Uploaded on

Tools and techniques for automated test execution have been around even before the activity of testing was seen as independent of debugging. And with growing complexity of software, companies have …

Tools and techniques for automated test execution have been around even before the activity of testing was seen as independent of debugging. And with growing complexity of software, companies have embraced test automation as an integral part of their test strategy. This is primarily to augment human testing in order to meet goals ranging from increasing test coverage on greater number of platforms to shorter release cycles. However, it is surprising to see how many of these projects fail. According to some industry estimates, 85% of these projects fail to bring any real ROI.

Along with answering the all important questions of what to automate and when to automate, test managers need to understand the implications of using the various tools, techniques and frameworks. And this choice is largely determined by the mission that the project needs to accomplish. Will only the underlying tool suffice, what would be the limitations? Should you be using a keyword driven framework or should you be designing a domain specific language on top of your tools? Given a fast changing application, which of the many approaches will work better? Which one can be learnt and adopted faster by a large team of human testers? These and many other questions can be answered only by the experience of applying the approaches to real projects.

In this talk, based on our long experience of working on test automation projects, we help test managers understand and answer similar questions. We trace maturity of automated testing from tools to frameworks, and detail out the nuances and pit-falls of the approaches in the wake of a given mission. In addition we show how using the many open source tools test mangers can develop robust yet cost-effective solutions.

More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads


Total Views
On Slideshare
From Embeds
Number of Embeds



Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

    No notes for slide


  • 1. Test Automation – Insights into
    using Frameworks & Techniques
    Anup Patnaik, Director Quality Engineering &
    New Initiatives
  • 2. What’s in there?
    What went wrong – A little story
    Why is it hard – Goals Vs Reality
    Action Based Frameworks
    Page Object Patterns
    Domain Specific Automation
    Putting it all together – DIAT
  • 3. No Name Inc.
    “The Product”
    Test Engineers
    Test Automation Engineers
  • 4. So many of them, really!
    Wow Bugs
  • 5. What went wrong?
    “The Product”
    Test Engineers
    Test Automation Engineers
  • 6. A glance
    Goals Vs Reality
  • 7. What’s the message?
    Doing Test Automation right is Hard!
    Let’s not paint a rosy picture
  • 8. The language of automation
    Easy action based automation using keywords for user actions
  • 9. How is it done
    Excel based input with libraries written in the tools language
    FitNesse + Selenium
  • 10. What’s lacking
    What did we loose on the way
    Flexibility – can we loop over, can we handle large data files
    What is still missing
    A clear structure
  • 11. UI Model Based
    Page Objects
    UI Modules that know about themselves
    We know where to change when a piece of UI changes
    Tip on Tool - Tellurium
  • 12. Let’s talk in the language of business
    Domain specific actions that let you write English like automated test scripts
    Clean mapping of requirements to automated scripts
  • 13. An Implementation
  • 14. What’s lacking
    What did we loose on the way
    Flexibility again (of composing user actions at the top level)
    What is still missing
    Supporting needs e.g. compatibility testing
  • 15. Test Lifecycle
    Distributed Intelligent Automated Test Framework
  • 16. A good recipe
    Distributed Intelligent Automated Test Framework
    Test Run
    XP_FF3 – TC 1
    Vista_IE7 – TC 2
    DIAT Client - Agent
    Test Case 1
    Test Data 1
    VM Host
    Test Data 2
  • 17. Real Implementations
  • 18. What’s the message?
    There is no silver bullet
  • 19. reachme: anup@qainfotech.com
    All content / information present here is the exclusive property of QA InfoTech Pvt. Ltd. The content / information contained here is correct at the time of publishing. No material from here may be copied, modified, reproduced, republished, uploaded, or posted in any form without prior written permission from QA InfoTech. Unauthorized use of the content / information appearing here may violate copyright, trademark and other applicable laws, and could result in criminal or civil penalties.
    Copyright © 2009 QA InfoTech Pvt. Ltd.