This document discusses automated testing for web applications. It defines automated testing as writing a program to perform tests that would otherwise need to be done manually. The document outlines advantages of automated testing like ability to rerun tests quickly and ability to perform cross-browser compatibility testing. It also discusses disadvantages like initial costs. The document provides examples of automated testing frameworks and demonstrates Watir and Selenium frameworks. It ends with asking for any questions.

1. Automated Testing for Web application
Kiattikhun Prathumma
June 21, 2012
© Copyright 2010, Accellence (Thailand) Ltd.

2. Agenda
• What is Automated Testing
• Automated Testing vs Manual testing
• Automated Testing Framework
• Demo
• Q&A
© 2010 Accellence (Thailand) Limited.

3. What is Automated Testing
“…Test automation is the process of writing a
computer program to do testing that would
otherwise need to be done manually…”
Source: http://en.wikipedia.org/wiki/Test_automation
© 2010 Accellence (Thailand) Limited.

4. Advantages
Automated Testing Manual Testing
If Test Cases have to be run a small
If you have to run a set of tests
number of times it's more likely to
repeatedly automation is a huge gain
perform manual testing
Helps performing "compatibility
It allows the tester to perform more
testing" - testing the software on
ad-hoc (random testing)
different configurations
It gives you the ability to run
automation scenarios to perform Short term costs are reduced
regressions in a shorter time
It gives you the ability to run The more time tester spends testing a
regressions on a code that is module the grater the odds to find
continuously changing real user bugs
Can be run simultaneously on different
machines thus decreasing testing time
Long term costs are reduced
© 2010 Accellence (Thailand) Limited.

5. Disadvantages
Automated Testing Manual Testing
It's more expensive to
Manual tests can be very time
automate. Initial investments
consuming
are bigger than manual testing
You cannot automate For every release you must
everything, some tests still have rerun the same set of tests
to be done manually which can be tiresome
© 2010 Accellence (Thailand) Limited.

6. Use Automated Testing?
“…It only makes sense to use automated
testing tools when the costs of acquiring the
tool and building and maintaining the tests is
less than the efficiency gained from the effort"
John Overbaugh,
Senior Lead Software Development Engineer In Test
(SDET) at Microsoft
© 2010 Accellence (Thailand) Limited.

7. Use Manual Testing?
“…Once a team is good at managing testing risk
and test coverage and applying the right testing
techniques, then talking about automation
makes sense."
Mike Kelly,
Software development manager for a Fortune 100
company
© 2010 Accellence (Thailand) Limited.

8. Other factors
• The performance of your test tools
• The knowledge level of your testing team
• The continuous growth of software to be tested
• Number of necessary regressions
© 2010 Accellence (Thailand) Limited.

9. General approaches to test automation
1. Code-driven testing
- Testing frameworks such as the xUnit
frameworks
2. Graphical user interface testing
- A testing framework generates user interface
events such as keystrokes and mouse clicks,
and observes the changes that result in the
user interface
© 2010 Accellence (Thailand) Limited.

10. Automated Testing Framework
Tool name Produced by Latest version
HP QuickTest Professional HP Software Division 11.0
HTTP Test Tool Open source 2.0.8
IBM Rational Functional
IBM Rational 8.2.1
Tester
LabVIEW National Instruments 2011
Maveryx Maveryx 1.2.0
Oracle Application Testing
Oracle Corporation 12.1
Suite
QF-Test Quality First Software GmbH 3.4.7
Ranorex Ranorex GmbH 3.2.3
Rational robot IBM Rational 2003
Selenium Open source 2.20
SilkTest Micro Focus 2011
© 2010 Accellence (Thailand) Limited.

11. Automated Testing Framework (Cont.)
Tool name Produced by Latest version
eggPlant TestPlant 2012
EiffelStudio AutoTest Eiffel Software 7.0, Nov 2011
SOAtest Parasoft 9.2
TestComplete SmartBear Software 8.7
Testing Anywhere Automation Anywhere 7.5
TestPartner Micro Focus 6.3
TPT PikeTec GmbH 4.0
TRICENTIS Technology &
TOSCA Testsuite 7.3.1
Consulting
Visual Studio Test
Microsoft 2010
Professional
WATIR Open source 3.0
Telerik Test Studio Telerik, Inc. 2012.1
© 2010 Accellence (Thailand) Limited.

12. Watir
• It‟s a Ruby library
• Multi browser (& OS) support
• Has a rich API
• Has a „Simple‟ class (for non-tech users)
• Watij & Watin (Java & .NET)
© 2010 Accellence (Thailand) Limited.

13. Watir Users
Source: http://wiki.openqa.org/display/WTR/Watir+Users
© 2010 Accellence (Thailand) Limited.

14. What kind of automated testing does
Facebook do?
© 2010 Accellence (Thailand) Limited.

15. Watir at Facebook
* Steven Grimm, Facebook‟s test engineering tech lead
© 2010 Accellence (Thailand) Limited.

16. Watir Demo
© 2010 Accellence (Thailand) Limited.

17. Selenium
• Multi browser, OS & language support
• Install server-side or as FF add-on
• Has its own IDE
• Record and playback tests
© 2010 Accellence (Thailand) Limited.

18. Selenium Demo
© 2010 Accellence (Thailand) Limited.

19. Q&A
Problem?
© 2010 Accellence (Thailand) Limited.

20. Reference
•http://www.slideshare.net/vivek_prahlad/web-test-automation-with-selenium
•http://www.slideshare.net/sebastian_bergmann/testing-phpweb-applications-with-phpunit-and-selenium
•http://davidweiss.blogspot.com/2006/08/when-to-automate-testing.html
•http://en.wikipedia.org/wiki/Test_automation
•http://en.wikipedia.org/wiki/List_of_GUI_testing_tools
•http://www.fitnesse.org/FrontPage
•http://seleniumhq.org/
•http://www.chapterpiece.com/software-development-process/2010/02/06/choosing-automated-testing-or-manual-testing/
•http://www.welovebug.com/software-testing/manual-vs-automated-testing/
•http://www.chapterpiece.com/software-development-process/2010/01/21/tell-us-why-automated-testing-failed/
•http://www.chapterpiece.com/software-development-process/2010/01/30/why-automated-testing-fails/
•http://www.chapterpiece.com/software-development-process/2010/01/03/testing-in-agile/
•http://blogs.mulesoft.org/web-testing-selenium/
•http://watir.com/
•http://www.outsourcebazaar.com/index_Article_AutomatedVsManualTesing.html
•http://www.slideshare.net/directi/automated-testing-vs-manual-testing-391121
© 2010 Accellence (Thailand) Limited.

21. Reference (Cont.)
•http://allfacebook.com/how-facebook-automatically-tests-code-phpunit-watir_b15369
•http://www.quora.com/Facebook-Engineering/What-kind-of-automated-testing-does-Facebook-do
•http://www.slideshare.net/sumanth/watir-presentation-sumanth-krishna-a
•http://java-thai-talk.blogspot.com/2011/01/automated-testing-vs-manual-testing.html
•http://googletesting.blogspot.com/2007/10/automating-tests-vs-test-automation.html
•http://www.hanselman.com/blog/NewReleaseOfWatirMakerNowWatirRecorder.aspx
•http://wiki.openqa.org/display/WTR/Example+Test+Case
•http://blog.sahi.co.in/2010/04/sahi-vs-selenium.html
© 2010 Accellence (Thailand) Limited.