Open Source & Free Test Tools
A Test Management Summit Facilitation
January 2009
Alan Richardson
www.compendiumdev.co.uk www.eviltester.com
How do you define “test tool”?
Test Tool
=
{software that we use to augment
our testing process in any way}
Is O/S your 1st
Choice?
1)O/S
2)Free
3)Custom
4)Commercial
Swiss army knife vs Hammer
Which Free and O/S tools do you
use?
● Selenium-RC
● Fiddler
● SoapUI
● Greenshot
● MiniCap
● Jmeter
● Webload
● PerlClip
● Eclipse
● Java
● FreeMind
● HTMLUnit
● PushToTest
● VirtualPC
● VMWare
● MWSnap
● WinPooch
● SysInternals
● AutoIt
● Notepad++
● Google Docs
● WinMerge
● Firebug
● Selenium IDE
Which Commercial Tools Do You
Use?
● Jira
● Confluence
● Avalanche
● SnagIt
● BeyondCompare
Reasons Why You Use O/S?
● Cost
● Google Investments
● Choice
● Better staff
● Easier to retain staff
● Long Evaluations
● No lock-in
● Easier to keep up to date
Why do you use commercial tools?
● Support
● Plausible Deniability
● Long Term Cost
● Easier to recruit Staff
● Less Technical
● Tool was already there
Have you noticed any Trends about
Commercial vs O/S?
Commercial tools
● Hide the scripting (-)
● Proprietery &
Unattractive scripting
languages (-)
● Tools for testers (-)
● Do All Things (-)
Open Source
● More technically
demanding (+)
● Common Programming
Languages (+)
● Use by Dev & Test (+)
● Specialised (+)
What could commercial tools do?
● Augment Open Source
● Specialise
● Cheaper
● More Open
But will customers ask
for this?
Is O/S too Risky?
● Skills
● Updates Slow
● Tools not good
enough
● Flash etc.
● Too many to choose
from
● Selenium != IDE
● Access to 'bleeding
edge' daily builds
● Throw it away – no
commitment
How to find and keep up to date?
● O/S
● Sourceforge.net
● OpenQA.com
● Better Software,
ST&P
● Blogs
– Testing Reflections
– For each tool
– Google blogs
– ...too many rss feeds...
● Commercial
● Tools Fairs?
● Testing Experience
● ...Suggestions...
Usage Strategies for effective tool
usage?
● Abstraction
● Best fit
● Skilled Staff
● Keep looking for alternatives
Share your experiences
● What is a test tool?
● O/S as first choice?
● Which tools do you use?
● Why do you use those tools?
● Why don't you use O/S?
● What trends would make a difference?
● What are your usage and learning strategies?

Open source tools - Test Management Summit - 2009

  • 1.
    Open Source &Free Test Tools A Test Management Summit Facilitation January 2009 Alan Richardson www.compendiumdev.co.uk www.eviltester.com
  • 2.
    How do youdefine “test tool”? Test Tool = {software that we use to augment our testing process in any way}
  • 3.
    Is O/S your1st Choice? 1)O/S 2)Free 3)Custom 4)Commercial Swiss army knife vs Hammer
  • 4.
    Which Free andO/S tools do you use? ● Selenium-RC ● Fiddler ● SoapUI ● Greenshot ● MiniCap ● Jmeter ● Webload ● PerlClip ● Eclipse ● Java ● FreeMind ● HTMLUnit ● PushToTest ● VirtualPC ● VMWare ● MWSnap ● WinPooch ● SysInternals ● AutoIt ● Notepad++ ● Google Docs ● WinMerge ● Firebug ● Selenium IDE
  • 5.
    Which Commercial ToolsDo You Use? ● Jira ● Confluence ● Avalanche ● SnagIt ● BeyondCompare
  • 6.
    Reasons Why YouUse O/S? ● Cost ● Google Investments ● Choice ● Better staff ● Easier to retain staff ● Long Evaluations ● No lock-in ● Easier to keep up to date
  • 7.
    Why do youuse commercial tools? ● Support ● Plausible Deniability ● Long Term Cost ● Easier to recruit Staff ● Less Technical ● Tool was already there
  • 8.
    Have you noticedany Trends about Commercial vs O/S? Commercial tools ● Hide the scripting (-) ● Proprietery & Unattractive scripting languages (-) ● Tools for testers (-) ● Do All Things (-) Open Source ● More technically demanding (+) ● Common Programming Languages (+) ● Use by Dev & Test (+) ● Specialised (+)
  • 9.
    What could commercialtools do? ● Augment Open Source ● Specialise ● Cheaper ● More Open But will customers ask for this?
  • 10.
    Is O/S tooRisky? ● Skills ● Updates Slow ● Tools not good enough ● Flash etc. ● Too many to choose from ● Selenium != IDE ● Access to 'bleeding edge' daily builds ● Throw it away – no commitment
  • 11.
    How to findand keep up to date? ● O/S ● Sourceforge.net ● OpenQA.com ● Better Software, ST&P ● Blogs – Testing Reflections – For each tool – Google blogs – ...too many rss feeds... ● Commercial ● Tools Fairs? ● Testing Experience ● ...Suggestions...
  • 12.
    Usage Strategies foreffective tool usage? ● Abstraction ● Best fit ● Skilled Staff ● Keep looking for alternatives
  • 13.
    Share your experiences ●What is a test tool? ● O/S as first choice? ● Which tools do you use? ● Why do you use those tools? ● Why don't you use O/S? ● What trends would make a difference? ● What are your usage and learning strategies?