Whole Team Approach to Testing, IllustratedPresentation Transcript
1The Whole-Team Approach toTesting, Illustrated:Choosing a New GUI Test ToolØREDEV 2012Lisa CrispinCopyright 2012, Lisa Crispin
Copyright 2012: Lisa Crispin2About me…Tester, agile team member
Agile Testing: A Practical Guide for Testers andAgile Teams; Addison Wesley 2009
Copyright 2012: Lisa CrispinWhole-Team Approach is:• Meaningful commitment to quality• Shared vision of product• Diversity of skills, experience, viewpoint
Copyright 2012: Lisa CrispinIs this rebellion?What’s rebellious here?“Control is ultimately held by the doers”
6A recent example from my last team…
Copyright 2012: Lisa Crispin7A Problem: User MistakesUsers mis-type bankaccount numbers =>many phone calls forOperations
Copyright 2012: Lisa Crispin8A solution: DojoType-ahead select lists (& other features)
Copyright 2012: Lisa CrispinA new problemWe want to help users avoidmistakes, but we can’t have productioncode that’s not protected by automatedtests
Copyright 2012: Lisa CrispinLooking to the future…Dojo would improve UX on ournew UI…Let’s researchpossiblesolutions.
Copyright 2012: Lisa CrispinTeam meetingDo we need training? Consulting?
Copyright 2012: Lisa CrispinSys admin volunteers to do a spikeSelenium 2 Webdriver does the job!
Copyright 2012: Lisa CrispinA framework spike• Testers research framework options• Sys admin spikes homegrown framework“George”• Architect spikes open-source framework “Geb”
Copyright 2012: Lisa Crispin14First “Bake-off”“George” “Geb”
Copyright 2012: Lisa Crispin15Proof of Concept with Geb• Developers write tests for newUI page•Testers and sys adminintegrate tests into Jenkins CI• Pros: developers moreinvolved in GUI test design• Cons: Learning curve fortesters, result reporting
Copyright 2012: Lisa Crispin16Time for another experiment
Copyright 2012: Lisa Crispin17Another bake-offRobot Framework vs. Xebium• Xebium uses FitNesse framework• Robot Framework result reporting excellent
Copyright 2012: Lisa Crispin18Proof of Concept with RF• Sys admin helpsinstall, integrate w/Jenkins, customize testresults, example page objects• Testers write tests for samepages as Geb tests• Friends help with Se 2keywords
Copyright 2012: Lisa CrispinNext StepsDojo trainingTest design& RFtrainingGet startedin a gooddirection
Copyright 2012: Lisa CrispinWhole Team FTW!• Team commitment to improve site• Sys admin, architect, developers, testers,DBAs all worked on experiments• Gave us confidence to experiment, find thebest solution for us• We could go forward with plans to improveUX, reduce user mistakes
Copyright 2012: Lisa CrispinAnother Experiment, Another Team:API Automation•Team wants to do SBE/ATDD for API•Also need better regression test coverage
Copyright 2012: Lisa CrispinSlightly different approach•Tester/dev pair spiked 1 week•Presented results to team•Consensus – too much overlap w/ existingtestsShouldhave
Copyright 2012: Lisa CrispinSecond automation spike• API console• Team consensus –explore, enhance, expand• Spike for doc generation• Team consensus – go with it• Continue to build on strategy
Copyright 2012: Lisa CrispinTips for Experimenting•Divide and conquer•Sub-teams•Time boxed•Pros and Cons•Pof concept•Rinse and repeat
Copyright 2012: Lisa CrispinYour experiences & ideas?• Has your whole team pulled together tosolve a problem?• Have you tried a “divide and conquer”approach?• Do you have problems that might be solvedmore easily if people in multiple positionshelped?