Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Whole Team Approach to Testing, Illustrated


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Whole Team Approach to Testing, Illustrated

  1. 1. 1The Whole-Team Approach toTesting, Illustrated:Choosing a New GUI Test ToolØREDEV 2012Lisa CrispinCopyright 2012, Lisa Crispin
  2. 2. Copyright 2012: Lisa Crispin2About me…Tester, agile team member
  3. 3. Agile Testing: A Practical Guide for Testers andAgile Teams; Addison Wesley 2009
  4. 4. Copyright 2012: Lisa CrispinWhole-Team Approach is:• Meaningful commitment to quality• Shared vision of product• Diversity of skills, experience, viewpoint
  5. 5. Copyright 2012: Lisa CrispinIs this rebellion?What’s rebellious here?“Control is ultimately held by the doers”
  6. 6. 6A recent example from my last team…
  7. 7. Copyright 2012: Lisa Crispin7A Problem: User MistakesUsers mis-type bankaccount numbers =>many phone calls forOperations
  8. 8. Copyright 2012: Lisa Crispin8A solution: DojoType-ahead select lists (& other features)
  9. 9. Copyright 2012: Lisa CrispinA new problemWe want to help users avoidmistakes, but we can’t have productioncode that’s not protected by automatedtests
  10. 10. Copyright 2012: Lisa CrispinLooking to the future…Dojo would improve UX on ournew UI…Let’s researchpossiblesolutions.
  11. 11. Copyright 2012: Lisa CrispinTeam meetingDo we need training? Consulting?
  12. 12. Copyright 2012: Lisa CrispinSys admin volunteers to do a spikeSelenium 2 Webdriver does the job!
  13. 13. Copyright 2012: Lisa CrispinA framework spike• Testers research framework options• Sys admin spikes homegrown framework“George”• Architect spikes open-source framework “Geb”
  14. 14. Copyright 2012: Lisa Crispin14First “Bake-off”“George” “Geb”
  15. 15. Copyright 2012: Lisa Crispin15Proof of Concept with Geb• Developers write tests for newUI page•Testers and sys adminintegrate tests into Jenkins CI• Pros: developers moreinvolved in GUI test design• Cons: Learning curve fortesters, result reporting
  16. 16. Copyright 2012: Lisa Crispin16Time for another experiment
  17. 17. Copyright 2012: Lisa Crispin17Another bake-offRobot Framework vs. Xebium• Xebium uses FitNesse framework• Robot Framework result reporting excellent
  18. 18. Copyright 2012: Lisa Crispin18Proof of Concept with RF• Sys admin helpsinstall, integrate w/Jenkins, customize testresults, example page objects• Testers write tests for samepages as Geb tests• Friends help with Se 2keywords
  19. 19. Copyright 2012: Lisa CrispinNext StepsDojo trainingTest design& RFtrainingGet startedin a gooddirection
  20. 20. Copyright 2012: Lisa CrispinWhole Team FTW!• Team commitment to improve site• Sys admin, architect, developers, testers,DBAs all worked on experiments• Gave us confidence to experiment, find thebest solution for us• We could go forward with plans to improveUX, reduce user mistakes
  21. 21. Copyright 2012: Lisa CrispinAnother Experiment, Another Team:API Automation•Team wants to do SBE/ATDD for API•Also need better regression test coverage
  22. 22. Copyright 2012: Lisa CrispinSlightly different approach•Tester/dev pair spiked 1 week•Presented results to team•Consensus – too much overlap w/ existingtestsShouldhave
  23. 23. Copyright 2012: Lisa CrispinSecond automation spike• API console• Team consensus –explore, enhance, expand• Spike for doc generation• Team consensus – go with it• Continue to build on strategy
  24. 24. Copyright 2012: Lisa CrispinTips for Experimenting•Divide and conquer•Sub-teams•Time boxed•Pros and Cons•Pof concept•Rinse and repeat
  25. 25. Copyright 2012: Lisa CrispinYour experiences & ideas?• Has your whole team pulled together tosolve a problem?• Have you tried a “divide and conquer”approach?• Do you have problems that might be solvedmore easily if people in multiple positionshelped?
  26. 26. What small experiment will YOU try?
  27. 27. Copyright 2012: Lisa Crispin27Some Agile Testing Resources•••••••••
  28. 28. 28Agile Testing: A Practical Guide for Testers and AgileTeamsBy Lisa Crispin and Janet
  29. 29. 29Experiences of Test AutomationDorothy Graham and Mark Fewster
  30. 30. Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire30Specification by ExampleHow successful teams deliver the rightsoftwareGojko AdzicCase studies from > 50 teams
  31. 31. Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire31ATDD by ExampleA practical guide to Acceptance Test-DrivendevelopmentMarkus Gaertner
  32. 32. Copyright 2012: Lisa Crispin32All Proceeds to Charity!Beautiful Testing: Leading Professionals Reveal HowThey Improve SoftwareEdited by Tim Riley, Adam GoucherIncludes chapter by yours truly