A taste of Exploratory Testing


Published on

  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

A taste of Exploratory Testing

  1. 1. copyright ©TestingTimes 2013ATASTE OF EXPLORATORYTESTINGAnne-Marie Charrett@charrettSkype: CharrettsBlog: Mavericktester.comThis work is licensed under the Creative Commons Attribution-NoDerivs 3.0 Unported License.To view a copy of this license,visit http://creativecommons.org/licenses/by-nd/3.0/.
  2. 2. copyright ©TestingTimes 2013A LONGTIME AGO...
  3. 3. copyright ©TestingTimes 2013CHALLENGES• Did the program run?• Where the punch cards correct? (Source Code)• Was the data correct ?• Was the compiler correct? (Program Code)• Did the program solve the problem?
  4. 4. copyright ©TestingTimes 2013Test Strategy Test Spec Test ExecutionAnalysisDocuments/CodeDesign TestingActivitiesSCRIPTEDTESTINGTest ReportStrategyModellingDecision MakingModellingConfigurationOperationObservationEvaluationConfigurationReportingOperationObservationEvaluation Communicationcopyright ©TestingTimes 2013
  5. 5. copyright ©TestingTimes 2013LEGACYRequires a tester to be able to:Often has formalised methodology based onIEEE829DesignTest Scripts upfront against RequirementsRequires ExperiencedTest AnalystVsTesterIndicate Expected Result upfrontComplete when 100%Test Executed
  6. 6. copyright ©TestingTimes 2013PROGRESS
  7. 7. copyright ©TestingTimes 2013HOW WE DISCOVER
  8. 8. copyright ©TestingTimes 2013“Exploratory testing is an approach to software testing that isconcisely described as simultaneous learning, test design andtest execution.” Cem Kaner“The plainest definition of exploratory testing is test designand test execution at the same time.” J. Bach
  9. 9. copyright ©TestingTimes 2013ActivitiesEXPLORATORY TESTINGModellingDecision MakingConfigurationOperationObservationEvaluationLearningTestingDesignStrategy
  10. 10. copyright ©TestingTimes 2013TESTER CENTRICDesignTestingLearningAutodidacticSelf AwarenessAutonomyCourageMental Engagement
  11. 11. • Download iHandy Coin Flip Free from Appstore• Download iHandy Coin Flip Free from GooglePlayTEST COIN FLIP FREEAny Questions?copyright ©TestingTimes 2013
  12. 12. copyright ©TestingTimes 2013DISCUSSION
  13. 13. BUGS• flipping phone goes to adds• coin changes automatically• coin flip has preVibrate on Android is not working• Flick Upward works when disabled• there is no instruction screen, instruction menu or help text which I would normally expect(comparable product)• flip the coin 20 times in a row. 18 out of 20 resulted in heads. Doesnt feel like random distribution...• Screen Size not scalable• RapidTapping makes it crash (Android)• Windows 8 touch screen problems.• Doesn’t support Android 2.2 (Download page says it should)
  14. 14. copyright ©TestingTimes 2013WHAT DIDYOU DO?• Played around• Tried out different things• Figured out how it worked• Saw something unusual - looked more• Read up the information (on Website)• Compared your findingsSPONTANEOUSTESTING--- James Bach & Michael Bolton - Rapid SoftwareTesting
  15. 15. copyright ©TestingTimes 2013“If you are not using thelearning garnered from testdesign and test execution in acontinuous and rapid loop tooptimize the quality of thework, you are not doingexploratory testing”--Michael Bolton
  16. 16. copyright ©TestingTimes 2013DELIBERATIVETESTING• Scripting in your head• Requires considered response to testing• Requires awareness of your approach• May require use of tools or setting up of test data• May require extensive investigation-- James Bach & Michael Bolton - Rapid SoftwareTesting
  17. 17. copyright ©TestingTimes 2013HeuristicsA heuristic is a falliblemethod of solving aproblem or making adecision.• Requires Skill• Context Dependent• LessVisibleHEURISTICSThe essence of heuristics: http://www.satisfice.com/blog/archives/462
  18. 18. copyright ©TestingTimes 2013GROCERY SHOPPINGYou are purchasing three items at the store, at theseprices:• $19.95• $39.98• $29.97About how much money are you spending?
  19. 19. copyright ©TestingTimes 2013HEURISTICSThe fastest way to solve this problem is to round offand approximate.The first item costs about $20, thesecond about $40, and the third about $30; therefore,you are spending about $90 on your shopping spree.Rounding is often an excellent heuristic for arriving quicklyat approximate answers to mathematical problems.
  20. 20. copyright ©TestingTimes 2013MENTAL ENGAGEMENT• Alternation• Branching and BackTracking• Embrace Distraction• Jump in & Play• Focus & Defocus --- James Bach & Michael Bolton - Rapid SoftwareTesting
  21. 21. copyright ©TestingTimes 2013EXPLORATORYTESTINGHEURISTICS• FEW HICCUPS (Ways to Recognise Bugs) - Michael Bolton• SFDIPOT (Ways to Model and generate test ideas) - JamesBach• HeuristicTest Strategy Model - James Bach• http://www.qualityperspectives.ca/resources_mnemonics.html
  22. 22. copyright ©TestingTimes 2013MANY WAYS OF ET• Many different ways to useexploratory testing• Mix level of documentation• Mix level of reporting• Mix level of learning• Mix level of test design• Mix level of testability
  23. 23. copyright ©TestingTimes 2013• elements of design, execution, interpretation, and learning are performed by the sameperson;• the design, execution, interpretation, and learning happen together, rather than beingseparated in time;• the tester is making her own choices about what to test, when to test it, and how totest it—the tester may use any automation or tools in support of her testing, or noneat all, as she sees fit;• everything that has been learned so far, including the result of the last test, informs thetester’s choices about the next test;• the tester is focused on revealing new information, rather than confirming existingknowledge about the product;• in general, the tester is varying aspects of her tests rather than repeating them, exceptwhere the repeating aspects of the test are intended to support the discovery of newinformation.Michael Bolton - Evolving Understanding of ExploratoryTestingSUMMARY
  24. 24. copyright ©TestingTimes 2013FURTHER READING• Exploratory Skills and Dynamics• http://www.developsense.com/resources.html• HeuristicTest Strategy Model• Test Heuristics Cheat Sheet Elisabeth Hendricksons• You Are Not DoneYet Michael Hunters Coverage
  25. 25. copyright ©TestingTimes 2013QUESTIONS?
  26. 26. copyright ©TestingTimes 2013THANKYOU!amcharrett@testingtimes.com.au@charrettSkype: charretts