A taste of Exploratory Testing
Upcoming SlideShare
Loading in...5
×
 

A taste of Exploratory Testing

on

  • 1,015 views

 

Statistics

Views

Total Views
1,015
Views on SlideShare
1,002
Embed Views
13

Actions

Likes
2
Downloads
6
Comments
0

3 Embeds 13

http://www.linkedin.com 9
https://twitter.com 2
https://www.linkedin.com 2

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    A taste of Exploratory Testing A taste of Exploratory Testing Presentation Transcript

    • copyright ©TestingTimes 2013ATASTE OF EXPLORATORYTESTINGAnne-Marie Charrett@charrettSkype: CharrettsBlog: Mavericktester.comThis work is licensed under the Creative Commons Attribution-NoDerivs 3.0 Unported License.To view a copy of this license,visit http://creativecommons.org/licenses/by-nd/3.0/.
    • copyright ©TestingTimes 2013A LONGTIME AGO...
    • copyright ©TestingTimes 2013CHALLENGES• Did the program run?• Where the punch cards correct? (Source Code)• Was the data correct ?• Was the compiler correct? (Program Code)• Did the program solve the problem?
    • copyright ©TestingTimes 2013Test Strategy Test Spec Test ExecutionAnalysisDocuments/CodeDesign TestingActivitiesSCRIPTEDTESTINGTest ReportStrategyModellingDecision MakingModellingConfigurationOperationObservationEvaluationConfigurationReportingOperationObservationEvaluation Communicationcopyright ©TestingTimes 2013
    • copyright ©TestingTimes 2013LEGACYRequires a tester to be able to:Often has formalised methodology based onIEEE829DesignTest Scripts upfront against RequirementsRequires ExperiencedTest AnalystVsTesterIndicate Expected Result upfrontComplete when 100%Test Executed
    • copyright ©TestingTimes 2013PROGRESS
    • copyright ©TestingTimes 2013HOW WE DISCOVER
    • copyright ©TestingTimes 2013“Exploratory testing is an approach to software testing that isconcisely described as simultaneous learning, test design andtest execution.” Cem Kaner“The plainest definition of exploratory testing is test designand test execution at the same time.” J. Bach
    • copyright ©TestingTimes 2013ActivitiesEXPLORATORY TESTINGModellingDecision MakingConfigurationOperationObservationEvaluationLearningTestingDesignStrategy
    • copyright ©TestingTimes 2013TESTER CENTRICDesignTestingLearningAutodidacticSelf AwarenessAutonomyCourageMental Engagement
    • • Download iHandy Coin Flip Free from Appstore• Download iHandy Coin Flip Free from GooglePlayTEST COIN FLIP FREEAny Questions?copyright ©TestingTimes 2013
    • copyright ©TestingTimes 2013DISCUSSION
    • BUGS• flipping phone goes to adds• coin changes automatically• coin flip has preVibrate on Android is not working• Flick Upward works when disabled• there is no instruction screen, instruction menu or help text which I would normally expect(comparable product)• flip the coin 20 times in a row. 18 out of 20 resulted in heads. Doesnt feel like random distribution...• Screen Size not scalable• RapidTapping makes it crash (Android)• Windows 8 touch screen problems.• Doesn’t support Android 2.2 (Download page says it should)
    • copyright ©TestingTimes 2013WHAT DIDYOU DO?• Played around• Tried out different things• Figured out how it worked• Saw something unusual - looked more• Read up the information (on Website)• Compared your findingsSPONTANEOUSTESTING--- James Bach & Michael Bolton - Rapid SoftwareTesting
    • copyright ©TestingTimes 2013“If you are not using thelearning garnered from testdesign and test execution in acontinuous and rapid loop tooptimize the quality of thework, you are not doingexploratory testing”--Michael Bolton
    • copyright ©TestingTimes 2013DELIBERATIVETESTING• Scripting in your head• Requires considered response to testing• Requires awareness of your approach• May require use of tools or setting up of test data• May require extensive investigation-- James Bach & Michael Bolton - Rapid SoftwareTesting
    • copyright ©TestingTimes 2013HeuristicsA heuristic is a falliblemethod of solving aproblem or making adecision.• Requires Skill• Context Dependent• LessVisibleHEURISTICSThe essence of heuristics: http://www.satisfice.com/blog/archives/462
    • copyright ©TestingTimes 2013GROCERY SHOPPINGYou are purchasing three items at the store, at theseprices:• $19.95• $39.98• $29.97About how much money are you spending?
    • copyright ©TestingTimes 2013HEURISTICSThe fastest way to solve this problem is to round offand approximate.The first item costs about $20, thesecond about $40, and the third about $30; therefore,you are spending about $90 on your shopping spree.Rounding is often an excellent heuristic for arriving quicklyat approximate answers to mathematical problems.
    • copyright ©TestingTimes 2013MENTAL ENGAGEMENT• Alternation• Branching and BackTracking• Embrace Distraction• Jump in & Play• Focus & Defocus --- James Bach & Michael Bolton - Rapid SoftwareTesting
    • copyright ©TestingTimes 2013EXPLORATORYTESTINGHEURISTICS• FEW HICCUPS (Ways to Recognise Bugs) - Michael Bolton• SFDIPOT (Ways to Model and generate test ideas) - JamesBach• HeuristicTest Strategy Model - James Bach• http://www.qualityperspectives.ca/resources_mnemonics.html
    • copyright ©TestingTimes 2013MANY WAYS OF ET• Many different ways to useexploratory testing• Mix level of documentation• Mix level of reporting• Mix level of learning• Mix level of test design• Mix level of testability
    • copyright ©TestingTimes 2013• elements of design, execution, interpretation, and learning are performed by the sameperson;• the design, execution, interpretation, and learning happen together, rather than beingseparated in time;• the tester is making her own choices about what to test, when to test it, and how totest it—the tester may use any automation or tools in support of her testing, or noneat all, as she sees fit;• everything that has been learned so far, including the result of the last test, informs thetester’s choices about the next test;• the tester is focused on revealing new information, rather than confirming existingknowledge about the product;• in general, the tester is varying aspects of her tests rather than repeating them, exceptwhere the repeating aspects of the test are intended to support the discovery of newinformation.Michael Bolton - Evolving Understanding of ExploratoryTestingSUMMARY
    • copyright ©TestingTimes 2013FURTHER READING• Exploratory Skills and Dynamics• http://www.developsense.com/resources.html• HeuristicTest Strategy Model• Test Heuristics Cheat Sheet Elisabeth Hendricksons• You Are Not DoneYet Michael Hunters Coverage
    • copyright ©TestingTimes 2013QUESTIONS?
    • copyright ©TestingTimes 2013THANKYOU!amcharrett@testingtimes.com.au@charrettSkype: charretts