SlideShare a Scribd company logo
EXPLORATORY
TESTING
EXPLAINED

ALEKSIS TULONEN
COMIQ OY
www.comiq.fi
www.commonsensetesting.org
I want to thank James Bach and Michael Bolton for the
discussions we’ve had related to this topic. Much of my
current understanding has came from those discussions.
TESTING

Experimenting with something in order to
evaluate it.
Testing is about mental engagement.
EXPLORATORY
TESTING
An approach to testing that emphasizes testers
ability to explore an unknown object or space
through concurrent test design and test execution.
Explore = travel through (an unfamiliar area) in order to
learn about it (Oxford Dictionaries)
FREEDOM &
RESPONSIBILITY

“A style of software testing that emphasizes the personal

freedom and responsibility of the individual tester
to optimize the quality of his or her work by treating
test design, test execution, test interpretation, and test-related
learning as mutually supportive activities that continue in parallel
throughout the project.” – Cem Kaner
At the end of each iteration, each team member should
be able to say why she is worth more money to her
employer than she was at the beginning. – (Brian
Marick)
CREATING BY
REACTING
“Likewise, most musicians don't compose entire
melodies in their head and then write them down;
instead, they noodle around on a instrument for a
while, playing with patterns and reacting to what
they hear, adjusting and sculpting.
An essential aspect of a painter's canvas and a
musical instrument is the immediacy with which
the artist gets something there to react to. A
canvas or sketchbook serves as an "external
imagination", where an artist can grow an idea
from birth to maturity by continuously reacting to
what's in front of him.” – Bret Victor (Learnable
Programming)
SUMMARIZING
Exploration, Freedom, Responsibility, Mental
Engagement, Experiments, …

So what?

What’s the big deal?
SUMMARIZING
• Most bugs are not obvious

• They are not out there in the open
• They are not found by following a script or walking the
happy path
• They hide all over the spaces that tend to be BIG

If we want to have chances in finding them
(bugs) – we need to become good at
exploring
SOURCES OF
INFORMATION
• Evolving Understanding of Exploratory Testing (by
Michael Bolton) http://www.developsense.com/resources.html#exploratory
• Exploratory Testing (by Cem Kaner) http://www.testingeducation.org/BBST/exploratory/
• Telling Your Exploratory Story (by Jon Bach) http://www.youtube.com/watch?v=uUdWm7ddgfU
• Exploratory Testing (by Jon Bach) http://www.youtube.com/watch?v=8Y4WCdJRfV4
• A Case Against Test Cases (by Jon Bach) http://www.quardev.com/blog/a_case_against_test_cases
SOURCES OF
INFORMATION
• The Leprechauns of Software Engineering (by Laurent
Bossavit) - https://leanpub.com/leprechauns
• Perfect Software: And Other Illusions about Testing (by
Jerry Weinberg) – You can find it from Amazon
• Explore It!: Reduce Risk and Increase Confidence with
Exploratory Testing (by Elisabeth Hendrickson) – You can
find it from Amazon
• Mindstorms: Children, Computers, and Powerful Ideas (by
Seymour Papert) – You can find it from Amazon
• Mindset: The New Psychology of Success (by Carol
Dweck) – You can find it from Amazon
• “The Idea Accelerator” (by Ken Hudson) – You can find it
from Amazon
SOURCES OF
INFORMATION
•

“What is Exploratory Testing?”
http://swtester.blogspot.ca/2012/05/what-is-exploratorytesting.html (by Paul Carvalho)

•

“The Little Black Book on Test Design”
http://thetesteye.com/blog/2011/09/the-little-black-book-ontest-design/ (by Rikard Edgren)

•

“To The New Tester”
http://www.satisfice.com/blog/archives/958 (by James Bach)

•

“Fractal Exploratory Testing” http://www.a-sisypheantask.com/2013/01/fractal-exploratorytesting.html#.UpxHGWRgY3Y (by Adam Knight)

•

“Learnable Programming”
http://worrydream.com/LearnableProgramming/ (by Bret
Victor)
SOURCES OF
INFORMATION
•

“Two Forgotten Agile Values: Discipline and Skill”
http://www.exampler.com/discipline-and-skill.html (by Brian
Marick)

•

“Practical Tools For Playing Well With Others”
http://oredev.org/2013/wed-fri-conference/practical-tools-forplaying-well-with-others (by J.B. Rainsberger)

•

“Patterns for The People” http://vimeo.com/19124478 (by
Kevlin Henney)

•

“The Satir Interaction Model” http://sstconline.org/2006/pdfs/JB1365Notes.pdf (by Virginia Satir)

•

“Test Heuristics Cheat Sheet” http://testobsessed.com/wpcontent/uploads/2011/04/testheuristicscheatsheetv1.pdf (by
Elisabeth Hendrickson)
Twitter: @al3ksis
Blog: flowoftesting.wordpress.com
LinkedIn: Aleksis Tulonen
Email: aleksis.tulonen@gmail.com

More Related Content

Similar to Exploratory Testing Explained (Tampere Goes Agile - 2013)

How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)
How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)
How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)
Aleksis Tulonen
 
How To Think Like An Exploratory Tester (Turku Agile Day 2014)
How To Think Like An Exploratory Tester (Turku Agile Day 2014)How To Think Like An Exploratory Tester (Turku Agile Day 2014)
How To Think Like An Exploratory Tester (Turku Agile Day 2014)
Aleksis Tulonen
 
Lean Ethnography
Lean EthnographyLean Ethnography
Lean Ethnography
Kate Lawrence
 
WHCL Innovate 2019: OER Basics
WHCL Innovate 2019: OER BasicsWHCL Innovate 2019: OER Basics
WHCL Innovate 2019: OER Basics
Kelsey Smith
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
TechWell
 
2016.biology.human evolution
2016.biology.human evolution2016.biology.human evolution
2016.biology.human evolution
juanvidal71
 
Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012
Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012
Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012
TEST Huddle
 
CI 350 The Theory of Evolution Webquest
CI 350 The Theory of Evolution WebquestCI 350 The Theory of Evolution Webquest
CI 350 The Theory of Evolution Webquest
Herdheaven
 
COSC 111 Research Fall 2012
COSC 111 Research Fall 2012COSC 111 Research Fall 2012
COSC 111 Research Fall 2012Laksamee Putnam
 
Best Practices in Online Lab Science Education
Best Practices in Online Lab Science EducationBest Practices in Online Lab Science Education
Best Practices in Online Lab Science Education
Peter Jeschofnig
 
Vale2017 b13-presentation
Vale2017 b13-presentationVale2017 b13-presentation
Vale2017 b13-presentation
Ray Schwartz
 
Open Research (workshop)
Open Research (workshop)Open Research (workshop)
Open Research (workshop)
Robert Farrow
 
Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...
Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...
Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...
Visual Resources Association
 
Lesson 9.2 Activity: The Impact of Population Growth Essay
Lesson 9.2 Activity: The Impact of Population Growth EssayLesson 9.2 Activity: The Impact of Population Growth Essay
Lesson 9.2 Activity: The Impact of Population Growth Essay
Big History Project
 
Mc gaughey, jaclyn cellular respiration
Mc gaughey, jaclyn cellular respirationMc gaughey, jaclyn cellular respiration
Mc gaughey, jaclyn cellular respiration
Jaclyn McGaughey
 
James thomas
James thomasJames thomas
James thomas
James Thomas
 
Visions of future learning
Visions of future learningVisions of future learning
Visions of future learning
Rebecca Ferguson
 
Exploratory testing part 1
Exploratory testing part 1Exploratory testing part 1
Exploratory testing part 1
Dawn Code
 
Santa Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and ExperiencedSanta Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and Experienced
Maaret Pyhäjärvi
 
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
Right to Research
 

Similar to Exploratory Testing Explained (Tampere Goes Agile - 2013) (20)

How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)
How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)
How To Think Like an Exploratory Tester (FISTB Testing Assembly 2014)
 
How To Think Like An Exploratory Tester (Turku Agile Day 2014)
How To Think Like An Exploratory Tester (Turku Agile Day 2014)How To Think Like An Exploratory Tester (Turku Agile Day 2014)
How To Think Like An Exploratory Tester (Turku Agile Day 2014)
 
Lean Ethnography
Lean EthnographyLean Ethnography
Lean Ethnography
 
WHCL Innovate 2019: OER Basics
WHCL Innovate 2019: OER BasicsWHCL Innovate 2019: OER Basics
WHCL Innovate 2019: OER Basics
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
2016.biology.human evolution
2016.biology.human evolution2016.biology.human evolution
2016.biology.human evolution
 
Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012
Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012
Michael Bolton - Testing Through The Qualitive Lens - EuroSTAR 2012
 
CI 350 The Theory of Evolution Webquest
CI 350 The Theory of Evolution WebquestCI 350 The Theory of Evolution Webquest
CI 350 The Theory of Evolution Webquest
 
COSC 111 Research Fall 2012
COSC 111 Research Fall 2012COSC 111 Research Fall 2012
COSC 111 Research Fall 2012
 
Best Practices in Online Lab Science Education
Best Practices in Online Lab Science EducationBest Practices in Online Lab Science Education
Best Practices in Online Lab Science Education
 
Vale2017 b13-presentation
Vale2017 b13-presentationVale2017 b13-presentation
Vale2017 b13-presentation
 
Open Research (workshop)
Open Research (workshop)Open Research (workshop)
Open Research (workshop)
 
Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...
Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...
Dos, Don'ts and Do Overs: A Case Study in Interviewing, Transcribing, and Edi...
 
Lesson 9.2 Activity: The Impact of Population Growth Essay
Lesson 9.2 Activity: The Impact of Population Growth EssayLesson 9.2 Activity: The Impact of Population Growth Essay
Lesson 9.2 Activity: The Impact of Population Growth Essay
 
Mc gaughey, jaclyn cellular respiration
Mc gaughey, jaclyn cellular respirationMc gaughey, jaclyn cellular respiration
Mc gaughey, jaclyn cellular respiration
 
James thomas
James thomasJames thomas
James thomas
 
Visions of future learning
Visions of future learningVisions of future learning
Visions of future learning
 
Exploratory testing part 1
Exploratory testing part 1Exploratory testing part 1
Exploratory testing part 1
 
Santa Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and ExperiencedSanta Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and Experienced
 
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
I won't be #BulliedIntoBadScience! - Laurent Gatto - OpenCon 2017
 

Recently uploaded

The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 

Recently uploaded (20)

The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 

Exploratory Testing Explained (Tampere Goes Agile - 2013)

  • 4. I want to thank James Bach and Michael Bolton for the discussions we’ve had related to this topic. Much of my current understanding has came from those discussions.
  • 5.
  • 6. TESTING Experimenting with something in order to evaluate it.
  • 7.
  • 8. Testing is about mental engagement.
  • 9. EXPLORATORY TESTING An approach to testing that emphasizes testers ability to explore an unknown object or space through concurrent test design and test execution. Explore = travel through (an unfamiliar area) in order to learn about it (Oxford Dictionaries)
  • 10. FREEDOM & RESPONSIBILITY “A style of software testing that emphasizes the personal freedom and responsibility of the individual tester to optimize the quality of his or her work by treating test design, test execution, test interpretation, and test-related learning as mutually supportive activities that continue in parallel throughout the project.” – Cem Kaner
  • 11. At the end of each iteration, each team member should be able to say why she is worth more money to her employer than she was at the beginning. – (Brian Marick)
  • 12. CREATING BY REACTING “Likewise, most musicians don't compose entire melodies in their head and then write them down; instead, they noodle around on a instrument for a while, playing with patterns and reacting to what they hear, adjusting and sculpting. An essential aspect of a painter's canvas and a musical instrument is the immediacy with which the artist gets something there to react to. A canvas or sketchbook serves as an "external imagination", where an artist can grow an idea from birth to maturity by continuously reacting to what's in front of him.” – Bret Victor (Learnable Programming)
  • 13. SUMMARIZING Exploration, Freedom, Responsibility, Mental Engagement, Experiments, … So what? What’s the big deal?
  • 14. SUMMARIZING • Most bugs are not obvious • They are not out there in the open • They are not found by following a script or walking the happy path • They hide all over the spaces that tend to be BIG If we want to have chances in finding them (bugs) – we need to become good at exploring
  • 15. SOURCES OF INFORMATION • Evolving Understanding of Exploratory Testing (by Michael Bolton) http://www.developsense.com/resources.html#exploratory • Exploratory Testing (by Cem Kaner) http://www.testingeducation.org/BBST/exploratory/ • Telling Your Exploratory Story (by Jon Bach) http://www.youtube.com/watch?v=uUdWm7ddgfU • Exploratory Testing (by Jon Bach) http://www.youtube.com/watch?v=8Y4WCdJRfV4 • A Case Against Test Cases (by Jon Bach) http://www.quardev.com/blog/a_case_against_test_cases
  • 16. SOURCES OF INFORMATION • The Leprechauns of Software Engineering (by Laurent Bossavit) - https://leanpub.com/leprechauns • Perfect Software: And Other Illusions about Testing (by Jerry Weinberg) – You can find it from Amazon • Explore It!: Reduce Risk and Increase Confidence with Exploratory Testing (by Elisabeth Hendrickson) – You can find it from Amazon • Mindstorms: Children, Computers, and Powerful Ideas (by Seymour Papert) – You can find it from Amazon • Mindset: The New Psychology of Success (by Carol Dweck) – You can find it from Amazon • “The Idea Accelerator” (by Ken Hudson) – You can find it from Amazon
  • 17. SOURCES OF INFORMATION • “What is Exploratory Testing?” http://swtester.blogspot.ca/2012/05/what-is-exploratorytesting.html (by Paul Carvalho) • “The Little Black Book on Test Design” http://thetesteye.com/blog/2011/09/the-little-black-book-ontest-design/ (by Rikard Edgren) • “To The New Tester” http://www.satisfice.com/blog/archives/958 (by James Bach) • “Fractal Exploratory Testing” http://www.a-sisypheantask.com/2013/01/fractal-exploratorytesting.html#.UpxHGWRgY3Y (by Adam Knight) • “Learnable Programming” http://worrydream.com/LearnableProgramming/ (by Bret Victor)
  • 18. SOURCES OF INFORMATION • “Two Forgotten Agile Values: Discipline and Skill” http://www.exampler.com/discipline-and-skill.html (by Brian Marick) • “Practical Tools For Playing Well With Others” http://oredev.org/2013/wed-fri-conference/practical-tools-forplaying-well-with-others (by J.B. Rainsberger) • “Patterns for The People” http://vimeo.com/19124478 (by Kevlin Henney) • “The Satir Interaction Model” http://sstconline.org/2006/pdfs/JB1365Notes.pdf (by Virginia Satir) • “Test Heuristics Cheat Sheet” http://testobsessed.com/wpcontent/uploads/2011/04/testheuristicscheatsheetv1.pdf (by Elisabeth Hendrickson)
  • 19. Twitter: @al3ksis Blog: flowoftesting.wordpress.com LinkedIn: Aleksis Tulonen Email: aleksis.tulonen@gmail.com

Editor's Notes

  1. -Understanding about Exploratory Testing based on my understanding about Testing-Not universal definition but helps you to understand what I mean when I talk about testing
  2. Could be “Experimenting with a product” – Didn’t want to restrict your thinking only on a concrete product (e.g. software)Testing can have different missions:Common one being “Find important bugs”Can be also to see if first build of a web site is testable. Yes experimenting with a product in order to evaluate, but not necessarily to find important bugs – instead see if the build is testable. Or will it crash from every click.
  3. In the end testing is much about asking “What if?”.What if I log in with a user that has no access rights? What if I send a message with customer that has leading zeros on its customer number? What if I operate on web portal over 8 hours with less than 15 minutes breaks? I explain that sometimes these questions can lead to me asking a question from someone else, operating with the software by myself or perhaps with the help of some specific tool. All start from a thought that aims at learning more about the product and therefore revealing quality related information.
  4. When we evaluate a test process, we need to evaluate the mental process of testing. What happens on the keyboard, or the questions we make, is important, but still a result of our thinking. Remember this while we move into discussing about Exploratory Testing
  5. Concentrate on the first part – open up the “concurrent test design & test execution” later with the help of a metaphorET is an approach, not a separate techniqueBy testers I mean the person that is testing, should not be confused to a role of tester.If testing is experimenting – then that requires exploration as far as I understand – which means that all testing is exploratory testing
  6. If given freedom to think – need to honor that responsibilityExamples: not using tool when it is a good idea, not improving test data when it is a good idea
  7. Product acts as a something there to react to“Concurrent test design and test execution” can be similar to continuously reacting to what’s in front of him.