XXXXXXX = Lucky nr 7 + Racer
XXXXXXX = No license plate
Why scripted testing has it’s limitations
System under test
(3rd party) libraries
Processes from other systems
Program state with unexpected outputs
Impact on system resources
Impact on connected systems
The 5 orders of ignorance
0OI = Lack of Ignorance
I (probably) know something. I have the answer and can explain it.
1OI = Lack of Knowledge
I don't know something, but I have a well formed question.
2OI = Lack of Awareness
I don't know that I don't know something. I have no idea what the right question is.
3OI = Lack of Process
I don't know a suitably way to find out I don't know that I don't know something.
I have no clue how to find the right idea's to search for the right question.
4OI = Meta-ignorance
I don't know about the Five Orders of Ignorance.
“Exploratory testing is simultaneous
learning, test design, and test execution.”
James Bach, 1995
Test techniques improve result
Immediate investigation gives most information
Get to know the system
Definition of Exploratory testing
“A tester is somebody who knows
that things can be different.”
testing is about critical
thinking and imagination
…solving problems through an indirect
and creative approach, using reasoning that is
not immediately obvious and involving ideas
that may not be obtainable by using only
traditional step-by-step logic.
Lateral thinking is…
1. Checking = a part of testing (which can often be automated)
2. BDD = mainly about having a conversation understanding system behaviour
3. Automated checking =! Test automation
4. You need creativity, critical and lateral thinking skills for testing
5. Assume that you are wrong when you think you know something (5 orders)
There is test automation!
“Learning comes from
experiencing the unexpected”
“Ignorance is the single greatest
impediment to throughput”
Dan North - Introducing deliberate discovery
Hey, I just met you
And this was crazy
So here’s my twitter
So tweet me maybe?!
Credits for some slides go to: Cem Kaner, James Bach, Ilari Henrik, Elisabeth Hendrickson
Or me: firstname.lastname@example.org
Useful books on testing & checking