Critical ThinkingScientific Thinkingposing useful questionsobserving what’s going ondescribing what you perceivethinking critically about what you knowrecognizing and managing biasdesigning hypotheses and experimentsthinking despite already knowinganalyzing someone else’s thinkingreasoning about cause and effecttreating “facts” as merely what we believe we know as of this moment
Developers Tunnel vision: Biased to test for what is there
Deciding where to Test –add value to your testing
Oracles - How do we know it’s a problem?
Did you ask useful questions?Did you know your mission?Did you Know who you’re testing for?Did you make a conscious decision on what to test ? Where you aware of any bias? Did you make any assumptions?
Discovering Your Inner Tester Parts of this class have been excerpted from:
Rapid Software Testing, by James Bach, email@example.com
Black Box Software Testing, by CemKaner, firstname.lastname@example.org
Generic Risk List Complex Anything disporportionality large, intricate or convoluted New Anything that has no history in the product Changed Anything that has been tampered or "improved" Upsteam Dependency Anything whose failure will cause cascading failures in the rest of the system Downstream Dependency Anything that is especially sensitive to failures in the rest of the system Critical Anything whose failure could cause substantial damage Precise Anything that must meet requirements exactly Strategic Anything that has special importance to your business, such as a feature that sets you apart from the competition Third-Party Anything used in the product, but developed outside of the project Distributed Anything spread out in time or space, yet whose elements must work together Buggy Anything known to have lots of problems Recent Failure Anything with a recent history of failure Focus
How do we choose where to look? How do we see what is NOT there? Depends a lot on our choice of Model Input Output State Machine Event Driven Behaviour Modeling Trap Diversify
Observation Trap Be aware of what you are looking out for Your “idea” or “model” of your what you’re testing often determines What you decide to test What you decide is a bug Remember. You may be biased!
Tilted Twister This is a mind storm Tilted Twister It solves Rubix Cubes It consists of software and hardware I will be video recording this I want you to test it
Mission: Tilted Twister Data Project Manager: A client requested a rubix cube solver, the developers gone on holiday. I want you to test this, before the client turns up. Find Top 5 Issues in the next 20 mins Any questions?
Turbo Twister Instructions Orange Button = Select Light Grey Buttons – Move through options Dark Grey – Back or Exit My Files->Software Files->Tilted Twister
Problems Found Cannot detect colour differences Motor arm overshoots Hard to know how to turn it on Calibration Rubix cube is too big Takes to long to work out solution & then runs out of memory
Debrief What was your mission? What problems did you find? How did you know they were problems? How did you find them? What questions did you ask? Can you report credibly? Did you need more time?
Tips & Tricks To Test Effectively Know your mission, stakeholders Too much, Too little, Just Right Focus – Defocus Boundary Testing Pair Testing Scenario Testing Negative Testing Caricatures 14
Follow up Mind Map of Heuristics Hand Out Email me: email@example.com FREE Online Coaching – skype: charretts