Exploring How Software Testing Is Going
to Change
Alan Richardson
@EvilTester
EvilTester.com
compendiumdev.co.uk
digitalonlinetactics.com
@EvilTester 1
The Future
Wild speculation
What we want to happen
What we think will happen
All have Risk associated with them.
@EvilTester 2
What we want to happen
reveals our biases
reveals our experience
@EvilTester 3
What we think will happen
reveals our model of the world
reveals our perception of the industry
@EvilTester 4
The Future
Is driven by individual vision
backed by individuals who believe
Is crafted by individuals taking action
Is allowed by individuals taking no action
Individuals are key.
@EvilTester 5
Warning: As a tester, risk of perceived
negativity ahead
@EvilTester 6
Machiavelli Says...
"he who would forecast what is about to happen should look to what
has been ; since all human events, whether present or to come, have
their exact counterpart in the past. And this, because these events are
brought about by men, whose passions and dispositions remaining in
all ages the same naturally give rise to the same effects"
Chapter XLIII of "Discourses on the first decade of Titus Livius"
@EvilTester 7
Predict More of the Same
"Predicting the future is much too easy, anyway. You look at the
people around you, the street you stand on, the visible air you
breathe, and predict more of the same..."
Ray Bradbury
@EvilTester 8
What I think ‑ based on the present
We will pursue the 'new', seeking the 'one' true tool
rather than find full potential in the 'old'
Market over‑saturated with 'new' and 'better' tools
no such thing as a bad tool, but hard to differentiate
Technology will be over‑hyped
seeds fear, and disappointment
Lack of confidence from Testing
@EvilTester 9
We Need to Have Confidence in Testing
Lack of confidence from Testing leads to
New Trends will continue to unnerve Testers
Testing will be defined by people who have not studied Testing
Attempting to replace Testers with Tools
AI, Automation
Testers will not be confident about their core
Testers will continue to reframe
@EvilTester 10
Individuals, Organisation, Industry
"I don’t try to predict the future. I try to prevent it."
Ray Bradbury
The future is not yet written.
@EvilTester 11
The Future Comes with Risks
@EvilTester 12
“A good science fiction story should be able to
predict not the automobile but the traffic jam."
– Frederik Pohl
@EvilTester 13
"he who looks carefully into the matter will find,
that in all human affairs, we cannot rid ourselves of
one inconvenience without running into another."
Niccolo Machiavelli
@EvilTester 14
Q: Who Identifies and pursues Risk?
A: Testers
@EvilTester 15
Q: What process is used to detect the
manifestation of risk?
A: Testing
@EvilTester 16
What I Want
So tell me what you want, what you really, really want
I wanna, (ha) I wanna, (ha) I wanna, (ha) I wanna, (ha)
I wanna really, really, really wanna zigazig ah
Spice Girls
@EvilTester 17
"I want better"
"Predicting the future is much too easy, anyway. You look at the
people around you, the street you stand on, the visible air you
breathe, and predict more of the same.
To hell with more. I want better."
Ray Bradbury
@EvilTester 18
What I Want ‑ Better Understanding of
Testing
More effective communication and understanding of Testing
People experienced in Testing, describe "Testing"
@EvilTester 19
Go Meta ‑ the core of testing remains
untouched
Six: What do you want?
Two: Information.
Six: Whose side are you on?
Two: That would be telling. We want information...information...
information!!!
Six: You won't get it!
Two: By hook or by crook, we will.
The Prisoner, title sequence
@EvilTester 20
What I Want ‑ Better Team Interaction
Teams constructed based on skill mix and utilisation
rather than role based
Separation between Automating and Testing
@EvilTester 21
What I Want ‑ Better and Flexible Tools
Tools support more Open and Standard APIs
User expandable tools ‑ APIs and Scriptable
Fewer frameworks and more libraries
Less risk in tool adoption
migration paths and open standards
Eco systems of interoperable tools and libraries
@EvilTester 22
What I want ‑ supporting tools
Understanding that 'people' are at the center of testing
Tools which observe more
Tools which help me interrogate faster
Tools which help me manipulate more easily
@EvilTester 23
What I Want ‑ Effective Processes
Algorithmic and Model Based Approaches
so much we haven't built on
More tools suitable for more skill ranges
Easier for people to decide which tool to adopt
@EvilTester 24
What I Want ‑ AI Augmentation
Not AI that replaces algorithms
AI that monitors and flags weak signals
AI that understands its limits
points out 'things'
and brings in people
AI that works in combination with people
@EvilTester 25
What I Want ‑ Gaps in tooling filled
visualising and communicating our work
deterministic algorithmic model coverage
spin off side projects
test data
...
@EvilTester 26
What I want ‑ Optimism
Testers Taking Testing Forward
Bringing in Lessons from other disciplines
Testers Defining Testing
Testers Demonstrating Value
Testers Harnessing Technology
@EvilTester 27
Whichever Future we pick ‑ Model it
Whichever Future we pick: Speculative, Want, Think
What would prevent it happening?
What would prevent us being part of it?
What would be the impact?
How do we get there?
@EvilTester 28
How to Handle the Future Now
Identify end point
Identify how you fit
identify what skills and attitudes you need
Work backwards from there
to create a plan for evolving
@EvilTester 29
Build the Future
Do not just let the future happen to you
Work to be part of the future you want
@EvilTester 30
Work to create the future you want
Alan Richardson ‑ EvilTester.com
@EvilTester 31

The Future of Testing Webinar

  • 1.
    Exploring How SoftwareTesting Is Going to Change Alan Richardson @EvilTester EvilTester.com compendiumdev.co.uk digitalonlinetactics.com @EvilTester 1
  • 2.
    The Future Wild speculation Whatwe want to happen What we think will happen All have Risk associated with them. @EvilTester 2
  • 3.
    What we wantto happen reveals our biases reveals our experience @EvilTester 3
  • 4.
    What we thinkwill happen reveals our model of the world reveals our perception of the industry @EvilTester 4
  • 5.
    The Future Is drivenby individual vision backed by individuals who believe Is crafted by individuals taking action Is allowed by individuals taking no action Individuals are key. @EvilTester 5
  • 6.
    Warning: As atester, risk of perceived negativity ahead @EvilTester 6
  • 7.
    Machiavelli Says... "he whowould forecast what is about to happen should look to what has been ; since all human events, whether present or to come, have their exact counterpart in the past. And this, because these events are brought about by men, whose passions and dispositions remaining in all ages the same naturally give rise to the same effects" Chapter XLIII of "Discourses on the first decade of Titus Livius" @EvilTester 7
  • 8.
    Predict More ofthe Same "Predicting the future is much too easy, anyway. You look at the people around you, the street you stand on, the visible air you breathe, and predict more of the same..." Ray Bradbury @EvilTester 8
  • 9.
    What I think‑ based on the present We will pursue the 'new', seeking the 'one' true tool rather than find full potential in the 'old' Market over‑saturated with 'new' and 'better' tools no such thing as a bad tool, but hard to differentiate Technology will be over‑hyped seeds fear, and disappointment Lack of confidence from Testing @EvilTester 9
  • 10.
    We Need toHave Confidence in Testing Lack of confidence from Testing leads to New Trends will continue to unnerve Testers Testing will be defined by people who have not studied Testing Attempting to replace Testers with Tools AI, Automation Testers will not be confident about their core Testers will continue to reframe @EvilTester 10
  • 11.
    Individuals, Organisation, Industry "Idon’t try to predict the future. I try to prevent it." Ray Bradbury The future is not yet written. @EvilTester 11
  • 12.
    The Future Comeswith Risks @EvilTester 12
  • 13.
    “A good sciencefiction story should be able to predict not the automobile but the traffic jam." – Frederik Pohl @EvilTester 13
  • 14.
    "he who lookscarefully into the matter will find, that in all human affairs, we cannot rid ourselves of one inconvenience without running into another." Niccolo Machiavelli @EvilTester 14
  • 15.
    Q: Who Identifiesand pursues Risk? A: Testers @EvilTester 15
  • 16.
    Q: What processis used to detect the manifestation of risk? A: Testing @EvilTester 16
  • 17.
    What I Want Sotell me what you want, what you really, really want I wanna, (ha) I wanna, (ha) I wanna, (ha) I wanna, (ha) I wanna really, really, really wanna zigazig ah Spice Girls @EvilTester 17
  • 18.
    "I want better" "Predictingthe future is much too easy, anyway. You look at the people around you, the street you stand on, the visible air you breathe, and predict more of the same. To hell with more. I want better." Ray Bradbury @EvilTester 18
  • 19.
    What I Want‑ Better Understanding of Testing More effective communication and understanding of Testing People experienced in Testing, describe "Testing" @EvilTester 19
  • 20.
    Go Meta ‑the core of testing remains untouched Six: What do you want? Two: Information. Six: Whose side are you on? Two: That would be telling. We want information...information... information!!! Six: You won't get it! Two: By hook or by crook, we will. The Prisoner, title sequence @EvilTester 20
  • 21.
    What I Want‑ Better Team Interaction Teams constructed based on skill mix and utilisation rather than role based Separation between Automating and Testing @EvilTester 21
  • 22.
    What I Want‑ Better and Flexible Tools Tools support more Open and Standard APIs User expandable tools ‑ APIs and Scriptable Fewer frameworks and more libraries Less risk in tool adoption migration paths and open standards Eco systems of interoperable tools and libraries @EvilTester 22
  • 23.
    What I want‑ supporting tools Understanding that 'people' are at the center of testing Tools which observe more Tools which help me interrogate faster Tools which help me manipulate more easily @EvilTester 23
  • 24.
    What I Want‑ Effective Processes Algorithmic and Model Based Approaches so much we haven't built on More tools suitable for more skill ranges Easier for people to decide which tool to adopt @EvilTester 24
  • 25.
    What I Want‑ AI Augmentation Not AI that replaces algorithms AI that monitors and flags weak signals AI that understands its limits points out 'things' and brings in people AI that works in combination with people @EvilTester 25
  • 26.
    What I Want‑ Gaps in tooling filled visualising and communicating our work deterministic algorithmic model coverage spin off side projects test data ... @EvilTester 26
  • 27.
    What I want‑ Optimism Testers Taking Testing Forward Bringing in Lessons from other disciplines Testers Defining Testing Testers Demonstrating Value Testers Harnessing Technology @EvilTester 27
  • 28.
    Whichever Future wepick ‑ Model it Whichever Future we pick: Speculative, Want, Think What would prevent it happening? What would prevent us being part of it? What would be the impact? How do we get there? @EvilTester 28
  • 29.
    How to Handlethe Future Now Identify end point Identify how you fit identify what skills and attitudes you need Work backwards from there to create a plan for evolving @EvilTester 29
  • 30.
    Build the Future Donot just let the future happen to you Work to be part of the future you want @EvilTester 30
  • 31.
    Work to createthe future you want Alan Richardson ‑ EvilTester.com @EvilTester 31