HOW TO REDUCE THE
COST OF SOFTWARE
TESTING
ANNE-MARIE CHARRETT
TESTING TIMES
!

http://mavericktester.com

@charrett
DON’T TEST

@charrett
TESTING

@charrett
@charrett
TESTING ASKS

IS THAT PROBLEM
SOLVED?
- - Cem Kaner

@charrett
@charrett
Software Testing is
questioning a product in
order to evaluate it
—James Bach

@charrett
DISCOVERY
@charrett
@charrett
CHECKING
•

Limited Information

•

Doesn’t question

•

Needs to be extensive

•

Expensive to maintain

@charrett
CALCULATOR EXERCISE
•

Imagine a calculator

•

You power it on

•

You type 2 + 2 =

•

What is the answer you see?

•

Is that the answer you expect?
exercise by James Bach

@charrett
WHEN 2+2 = 4 IS A FAIL
•

Smoke comes out of the calculator

•

It emits a screeching sound

•

a dancing bear moves across the
screen • you get 0000000000004

•

or the answer disappears after 2
seconds

@charrett
TESTING IS A SKILLED ACTIVITY
@charrett
HOW TO KNOW A TESTER
•

Modelling

•

Critical Thinker

•

Strategic Thinker

•

Understands Risk

•

Good Communication

(vs a checker)

@charrett
MAKING TESTING
WORK FOR YOU

@charrett
TRAPS for the UNWARY
•

Replace all testers with 1 automated tester

•

Outsource the problem

•

Hire developers instead of testers

•

Automate for quick tests not valuable tests

•

Attempt 100% Automation

•

Focus on tools instead of people

@charrett
HOW TO
REDUCE COST?

@charrett
REMOVE WASTE

@charrett
QUALITY & DONE
•

Developers perform checking

•

Testers perform Exploratory Testing

•

Testers assist developers in testing

•

Testers pair with developers

•

Testers review stories (3 amigos)

@charrett
EXPLORATORY TESTING
!

“a style of software testing that emphasises
the personal freedom and responsibility of
the individual tester to continually optimise
the quality of his/her work by treating testrelated learning, test design, test execution,
and test result interpretation as mutually
supportive activities that run in parallel
throughout the project

@charrett
COST VS VALUE

@charrett
TESTER JUMPER
•

Share testers between teams

•

Advise on Test Design

•

Involved in User Stories

•

Must be highly skilled

•

Advise on risk

•

Advise on heuristics
@charrett
SKILL
•

Coach how to learn

•

Coach developers on how to test

•

Coach testers on how to ‘test’

@charrett
IDEAS ON TESTING
•

Reduce usage of costly license tools

•

Focus on excellent strategy and test design

•

Make checking a developer task

•

Everyone is responsible for quality

•

Invest in Exploratory Testing

•

Invest in quality automation (Less is More Heuristic)

•

Testers take on a coaching role

•

Pair Testers with Developers

•

Lightweight Regression Test Suite

@charrett
BE SKEPTICAL
•

Challenge your consultants
•
•

How do you know x is true

•
•

How do you mean by x?

Does it matter to you?

Demand consultants who understand testing

@charrett
THE FUTURE?

@charrett
Thank you!
Anne-Marie Charrett
Testing Times

!
Software Tester, Coach, Consultant

!
Email: amcharrett@testingtimes.com.au

@charrett

how to reduce the cost of software testing