GTR-The End Of Testing As We Know It

1
© 2022 Sogeti. All rights reserved.
The end of testing as
we know it!!
Rik Marselis
Global Testing Retreat
online
10 December 2022
TMAP: the body of knowledge for
quality engineering in IT delivery

2
Rik Marselis
Principal Quality Consultant
2007 2012 2012
2008 2014
2009
2018
1980 2020

3

4
The end of testing as we know it…

5
Why would we want to test?

6

7
Testing in the 1970’s
Testing is
the process of
executing a program
with the intent
of finding errors

8
Which activity is missing in this picture?
?

9
You were thinking of “testing” or “quality assurance”, weren’t you?
Fixing at the end of the IT delivery process is not efficient and not effective.
So, instead of hunting faults… don’t implement a fixing phase…
Organize your DevOps process properly, to get sufficient quality right first time!
Actually, this is the activity where all faults that were inserted previously are hunted for and when
found they are fixed.
Therefore, we like to refer to it as the “fixing phase”.

10
Lesson from 1979, the Böhm curve, still relevant:
Shift left & early quality & built-in quality
The “Böhm-curve”:
If you find and solve a problem early that’s cheaper than later…
SHIFT LEFT !!!!

11
Make sure quality engineering is part of all IT delivery activities
Note: this picture shows some general activities, in DevOps these are performed in parallel.
Quality engineering

12
So, today testing is
not hunting bugs,
then what is it?

13
Challenges of today’s IT delivery
The business demands:
• Deliver business value
• Deliver quality at speed
The team challenges are:
• Quality engineering is everyone's responsibility
• QA & testing is integrated in process and people
The focus is:
• Organize high-performing cross-functional teams (you build it, you run it!)
• Automate everything (as long as it is useful)

14
Deliver quality at speed…

15
Focus on BUSINESS VALUE

16
Build quality in by
applying relevant
quality measures
Supply information
based on
measuring indicators
The VOICE model: align activities with pursued business value
Measuring indicators
=
(mainly) testing
Figure 3.1 from the book Quality for DevOps teams

17
Embrace continuous improvement  Quality Engineering (definition)
Quality Engineering
is about team members and their stakeholders
taking joint responsibility
to continuously deliver IT systems
with the right quality at the right moment
to the businesspeople and their customers.
It is a principle of software engineering
concerned with applying quality measures
to assure the quality of IT systems.
Definition from TMAP glossary (see www.TMAP.net)

18
Quality Engineering & Testing support delivering business value
Quality Engineering
Testing
“Detective”
quality measures
“Preventive”
quality measures
Build quality in,
right first time
Provide information
about quality & risks
“Corrective”
quality measures
Pro-active quality
improvement

19
Definition of testing within business delivery & quality engineering
Testing consists of verification, validation and exploration activities
that provide information about the quality and the related risks,
to establish the level of confidence
that a test object will be able to deliver the pursued business value.

20
Quality engineering
& testing topics
Team scope
Multi-team
scope
Organizing
Aimed at:
orchestrating, arranging,
planning, preparing and
controlling
Performing
Aimed at:
operational
QA & testing
activities.

21
The relation of quality engineering topics and DevOps

22
Structure your testing!

23
Static versus Dynamic testing
(examples)
Perspective based reviewing “Running” the system

24
Testing new & changed versus unchanged deliverables
Testing new and changed
deliverables
Testing unchanged
deliverables
Testing fixed problems

25
The process of testing: goal, test design and test execution
Goal Test design Test execution

26
Test approaches and techniques
Experience-based
testing
Error-guessing
Exploratory
testing
Crowd
testing
Checklists
Figures 43.1, 45.1 and 47.5 from the book Quality for DevOps teams

27
16 test design techniques defined by TMAP
https://tmap.net/page/test-design and https://tmap.net/building-blocks/coverage
Figures 45.2, 45.3, 45.4 and 45.5 from the book Quality for DevOps teams

28
www.TMAP.net information and downloads, for example templates

29
A test case consists of:
input & actions, expected outcome, actual outcome, pass/fail
EXPECTED
outcome
!!!!

30
What about
Test automation?

31
Continuous feedback & shift left

32
Quality at speed  Automate everything (as long as it is useful)
An automated pipeline enables: • Elimination of errors due to manual task execution
• Provisioning of standardized development feedback loops
• Enabling of fast product iterations
Figure 6.1 from the book
One team
Multiple
teams

33
The testing pyramid automated testing (as long as it is useful)
Testing should be automated as
much as possible, and testing
should be done as early as
possible. But manual testing also
has value!
Note: When in automated regression testing
not many anomalies are found this is good,
because regression testing is mainly to
check if no unexpected changes were made
to the system.

34
It’s seldom wise to
automate nothing…
It’s NEVER wise to
automate everything!

35
Conclusion…
transition from
testing at the end to
Quality Engineering
from the start

36
Conclusion: The change that quality engineering achieves
Testing = Messenger
of bad news
Quality engineering =
Enabler of an
adequate quality level
that delivers
Business Value
No more Instead

37
Want to know more?

38
Stay up-to-date with the latest TMAP developments
Sign up for the TMAP LinkedIn group:
https://www.linkedin.com/groups/8948400/
(use the link or just search for TMAP on LinkedIn)

39
TMAP training courses and certification scheme
TMAP: Quality
for cross-
functional teams
TMAP: High-
performance
quality
engineering
TMAP:
Organizing built-
in quality
at scale
Performing
people
3-day training course
including
exam of 30 questions
3-day training courses
with separate
exams of 40 questions
All people
involved in
cross-
functional
teams
Organizing
people
Exams provided by:
More info: www.TMAP.net  menu “training”
www.TMAPcert.com (certification)

40
TMAP® Exam candidates from all over the world
Sweden
Norway
Denmark
Netherlands
UK
France
Brasil
Mexico
Surinam
South
Africa
Rwanda India
Singapore
And maybe some
more because
with online
exams it’s not
always fully clear
where people are
from.
Turkey
Germany
This is for the renewed scheme, since 2020

41
Questions & Answers
And soon we will announce
the 3 winners of a free copy
of the electronic version!!

42
About Sogeti
Learn more about us at
www.sogeti.com This message contains information that may be privileged or
confidential and is the property of the Capgemini Group.
Copyright© 2022 Sogeti. All rights reserved.
Sogeti is a leading provider of technology and engineering services. Sogeti delivers
solutions that enable digital transformation and offers cutting-edge expertise in Cloud,
Cybersecurity, Digital Manufacturing, Digital Assurance & Testing, and emerging
technologies. Sogeti combines agility and speed of implementation with strong technology
supplier partnerships, world class methodologies and its global delivery model,
Rightshore®. Sogeti brings together more than 25,000 professionals in 15 countries,
based in over 100 locations in Europe, USA and India. Sogeti is a wholly-owned subsidiary
of Capgemini SE, listed on the Paris Stock Exchange.
TMAP website:
www.tmap.net
Sogeti academy:
academy.sogeti.nl
TMAP:
body of knowledge for
quality engineering
email: Rik.Marselis@sogeti.com

GTR-The End Of Testing As We Know It

More Related Content

Similar to GTR-The End Of Testing As We Know It

More from Rik Marselis

Recently uploaded

GTR-The End Of Testing As We Know It