Quality Engineering in today's cross-functTeams with TMAP

1
© 2022 Sogeti. All rights reserved.
Quality engineering
in today’s
cross-functional teams
TMAP: the body of knowledge
for quality engineering & testing
in IT delivery
Rik Marselis
19 October 2022

2
Challenges of today’s IT delivery
The business demands:
• Deliver business value
• Deliver quality at speed
The team challenges are:
• Quality engineering is everyone's responsibility
• QA & testing is integrated in process and people
The focus is:
• Organize high-performing cross-functional teams (you build it, you run it!)
• Automate everything (as long as it is useful)

3
High-performance IT delivery
is an approach
that enables cross-functional teams
to continuously improve
the products, processes and people
that are required to
deliver value
to the end users.

4
Waterfall V-model Scrum DevOps Demand-Supply SAFe®
Figure 7.1 from the book Quality for DevOps teams
Agile mindset

5
DevOps – highlights
The six DevOps principles:
1. Customer-centric action
2. Create with the end in mind
3. End-to-end responsibility
4. Cross-functional autonomous teams
5. Continuous improvement
6. Automate everything you can
DevOps is a cross-functional systems engineering culture that aims at unifying
systems development (Dev) and systems operations (Ops) with the ability to create and
deliver fast, cheap, flexible and with adequate quality, whereby the team as a whole is
responsible for the quality. Other areas of expertise, such as business analysis and quality
assurance (including testing) are usually integrated in the team. A DevOps culture has an
Agile mindset that can be supported/implemented by e.g. the Scrum framework.
The six fundamental DevOps activities

6
is an approach
deliver value
to the end users.

7
TEAM:
Together
Everyone
Achieves
More
Example of a cross-functional
high-performance IT delivery team
The starting point for DevOps:
A cross-functional team
takes joint responsibility
Aligned with the DevOps culture of IT delivery – where roles are important and functions
are not – keep in mind that if in TMAP you see a term such as developer or tester, we
refer to the role of a team member at a specific moment in time, not to a function.
And for Agile
in general

8
is an approach
deliver value
to the end users.

9
The starting point of organizations is to deliver business value

10
Build quality in by
applying relevant
quality measures
Supply information
based on
measuring indicators
Our “VOICE model” for delivering business value
Measuring indicators
=
(mainly) testing

11
is an approach
deliver value
to the end users.

12
Business value depends on the quality of products, processes & people
Quality
Products People
Processes

13
TMAP®
the body of knowledge for quality engineering & testing

14
is an approach
deliver value
to the end users.

15
High-performance IT delivery requires continuous improvement of
products, processes & people
Products
People
Processes

16
Quality Engineering (definition)
Quality Engineering
is about team members and their stakeholders
taking joint responsibility
to continuously deliver IT systems
with the right quality at the right moment
to the businesspeople and their customers.
It is a principle of software engineering
concerned with applying quality measures
to assure the quality of IT systems.

17
Quality Engineering & Testing support delivering business value
Quality Engineering
Testing
“Detective”
quality measures
“Preventive”
quality measures
Build quality in,
right first time
Provide information
about quality & risks
“Corrective”
quality measures
Pro-active quality
improvement

18
Definition of testing within business delivery & quality engineering
Testing consists of verification, validation and exploration activities
that provide information about the quality and the related risks,
to establish the level of confidence
that a test object will be able to deliver the pursued business value.

19
Quality engineering
& testing topics
Team scope
Multi-team
scope
Organizing
Aimed at:
orchestrating, arranging,
planning, preparing and
controlling
Performing
Aimed at:
operational
QA & testing
activities.

20
Development
Business
analysis
Operations
Testing
Organizing
Organizing
Quality measures per role

21

22
• Aimed at preventing a lack in quality, to support achieving the right
level of built-in quality
• E.g.: Pair programming, Definition of Done, Pro-active patching
Preventive Quality Measures – Build quality in
• Aimed at measuring the level of quality, to supply information and
whenever needed improve quality
• E.g.: Reviewing, Test design, Test Execution, Code analysis
Detective Quality Measures – Demonstrate the quality level
• Aimed at improving the quality, to solve technical debt and fix any
problems with the quality level of a product
• E.g.: Feature toggles, reactive patching, refactor/rebuild
Corrective Quality Measures – Improve the quality

23
Development
Business
analysis
Operations
Testing
Organizing
Organizing
Quality measures per role:
Development

24
Mutation testing tests the test
Mutation testing is a type of testing where certain statements in the source code are changed
(mutated) to check if test cases will identify the fault that was introduced this way.
This is a manner to verify the quality of the test set (instead of the object under test).
Mutation testing usually is supported by tools.
Mutation testing focuses on conditional statements.
Suppose we have the following code and test cases:
IF A > 10 PRINT “YES” ENDIF
Testcase1: A := 10, expected result no print
Testcase2: A := 11, expected result “YES”
What mutation in this code would not make any of these tests fail?
IF A <> 10 PRINT “YES” ENDIF ➔ Testcase3: A := 9, expected result no print
IF A = 11 PRINT “YES” ENDIF ➔ Testcase4: A := 12, expected result “YES”

25
Development
Business
analysis
Operations
Testing
Organizing
Organizing
Testing

26
The process of testing: goal, test design and test execution
Goal Test design Test execution

27
Test approaches and techniques
Experience-based
testing
Error-guessing
Exploratory
testing
Crowd
testing
Checklists
Test
Figures 43.1, 45.1 and 47.5 from the book Quality for DevOps teams

28
16 test design techniques defined by TMAP
https://tmap.net/page/test-design and https://tmap.net/building-blocks/coverage
Figures 45.2, 45.3, 45.4 and 45.5 from the book Quality for DevOps teams

29
Development
Business
analysis
Operations
Testing
Organizing
Organizing
Organizing people

30
Quality Engineering Strategy
A quality engineering strategy relates
quality measures with IT delivery items
(e.g. user stories, features etc.),
and indicates the intensity of the
quality measures that are needed.
Goal: Built-in quality

31
IT Delivery item
(e.g.: User story,
feature, epic)
Relevant Quality
attributes
(e.g.: performance,
security, usability, …)
Risk class
(e.g:
A – high risk)
Select
appropriate
Quality
measure
Determine
applied
intensity of QM

32
Orchestration, for example:
End-to-end business process testing ➔ separate support team
Deliverables
of team 1
Deliverables
of team 3
Deliverables
of team 4
Deliverables
of team 2

33
It’s seldom wise to
automate nothing…
It’s NEVER wise to
automate everything!

34
Exchanging views
and opinions
Quality Engineering for

35
Share your questions and subjects in the chatbox
At this point…
What questions do you have?
What subjects would you like to
discuss?

36
Conclusion…
Quality Engineering for

37
Conclusion: The change that quality engineering achieves
Testing = Messenger
of bad news
Quality engineering =
Enabler of an
adequate quality level
that delivers
Business Value
No more Instead

38
Want to know more?
Quality Engineering & Testing

39
TMAP training courses and certification scheme of
TMAP: Quality
for cross-
functional teams
TMAP: High-
performance
quality
engineering
TMAP:
Organizing built-
in quality
at scale
Performing
people
3-day training course
exam of 30 questions
3-day training courses
exams of 40 questions
All people
involved in
cross-
functional
teams
Organizing
people
Exams provided by
Info about TMAP certification at:
www.TMAPcert.com
www.TMAP.net
Info about TMAP training courses at:

40
TMAP® Exam Candidates from all over the world
Sweden
Norway
Denmark
Netherlands
UK
France
Brasil
Mexico
Surinam
South
Africa
Rwanda India
Singapore
And maybe some
more because
with online
exams it’s not
always fully clear
where people
are.
Turkey
Germany

41
www.TMAP.net body of knowledge for quality engineering

42
www.TMAP.net information and downloads, for example templates

43
Stay up-to-date with the latest TMAP developments
Follow TMAP on LinkedIn:
www.linkedin.com/company/2020-tmap-quality-engineering-for-high-performance-it-delivery/
(use the link or just search for TMAP and the
world of quality engineering on LinkedIn)

44
About Sogeti
Learn more about us at
www.sogeti.com This message contains information that may be privileged or
confidential and is the property of the Capgemini Group.
Copyright© 2022 Sogeti. All rights reserved.
Sogeti is a leading provider of technology and engineering services. Sogeti delivers
solutions that enable digital transformation and offers cutting-edge expertise in Cloud,
Cybersecurity, Digital Manufacturing, Digital Assurance & Testing, and emerging
technologies. Sogeti combines agility and speed of implementation with strong technology
supplier partnerships, world class methodologies and its global delivery model,
Rightshore®. Sogeti brings together more than 25,000 professionals in 15 countries,
based in over 100 locations in Europe, USA and India. Sogeti is a wholly-owned subsidiary
of Capgemini SE, listed on the Paris Stock Exchange.
TMAP:
body of knowledge for
quality engineering
and testing
Feel free to contact me on:
Rik.Marselis@Sogeti.com
TMAP website:
www.tmap.net
Sogeti academy:
academy.sogeti.nl

45
Rik Marselis
Principal Quality Consultant
2007 2012 2012
2008 2014
2009
2018
1980 2020

46
https://www.sq-mag.com/sq-mag-no-12/

Quality Engineering in today's cross-functTeams with TMAP

Recommended

Recommended

More Related Content

Similar to Quality Engineering in today's cross-functTeams with TMAP

Similar to Quality Engineering in today's cross-functTeams with TMAP (20)

More from Rik Marselis

More from Rik Marselis (20)

Recently uploaded

Recently uploaded (20)

Quality Engineering in today's cross-functTeams with TMAP