This document discusses the concept of "thinking quality in" rather than just "testing quality in". It suggests that quality should be considered at every stage of a product's lifecycle from concept to maintenance. It provides examples to discuss what quality means and how it can be subjective. It also shares definitions of quality from standards and thought leaders. The document aims to help people better understand quality and provide practical ways to think about it in their work.
2. Why ‘Thinking Quality In’?
testing something doesn’t change its quality, but
testing can provide information which helps us understand quality and
to make decisions about what we can do next (which may improve quality)
2
We don’t ‘test quality in’. When we test, we:
Experiment Explore Inform
www.richrtesting.com
3. Why ‘Thinking Quality In’?
We don’t ‘build quality in’
Quality isn’t the sole responsibility of programmers
Coding can be an important factor in product quality…. but it isn’t the only
factor
Quality isn’t simply an ingredient in our product’s recipe
3www.richrtesting.com
4. Think about
Quality…
Why ‘Thinking Quality In’?
…we need to think (and talk) about quality at every stage
of a product’s life, from concept to delivery, and beyond.
4
To ‘think quality in’….
Concept
Design
Development
Testing
Deployment
Support
Maintenance
Enhancement
www.richrtesting.com
5. Purpose – Why we are here today
5
1) To better understand what Quality means
2) To consider a more human perspective on
quality.
3) To provide some practical ways to think and
talk about quality in your work place.
And… what do you want to get out of the day?
www.richrtesting.com
9. Is this Quality?
A description to consider:
a mode of transport
a range of pricing options for customers
clean and comfortable
appealing features
entertainment during your journey
the very latest technological advances
9www.richrtesting.com
10. Is this Quality?
A description to consider:
a mode of transport
a range of pricing options for customers
clean and comfortable
appealing features
entertainment during your journey
the very latest technological advances
10www.richrtesting.com
11. Is this Quality?
A description to consider:
a mode of transport
a range of pricing options for customers
clean and comfortable
appealing features
entertainment during your journey
the very latest technological advances
11www.richrtesting.com
12. Is this Quality?
A description to consider:
a mode of transport
a range of pricing options for customers
clean and comfortable
appealing features
entertainment during your journey
the very latest technological advances
12www.richrtesting.com
13. Is this Quality?
Another description to consider:
a game for mobile devices
frequent crashes and lost data
poor response and availability
scaling problems and overloaded servers
drains the battery on Android devices
iOS security flaws
13www.richrtesting.com
14. Is this Quality?
Another description to consider:
a game for mobile devices
frequent crashes and lost data
poor response and availability
scaling problems and overloaded servers
drains the battery on Android devices
iOS security flaws
(most downloaded game of 2016
on both Android and iOS)
14www.richrtesting.com
15. Quality is subjective and variable, but are there
examples of products which might be (or have
been) perceived as high quality?
15www.richrtesting.com
16. Quality is subjective and variable, but are there
examples of products which might be (or have
been) perceived as poor quality?
16www.richrtesting.com
17. Group Exercise: “Quality Is….”
A task for small groups:
You have ten minutes to discuss Quality, then to complete
the sentence “Quality is…..” in no more than twenty words.
We will then ask each group to read out their definition.
Now, can we agree on a definition across the whole group?
Difficult, isn’t it?
17
18. Famous Definitions of Quality
“Degree to which a set of inherent characteristics
fulfills requirements.”
ISO 9000 Standard [2]
References:
[1] https://web.archive.org/web/20071018022809/http://www.motorola.com/content.jsp?globalObjectId=3074-5804
[2] ISO 9000:2005, Quality management systems -- Fundamentals and vocabulary
"Six Sigma Quality is a level of quality that
represents only 3.4 defects per million
opportunities"
Motorola University Six Sigma Dictionary [1]
18www.richrtesting.com
19. Famous Definitions of Quality
“Quality is conformance to requirements.”
Philip B. Crosby [3]
"Quality in a product or service is not what the
supplier puts in. It is what the customer gets
out and is willing to pay for."
Peter Drucker [4]
"Quality is value to some person."
Gerald Weinberg [5]
References:
[3] ‘Quality is Free’ by Philip Crosby - ISBN 0-07-014512-1
[4] ‘Innovation and entrepreneurship’ by Peter Drucker - ISBN 978-0-06-091360-1
[5] ‘Quality Software Management Volume 1. Systems Thinking’ by Gerald M. Weinberg - ISBN 978-0-932633-72-9
19www.richrtesting.com
20. Quotes about Quality
D - “Quality is
the best
business plan.”
E - “Quality
is not an act.
It is a habit”
B - “Quality
means doing it
right when no
one is looking.”
C- “If you do things
well, do them better.
Be daring, be first, be
different, be just.”
A -“Good
enough
never is.”
20
Aristotle,
Greek philosopher
1
John Lasseter,
Pixar
2
Henry Ford,
Industrialist
3
Debbi Fields,
Mrs. Fields Cookies
4
Anita Roddick,
The Body Shop
5
www.richrtesting.com
21. Quotes about Quality
21Aristotle
1
John Lasseter
2
Henry Ford
3
Debbi Fields
4
Anita Roddick
5
D - “Quality is
the best
business plan.”
E - “Quality
is not an act.
It is a habit”
B - “Quality
means doing it
right when no
one is looking.”
C- “If you do things
well, do them better.
Be daring, be first, be
different, be just.”
A -“Good
enough
never is.”
www.richrtesting.com
22. Examples of Quality Criteria –
Heuristic Test Strategy Model
22
http://www.satisfice.com/tools/htsm.pdf
23. Other Examples of Quality Criteria
23
Accessibility
Archiving
Auditability
Authentication Authorisation
Availability
Compatibility
Configurability
Continuity
Data Integrity
& Consistency
Data Privacy
Distributability
Extensibility
Help & Support
Installability &
Deployment
Integratability &
Interoperability
Legal
Compliance
Leverageability
& Reuse
Localisation &
Internationalisation
Multiple
Environment Support
Partition
Tolerance
Performance
Portability
Reliability Resilience &
Fault Tolerance
Scalability
Security
Supportability
Usability &
User Experience
Versioning &
Upgradability
www.richrtesting.com
26. Case Studies – Task Summary
26
• Which quality criteria are likely to be important? You can
make use of those we discussed earlier today to come up
with a list. Your team is to identify up to 16 criteria which
you want to consider?
• Once you have done so, talk through the risks associated
with each of the criteria in the context of the case study.
• How likely is it that there will be problems relating to each
of the criteria? If there are problems, how serious would
this be?
www.richrtesting.com
27. Case Studies – Task Summary Part 2
27
• Once you have done this, we will work through a ‘budget’
exercise. Which of the criteria do you want to spend your
budget on?
www.richrtesting.com