How do you get product managers to understand the non-functional metrics are as important as the features of their product? How do you identify who owns which metrics and therefore provide stewardship to the whole process of metrics and business value? Shilpa digs deep in this final session of her 3-part series.

1. www.xbosoft.com
Webinar
March 20 2014 11.00 AM EST
You are at the right
place, it’s almost
time….10 minute
countdown

2. 2

3. WELCOME
XBOSOFT Software Quality
Knowledge Center is proud to
partner with and introduce
Shilpa Dadhwal
CEO and Founder
SQE Labs, Inc.

4. On the call
Shilpa Dadhwal, Philip Lew and Jan Princen
Moderator: Carolyn Choh
Shilpa Dadhwal,
Founder and CEO,
SQE Labs Inc
Philip Lew
CEO,
XBOSoft
Jan Princen
Managing Director,
XBOSoft

5. Agenda
• Introduction XBOsoft
• Software Quality – Quick recap of Day 1 and 2
• Software quality models
• Advantages and impact of using them
• Moving on to Day 3
– Barriers and issues to business of software quality
– Implications for Senior Management for setting
guidelines
– Implications for Project Management for best
practices
• Q and A
• Today’s meeting March 20th
https://www3.gotomeeting.com/register/886356774

6. • Specialize in: Software Quality
Improvement
• Quality Process Improvement &
Testing
• American Company
• Located in: San Francisco, Amsterdam
& Beijing
• Over 100 Software Quality Experts
XBOSoft Introduction

7. “Proven Results”
“Our products are very complex. We expected a one
year ramp up time, but XBO was able to contribute to
our release cycles in just 6 months. ."
- Development Vice President, Hyperion-
Oracle
“
"The results are very encouraging. Thanks a lot for all the effort put
into this project. We really appreciate your work."
- Manager, Quality Assurance, Autodesk
"Everything you've done is impressive and we are quite pleased with the
quality of the test cases, well done!
So keep up the good work."
- QA Director, CA

8. Welcome to the Session 3 on
‘Measuring Software Quality –
Its Economic Value’
Shilpa Dadhwal
Founder & Director
SQE Labs Inc.
Skype ID : shilpa2d
Email ID : shilpa@sqelabs.com
Presentated By:

9. SQE Labs offers an independent Software Testing and Quality
Assurance services and is committed to improving quality by
providing superior QA solutions to customers
About USA Specialist Independent Software Testing Solutions Provider
Team of Software Quality Engineering professionals having strong
Techno-functional knowledge
Provides services in the areas of Outsourced Software Testing,
Software Testing Consultancy and Software Testing Trainings
Having Offices in Texas (US) and Chandigarh (India)

10. What is Software Quality?
What is its Economic Value?
How to mange Software Quality?
What are its Attributes?
Why do we need to measure it?
How do we measure it?
Issues while measuring it?
Guidelines for measuring it?
A Specialist Independent Software Testing Solution Provider Questions in
Mind
Session 1
Session 2
Session 3

11. 1. QUALITY MODELS for defining Software Quality Attributes
2. ADVANTAGES of measuring Software Quality
3. IMPACT of ‘Software Quality’ on Business
4. BARRIERS to achieve ‘High’ Software Quality
5. ISSUES in measuring Software Quality
6. GUIDELINES for measuring Software Quality
7. PRACTICES to be followed
A Specialist Independent Software Testing Solution Provider
Agenda

12. “Quality is never an accident; it is always the result
of intelligent effort.”
– John Ruskin
RemarkA Specialist Independent Software Testing Solutions Provider

13. QuestionsA Specialist Independent Software Testing Solutions Provider
 Do you know the most critical Software Quality
Attribute for your product/service?
 Do you know how to measure the identified Software
Quality Attribute?
 Are you able to make right decisions, after measuring
the critical Software Quality Attribute?
If any of the above answer is ‘No’, then …….

14. A quality model is a specification of the required characteristics that a software
system must exhibit
A quality model that defines quality attributes precisely improves
communications between acquirers, architects, and developers.
A quality model that specifies usable and practical metrics can improve the
quality of design models.
Effective application of a quality model adds more quality control earlier in the
project’s life cycle
Validate the completeness of a requirements definition
Identifies user acceptance criteria for a completed software product
Identifies software requirements
Identifies software design objectives
Identifies software testing objectives
Quality ModelsA Specialist Independent Software Testing Solutions Provider

15. Several quality models have been developed over the years.
McCall/GE Quality Model
• Organizes quality around three uses of software: product revision,
product operations, and product transition
Boehm Quality Model
• Shares a common subset with the McCall model and identifies
additional quality attributes
ISO/IEC 9126-1:2001 Quality Standard
• Identifies six quality characteristics – functionality, reliability,
usability, efficiency, maintainability, and portability. These are
further divided into several sub-characteristics
Quality ModelsA Specialist Independent Software Testing Solutions Provider

16. McCall’s Traingle
for Quality
An Independent Software Testing Solution Provider
PRODUCT REVISIONPRODUCT REVISION PRODUCT TRANSITIONPRODUCT TRANSITION
PRODUCT OPERATIONPRODUCT OPERATION
• Maintainability
• Flexibility
• Testability
• Portability
• Reusability
• Interoperability
• Correctness
• Usability
• Reliability
• Efficiency
• Integrity
Ability to change Adaptability to new environments
Basic operational characteristic
Factors (characteristics) describe the external view of the software as viewed
by users of the application

17. McCall’s Traingle
for Quality
The model details three types of quality characteristics (major
perspectives) in a hierarchy of factors, criteria and metrics:
11 Factors (To specify): They describe the external view of the
software, as viewed by the users.
23 quality criteria (To build): They describe the internal view of
the software, as seen by the developer.
Metrics (To control): They are defined and used to provide a
scale and method for measurement
A Specialist Independent Software Testing Solutions Provider

18. Factors (characteristics) describe the external view of the software as viewed
by users of the application
Boehm Quality
Model
A Specialist Independent Software Testing Solutions Provider

19. The high-level characteristics represent basic high-level requirements of
actual use to which evaluation of software quality could be put – the general
utility of software
The intermediate level characteristic represents Boehm’s 7 quality factors
that together represent the qualities expected from a software system
The primitive characteristics provide the foundation for defining qualities
metrics
Boehm Quality
Model
A Specialist Independent Software Testing Solutions Provider

20. ISO 9126 identifies the internal characteristics and external quality characteristics of
a software product and contains various characters.
ISO/IEC 9126-1:2001
Quality Standard
A Specialist Independent Software Testing Solutions Provider

21. Advantages of Measuring
Software Quality
High levels of defect removal efficiency
Happier customers
Better team morale
Shorter development schedules
Lower development costs
Lower maintenance costs and
Total cost of ownership (TCO) that will be less than 50% of the same
kinds of projects that botch up quality.
A Specialist Independent Software Testing Solutions Provider

22. Issues in Measuring
Software Quality
Cost of Collecting Metrics
• Automation is less costly than manual method
• CASE tool may not be free
• Development cost of the tool
• Extra execution time for collecting metrics
• Interpretation of metrics consumes resources
Validity of the metrics
• Does the metric really measure what it should?
• What exactly should be measured?
Selection of metrics for measurement
• Hundreds are available and with the same cost
A Specialist Independent Software Testing Solutions Provider

23. Impact of ‘Software
Quality’ on Business
Software Quality Income Expense
'High'
Software Quality
• More Customers
• Repeat Business
• Competitive Advantage
• Lower Production Cost
through reduced
inventory
• Lower Inspection Cost
• Lower Working Capital
'Low'
Software Quality
• Loss of Business
• Penalties for late delivery or
service
• Partial or late payments due
to customer dissatisfaction
• Scrap and rework cost
• Warranty Cost
• Sorting Cosy
• Express shipping cost
Profit = Income - Expense
A Specialist Independent Software Testing Solutions Provider

24. Barriers in Achieving
‘High’ Software Quality
Specifying Quality Requirements
• There has been little work in the field of formal specification for non-
functional requirements
Modeling Methods Don’t Address Quality Attributes
• Design methodologies are weak in representing nonfunctional
requirements
Designing for Quality Attributes
• Quality attributes are interdependent and cannot be achieved in
isolation
Solution Catalogues and Quality Attributes
• Design patterns can be used to address some quality attributes, but
mapping them to a design pattern’s context and problem statements is
not easy.
• It may be worthwhile to begin cataloguing patterns with respect to
standardized quality attributes
Quality Control is an Afterthought
• Putting testing off until the end of the project is effectively a statement
that quality is not important enough to be assessed early
A Specialist Independent Software Testing Solutions Provider

25. Guidelines
Use common sense and organizational sensitivity when interpreting metrics
data
Provide regular feedback to the individuals and teams who have worked to
collect measures and metrics.
Don’t use metrics to appraise individuals
Work with practitioners and teams to set clear goals and metrics that will be
used to achieve them
Never use metrics to threaten individuals or teams
Metrics data that indicate a problem area should not be considered
“negative.” These data are merely an indicator for process improvement
Don’t obsess on a single metric to the exclusion of other
important metrics
A Specialist Independent Software Testing Solutions Provider

26. Practices to improve
Software Quality
A Specialist Independent Software Testing Solutions Provider
Sl.
No
Practice Impact on
Quality
Benefit Relevant
Roles
1 Define Quality
Attribute to match
your needs
• Meet business
Requirements
• Achieve a satisfying
user experience
Development team is
chartered with a
definition of quality that
fits the given time,
resource and budget
constraints
• Business
Stakeholders
• Development
Team
2. Broadcast simple
quality metrics
Reduce defects Highly visible quality
metrics keeps quality on
the top of the mind for
the entire team and
exposes when the effort
falls short
Development Team
3. Fine tune team and
individual goals to
include quality
• Meet business
Requirements
Achieve a satisfying
user experience
Reduce defects
Team members perform
according to their
incentives; thus making
quality improvement part
of their goals reinforces
desirable behaviour
Management

27. Practices to improve
Software Quality
A Specialist Independent Software Testing Solutions Provider
Sl.
No
Practice Impact on
Quality
Benefit Relevant
Roles
4. Get requirements
right
• Meet business
Requirement
• Achieve a
satisfying user
experience
Less rework means less retesting
and fewer cycles, which greatly
reduces overall effort
• Managers
• Business
Analysts
• User Experience
designers
• Architects
5. Test smarter to
test less
Reduce defects • Focussing testing on the
most important and most
riskiest areas ensures that
the bugs that slip through
are likely to be confined to
the least important features
• Use Testing tools
• Quality
Assurance
• Managers
6. Design
applications to
lessen bug risks
Reduce defects Simple, cleaner designs results in
code that is simpler, cleaner and
easier to test and rework- which
means that the code will have
fewer bugs and those bugs found
will be easier to diagnose and
repair
• Architects
• Developers

28. Step 1: IDENTIFY the key ‘Software Quality’ attribute(s) for your product/service
Step 2: Identify the METRIC which can be used to measure the identified
‘Software Quality’ attribute(s)
Step 3: Devise PLAN to measure the Metric for each key ‘Software Quality’
attribute
Step 4: IMPLEMENT the plan to measure the metric during the course of the
software development lifecycle
Step 5: MONITOR the Metric and publish the results to all the affected
stakeholders
Step 6: If the results are not within acceptable limits, devise an action plan to
further IMPROVE it and go back to Step 4 till the Software Quality
Attribute measured is acceptable
Next Step…A Specialist Independent Software Testing Solutions Provider

29. What is Software Quality?
What is its Economic Value?
How to mange Software Quality?
What are its Attributes?
Why do we need to measure it?
How do we measure it?
Issues while measuring it?
Guidelines for measuring it?
A Specialist Independent Software Testing Solution Provider Questions
Answered
Session 1
Session 2
Session 3

30. A Specialist Independent Software Testing Solution Provider
Remember…
Commitment to QUALITY always pays off

31. Thank YouA Specialist Independent Software Testing Solutions Provider
India Office
SQE Labs Inc.
116/8, Mohali (Chandigarh)
India – 160062
www.sqelabs.com
US Office
SQE Labs LLC,
6533, Preston Rd, Plano,
TX - 75024
Contact me : shilpa@sqelabs.com

32. Follow: @XBOSoft
Questions: services@xbosoft.com
408-350-0508

33. Thank You!
See you tomorrow
Tomorrow’s meeting March 20th
https://www3.gotomeeting.com/register/886356774
Shilpa Dadhwal,
Founder and CEO,
SQE Labs Inc
Philip Lew
CEO,
XBOSoft
Jan Princen
Managing Director,
XBOSoft