The document outlines the hypothesis-based testing (HBT) methodology, focusing on a six-stage evaluation model aimed at delivering clean software efficiently. It emphasizes a goal-centric approach to validation and the need for systematic measurements to enhance software development processes. Key challenges addressed include decision-making speed, measurement consistency, and data visibility during project reviews.

1. DESIGNING RIGHT SET OF
MEASUREMENTS
M C Nagaraj
Director – Customer Excellence
in.linkedin.com/in/mcnagaraj

2. Hypothesis Based Testing (HBT)
A goal focused methodology to validation
Six-stage evaluation model (S1-S6)
S6 S1
Assess & Understand The central theme of HBT is
ANALYZE EXPECTATIONS “hypothesize potential defects that
can cause loss of expectations
and
S5 Tooling HBT
Understand
S2 prove that they will not exist”
SUPPORT CONTEXT
Devise Formulate The focus is on the goal and
PROOF HYPOTHESIS
how we shall achieve it
rather than the various activities
S3 S3
“goal-centric vs. activity-based”
Copyright STAG Software Private Limited, 2009 2

3. HBT and STEM
“outcome”
‘deliver clean software
S6 S1 GOAL quickly & cost-effectively’
Assess & Understand
ANALYZE EXPECTATIONS
D8 D1
Tooling D7 D2
S5
SUPPORT
STEM Understand
S2 “methodology”
D6 D3 CONTEXT
HBT a system of ways of doing
D5 D4
‘goal centered scientific
approach to validation’
Devise Formulate
PROOF HYPOTHESIS
S3 S3 “method”
STEM
a particular way of doing something
‘defect detection technology
from STAG’
Copyright STAG Software Private Limited, 2009 3

4. HBT - six stage personal test methodology
• Key focus in each stage
• Empowered by scientific approach using eight
disciplines (D1 to D8) of STEM
• 32 core concepts address factors like effectiveness,
consistency, scalability, efficiency, visibility and
agility of test methodology
• The outcome of each stage are well defined
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 4

5. HBT Stage 4 (Devise Proof)
Key focus: STEM discipline to design right set of
measurements D6(Visibility)
Problems addressed:
• Unable to take objective decision fast
• Too many measurements collected
• Inconsistency in getting data on planned measurements from all projects
• Key aspects to watch in reviews and related measurements link missing
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 5

6. Summary
Using D6 (Visibility ) we were able to address problems stated
in previous slides
• This discipline has well defined five steps
• Key deliverables: List of measurements, place and frequency
to collect them
• STEM core concepts: GQM, Quality quantification model
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 6

7. Thank You
Email ID: nagaraj@stagsoftware.com
@mcnagaraj
Copyright STAG Software Pvt. Ltd., 2011