The document discusses the Hypothesis Based Testing (HBT) methodology, emphasizing its six-stage evaluation model to validate software effectively and efficiently. It highlights the importance of automating testing processes, addressing common challenges organizations face in selecting and investing in appropriate tools. The conclusion outlines a structured approach for tooling assessment and automation strategy, ensuring improved software quality.

1. 3 W’S BOTHERING MANAGEMENT
WHY, WHAT AND WHEN TO
AUTOMATE?
M C Nagaraj
Director – Customer Excellence
in.linkedin.com/in/mcnagaraj

2. Hypothesis Based Testing (HBT)
A goal focused methodology to validation
Six-stage evaluation model (S1-S6)
S6 S1
Assess & Understand The central theme of HBT is
ANALYZE EXPECTATIONS “hypothesize potential defects that
can cause loss of expectations
and
S5 Tooling HBT
Understand
S2 prove that they will not exist”
SUPPORT CONTEXT
Devise Formulate The focus is on the goal and
PROOF HYPOTHESIS
how we shall achieve it
rather than the various activities
S3 S3
“goal-centric vs. activity-based”
Copyright STAG Software Private Limited, 2009 2

3. HBT and STEM
“outcome”
‘deliver clean software
S6 S1 GOAL quickly & cost-effectively’
Assess & Understand
ANALYZE EXPECTATIONS
D8 D1
Tooling D7 D2
S5
SUPPORT
STEM Understand
S2 “methodology”
D6 D3 CONTEXT
HBT a system of ways of doing
D5 D4
‘goal centered scientific
approach to validation’
Devise Formulate
PROOF HYPOTHESIS
S3 S3 “method”
STEM
a particular way of doing something
‘defect detection technology
from STAG’
Copyright STAG Software Private Limited, 2009 3

4. HBT - six stage personal test methodology
• Key focus in each stage
• Empowered by scientific approach using eight
disciplines (D1 to D8) of STEM
• 32 core concepts address factors like effectiveness,
consistency, scalability, efficiency, visibility and
agility of test methodology
• The outcome of each stage are well defined
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 4

5. HBT Stage 5 (Tooling)
Key focus: STEM discipline D5(Tooling)
Problems addressed:
• Organization is not sure on which tool they should make investment
• Functional test or non-functional test or both? What to automate?
• We have so many test cases. Where to start focusing on automation?
• We had excellent automation team who did some automation but not
working on latest version of product but no band width to look at it
• We have legacy tool used for automation it is not supported by vendor
anymore. Can we port it to another tool?
• Open source / commercial tools? Which will fit our automation strategy?
• Can you help us accelerate our automation project?
• Many things automated but product quality is still a concern!
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 5

6. Summary
Using D5 (Tooling ) we were able to address problems stated in
previous slides
• This discipline has well defined 7 steps for Functionality
assessment tooling and 6 steps for NF (LSPS – Load, Stress,
Performance and Scalability) assessment tooling
• Key deliverables: Needs and benefits document, Complexity
assessment report, Automation architecture, Tool
requirements, Automation phasing and scope, Automated
scripts
• STEM core concepts: Automation complexity assessment,
Minimal baby sitting principle, Clear separation of concerns
principle, Tooling needs analysis
Achieve effectiveness first before looking at efficiency. Certain test we
cannot execute manually
Copyright 2011. STAG Software Pvt Ltd. All rights reserved. 6

7. Thank You
Email ID: nagaraj@stagsoftware.com
@mcnagaraj
Copyright STAG Software Pvt. Ltd., 2011