SlideShare a Scribd company logo
Ashok Thiruvengadam
Founder & CEO
www.STAGSoftware.com
www.linkedin.com/in/ashokstag
7 Thinking Tools
to Test Rapidly
SmartQA Series Webinar
2
Manual testing | Automated testing
Two phrases that some people use to describe our practice
Jeez, they have a terrible way with words!
3
It is time we used Intellectual | Tool-supported
3
It is time we used Intellectual | Tool-supported
Think well. Exploit tools to do.
4
In current times, speed is everything, right?
4
In current times, speed is everything, right?
What can we do test quickly ?
Use tools.Automate. Right?
4
In current times, speed is everything, right?
Wait a minute!
This is about execution, right?
What about prior activities?
What can we do test quickly ?
Use tools.Automate. Right?
5
to answer, let us ask the basic question
what is testing after all?
6
testing is exploration
7
testing is scientific exploration
7
testing is scientific exploration
and exploration is a human activity
aided by tools & technology
8
how can we do
scientific exploration rapidly?
8
how can we do
scientific exploration rapidly?
by using tools that help us
think better and do faster
9
we all know about
a variety of test tools that help us automate
system setup, execution, static analysis, report, manage…
at different phases of lifecycle to “do faster”
9
we all know about
a variety of test tools that help us automate
system setup, execution, static analysis, report, manage…
at different phases of lifecycle to “do faster”
let’s examine tools that help us
“think better”
10
what is the first thing you do
before you embark on an exploration?
do a survey “reconnaissance"
11
Tool #1: Landscaper
do survey, understand the big picture
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
e.g ELearning system
Persona
Administrator
Student
Supervisor
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
e.g ELearning system
Persona
Administrator
Student
Supervisor
Feature
Create User
Upload content
Requirement
Go through lessons in courses
Take final assessment
Flow
Complete course, by taking it and
doing the final assessment
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
attributes
what do you
want to test for
e.g ELearning system
Persona
Administrator
Student
Supervisor
Feature
Create User
Upload content
Requirement
Go through lessons in courses
Take final assessment
Flow
Complete course, by taking it and
doing the final assessment
Migration
All course info of 2.5, 2.7, 3.0
to be ‘migrate-able’
Performance
Video streaming should
commence in a max of 2s with
500 concurrent users.
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
attributes
what do you
want to test for
environment
where do you
want to test on?
e.g ELearning system
Persona
Administrator
Student
Supervisor
Environment
OS Mac,Windows, Linux
Browser Firefox, Chrome, IE11
Database Mongo,MySQL,PostgreSQL
MobileOS Android,IOS
Device Laptop,Tablet,Mobile
Feature
Create User
Upload content
Requirement
Go through lessons in courses
Take final assessment
Flow
Complete course, by taking it and
doing the final assessment
Migration
All course info of 2.5, 2.7, 3.0
to be ‘migrate-able’
Performance
Video streaming should
commence in a max of 2s with
500 concurrent users.
12
now that you have done the survey,
what next?
12
now that you have done the survey,
what next?
create maps
to guide you and chalk out routes
13
Tool #2: Persona map
map out who uses what
who uses what
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
13
Tool #2: Persona map
map out who uses what
who uses what
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
14
Tool #3: Scope map
map out user’s expectations
attributes
what do you
want to test for
what-to-test-for-what
entities
what do to you
want to test
component, features
requirements.flows
14
Tool #3: Scope map
map out user’s expectations
attributes
what do you
want to test for
what-to-test-for-what
entities
what do to you
want to test
component, features
requirements.flows
Migration
Security
Performance
Load
15
Tool #4: Interaction map
map out what may affect what, to intelligently regress
entities
what do you
want to test
component, features
requirements, flows
F1 —> F2
F1 —> Flow3
15
Tool #4: Interaction map
map out what may affect what, to intelligently regress
entities
what do you
want to test
component, features
requirements, flows
F1 —> F2
F1 —> Flow3
16
Tool #5: Environment map
map out environments to test on
environment
where do you
want to test on?
Env #1
Env #2
…
16
Tool #5: Environment map
map out environments to test on
environment
where do you
want to test on?
Env #1
Env #2
…
17
now that we have the maps, what do we do next?
17
chalk out the routes
i.e. “test design” - come up with scenarios.
now that we have the maps, what do we do next?
Now you are ready to explore.
18
Tool #6: Scenario creator
create test scenarios
L4: Behaviour correctness
L1: Input correctness
L3: Structural integrity
L2: Interface correctness
L5: Flow correctness
L6: Environment correctness
L7: Attribute correctness
L8: Deployment correctness
L9: End user value
18
component test scenarios
feature test scenarios
requirement test scenarios
flow test scenarios
use techniques
use experience
be creative
learn and revise
use smart checklists
level-wise
Robust Test Design powered by HBT
(Hypothesis Based Testing)
18
Tool #6: Scenario creator
create test scenarios
L4: Behaviour correctness
L1: Input correctness
L3: Structural integrity
L2: Interface correctness
L5: Flow correctness
L6: Environment correctness
L7: Attribute correctness
L8: Deployment correctness
L9: End user value
18
component test scenarios
feature test scenarios
requirement test scenarios
flow test scenarios
use techniques
use experience
be creative
learn and revise
use smart checklists
level-wise
Robust Test Design powered by HBT
(Hypothesis Based Testing)
Table 1
(L4) Func. Behavior
Close a unresolved question
Re-open a closed question
Reply to an open unresolved
question
Edit reply for a question
Table 1-1
(L1) Input validation
Null inputs
Beyond boundaries
Duplicate values
19
now you are ready to explore
20
understand that
a map is not the terrain
as you explore, observe, learn, adapt, improvise, refine
21
observe, learn, adapt, improvise, refine
21
observe, learn, adapt, improvise, refine
persona entities
attributes environment
…the landscape
persona map scope map
interaction map environment map
…the maps
L4: Behaviour correctness
L1: Input correctness
L3: Structural integrity
L2: Interface correctness
L5: Flow correctness
L6: Environment correctness
L7: Attribute correctness
L8: Deployment correctness
L9: End user value
…the routes
22
ok, what next?
rest and recover
i.e. stop, analyse and refine
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
Inputs
1. Attributes considered?
2. Environ. considered?
3. Scenarios at all levels?
4. +/- distribution ok?
5. All personas covered?
Use Maps+Routes
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
Inputs
1. Attributes considered?
2. Environ. considered?
3. Scenarios at all levels?
4. +/- distribution ok?
5. All personas covered?
Use Maps+Routes
1. wrt attributes
2. wrt attributes
3. wrt entities
4. wrt interactions
5. wrt persona
Use Maps+Routes+Exec Info
Activities (plan vs.actual)
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
Inputs
1. Attributes considered?
2. Environ. considered?
3. Scenarios at all levels?
4. +/- distribution ok?
5. All personas covered?
Use Maps+Routes
1. wrt attributes
2. wrt attributes
3. wrt entities
4. wrt interactions
5. wrt persona
Use Maps+Routes+Exec Info
Activities (plan vs.actual)
1. wrt attributes
2. wrt attributes
3. wrt entities
4. wrt interactions
5. wrt persona
Use Maps+Routes+Exec Info
Outcomes
24
let’s summarise
our scientific exploration
using the ”7 Tools to Think Better”
25
25
Tool #1: Landscaper
do survey, understand the big picture
Tool #5: Environment map
map out environments to test on
Tool #2: Persona map
map out who uses what
Tool #4: Interaction map
map out what may affect what
Tool #3: Scope map
map out user’s expectations
Reconnaissance
do survey, make maps
Tool #6: Scenario creator
create test scenarios
Exploration
observe, search, learn, refine
Tool #7: Dashboard
stop, analyse and refine
Rest and recover
stop, analyse and refine
26
so how can one apply this?
IMMERSIVE SESSION TESTING “IST”
Reconnaissance
Exploration
Rest & Recover
S1 S2
S3
S4
S5
done in sessions of 60-90 minsconsists of THREE phases
from STAG Software
by using
a session based approach based on Hypothesis Based Testing
28
the tools outlined here and more will be
available as a SaaS tool doSmartQA shortly
we are keen to trial this with select users
email me if you are interested
‘ash at stagsoftware dot com’
testing is scientific exploration
7 Thinking Tools
to Test Rapidly
SmartQA Series Webinar
doSmartQA SaaS tool
email me if you are interested
‘ash at stagsoftware dot com’

More Related Content

What's hot

Shift left-testing
Shift left-testingShift left-testing
Shift left-testing
Alan Richardson
 
Software Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical SciencesSoftware Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical SciencesAron Ahmadia
 
Human-centric Software Development Tools
Human-centric Software Development ToolsHuman-centric Software Development Tools
Human-centric Software Development Tools
Gail Murphy
 
Sentiment Analysis in R
Sentiment Analysis in RSentiment Analysis in R
Sentiment Analysis in R
Edureka!
 
Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013Aron Ahmadia
 
Rita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
Rita Bush - How to Use Games to Mitigate Cognitive Bias in AnalysisRita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
Rita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
SeriousGamesAssoc
 

What's hot (6)

Shift left-testing
Shift left-testingShift left-testing
Shift left-testing
 
Software Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical SciencesSoftware Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical Sciences
 
Human-centric Software Development Tools
Human-centric Software Development ToolsHuman-centric Software Development Tools
Human-centric Software Development Tools
 
Sentiment Analysis in R
Sentiment Analysis in RSentiment Analysis in R
Sentiment Analysis in R
 
Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013
 
Rita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
Rita Bush - How to Use Games to Mitigate Cognitive Bias in AnalysisRita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
Rita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
 

Similar to Seven Thinking Tools to Test Rapidly

Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
 Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
VijiPriya Jeyamani
 
An Introduction to Usability
An Introduction to UsabilityAn Introduction to Usability
An Introduction to Usability
dirk.swart
 
Software engg. pressman_ch-12
Software engg. pressman_ch-12Software engg. pressman_ch-12
Software engg. pressman_ch-12Dhairya Joshi
 
Don't Fear the User
Don't Fear the UserDon't Fear the User
Don't Fear the User
Jacob Geib-Rosch
 
The UX Toolbelt for Developers
The UX Toolbelt for DevelopersThe UX Toolbelt for Developers
The UX Toolbelt for Developers
Sarah Dutkiewicz
 
World Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for DevelopersWorld Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for Developers
Sarah Dutkiewicz
 
UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017
Gary Coker
 
UX Activities for Pet Wearable iOS Mobile App
UX Activities for Pet Wearable iOS Mobile AppUX Activities for Pet Wearable iOS Mobile App
UX Activities for Pet Wearable iOS Mobile App
Nicole Warner
 
Search Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and TechniquesSearch Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and Techniques
Alessandro Benedetti
 
Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques
Andrea Gazzarini
 
UX Workshop: How to design a product with great user experience
UX Workshop: How to design a product with great user experienceUX Workshop: How to design a product with great user experience
UX Workshop: How to design a product with great user experience
Raj Lal
 
Obj report
Obj reportObj report
Obj report
Manish Raghav
 
Intranet Usability Testing
Intranet Usability TestingIntranet Usability Testing
Intranet Usability Testing
John Sorflaten, PhD, CUXP
 
Humane assessment on cards
Humane assessment on cardsHumane assessment on cards
Humane assessment on cards
Tudor Girba
 
Tech. Writing Usability Presentation
Tech. Writing Usability PresentationTech. Writing Usability Presentation
Tech. Writing Usability Presentation
mhobren
 
Abcd iqs ssoftware-projects-mercecrosas
Abcd iqs ssoftware-projects-mercecrosasAbcd iqs ssoftware-projects-mercecrosas
Abcd iqs ssoftware-projects-mercecrosas
Merce Crosas
 
A Preliminary Field Study of Game Programming on Mobile Devices
A Preliminary Field Study of Game Programming on Mobile DevicesA Preliminary Field Study of Game Programming on Mobile Devices
A Preliminary Field Study of Game Programming on Mobile Devices
Tao Xie
 

Similar to Seven Thinking Tools to Test Rapidly (20)

Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
 Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
 
An Introduction to Usability
An Introduction to UsabilityAn Introduction to Usability
An Introduction to Usability
 
Software engg. pressman_ch-12
Software engg. pressman_ch-12Software engg. pressman_ch-12
Software engg. pressman_ch-12
 
kritika_resume2
kritika_resume2kritika_resume2
kritika_resume2
 
Don't Fear the User
Don't Fear the UserDon't Fear the User
Don't Fear the User
 
The UX Toolbelt for Developers
The UX Toolbelt for DevelopersThe UX Toolbelt for Developers
The UX Toolbelt for Developers
 
203CR Portfolio 2 UCD
203CR Portfolio 2  UCD203CR Portfolio 2  UCD
203CR Portfolio 2 UCD
 
World Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for DevelopersWorld Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for Developers
 
UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017
 
UX Activities for Pet Wearable iOS Mobile App
UX Activities for Pet Wearable iOS Mobile AppUX Activities for Pet Wearable iOS Mobile App
UX Activities for Pet Wearable iOS Mobile App
 
Search Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and TechniquesSearch Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and Techniques
 
Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques
 
UX Workshop: How to design a product with great user experience
UX Workshop: How to design a product with great user experienceUX Workshop: How to design a product with great user experience
UX Workshop: How to design a product with great user experience
 
Obj report
Obj reportObj report
Obj report
 
Intranet Usability Testing
Intranet Usability TestingIntranet Usability Testing
Intranet Usability Testing
 
Sais svcc
Sais svccSais svcc
Sais svcc
 
Humane assessment on cards
Humane assessment on cardsHumane assessment on cards
Humane assessment on cards
 
Tech. Writing Usability Presentation
Tech. Writing Usability PresentationTech. Writing Usability Presentation
Tech. Writing Usability Presentation
 
Abcd iqs ssoftware-projects-mercecrosas
Abcd iqs ssoftware-projects-mercecrosasAbcd iqs ssoftware-projects-mercecrosas
Abcd iqs ssoftware-projects-mercecrosas
 
A Preliminary Field Study of Game Programming on Mobile Devices
A Preliminary Field Study of Game Programming on Mobile DevicesA Preliminary Field Study of Game Programming on Mobile Devices
A Preliminary Field Study of Game Programming on Mobile Devices
 

More from STAG Software Private Limited

Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"
STAG Software Private Limited
 
Choked by technical debt?
Choked by technical debt?Choked by technical debt?
Choked by technical debt?
STAG Software Private Limited
 
Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
STAG Software Private Limited
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
STAG Software Private Limited
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
STAG Software Private Limited
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
STAG Software Private Limited
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
STAG Software Private Limited
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
STAG Software Private Limited
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
STAG Software Private Limited
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
STAG Software Private Limited
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
STAG Software Private Limited
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
STAG Software Private Limited
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
STAG Software Private Limited
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
STAG Software Private Limited
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
STAG Software Private Limited
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
STAG Software Private Limited
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
STAG Software Private Limited
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
STAG Software Private Limited
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
STAG Software Private Limited
 
Regression Suite Optimization
Regression Suite OptimizationRegression Suite Optimization
Regression Suite Optimization
STAG Software Private Limited
 

More from STAG Software Private Limited (20)

Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"
 
Choked by technical debt?
Choked by technical debt?Choked by technical debt?
Choked by technical debt?
 
Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 
Regression Suite Optimization
Regression Suite OptimizationRegression Suite Optimization
Regression Suite Optimization
 

Recently uploaded

Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Jay Das
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Mind IT Systems
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
Paco van Beckhoven
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
Srikant77
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
Donna Lenk
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Natan Silnitsky
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
informapgpstrackings
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
AMB-Review
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
Philip Schwarz
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Globus
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
Fermin Galan
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
XfilesPro
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
Tier1 app
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
abdulrafaychaudhry
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Adele Miller
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
Ortus Solutions, Corp
 

Recently uploaded (20)

Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
 
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdfDominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
Dominate Social Media with TubeTrivia AI’s Addictive Quiz Videos.pdf
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
 
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
Innovating Inference - Remote Triggering of Large Language Models on HPC Clus...
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, BetterWebinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
 
Into the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdfInto the Box 2024 - Keynote Day 2 Slides.pdf
Into the Box 2024 - Keynote Day 2 Slides.pdf
 

Seven Thinking Tools to Test Rapidly

  • 1. Ashok Thiruvengadam Founder & CEO www.STAGSoftware.com www.linkedin.com/in/ashokstag 7 Thinking Tools to Test Rapidly SmartQA Series Webinar
  • 2. 2 Manual testing | Automated testing Two phrases that some people use to describe our practice Jeez, they have a terrible way with words!
  • 3. 3 It is time we used Intellectual | Tool-supported
  • 4. 3 It is time we used Intellectual | Tool-supported Think well. Exploit tools to do.
  • 5. 4 In current times, speed is everything, right?
  • 6. 4 In current times, speed is everything, right? What can we do test quickly ? Use tools.Automate. Right?
  • 7. 4 In current times, speed is everything, right? Wait a minute! This is about execution, right? What about prior activities? What can we do test quickly ? Use tools.Automate. Right?
  • 8. 5 to answer, let us ask the basic question what is testing after all?
  • 10. 7 testing is scientific exploration
  • 11. 7 testing is scientific exploration and exploration is a human activity aided by tools & technology
  • 12. 8 how can we do scientific exploration rapidly?
  • 13. 8 how can we do scientific exploration rapidly? by using tools that help us think better and do faster
  • 14. 9 we all know about a variety of test tools that help us automate system setup, execution, static analysis, report, manage… at different phases of lifecycle to “do faster”
  • 15. 9 we all know about a variety of test tools that help us automate system setup, execution, static analysis, report, manage… at different phases of lifecycle to “do faster” let’s examine tools that help us “think better”
  • 16. 10 what is the first thing you do before you embark on an exploration? do a survey “reconnaissance"
  • 17. 11 Tool #1: Landscaper do survey, understand the big picture
  • 18. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users e.g ELearning system Persona Administrator Student Supervisor
  • 19. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users entities what do you want to test component, features requirements, flows e.g ELearning system Persona Administrator Student Supervisor Feature Create User Upload content Requirement Go through lessons in courses Take final assessment Flow Complete course, by taking it and doing the final assessment
  • 20. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users entities what do you want to test component, features requirements, flows attributes what do you want to test for e.g ELearning system Persona Administrator Student Supervisor Feature Create User Upload content Requirement Go through lessons in courses Take final assessment Flow Complete course, by taking it and doing the final assessment Migration All course info of 2.5, 2.7, 3.0 to be ‘migrate-able’ Performance Video streaming should commence in a max of 2s with 500 concurrent users.
  • 21. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users entities what do you want to test component, features requirements, flows attributes what do you want to test for environment where do you want to test on? e.g ELearning system Persona Administrator Student Supervisor Environment OS Mac,Windows, Linux Browser Firefox, Chrome, IE11 Database Mongo,MySQL,PostgreSQL MobileOS Android,IOS Device Laptop,Tablet,Mobile Feature Create User Upload content Requirement Go through lessons in courses Take final assessment Flow Complete course, by taking it and doing the final assessment Migration All course info of 2.5, 2.7, 3.0 to be ‘migrate-able’ Performance Video streaming should commence in a max of 2s with 500 concurrent users.
  • 22. 12 now that you have done the survey, what next?
  • 23. 12 now that you have done the survey, what next? create maps to guide you and chalk out routes
  • 24. 13 Tool #2: Persona map map out who uses what who uses what persona who are the end users entities what do you want to test component, features requirements, flows
  • 25. 13 Tool #2: Persona map map out who uses what who uses what persona who are the end users entities what do you want to test component, features requirements, flows
  • 26. 14 Tool #3: Scope map map out user’s expectations attributes what do you want to test for what-to-test-for-what entities what do to you want to test component, features requirements.flows
  • 27. 14 Tool #3: Scope map map out user’s expectations attributes what do you want to test for what-to-test-for-what entities what do to you want to test component, features requirements.flows Migration Security Performance Load
  • 28. 15 Tool #4: Interaction map map out what may affect what, to intelligently regress entities what do you want to test component, features requirements, flows F1 —> F2 F1 —> Flow3
  • 29. 15 Tool #4: Interaction map map out what may affect what, to intelligently regress entities what do you want to test component, features requirements, flows F1 —> F2 F1 —> Flow3
  • 30. 16 Tool #5: Environment map map out environments to test on environment where do you want to test on? Env #1 Env #2 …
  • 31. 16 Tool #5: Environment map map out environments to test on environment where do you want to test on? Env #1 Env #2 …
  • 32. 17 now that we have the maps, what do we do next?
  • 33. 17 chalk out the routes i.e. “test design” - come up with scenarios. now that we have the maps, what do we do next? Now you are ready to explore.
  • 34. 18 Tool #6: Scenario creator create test scenarios L4: Behaviour correctness L1: Input correctness L3: Structural integrity L2: Interface correctness L5: Flow correctness L6: Environment correctness L7: Attribute correctness L8: Deployment correctness L9: End user value 18 component test scenarios feature test scenarios requirement test scenarios flow test scenarios use techniques use experience be creative learn and revise use smart checklists level-wise Robust Test Design powered by HBT (Hypothesis Based Testing)
  • 35. 18 Tool #6: Scenario creator create test scenarios L4: Behaviour correctness L1: Input correctness L3: Structural integrity L2: Interface correctness L5: Flow correctness L6: Environment correctness L7: Attribute correctness L8: Deployment correctness L9: End user value 18 component test scenarios feature test scenarios requirement test scenarios flow test scenarios use techniques use experience be creative learn and revise use smart checklists level-wise Robust Test Design powered by HBT (Hypothesis Based Testing) Table 1 (L4) Func. Behavior Close a unresolved question Re-open a closed question Reply to an open unresolved question Edit reply for a question Table 1-1 (L1) Input validation Null inputs Beyond boundaries Duplicate values
  • 36. 19 now you are ready to explore
  • 37. 20 understand that a map is not the terrain as you explore, observe, learn, adapt, improvise, refine
  • 38. 21 observe, learn, adapt, improvise, refine
  • 39. 21 observe, learn, adapt, improvise, refine persona entities attributes environment …the landscape persona map scope map interaction map environment map …the maps L4: Behaviour correctness L1: Input correctness L3: Structural integrity L2: Interface correctness L5: Flow correctness L6: Environment correctness L7: Attribute correctness L8: Deployment correctness L9: End user value …the routes
  • 40. 22 ok, what next? rest and recover i.e. stop, analyse and refine
  • 41. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system?
  • 42. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system? Inputs 1. Attributes considered? 2. Environ. considered? 3. Scenarios at all levels? 4. +/- distribution ok? 5. All personas covered? Use Maps+Routes
  • 43. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system? Inputs 1. Attributes considered? 2. Environ. considered? 3. Scenarios at all levels? 4. +/- distribution ok? 5. All personas covered? Use Maps+Routes 1. wrt attributes 2. wrt attributes 3. wrt entities 4. wrt interactions 5. wrt persona Use Maps+Routes+Exec Info Activities (plan vs.actual)
  • 44. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system? Inputs 1. Attributes considered? 2. Environ. considered? 3. Scenarios at all levels? 4. +/- distribution ok? 5. All personas covered? Use Maps+Routes 1. wrt attributes 2. wrt attributes 3. wrt entities 4. wrt interactions 5. wrt persona Use Maps+Routes+Exec Info Activities (plan vs.actual) 1. wrt attributes 2. wrt attributes 3. wrt entities 4. wrt interactions 5. wrt persona Use Maps+Routes+Exec Info Outcomes
  • 45. 24 let’s summarise our scientific exploration using the ”7 Tools to Think Better”
  • 46. 25
  • 47. 25 Tool #1: Landscaper do survey, understand the big picture Tool #5: Environment map map out environments to test on Tool #2: Persona map map out who uses what Tool #4: Interaction map map out what may affect what Tool #3: Scope map map out user’s expectations Reconnaissance do survey, make maps Tool #6: Scenario creator create test scenarios Exploration observe, search, learn, refine Tool #7: Dashboard stop, analyse and refine Rest and recover stop, analyse and refine
  • 48. 26 so how can one apply this?
  • 49. IMMERSIVE SESSION TESTING “IST” Reconnaissance Exploration Rest & Recover S1 S2 S3 S4 S5 done in sessions of 60-90 minsconsists of THREE phases from STAG Software by using a session based approach based on Hypothesis Based Testing
  • 50. 28 the tools outlined here and more will be available as a SaaS tool doSmartQA shortly we are keen to trial this with select users email me if you are interested ‘ash at stagsoftware dot com’
  • 51. testing is scientific exploration 7 Thinking Tools to Test Rapidly SmartQA Series Webinar doSmartQA SaaS tool email me if you are interested ‘ash at stagsoftware dot com’