SlideShare a Scribd company logo
1 of 51
Download to read offline
Ashok Thiruvengadam
Founder & CEO
www.STAGSoftware.com
www.linkedin.com/in/ashokstag
7 Thinking Tools
to Test Rapidly
SmartQA Series Webinar
2
Manual testing | Automated testing
Two phrases that some people use to describe our practice
Jeez, they have a terrible way with words!
3
It is time we used Intellectual | Tool-supported
3
It is time we used Intellectual | Tool-supported
Think well. Exploit tools to do.
4
In current times, speed is everything, right?
4
In current times, speed is everything, right?
What can we do test quickly ?
Use tools.Automate. Right?
4
In current times, speed is everything, right?
Wait a minute!
This is about execution, right?
What about prior activities?
What can we do test quickly ?
Use tools.Automate. Right?
5
to answer, let us ask the basic question
what is testing after all?
6
testing is exploration
7
testing is scientific exploration
7
testing is scientific exploration
and exploration is a human activity
aided by tools & technology
8
how can we do
scientific exploration rapidly?
8
how can we do
scientific exploration rapidly?
by using tools that help us
think better and do faster
9
we all know about
a variety of test tools that help us automate
system setup, execution, static analysis, report, manage…
at different phases of lifecycle to “do faster”
9
we all know about
a variety of test tools that help us automate
system setup, execution, static analysis, report, manage…
at different phases of lifecycle to “do faster”
let’s examine tools that help us
“think better”
10
what is the first thing you do
before you embark on an exploration?
do a survey “reconnaissance"
11
Tool #1: Landscaper
do survey, understand the big picture
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
e.g ELearning system
Persona
Administrator
Student
Supervisor
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
e.g ELearning system
Persona
Administrator
Student
Supervisor
Feature
Create User
Upload content
Requirement
Go through lessons in courses
Take final assessment
Flow
Complete course, by taking it and
doing the final assessment
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
attributes
what do you
want to test for
e.g ELearning system
Persona
Administrator
Student
Supervisor
Feature
Create User
Upload content
Requirement
Go through lessons in courses
Take final assessment
Flow
Complete course, by taking it and
doing the final assessment
Migration
All course info of 2.5, 2.7, 3.0
to be ‘migrate-able’
Performance
Video streaming should
commence in a max of 2s with
500 concurrent users.
11
Tool #1: Landscaper
do survey, understand the big picture
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
attributes
what do you
want to test for
environment
where do you
want to test on?
e.g ELearning system
Persona
Administrator
Student
Supervisor
Environment
OS Mac,Windows, Linux
Browser Firefox, Chrome, IE11
Database Mongo,MySQL,PostgreSQL
MobileOS Android,IOS
Device Laptop,Tablet,Mobile
Feature
Create User
Upload content
Requirement
Go through lessons in courses
Take final assessment
Flow
Complete course, by taking it and
doing the final assessment
Migration
All course info of 2.5, 2.7, 3.0
to be ‘migrate-able’
Performance
Video streaming should
commence in a max of 2s with
500 concurrent users.
12
now that you have done the survey,
what next?
12
now that you have done the survey,
what next?
create maps
to guide you and chalk out routes
13
Tool #2: Persona map
map out who uses what
who uses what
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
13
Tool #2: Persona map
map out who uses what
who uses what
persona
who are the
end users
entities
what do you
want to test
component, features
requirements, flows
14
Tool #3: Scope map
map out user’s expectations
attributes
what do you
want to test for
what-to-test-for-what
entities
what do to you
want to test
component, features
requirements.flows
14
Tool #3: Scope map
map out user’s expectations
attributes
what do you
want to test for
what-to-test-for-what
entities
what do to you
want to test
component, features
requirements.flows
Migration
Security
Performance
Load
15
Tool #4: Interaction map
map out what may affect what, to intelligently regress
entities
what do you
want to test
component, features
requirements, flows
F1 —> F2
F1 —> Flow3
15
Tool #4: Interaction map
map out what may affect what, to intelligently regress
entities
what do you
want to test
component, features
requirements, flows
F1 —> F2
F1 —> Flow3
16
Tool #5: Environment map
map out environments to test on
environment
where do you
want to test on?
Env #1
Env #2
…
16
Tool #5: Environment map
map out environments to test on
environment
where do you
want to test on?
Env #1
Env #2
…
17
now that we have the maps, what do we do next?
17
chalk out the routes
i.e. “test design” - come up with scenarios.
now that we have the maps, what do we do next?
Now you are ready to explore.
18
Tool #6: Scenario creator
create test scenarios
L4: Behaviour correctness
L1: Input correctness
L3: Structural integrity
L2: Interface correctness
L5: Flow correctness
L6: Environment correctness
L7: Attribute correctness
L8: Deployment correctness
L9: End user value
18
component test scenarios
feature test scenarios
requirement test scenarios
flow test scenarios
use techniques
use experience
be creative
learn and revise
use smart checklists
level-wise
Robust Test Design powered by HBT
(Hypothesis Based Testing)
18
Tool #6: Scenario creator
create test scenarios
L4: Behaviour correctness
L1: Input correctness
L3: Structural integrity
L2: Interface correctness
L5: Flow correctness
L6: Environment correctness
L7: Attribute correctness
L8: Deployment correctness
L9: End user value
18
component test scenarios
feature test scenarios
requirement test scenarios
flow test scenarios
use techniques
use experience
be creative
learn and revise
use smart checklists
level-wise
Robust Test Design powered by HBT
(Hypothesis Based Testing)
Table 1
(L4) Func. Behavior
Close a unresolved question
Re-open a closed question
Reply to an open unresolved
question
Edit reply for a question
Table 1-1
(L1) Input validation
Null inputs
Beyond boundaries
Duplicate values
19
now you are ready to explore
20
understand that
a map is not the terrain
as you explore, observe, learn, adapt, improvise, refine
21
observe, learn, adapt, improvise, refine
21
observe, learn, adapt, improvise, refine
persona entities
attributes environment
…the landscape
persona map scope map
interaction map environment map
…the maps
L4: Behaviour correctness
L1: Input correctness
L3: Structural integrity
L2: Interface correctness
L5: Flow correctness
L6: Environment correctness
L7: Attribute correctness
L8: Deployment correctness
L9: End user value
…the routes
22
ok, what next?
rest and recover
i.e. stop, analyse and refine
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
Inputs
1. Attributes considered?
2. Environ. considered?
3. Scenarios at all levels?
4. +/- distribution ok?
5. All personas covered?
Use Maps+Routes
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
Inputs
1. Attributes considered?
2. Environ. considered?
3. Scenarios at all levels?
4. +/- distribution ok?
5. All personas covered?
Use Maps+Routes
1. wrt attributes
2. wrt attributes
3. wrt entities
4. wrt interactions
5. wrt persona
Use Maps+Routes+Exec Info
Activities (plan vs.actual)
23
Tool #7: Dashboard
stop, analyse and refine
23
adequacy
scenarios
good enough
progress
are we
on track?
quality
how good is
the system?
Inputs
1. Attributes considered?
2. Environ. considered?
3. Scenarios at all levels?
4. +/- distribution ok?
5. All personas covered?
Use Maps+Routes
1. wrt attributes
2. wrt attributes
3. wrt entities
4. wrt interactions
5. wrt persona
Use Maps+Routes+Exec Info
Activities (plan vs.actual)
1. wrt attributes
2. wrt attributes
3. wrt entities
4. wrt interactions
5. wrt persona
Use Maps+Routes+Exec Info
Outcomes
24
let’s summarise
our scientific exploration
using the ”7 Tools to Think Better”
25
25
Tool #1: Landscaper
do survey, understand the big picture
Tool #5: Environment map
map out environments to test on
Tool #2: Persona map
map out who uses what
Tool #4: Interaction map
map out what may affect what
Tool #3: Scope map
map out user’s expectations
Reconnaissance
do survey, make maps
Tool #6: Scenario creator
create test scenarios
Exploration
observe, search, learn, refine
Tool #7: Dashboard
stop, analyse and refine
Rest and recover
stop, analyse and refine
26
so how can one apply this?
IMMERSIVE SESSION TESTING “IST”
Reconnaissance
Exploration
Rest & Recover
S1 S2
S3
S4
S5
done in sessions of 60-90 minsconsists of THREE phases
from STAG Software
by using
a session based approach based on Hypothesis Based Testing
28
the tools outlined here and more will be
available as a SaaS tool doSmartQA shortly
we are keen to trial this with select users
email me if you are interested
‘ash at stagsoftware dot com’
testing is scientific exploration
7 Thinking Tools
to Test Rapidly
SmartQA Series Webinar
doSmartQA SaaS tool
email me if you are interested
‘ash at stagsoftware dot com’

More Related Content

What's hot

Software Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical SciencesSoftware Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical Sciences
Aron Ahmadia
 
Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013
Aron Ahmadia
 

What's hot (6)

Shift left-testing
Shift left-testingShift left-testing
Shift left-testing
 
Software Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical SciencesSoftware Carpentry for the Geophysical Sciences
Software Carpentry for the Geophysical Sciences
 
Human-centric Software Development Tools
Human-centric Software Development ToolsHuman-centric Software Development Tools
Human-centric Software Development Tools
 
Sentiment Analysis in R
Sentiment Analysis in RSentiment Analysis in R
Sentiment Analysis in R
 
Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013Software Carpentry and the Hydrological Sciences @ AGU 2013
Software Carpentry and the Hydrological Sciences @ AGU 2013
 
Rita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
Rita Bush - How to Use Games to Mitigate Cognitive Bias in AnalysisRita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
Rita Bush - How to Use Games to Mitigate Cognitive Bias in Analysis
 

Similar to Seven Thinking Tools to Test Rapidly

Software engg. pressman_ch-12
Software engg. pressman_ch-12Software engg. pressman_ch-12
Software engg. pressman_ch-12
Dhairya Joshi
 

Similar to Seven Thinking Tools to Test Rapidly (20)

Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
 Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
Expert System Lecture Notes Chapter 1,2,3,4,5 - Dr.J.VijiPriya
 
An Introduction to Usability
An Introduction to UsabilityAn Introduction to Usability
An Introduction to Usability
 
Software engg. pressman_ch-12
Software engg. pressman_ch-12Software engg. pressman_ch-12
Software engg. pressman_ch-12
 
kritika_resume2
kritika_resume2kritika_resume2
kritika_resume2
 
Don't Fear the User
Don't Fear the UserDon't Fear the User
Don't Fear the User
 
The UX Toolbelt for Developers
The UX Toolbelt for DevelopersThe UX Toolbelt for Developers
The UX Toolbelt for Developers
 
203CR Portfolio 2 UCD
203CR Portfolio 2  UCD203CR Portfolio 2  UCD
203CR Portfolio 2 UCD
 
World Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for DevelopersWorld Usability Day 2014 - UX Toolbelt for Developers
World Usability Day 2014 - UX Toolbelt for Developers
 
UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017UX (User Experience) Process, May 2017
UX (User Experience) Process, May 2017
 
UX Activities for Pet Wearable iOS Mobile App
UX Activities for Pet Wearable iOS Mobile AppUX Activities for Pet Wearable iOS Mobile App
UX Activities for Pet Wearable iOS Mobile App
 
Search Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and TechniquesSearch Quality Evaluation: Tools and Techniques
Search Quality Evaluation: Tools and Techniques
 
Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques Haystack London - Search Quality Evaluation, Tools and Techniques
Haystack London - Search Quality Evaluation, Tools and Techniques
 
UX Workshop: How to design a product with great user experience
UX Workshop: How to design a product with great user experienceUX Workshop: How to design a product with great user experience
UX Workshop: How to design a product with great user experience
 
Obj report
Obj reportObj report
Obj report
 
Intranet Usability Testing
Intranet Usability TestingIntranet Usability Testing
Intranet Usability Testing
 
Sais svcc
Sais svccSais svcc
Sais svcc
 
Humane assessment on cards
Humane assessment on cardsHumane assessment on cards
Humane assessment on cards
 
Tech. Writing Usability Presentation
Tech. Writing Usability PresentationTech. Writing Usability Presentation
Tech. Writing Usability Presentation
 
Abcd iqs ssoftware-projects-mercecrosas
Abcd iqs ssoftware-projects-mercecrosasAbcd iqs ssoftware-projects-mercecrosas
Abcd iqs ssoftware-projects-mercecrosas
 
A Preliminary Field Study of Game Programming on Mobile Devices
A Preliminary Field Study of Game Programming on Mobile DevicesA Preliminary Field Study of Game Programming on Mobile Devices
A Preliminary Field Study of Game Programming on Mobile Devices
 

More from STAG Software Private Limited

Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
STAG Software Private Limited
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
STAG Software Private Limited
 

More from STAG Software Private Limited (20)

Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"Application Scenarios of "doSmartQA -Smart Probing Assistant"
Application Scenarios of "doSmartQA -Smart Probing Assistant"
 
Choked by technical debt?
Choked by technical debt?Choked by technical debt?
Choked by technical debt?
 
Are your quality metrics insightful?
Are your quality metrics insightful?Are your quality metrics insightful?
Are your quality metrics insightful?
 
Weighed down by automation?
Weighed down by automation?Weighed down by automation?
Weighed down by automation?
 
Covid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & CriteriaCovid19 and Clean Code Part 2 - Process & Criteria
Covid19 and Clean Code Part 2 - Process & Criteria
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 
Regression Suite Optimization
Regression Suite OptimizationRegression Suite Optimization
Regression Suite Optimization
 

Recently uploaded

Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
drm1699
 
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Lisi Hocke
 

Recently uploaded (20)

Your Ultimate Web Studio for Streaming Anywhere | Evmux
Your Ultimate Web Studio for Streaming Anywhere | EvmuxYour Ultimate Web Studio for Streaming Anywhere | Evmux
Your Ultimate Web Studio for Streaming Anywhere | Evmux
 
[GRCPP] Introduction to concepts (C++20)
[GRCPP] Introduction to concepts (C++20)[GRCPP] Introduction to concepts (C++20)
[GRCPP] Introduction to concepts (C++20)
 
Lessons Learned from Building a Serverless Notifications System.pdf
Lessons Learned from Building a Serverless Notifications System.pdfLessons Learned from Building a Serverless Notifications System.pdf
Lessons Learned from Building a Serverless Notifications System.pdf
 
Transformer Neural Network Use Cases with Links
Transformer Neural Network Use Cases with LinksTransformer Neural Network Use Cases with Links
Transformer Neural Network Use Cases with Links
 
GraphSummit Milan - Visione e roadmap del prodotto Neo4j
GraphSummit Milan - Visione e roadmap del prodotto Neo4jGraphSummit Milan - Visione e roadmap del prodotto Neo4j
GraphSummit Milan - Visione e roadmap del prodotto Neo4j
 
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
 
Test Automation Design Patterns_ A Comprehensive Guide.pdf
Test Automation Design Patterns_ A Comprehensive Guide.pdfTest Automation Design Patterns_ A Comprehensive Guide.pdf
Test Automation Design Patterns_ A Comprehensive Guide.pdf
 
Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024
 
The mythical technical debt. (Brooke, please, forgive me)
The mythical technical debt. (Brooke, please, forgive me)The mythical technical debt. (Brooke, please, forgive me)
The mythical technical debt. (Brooke, please, forgive me)
 
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
 
AzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdf
AzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdfAzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdf
AzureNativeQumulo_HPC_Cloud_Native_Benchmarks.pdf
 
Encryption Recap: A Refresher on Key Concepts
Encryption Recap: A Refresher on Key ConceptsEncryption Recap: A Refresher on Key Concepts
Encryption Recap: A Refresher on Key Concepts
 
Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024
 
Weeding your micro service landscape.pdf
Weeding your micro service landscape.pdfWeeding your micro service landscape.pdf
Weeding your micro service landscape.pdf
 
Rapidoform for Modern Form Building and Insights
Rapidoform for Modern Form Building and InsightsRapidoform for Modern Form Building and Insights
Rapidoform for Modern Form Building and Insights
 
Auto Affiliate AI Earns First Commission in 3 Hours..pdf
Auto Affiliate  AI Earns First Commission in 3 Hours..pdfAuto Affiliate  AI Earns First Commission in 3 Hours..pdf
Auto Affiliate AI Earns First Commission in 3 Hours..pdf
 
Microsoft365_Dev_Security_2024_05_16.pdf
Microsoft365_Dev_Security_2024_05_16.pdfMicrosoft365_Dev_Security_2024_05_16.pdf
Microsoft365_Dev_Security_2024_05_16.pdf
 
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit MilanWorkshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
 
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
Team Transformation Tactics for Holistic Testing and Quality (NewCrafts Paris...
 
BusinessGPT - Security and Governance for Generative AI
BusinessGPT  - Security and Governance for Generative AIBusinessGPT  - Security and Governance for Generative AI
BusinessGPT - Security and Governance for Generative AI
 

Seven Thinking Tools to Test Rapidly

  • 1. Ashok Thiruvengadam Founder & CEO www.STAGSoftware.com www.linkedin.com/in/ashokstag 7 Thinking Tools to Test Rapidly SmartQA Series Webinar
  • 2. 2 Manual testing | Automated testing Two phrases that some people use to describe our practice Jeez, they have a terrible way with words!
  • 3. 3 It is time we used Intellectual | Tool-supported
  • 4. 3 It is time we used Intellectual | Tool-supported Think well. Exploit tools to do.
  • 5. 4 In current times, speed is everything, right?
  • 6. 4 In current times, speed is everything, right? What can we do test quickly ? Use tools.Automate. Right?
  • 7. 4 In current times, speed is everything, right? Wait a minute! This is about execution, right? What about prior activities? What can we do test quickly ? Use tools.Automate. Right?
  • 8. 5 to answer, let us ask the basic question what is testing after all?
  • 10. 7 testing is scientific exploration
  • 11. 7 testing is scientific exploration and exploration is a human activity aided by tools & technology
  • 12. 8 how can we do scientific exploration rapidly?
  • 13. 8 how can we do scientific exploration rapidly? by using tools that help us think better and do faster
  • 14. 9 we all know about a variety of test tools that help us automate system setup, execution, static analysis, report, manage… at different phases of lifecycle to “do faster”
  • 15. 9 we all know about a variety of test tools that help us automate system setup, execution, static analysis, report, manage… at different phases of lifecycle to “do faster” let’s examine tools that help us “think better”
  • 16. 10 what is the first thing you do before you embark on an exploration? do a survey “reconnaissance"
  • 17. 11 Tool #1: Landscaper do survey, understand the big picture
  • 18. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users e.g ELearning system Persona Administrator Student Supervisor
  • 19. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users entities what do you want to test component, features requirements, flows e.g ELearning system Persona Administrator Student Supervisor Feature Create User Upload content Requirement Go through lessons in courses Take final assessment Flow Complete course, by taking it and doing the final assessment
  • 20. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users entities what do you want to test component, features requirements, flows attributes what do you want to test for e.g ELearning system Persona Administrator Student Supervisor Feature Create User Upload content Requirement Go through lessons in courses Take final assessment Flow Complete course, by taking it and doing the final assessment Migration All course info of 2.5, 2.7, 3.0 to be ‘migrate-able’ Performance Video streaming should commence in a max of 2s with 500 concurrent users.
  • 21. 11 Tool #1: Landscaper do survey, understand the big picture persona who are the end users entities what do you want to test component, features requirements, flows attributes what do you want to test for environment where do you want to test on? e.g ELearning system Persona Administrator Student Supervisor Environment OS Mac,Windows, Linux Browser Firefox, Chrome, IE11 Database Mongo,MySQL,PostgreSQL MobileOS Android,IOS Device Laptop,Tablet,Mobile Feature Create User Upload content Requirement Go through lessons in courses Take final assessment Flow Complete course, by taking it and doing the final assessment Migration All course info of 2.5, 2.7, 3.0 to be ‘migrate-able’ Performance Video streaming should commence in a max of 2s with 500 concurrent users.
  • 22. 12 now that you have done the survey, what next?
  • 23. 12 now that you have done the survey, what next? create maps to guide you and chalk out routes
  • 24. 13 Tool #2: Persona map map out who uses what who uses what persona who are the end users entities what do you want to test component, features requirements, flows
  • 25. 13 Tool #2: Persona map map out who uses what who uses what persona who are the end users entities what do you want to test component, features requirements, flows
  • 26. 14 Tool #3: Scope map map out user’s expectations attributes what do you want to test for what-to-test-for-what entities what do to you want to test component, features requirements.flows
  • 27. 14 Tool #3: Scope map map out user’s expectations attributes what do you want to test for what-to-test-for-what entities what do to you want to test component, features requirements.flows Migration Security Performance Load
  • 28. 15 Tool #4: Interaction map map out what may affect what, to intelligently regress entities what do you want to test component, features requirements, flows F1 —> F2 F1 —> Flow3
  • 29. 15 Tool #4: Interaction map map out what may affect what, to intelligently regress entities what do you want to test component, features requirements, flows F1 —> F2 F1 —> Flow3
  • 30. 16 Tool #5: Environment map map out environments to test on environment where do you want to test on? Env #1 Env #2 …
  • 31. 16 Tool #5: Environment map map out environments to test on environment where do you want to test on? Env #1 Env #2 …
  • 32. 17 now that we have the maps, what do we do next?
  • 33. 17 chalk out the routes i.e. “test design” - come up with scenarios. now that we have the maps, what do we do next? Now you are ready to explore.
  • 34. 18 Tool #6: Scenario creator create test scenarios L4: Behaviour correctness L1: Input correctness L3: Structural integrity L2: Interface correctness L5: Flow correctness L6: Environment correctness L7: Attribute correctness L8: Deployment correctness L9: End user value 18 component test scenarios feature test scenarios requirement test scenarios flow test scenarios use techniques use experience be creative learn and revise use smart checklists level-wise Robust Test Design powered by HBT (Hypothesis Based Testing)
  • 35. 18 Tool #6: Scenario creator create test scenarios L4: Behaviour correctness L1: Input correctness L3: Structural integrity L2: Interface correctness L5: Flow correctness L6: Environment correctness L7: Attribute correctness L8: Deployment correctness L9: End user value 18 component test scenarios feature test scenarios requirement test scenarios flow test scenarios use techniques use experience be creative learn and revise use smart checklists level-wise Robust Test Design powered by HBT (Hypothesis Based Testing) Table 1 (L4) Func. Behavior Close a unresolved question Re-open a closed question Reply to an open unresolved question Edit reply for a question Table 1-1 (L1) Input validation Null inputs Beyond boundaries Duplicate values
  • 36. 19 now you are ready to explore
  • 37. 20 understand that a map is not the terrain as you explore, observe, learn, adapt, improvise, refine
  • 38. 21 observe, learn, adapt, improvise, refine
  • 39. 21 observe, learn, adapt, improvise, refine persona entities attributes environment …the landscape persona map scope map interaction map environment map …the maps L4: Behaviour correctness L1: Input correctness L3: Structural integrity L2: Interface correctness L5: Flow correctness L6: Environment correctness L7: Attribute correctness L8: Deployment correctness L9: End user value …the routes
  • 40. 22 ok, what next? rest and recover i.e. stop, analyse and refine
  • 41. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system?
  • 42. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system? Inputs 1. Attributes considered? 2. Environ. considered? 3. Scenarios at all levels? 4. +/- distribution ok? 5. All personas covered? Use Maps+Routes
  • 43. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system? Inputs 1. Attributes considered? 2. Environ. considered? 3. Scenarios at all levels? 4. +/- distribution ok? 5. All personas covered? Use Maps+Routes 1. wrt attributes 2. wrt attributes 3. wrt entities 4. wrt interactions 5. wrt persona Use Maps+Routes+Exec Info Activities (plan vs.actual)
  • 44. 23 Tool #7: Dashboard stop, analyse and refine 23 adequacy scenarios good enough progress are we on track? quality how good is the system? Inputs 1. Attributes considered? 2. Environ. considered? 3. Scenarios at all levels? 4. +/- distribution ok? 5. All personas covered? Use Maps+Routes 1. wrt attributes 2. wrt attributes 3. wrt entities 4. wrt interactions 5. wrt persona Use Maps+Routes+Exec Info Activities (plan vs.actual) 1. wrt attributes 2. wrt attributes 3. wrt entities 4. wrt interactions 5. wrt persona Use Maps+Routes+Exec Info Outcomes
  • 45. 24 let’s summarise our scientific exploration using the ”7 Tools to Think Better”
  • 46. 25
  • 47. 25 Tool #1: Landscaper do survey, understand the big picture Tool #5: Environment map map out environments to test on Tool #2: Persona map map out who uses what Tool #4: Interaction map map out what may affect what Tool #3: Scope map map out user’s expectations Reconnaissance do survey, make maps Tool #6: Scenario creator create test scenarios Exploration observe, search, learn, refine Tool #7: Dashboard stop, analyse and refine Rest and recover stop, analyse and refine
  • 48. 26 so how can one apply this?
  • 49. IMMERSIVE SESSION TESTING “IST” Reconnaissance Exploration Rest & Recover S1 S2 S3 S4 S5 done in sessions of 60-90 minsconsists of THREE phases from STAG Software by using a session based approach based on Hypothesis Based Testing
  • 50. 28 the tools outlined here and more will be available as a SaaS tool doSmartQA shortly we are keen to trial this with select users email me if you are interested ‘ash at stagsoftware dot com’
  • 51. testing is scientific exploration 7 Thinking Tools to Test Rapidly SmartQA Series Webinar doSmartQA SaaS tool email me if you are interested ‘ash at stagsoftware dot com’