SlideShare a Scribd company logo
Session Based Test Management
Webinar
Ashutosh Garg
Brief about me
I am Ashutosh Garg
• MBA in Finance and Marketing from IIM Lucknow (PGPWE)
• Department Manager at Mediatek Inc.
• Trainer and Writer on diverse topics like Agile, MS Excel, Negotiations, Communication, Content
Marketing, QA
• Father to a 1.5 year old boy
Outline
• What is Exploratory testing?
• General Problems with Exploratory Testing
• Solution - SBTM
• Details about Session Based Test Management
• Examples
• Way forward
Defining Exploratory Testing
• Exploratory testing is also known as Free testing (May be the word which you most commonly
know)
• It is unscripted, does not have a structure, it is unrehearsed
• Its success depends on a lot of factors like the skill of the tester, their inquisitiveness, their
experience and the courage to follow their hunch
• So all in all, it is extremely dependent on the tester who is executing the exploratory test
General Problems with Exploratory Testing
• Since these are intangibles and cannot be measured quantitatively, it is extremely difficult for the test
managers to get a status.
○ Most testers are not able to express it diligently, since they do a lot but when it comes to mentioning, it
gets difficult for them (either they forget or may not be able to think out loud)
• And since testers are not able to recall what they did, managers are not able to understand the coverage and
more importantly what is the health of the module they tested (How good or bad is it in terms of Quality)
• So, there is no detail on coverage, confidence on quality, accountability and the method to mention the
creativity of the tester.
A brief about Session Based Test Management
• A technique invented by Jonathan and James Bach, way back in 2000.
• It intends to make the intangibles as tangible.
• In layman terms, it is structured exploratory testing
○ Structure and Exploratory? Yes! Not exactly pre-scripted. But more of a set of expectations and a
structure on the reporting
• SBTM Involves exploratory testing in sessions. The session could be as short as 1 hour or as long as 1 day.
○ However, from experience, it is not recommended to keep less than 2 hours and not more than 2 days.
Key Item of Session Based Test Management - Charter
• A charter can be understood as the script which the tester will follow and also the report it will fill
• The Key components of the charter are as follows
○ Details about the test environment (To be filled by the manager first)
○ Test notes (To be filled by the manager first)
○ Task Breakdown (To be filled by the tester post the charter execution)
○ New areas discovered (To be filled by the tester post the charter execution)
○ Results of the test notes (To be filled by the tester post the charter execution)
Session Based Test Management - Flow
Preparation of the Charter
The test manager will fill the charter as to
what his expectations are from the
exploratory test
Debriefing
Tester and Manager will discuss the
charter. Since everything is now
documented, the debriefing session
becomes result oriented
Execution of the charter
and reporting.
Executing the charter shared by the test
manager. Reporting the results, findings
and effort related details
03
01 02
Sample Problem
Type of transaction Weekdays-Day time Weekdays-Night time Weekends
Domestic 0.5% 0.75% 1.5%
International 0.75% 1% 2%
A credit card company will charge the following commission to a book based ecommerce portal based on the time of transaction
The maximum purchase a person can do on the website is 100000 INR
Need to design the test charter to check the commission calculation function (Server side can be ignored)
This is the requirement given. Know thy requirement. Ask as many questions.
Examples: When do we consider the day time to be over and when the night time to begin? Is the same cut off date for
weekends also? How probable is that someone will do a order of 1 Lakh, are there that expensive items?
Mind map for the sample problem
Pros and Cons
• Pros
○ Makes the free testing more traceable to get confidence
○ Makes the tester accountable for unstructured test also
○ Get the real picture of the test session (whether the tester had sufficient time or not)
• Cons
○ Does not mention about the issues the tester faced (however that is an easy extension one can do)
○ Test Manager need to still understand that this is an exploratory testing technique. Do not try and give so
much of a structure to this
Chat with me in case you have more
queries or you want to implement this in
your place of work
a@gargashutosh.com, ashutosh@2pir.in
+919810134649
www.2pir.in
www.gargashutosh.com

More Related Content

Similar to Session Based test management

Test case design techniques
Test case design techniquesTest case design techniques
Test case design techniquesAshutosh Garg
 
Test case design techniques
Test case design techniquesTest case design techniques
Test case design techniques2PiRTechnologies
 
Process Management by Jan Mohammed.pptx
Process Management by Jan Mohammed.pptxProcess Management by Jan Mohammed.pptx
Process Management by Jan Mohammed.pptxJanMohammed3
 
Interview with a tester
Interview with a testerInterview with a tester
Interview with a testerJohan Hoberg
 
Interview Preparation
Interview PreparationInterview Preparation
Interview PreparationSupportGCI
 
Effective Business Analysis in a Changing World
Effective Business Analysis in a Changing WorldEffective Business Analysis in a Changing World
Effective Business Analysis in a Changing WorldDevFactoTechnologies
 
Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you? Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you? SQALab
 
Test estimation session
Test estimation sessionTest estimation session
Test estimation sessionVipul Agarwal
 
PERFORMANCE APPRASIAL.pptx summary on performance appraisal
PERFORMANCE APPRASIAL.pptx summary on performance appraisalPERFORMANCE APPRASIAL.pptx summary on performance appraisal
PERFORMANCE APPRASIAL.pptx summary on performance appraisalAnshikaNeema
 
Building a testing team
Building a testing teamBuilding a testing team
Building a testing teamSQALab
 
Anton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBAnton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBIevgenii Katsan
 
STARCANADA 2013 Keynote: Lightning Strikes the Keynotes
STARCANADA 2013 Keynote: Lightning Strikes the KeynotesSTARCANADA 2013 Keynote: Lightning Strikes the Keynotes
STARCANADA 2013 Keynote: Lightning Strikes the KeynotesTechWell
 
Identifying and measuring testing debt
Identifying and measuring testing debtIdentifying and measuring testing debt
Identifying and measuring testing debtPeter Varhol
 

Similar to Session Based test management (20)

Test case design techniques
Test case design techniquesTest case design techniques
Test case design techniques
 
Test case design techniques
Test case design techniquesTest case design techniques
Test case design techniques
 
Process Management by Jan Mohammed.pptx
Process Management by Jan Mohammed.pptxProcess Management by Jan Mohammed.pptx
Process Management by Jan Mohammed.pptx
 
Interview with a tester
Interview with a testerInterview with a tester
Interview with a tester
 
Beginning auditor (1)
Beginning auditor (1)Beginning auditor (1)
Beginning auditor (1)
 
Interview Preparation
Interview PreparationInterview Preparation
Interview Preparation
 
Effective Business Analysis in a Changing World
Effective Business Analysis in a Changing WorldEffective Business Analysis in a Changing World
Effective Business Analysis in a Changing World
 
Agile certificates, PMI -ACP and Agile practice guide
Agile certificates,  PMI -ACP and Agile practice guideAgile certificates,  PMI -ACP and Agile practice guide
Agile certificates, PMI -ACP and Agile practice guide
 
Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you? Are you in control of Testing, or does Testing control you?
Are you in control of Testing, or does Testing control you?
 
ICSA Annual Conference: Day 1, 11.30am
ICSA Annual Conference: Day 1, 11.30amICSA Annual Conference: Day 1, 11.30am
ICSA Annual Conference: Day 1, 11.30am
 
Test estimation session
Test estimation sessionTest estimation session
Test estimation session
 
PERFORMANCE APPRASIAL.pptx summary on performance appraisal
PERFORMANCE APPRASIAL.pptx summary on performance appraisalPERFORMANCE APPRASIAL.pptx summary on performance appraisal
PERFORMANCE APPRASIAL.pptx summary on performance appraisal
 
Teaching Scrum Fundamentals_A Quick Guide to Getting Started.pdf
Teaching Scrum Fundamentals_A Quick Guide to Getting Started.pdfTeaching Scrum Fundamentals_A Quick Guide to Getting Started.pdf
Teaching Scrum Fundamentals_A Quick Guide to Getting Started.pdf
 
Building a testing team
Building a testing teamBuilding a testing team
Building a testing team
 
Anton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBAnton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQB
 
Teaching Scrum Fundamentals_A Quick Guide to Getting Started.pdf
Teaching Scrum Fundamentals_A Quick Guide to Getting Started.pdfTeaching Scrum Fundamentals_A Quick Guide to Getting Started.pdf
Teaching Scrum Fundamentals_A Quick Guide to Getting Started.pdf
 
Fundamentals of Project Management
Fundamentals of Project ManagementFundamentals of Project Management
Fundamentals of Project Management
 
STARCANADA 2013 Keynote: Lightning Strikes the Keynotes
STARCANADA 2013 Keynote: Lightning Strikes the KeynotesSTARCANADA 2013 Keynote: Lightning Strikes the Keynotes
STARCANADA 2013 Keynote: Lightning Strikes the Keynotes
 
Notes on usability testing
Notes on usability testingNotes on usability testing
Notes on usability testing
 
Identifying and measuring testing debt
Identifying and measuring testing debtIdentifying and measuring testing debt
Identifying and measuring testing debt
 

Recently uploaded

Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILNatan Silnitsky
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxvarshanayak241
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessWSO2
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...Juraj Vysvader
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageGlobus
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowPeter Caitens
 
How Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptxHow Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Globus
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTier1 app
 
Agnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in KrakówAgnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in Krakówbim.edu.pl
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsGlobus
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesGlobus
 
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...Hivelance Technology
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?XfilesPro
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisGlobus
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024Ortus Solutions, Corp
 

Recently uploaded (20)

Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Understanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSageUnderstanding Globus Data Transfers with NetSage
Understanding Globus Data Transfers with NetSage
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
 
How Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptxHow Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptx
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
Agnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in KrakówAgnieszka Andrzejewska - BIM School Course in Kraków
Agnieszka Andrzejewska - BIM School Course in Kraków
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Corporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMSCorporate Management | Session 3 of 3 | Tendenci AMS
Corporate Management | Session 3 of 3 | Tendenci AMS
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
Multiple Your Crypto Portfolio with the Innovative Features of Advanced Crypt...
 
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
 
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data AnalysisProviding Globus Services to Users of JASMIN for Environmental Data Analysis
Providing Globus Services to Users of JASMIN for Environmental Data Analysis
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
 

Session Based test management

  • 1. Session Based Test Management Webinar Ashutosh Garg
  • 2. Brief about me I am Ashutosh Garg • MBA in Finance and Marketing from IIM Lucknow (PGPWE) • Department Manager at Mediatek Inc. • Trainer and Writer on diverse topics like Agile, MS Excel, Negotiations, Communication, Content Marketing, QA • Father to a 1.5 year old boy
  • 3. Outline • What is Exploratory testing? • General Problems with Exploratory Testing • Solution - SBTM • Details about Session Based Test Management • Examples • Way forward
  • 4. Defining Exploratory Testing • Exploratory testing is also known as Free testing (May be the word which you most commonly know) • It is unscripted, does not have a structure, it is unrehearsed • Its success depends on a lot of factors like the skill of the tester, their inquisitiveness, their experience and the courage to follow their hunch • So all in all, it is extremely dependent on the tester who is executing the exploratory test
  • 5. General Problems with Exploratory Testing • Since these are intangibles and cannot be measured quantitatively, it is extremely difficult for the test managers to get a status. ○ Most testers are not able to express it diligently, since they do a lot but when it comes to mentioning, it gets difficult for them (either they forget or may not be able to think out loud) • And since testers are not able to recall what they did, managers are not able to understand the coverage and more importantly what is the health of the module they tested (How good or bad is it in terms of Quality) • So, there is no detail on coverage, confidence on quality, accountability and the method to mention the creativity of the tester.
  • 6. A brief about Session Based Test Management • A technique invented by Jonathan and James Bach, way back in 2000. • It intends to make the intangibles as tangible. • In layman terms, it is structured exploratory testing ○ Structure and Exploratory? Yes! Not exactly pre-scripted. But more of a set of expectations and a structure on the reporting • SBTM Involves exploratory testing in sessions. The session could be as short as 1 hour or as long as 1 day. ○ However, from experience, it is not recommended to keep less than 2 hours and not more than 2 days.
  • 7. Key Item of Session Based Test Management - Charter • A charter can be understood as the script which the tester will follow and also the report it will fill • The Key components of the charter are as follows ○ Details about the test environment (To be filled by the manager first) ○ Test notes (To be filled by the manager first) ○ Task Breakdown (To be filled by the tester post the charter execution) ○ New areas discovered (To be filled by the tester post the charter execution) ○ Results of the test notes (To be filled by the tester post the charter execution)
  • 8. Session Based Test Management - Flow Preparation of the Charter The test manager will fill the charter as to what his expectations are from the exploratory test Debriefing Tester and Manager will discuss the charter. Since everything is now documented, the debriefing session becomes result oriented Execution of the charter and reporting. Executing the charter shared by the test manager. Reporting the results, findings and effort related details 03 01 02
  • 9. Sample Problem Type of transaction Weekdays-Day time Weekdays-Night time Weekends Domestic 0.5% 0.75% 1.5% International 0.75% 1% 2% A credit card company will charge the following commission to a book based ecommerce portal based on the time of transaction The maximum purchase a person can do on the website is 100000 INR Need to design the test charter to check the commission calculation function (Server side can be ignored) This is the requirement given. Know thy requirement. Ask as many questions. Examples: When do we consider the day time to be over and when the night time to begin? Is the same cut off date for weekends also? How probable is that someone will do a order of 1 Lakh, are there that expensive items?
  • 10. Mind map for the sample problem
  • 11. Pros and Cons • Pros ○ Makes the free testing more traceable to get confidence ○ Makes the tester accountable for unstructured test also ○ Get the real picture of the test session (whether the tester had sufficient time or not) • Cons ○ Does not mention about the issues the tester faced (however that is an easy extension one can do) ○ Test Manager need to still understand that this is an exploratory testing technique. Do not try and give so much of a structure to this
  • 12. Chat with me in case you have more queries or you want to implement this in your place of work a@gargashutosh.com, ashutosh@2pir.in +919810134649 www.2pir.in www.gargashutosh.com