SlideShare a Scribd company logo
Experimenting in
Context for Exploratory
Testing
Maaret Pyhäjärvi
Email: <maaret@iki.fi> | Twitter:
maaretp
Replacing a test-
case-driven style
with a learning-
tester-driven style
in two
organizations
What Testing Gives Us
UnitTesting
ExploratoryTesting
SPEC
FEEDBACK
REGRESSION
GRANULARITY
GUIDANCE
UNDERSTANDING
MODELS
SERENDIPITY
Testing as
artifact
creation
Testing as
performanc
e
Givens.
Some things you
can’t change (yet)
Experiments.
Try changing something!
Finding the
appropriate stretch
Case 1.
Data-intensive
application
Givens. Things I could not
change.
• Waterfall process.
• Contractual distance between acceptance
testers and subcontractor.
• Test-case metric based reporting.
• I manage, I don’t test.
• Business end users as testers.
Experiments. Things I changed.
• Acceptance tester degree of freedom.
• Test cases from step-by-step scripts to test
data with process outline for notes.
• Making “change requests” acceptable.
• Reporting ~20% of testing to 3rd party.
• Inofficial tips sharing sessions with the
subcontractor.
Finding the
appropriate stretch
Case II.
Function-intensive
application
Givens. Things I could not
change.
• Roadmapping creating disconnect to
current priorities.
• Tendency for remote work.
• Developers doing majority of testing.
• Requirements / Specifications format as UI
spec
Experiments. Things I changed.
• No test cases or wasteful documentation.
• Tester with developer tools.
• Removing “acceptance testing” by moving
testing to the team.
• Continuous delivery (without test
automation).
• Holding space for testing to happen.
• True teamwork with mob programming.
Framework of Management
”A day’s work”
Vision (“Sandbox”) Current Charter
Other Charters Details
Bug
Reports
Perception of
quality and
coverage
Quality
ReportDebriefing
Tester
Test
Manager
Past
Results
Obstacles
Outlook
Feelings
?
#
xCharter backlog of the future
testing
Out of
budget
Next in
importance!#, ?, x,
+20:20:60
Session sheets of the past testing
Idea of
exploratio
n
Metrics
summar
y
Coachin
g
Playbooks
Thank you.
@maaretp
(please connect with me through
Twitter or LinkedIn)

More Related Content

What's hot

Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
TEST Huddle
 
Powerpoint part1 (1)
Powerpoint part1 (1)Powerpoint part1 (1)
Powerpoint part1 (1)
Mandy Ming
 
Measurement Uncertainty
Measurement UncertaintyMeasurement Uncertainty
Measurement Uncertainty
DenizErtekin2
 
G11 ia design
G11 ia designG11 ia design
G11 ia design
James Midgley
 
Ane Clausen - Success with Automated Regression Test revised
Ane Clausen - Success with Automated Regression Test revisedAne Clausen - Success with Automated Regression Test revised
Ane Clausen - Success with Automated Regression Test revised
TEST Huddle
 
Test process
Test processTest process
Test process
Soori Joy
 
Overview of test process improvement frameworks
Overview of test process improvement frameworksOverview of test process improvement frameworks
Overview of test process improvement frameworks
Nikita Knysh
 
Qa team in project mission,
Qa team in project   mission,Qa team in project   mission,
Qa team in project mission,
Kostiv Ruslan
 
Test Suite Reduction Based on Fault Detection with Cost Optimization
Test Suite Reduction Based on Fault Detection with Cost OptimizationTest Suite Reduction Based on Fault Detection with Cost Optimization
Test Suite Reduction Based on Fault Detection with Cost Optimization
ijcoa
 
Fundamental test process endang
Fundamental test process endangFundamental test process endang
Fundamental test process endang
endang setianingsih
 
Th14 Balanced Testing Presentation
Th14   Balanced Testing   PresentationTh14   Balanced Testing   Presentation
Th14 Balanced Testing Presentation
Edwin Loon, van
 
Measurement and Metrics for Test Managers
Measurement and Metrics for Test ManagersMeasurement and Metrics for Test Managers
Measurement and Metrics for Test Managers
TechWell
 
Fusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test ExecutionFusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test Execution
Jamie Tischart
 
A/B testing from basic concepts to advanced techniques
A/B testing  from basic concepts to advanced techniquesA/B testing  from basic concepts to advanced techniques
A/B testing from basic concepts to advanced techniques
Anatoliy Vuets
 
Test automation implementation strategy
Test automation implementation strategy Test automation implementation strategy
Test automation implementation strategy
Forte Group
 
Uncertainity in Measurement
Uncertainity in MeasurementUncertainity in Measurement
Uncertainity in Measurement
The Apprentiice
 
ITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill ManualITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill Manual
Noel Temena
 
Countries’ presentation on internal quality control: Nepal
Countries’ presentation on internal quality control: NepalCountries’ presentation on internal quality control: Nepal
Countries’ presentation on internal quality control: Nepal
ExternalEvents
 
The Finishing Line
The Finishing LineThe Finishing Line
The Finishing Line
Oban International
 
Fundamental Test Process - APRIDILA ANGGITA SURI
Fundamental Test Process - APRIDILA ANGGITA SURIFundamental Test Process - APRIDILA ANGGITA SURI
Fundamental Test Process - APRIDILA ANGGITA SURI
Apridila Anggita Suri
 

What's hot (20)

Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
Julie Gardiner - Branch out using Classification Trees for Test Case Design -...
 
Powerpoint part1 (1)
Powerpoint part1 (1)Powerpoint part1 (1)
Powerpoint part1 (1)
 
Measurement Uncertainty
Measurement UncertaintyMeasurement Uncertainty
Measurement Uncertainty
 
G11 ia design
G11 ia designG11 ia design
G11 ia design
 
Ane Clausen - Success with Automated Regression Test revised
Ane Clausen - Success with Automated Regression Test revisedAne Clausen - Success with Automated Regression Test revised
Ane Clausen - Success with Automated Regression Test revised
 
Test process
Test processTest process
Test process
 
Overview of test process improvement frameworks
Overview of test process improvement frameworksOverview of test process improvement frameworks
Overview of test process improvement frameworks
 
Qa team in project mission,
Qa team in project   mission,Qa team in project   mission,
Qa team in project mission,
 
Test Suite Reduction Based on Fault Detection with Cost Optimization
Test Suite Reduction Based on Fault Detection with Cost OptimizationTest Suite Reduction Based on Fault Detection with Cost Optimization
Test Suite Reduction Based on Fault Detection with Cost Optimization
 
Fundamental test process endang
Fundamental test process endangFundamental test process endang
Fundamental test process endang
 
Th14 Balanced Testing Presentation
Th14   Balanced Testing   PresentationTh14   Balanced Testing   Presentation
Th14 Balanced Testing Presentation
 
Measurement and Metrics for Test Managers
Measurement and Metrics for Test ManagersMeasurement and Metrics for Test Managers
Measurement and Metrics for Test Managers
 
Fusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test ExecutionFusion Testing - Maximizing Software Test Execution
Fusion Testing - Maximizing Software Test Execution
 
A/B testing from basic concepts to advanced techniques
A/B testing  from basic concepts to advanced techniquesA/B testing  from basic concepts to advanced techniques
A/B testing from basic concepts to advanced techniques
 
Test automation implementation strategy
Test automation implementation strategy Test automation implementation strategy
Test automation implementation strategy
 
Uncertainity in Measurement
Uncertainity in MeasurementUncertainity in Measurement
Uncertainity in Measurement
 
ITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill ManualITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill Manual
 
Countries’ presentation on internal quality control: Nepal
Countries’ presentation on internal quality control: NepalCountries’ presentation on internal quality control: Nepal
Countries’ presentation on internal quality control: Nepal
 
The Finishing Line
The Finishing LineThe Finishing Line
The Finishing Line
 
Fundamental Test Process - APRIDILA ANGGITA SURI
Fundamental Test Process - APRIDILA ANGGITA SURIFundamental Test Process - APRIDILA ANGGITA SURI
Fundamental Test Process - APRIDILA ANGGITA SURI
 

Viewers also liked

Imrul: Context Driven Testing
Imrul: Context Driven TestingImrul: Context Driven Testing
Imrul: Context Driven Testing
SQABD
 
Applying good context driven testing in an agile context
Applying good context driven testing in an agile contextApplying good context driven testing in an agile context
Applying good context driven testing in an agile context
Markus Gärtner
 
Breathing the breath of the monster combining agile and context-driven
Breathing the breath of the monster   combining agile and context-drivenBreathing the breath of the monster   combining agile and context-driven
Breathing the breath of the monster combining agile and context-driven
Ilari Henrik Aegerter
 
Michał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven TestingMichał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven Testing
Future Processing
 
Thinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing DaysThinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing Days
Huib Schoots
 
A Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in TestingA Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in Testing
BugRaptors
 
Exploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony WebinarExploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony Webinar
QASymphony
 
Context Driven School of testing w prostych przykładach
Context Driven School of testing w prostych przykładachContext Driven School of testing w prostych przykładach
Context Driven School of testing w prostych przykładach
Radoslaw Smilgin
 
Ready, set, go! - Anna Royzman
Ready, set, go! - Anna RoyzmanReady, set, go! - Anna Royzman
Ready, set, go! - Anna Royzman
QA or the Highway
 
[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team
[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team
[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team
Ho Chi Minh City Software Testing Club
 
SlideShare 101
SlideShare 101SlideShare 101
SlideShare 101
Amit Ranjan
 

Viewers also liked (11)

Imrul: Context Driven Testing
Imrul: Context Driven TestingImrul: Context Driven Testing
Imrul: Context Driven Testing
 
Applying good context driven testing in an agile context
Applying good context driven testing in an agile contextApplying good context driven testing in an agile context
Applying good context driven testing in an agile context
 
Breathing the breath of the monster combining agile and context-driven
Breathing the breath of the monster   combining agile and context-drivenBreathing the breath of the monster   combining agile and context-driven
Breathing the breath of the monster combining agile and context-driven
 
Michał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven TestingMichał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven Testing
 
Thinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing DaysThinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing Days
 
A Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in TestingA Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in Testing
 
Exploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony WebinarExploratory Testing with JIRA | QASymphony Webinar
Exploratory Testing with JIRA | QASymphony Webinar
 
Context Driven School of testing w prostych przykładach
Context Driven School of testing w prostych przykładachContext Driven School of testing w prostych przykładach
Context Driven School of testing w prostych przykładach
 
Ready, set, go! - Anna Royzman
Ready, set, go! - Anna RoyzmanReady, set, go! - Anna Royzman
Ready, set, go! - Anna Royzman
 
[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team
[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team
[HCMC STC Jan 2015] Developing an Offshore Context-Driven Testing Team
 
SlideShare 101
SlideShare 101SlideShare 101
SlideShare 101
 

Similar to AgileTD: Experimenting in Context for Exploratory Testing

Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Maaret Pyhäjärvi
 
Best Practices for Test Case Writing
Best Practices for Test Case WritingBest Practices for Test Case Writing
Best Practices for Test Case Writing
Sarah Goldberg
 
Shift Left Testing: A New Paradigm Shift To Quality
Shift Left Testing: A New Paradigm Shift To QualityShift Left Testing: A New Paradigm Shift To Quality
Shift Left Testing: A New Paradigm Shift To Quality
Pooja Wandile
 
Pooja shift left 1.0
Pooja shift left 1.0Pooja shift left 1.0
Pooja shift left 1.0
Xebia India
 
Lean Startup and Intrapreneurial Testing
Lean Startup and Intrapreneurial TestingLean Startup and Intrapreneurial Testing
Lean Startup and Intrapreneurial Testing
Maaret Pyhäjärvi
 
Test case development
Test case developmentTest case development
Test case development
Hrushikesh Wakhle
 
Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)
Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)
Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)
Maaret Pyhäjärvi
 
APRA_Contact Reports_2016_Turner_Hrubik_IJM
APRA_Contact Reports_2016_Turner_Hrubik_IJMAPRA_Contact Reports_2016_Turner_Hrubik_IJM
APRA_Contact Reports_2016_Turner_Hrubik_IJM
Thomas Turner
 
Data-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMData-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PM
Product School
 
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...
Nesma
 
Models ABC
Models ABCModels ABC
Models ABC
Sergey Sviridenko
 
Test cases
Test casesTest cases
Test cases
Chandra Maddigapu
 
Tuhin Mitra: How I Automate My Negative Tests
Tuhin Mitra: How I Automate My Negative TestsTuhin Mitra: How I Automate My Negative Tests
Tuhin Mitra: How I Automate My Negative Tests
Anna Royzman
 
Software-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-ChapgdgdgsghshshshshshshsSoftware-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-Chapgdgdgsghshshshshshshs
shaikbab
 
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Gabor Szabo, CQE
 
Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t
Synerzip
 
Quality Engineering material
Quality Engineering materialQuality Engineering material
Quality Engineering material
TeluguSudhakar3
 
Антон Мужайло, «Using the test process improvement models. Case study based o...
Антон Мужайло, «Using the test process improvement models. Case study based o...Антон Мужайло, «Using the test process improvement models. Case study based o...
Антон Мужайло, «Using the test process improvement models. Case study based o...
Sigma Software
 
System Testingin Agile Environment
System Testingin Agile EnvironmentSystem Testingin Agile Environment
System Testingin Agile Environment
Mary Jiang
 
Acceptance sampling
Acceptance samplingAcceptance sampling
Acceptance sampling
Hassan Habib
 

Similar to AgileTD: Experimenting in Context for Exploratory Testing (20)

Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
Tackling Barriers in Multi-Customer Contract Acceptance Testing (or Why Can't...
 
Best Practices for Test Case Writing
Best Practices for Test Case WritingBest Practices for Test Case Writing
Best Practices for Test Case Writing
 
Shift Left Testing: A New Paradigm Shift To Quality
Shift Left Testing: A New Paradigm Shift To QualityShift Left Testing: A New Paradigm Shift To Quality
Shift Left Testing: A New Paradigm Shift To Quality
 
Pooja shift left 1.0
Pooja shift left 1.0Pooja shift left 1.0
Pooja shift left 1.0
 
Lean Startup and Intrapreneurial Testing
Lean Startup and Intrapreneurial TestingLean Startup and Intrapreneurial Testing
Lean Startup and Intrapreneurial Testing
 
Test case development
Test case developmentTest case development
Test case development
 
Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)
Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)
Agile San Diego: Testing as Exploration (Continuous Delivery w/o Automation)
 
APRA_Contact Reports_2016_Turner_Hrubik_IJM
APRA_Contact Reports_2016_Turner_Hrubik_IJMAPRA_Contact Reports_2016_Turner_Hrubik_IJM
APRA_Contact Reports_2016_Turner_Hrubik_IJM
 
Data-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PMData-Driven Decision Making by Expedia Sr PM
Data-Driven Decision Making by Expedia Sr PM
 
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...
Nesma autumn conference 2015 - Functional testing miniguide - Ignacio López C...
 
Models ABC
Models ABCModels ABC
Models ABC
 
Test cases
Test casesTest cases
Test cases
 
Tuhin Mitra: How I Automate My Negative Tests
Tuhin Mitra: How I Automate My Negative TestsTuhin Mitra: How I Automate My Negative Tests
Tuhin Mitra: How I Automate My Negative Tests
 
Software-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-ChapgdgdgsghshshshshshshsSoftware-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-Chapgdgdgsghshshshshshshs
 
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
Measurement Systems Analysis - Variable Gage R&R Study Metrics, Applications ...
 
Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t
 
Quality Engineering material
Quality Engineering materialQuality Engineering material
Quality Engineering material
 
Антон Мужайло, «Using the test process improvement models. Case study based o...
Антон Мужайло, «Using the test process improvement models. Case study based o...Антон Мужайло, «Using the test process improvement models. Case study based o...
Антон Мужайло, «Using the test process improvement models. Case study based o...
 
System Testingin Agile Environment
System Testingin Agile EnvironmentSystem Testingin Agile Environment
System Testingin Agile Environment
 
Acceptance sampling
Acceptance samplingAcceptance sampling
Acceptance sampling
 

More from Maaret Pyhäjärvi

ATAGTR '20 Keynote: Building status
ATAGTR '20 Keynote: Building statusATAGTR '20 Keynote: Building status
ATAGTR '20 Keynote: Building status
Maaret Pyhäjärvi
 
MoT Cork: Exploring Realities of Testing - From Theory to Practice
MoT Cork: Exploring Realities of Testing - From Theory to PracticeMoT Cork: Exploring Realities of Testing - From Theory to Practice
MoT Cork: Exploring Realities of Testing - From Theory to Practice
Maaret Pyhäjärvi
 
Testing Voices '21 keynote: Testing Becoming Harder To BeValuable
Testing Voices '21 keynote: Testing Becoming Harder To BeValuableTesting Voices '21 keynote: Testing Becoming Harder To BeValuable
Testing Voices '21 keynote: Testing Becoming Harder To BeValuable
Maaret Pyhäjärvi
 
TestJSConf: Go Find What We May Have Missed
TestJSConf: Go Find What We May Have MissedTestJSConf: Go Find What We May Have Missed
TestJSConf: Go Find What We May Have Missed
Maaret Pyhäjärvi
 
SauceCon: It's More Complicated than THAT
SauceCon: It's More Complicated than THATSauceCon: It's More Complicated than THAT
SauceCon: It's More Complicated than THAT
Maaret Pyhäjärvi
 
TSQA: Something In The Way We Test
TSQA: Something In The Way We TestTSQA: Something In The Way We Test
TSQA: Something In The Way We Test
Maaret Pyhäjärvi
 
ATAGTR: Targeting Errors Of Omission
ATAGTR: Targeting Errors Of OmissionATAGTR: Targeting Errors Of Omission
ATAGTR: Targeting Errors Of Omission
Maaret Pyhäjärvi
 
Pivotal Moments, Pivotal Experiences
Pivotal Moments, Pivotal ExperiencesPivotal Moments, Pivotal Experiences
Pivotal Moments, Pivotal Experiences
Maaret Pyhäjärvi
 
Keynote at Sanae Beer.EX: The Automationist's Gambit
Keynote at Sanae Beer.EX: The Automationist's GambitKeynote at Sanae Beer.EX: The Automationist's Gambit
Keynote at Sanae Beer.EX: The Automationist's Gambit
Maaret Pyhäjärvi
 
Testing Assembly: From Observations to Insights on Test Specialist Careers
Testing Assembly: From Observations to Insights on Test Specialist CareersTesting Assembly: From Observations to Insights on Test Specialist Careers
Testing Assembly: From Observations to Insights on Test Specialist Careers
Maaret Pyhäjärvi
 
Let's Do a Thing and Call it Foo
Let's Do a Thing and Call it FooLet's Do a Thing and Call it Foo
Let's Do a Thing and Call it Foo
Maaret Pyhäjärvi
 
Selenium Conf: Patterns to Whole Team Test Automation Transformation
Selenium Conf: Patterns to Whole Team Test Automation TransformationSelenium Conf: Patterns to Whole Team Test Automation Transformation
Selenium Conf: Patterns to Whole Team Test Automation Transformation
Maaret Pyhäjärvi
 
AxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory Testing
AxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory TestingAxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory Testing
AxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory Testing
Maaret Pyhäjärvi
 
MoT Sfax: Good Exploratory Testing Tactics for Taking Over Testing
MoT Sfax: Good Exploratory Testing Tactics for Taking Over TestingMoT Sfax: Good Exploratory Testing Tactics for Taking Over Testing
MoT Sfax: Good Exploratory Testing Tactics for Taking Over Testing
Maaret Pyhäjärvi
 
Geekle QA: Automationist's Gambit
Geekle QA: Automationist's GambitGeekle QA: Automationist's Gambit
Geekle QA: Automationist's Gambit
Maaret Pyhäjärvi
 
Programming Assignments in Tester Interviews
Programming Assignments in Tester InterviewsProgramming Assignments in Tester Interviews
Programming Assignments in Tester Interviews
Maaret Pyhäjärvi
 
ATAGTR Keynote: I have a rock in my shoe - Navigating Improvement
ATAGTR Keynote: I have a rock in my shoe - Navigating ImprovementATAGTR Keynote: I have a rock in my shoe - Navigating Improvement
ATAGTR Keynote: I have a rock in my shoe - Navigating Improvement
Maaret Pyhäjärvi
 
MoT Sarajevo: How to get better at Exploratory testing
MoT Sarajevo: How to get better at Exploratory testingMoT Sarajevo: How to get better at Exploratory testing
MoT Sarajevo: How to get better at Exploratory testing
Maaret Pyhäjärvi
 
HUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at Scale
HUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at ScaleHUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at Scale
HUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at Scale
Maaret Pyhäjärvi
 
EuroSTAR '21 Keynote: Automationist's Gambit
EuroSTAR '21 Keynote: Automationist's GambitEuroSTAR '21 Keynote: Automationist's Gambit
EuroSTAR '21 Keynote: Automationist's Gambit
Maaret Pyhäjärvi
 

More from Maaret Pyhäjärvi (20)

ATAGTR '20 Keynote: Building status
ATAGTR '20 Keynote: Building statusATAGTR '20 Keynote: Building status
ATAGTR '20 Keynote: Building status
 
MoT Cork: Exploring Realities of Testing - From Theory to Practice
MoT Cork: Exploring Realities of Testing - From Theory to PracticeMoT Cork: Exploring Realities of Testing - From Theory to Practice
MoT Cork: Exploring Realities of Testing - From Theory to Practice
 
Testing Voices '21 keynote: Testing Becoming Harder To BeValuable
Testing Voices '21 keynote: Testing Becoming Harder To BeValuableTesting Voices '21 keynote: Testing Becoming Harder To BeValuable
Testing Voices '21 keynote: Testing Becoming Harder To BeValuable
 
TestJSConf: Go Find What We May Have Missed
TestJSConf: Go Find What We May Have MissedTestJSConf: Go Find What We May Have Missed
TestJSConf: Go Find What We May Have Missed
 
SauceCon: It's More Complicated than THAT
SauceCon: It's More Complicated than THATSauceCon: It's More Complicated than THAT
SauceCon: It's More Complicated than THAT
 
TSQA: Something In The Way We Test
TSQA: Something In The Way We TestTSQA: Something In The Way We Test
TSQA: Something In The Way We Test
 
ATAGTR: Targeting Errors Of Omission
ATAGTR: Targeting Errors Of OmissionATAGTR: Targeting Errors Of Omission
ATAGTR: Targeting Errors Of Omission
 
Pivotal Moments, Pivotal Experiences
Pivotal Moments, Pivotal ExperiencesPivotal Moments, Pivotal Experiences
Pivotal Moments, Pivotal Experiences
 
Keynote at Sanae Beer.EX: The Automationist's Gambit
Keynote at Sanae Beer.EX: The Automationist's GambitKeynote at Sanae Beer.EX: The Automationist's Gambit
Keynote at Sanae Beer.EX: The Automationist's Gambit
 
Testing Assembly: From Observations to Insights on Test Specialist Careers
Testing Assembly: From Observations to Insights on Test Specialist CareersTesting Assembly: From Observations to Insights on Test Specialist Careers
Testing Assembly: From Observations to Insights on Test Specialist Careers
 
Let's Do a Thing and Call it Foo
Let's Do a Thing and Call it FooLet's Do a Thing and Call it Foo
Let's Do a Thing and Call it Foo
 
Selenium Conf: Patterns to Whole Team Test Automation Transformation
Selenium Conf: Patterns to Whole Team Test Automation TransformationSelenium Conf: Patterns to Whole Team Test Automation Transformation
Selenium Conf: Patterns to Whole Team Test Automation Transformation
 
AxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory Testing
AxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory TestingAxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory Testing
AxiomSummit 2022: A Practitioner's Guide to Contemporary Exploratory Testing
 
MoT Sfax: Good Exploratory Testing Tactics for Taking Over Testing
MoT Sfax: Good Exploratory Testing Tactics for Taking Over TestingMoT Sfax: Good Exploratory Testing Tactics for Taking Over Testing
MoT Sfax: Good Exploratory Testing Tactics for Taking Over Testing
 
Geekle QA: Automationist's Gambit
Geekle QA: Automationist's GambitGeekle QA: Automationist's Gambit
Geekle QA: Automationist's Gambit
 
Programming Assignments in Tester Interviews
Programming Assignments in Tester InterviewsProgramming Assignments in Tester Interviews
Programming Assignments in Tester Interviews
 
ATAGTR Keynote: I have a rock in my shoe - Navigating Improvement
ATAGTR Keynote: I have a rock in my shoe - Navigating ImprovementATAGTR Keynote: I have a rock in my shoe - Navigating Improvement
ATAGTR Keynote: I have a rock in my shoe - Navigating Improvement
 
MoT Sarajevo: How to get better at Exploratory testing
MoT Sarajevo: How to get better at Exploratory testingMoT Sarajevo: How to get better at Exploratory testing
MoT Sarajevo: How to get better at Exploratory testing
 
HUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at Scale
HUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at ScaleHUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at Scale
HUSTEF '21 Keynote: Hands Off Exploratory Testing - Managing at Scale
 
EuroSTAR '21 Keynote: Automationist's Gambit
EuroSTAR '21 Keynote: Automationist's GambitEuroSTAR '21 Keynote: Automationist's Gambit
EuroSTAR '21 Keynote: Automationist's Gambit
 

Recently uploaded

Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
Deuglo Infosystem Pvt Ltd
 
E-commerce Application Development Company.pdf
E-commerce Application Development Company.pdfE-commerce Application Development Company.pdf
E-commerce Application Development Company.pdf
Hornet Dynamics
 
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, FactsALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
Green Software Development
 
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
mz5nrf0n
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
Philip Schwarz
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOMLORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
lorraineandreiamcidl
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
Fermin Galan
 
Artificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension FunctionsArtificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension Functions
Octavian Nadolu
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Crescat
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
Mobile app Development Services | Drona Infotech
Mobile app Development Services  | Drona InfotechMobile app Development Services  | Drona Infotech
Mobile app Development Services | Drona Infotech
Drona Infotech
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Adele Miller
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptxLORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
lorraineandreiamcidl
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
Green Software Development
 

Recently uploaded (20)

Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
 
E-commerce Application Development Company.pdf
E-commerce Application Development Company.pdfE-commerce Application Development Company.pdf
E-commerce Application Development Company.pdf
 
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, FactsALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
 
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
在线购买加拿大英属哥伦比亚大学毕业证本科学位证书原版一模一样
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOMLORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604Orion Context Broker introduction 20240604
Orion Context Broker introduction 20240604
 
Artificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension FunctionsArtificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension Functions
 
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
Introducing Crescat - Event Management Software for Venues, Festivals and Eve...
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
Mobile app Development Services | Drona Infotech
Mobile app Development Services  | Drona InfotechMobile app Development Services  | Drona Infotech
Mobile app Development Services | Drona Infotech
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptxLORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
 

AgileTD: Experimenting in Context for Exploratory Testing

  • 1. Experimenting in Context for Exploratory Testing Maaret Pyhäjärvi Email: <maaret@iki.fi> | Twitter: maaretp
  • 2. Replacing a test- case-driven style with a learning- tester-driven style in two organizations
  • 3. What Testing Gives Us UnitTesting ExploratoryTesting SPEC FEEDBACK REGRESSION GRANULARITY GUIDANCE UNDERSTANDING MODELS SERENDIPITY Testing as artifact creation Testing as performanc e
  • 8. Givens. Things I could not change. • Waterfall process. • Contractual distance between acceptance testers and subcontractor. • Test-case metric based reporting. • I manage, I don’t test. • Business end users as testers.
  • 9. Experiments. Things I changed. • Acceptance tester degree of freedom. • Test cases from step-by-step scripts to test data with process outline for notes. • Making “change requests” acceptable. • Reporting ~20% of testing to 3rd party. • Inofficial tips sharing sessions with the subcontractor.
  • 12. Givens. Things I could not change. • Roadmapping creating disconnect to current priorities. • Tendency for remote work. • Developers doing majority of testing. • Requirements / Specifications format as UI spec
  • 13. Experiments. Things I changed. • No test cases or wasteful documentation. • Tester with developer tools. • Removing “acceptance testing” by moving testing to the team. • Continuous delivery (without test automation). • Holding space for testing to happen. • True teamwork with mob programming.
  • 14. Framework of Management ”A day’s work” Vision (“Sandbox”) Current Charter Other Charters Details Bug Reports Perception of quality and coverage Quality ReportDebriefing Tester Test Manager Past Results Obstacles Outlook Feelings ? # xCharter backlog of the future testing Out of budget Next in importance!#, ?, x, +20:20:60 Session sheets of the past testing Idea of exploratio n Metrics summar y Coachin g Playbooks
  • 15. Thank you. @maaretp (please connect with me through Twitter or LinkedIn)

Editor's Notes

  1. All testing may be exploratory, but some of it is focused on creating artifacts. Saying “scripting is just an approach” is belittling when scripting can be the main approach to use the powers when testing.  “there’s a process of knowing” – learning Does not give as regression; serendipity (safety against things happening randomly) / unwanted serendipity events. This is what it is and what it could be. There’s a direction to it, not just statement of what it is. Coaching is not just feedback, it’s pointing them to the right way. Safety. EXPERIENCE (the verb) rather than facts ; emotions over facts. REACTIONS. HISTORY, Lessons learned, checklists. Modeling. UNDERSTANDING – where you start (knowing the thing (code & environment), knowing the user, knowing the problems, knowing the developers (how to help them and what they do so that you can efficiently test), knowing the hackers (weird use cases outside common ‘have you tried reading it upside down’) , knowing all stakeholders, knowing the business priorities) Uncovering things I cannot know, giving the application a change to reveal information for me. This allows you to know things.
  2. Example area: 53 test cases (P1 – visible) and 184 (P2 – not visible) Minimal energy principle in reviews: ”thanks for feedback, we decide if we change or not” Disobeying: ”add test case before writing a bug report” Our written test cases were bad – just as anyone else’s except for one