SlideShare a Scribd company logo
1 of 32
1
The Whole-Team Approach to
Testing, Illustrated:
Choosing a New GUI Test Tool
ØREDEV 2012
Lisa Crispin
Copyright 2012, Lisa Crispin
Copyright 2012: Lisa Crispin
2
About me…
Tester, agile team member
Agile Testing: A Practical Guide for Testers and
Agile Teams; Addison Wesley 2009
Copyright 2012: Lisa Crispin
Whole-Team Approach is:
• Meaningful commitment to quality
• Shared vision of product
• Diversity of skills, experience, viewpoint
Copyright 2012: Lisa Crispin
Is this rebellion?What’s rebellious here?
“Control is ultimately held by the doers”
6
A recent example from my last team…
Copyright 2012: Lisa Crispin
7
A Problem: User Mistakes
Users mis-type bank
account numbers =>
many phone calls for
Operations
Copyright 2012: Lisa Crispin
8
A solution: Dojo
Type-ahead select lists (& other features)
Copyright 2012: Lisa Crispin
A new problem
We want to help users avoid
mistakes, but we can’t have production
code that’s not protected by automated
tests
Copyright 2012: Lisa Crispin
Looking to the future…
Dojo would improve UX on our
new UI…
Let’s research
possible
solutions.
Copyright 2012: Lisa Crispin
Team meeting
Do we need training? Consulting?
Copyright 2012: Lisa Crispin
Sys admin volunteers to do a spike
Selenium 2 Webdriver does the job!
Copyright 2012: Lisa Crispin
A framework spike
• Testers research framework options
• Sys admin spikes homegrown framework
“George”
• Architect spikes open-source framework “Geb”
Copyright 2012: Lisa Crispin
14
First “Bake-off”
“George” “Geb”
Copyright 2012: Lisa Crispin
15
Proof of Concept with Geb
• Developers write tests for new
UI page
•Testers and sys admin
integrate tests into Jenkins CI
• Pros: developers more
involved in GUI test design
• Cons: Learning curve for
testers, result reporting
Copyright 2012: Lisa Crispin
16
Time for another experiment
Copyright 2012: Lisa Crispin
17
Another bake-off
Robot Framework vs. Xebium
• Xebium uses FitNesse framework
• Robot Framework result reporting excellent
Copyright 2012: Lisa Crispin
18
Proof of Concept with RF
• Sys admin helps
install, integrate w/
Jenkins, customize test
results, example page objects
• Testers write tests for same
pages as Geb tests
• Friends help with Se 2
keywords
Copyright 2012: Lisa Crispin
Next Steps
Dojo training
Test design
& RF
training
Get started
in a good
direction
Copyright 2012: Lisa Crispin
Whole Team FTW!
• Team commitment to improve site
• Sys admin, architect, developers, testers,
DBAs all worked on experiments
• Gave us confidence to experiment, find the
best solution for us
• We could go forward with plans to improve
UX, reduce user mistakes
Copyright 2012: Lisa Crispin
Another Experiment, Another Team:
API Automation
•Team wants to do SBE/ATDD for API
•Also need better regression test coverage
Copyright 2012: Lisa Crispin
Slightly different approach
•Tester/dev pair spiked 1 week
•Presented results to team
•Consensus – too much overlap w/ existing
tests
Should
have
Copyright 2012: Lisa Crispin
Second automation spike
• API console
• Team consensus –
explore, enhance, expand
• Spike for doc generation
• Team consensus – go with it
• Continue to build on strategy
Copyright 2012: Lisa Crispin
Tips for Experimenting
•Divide and conquer
•Sub-teams
•Time boxed
•Pros and Cons
•Pof concept
•Rinse and repeat
Copyright 2012: Lisa Crispin
Your experiences & ideas?
• Has your whole team pulled together to
solve a problem?
• Have you tried a “divide and conquer”
approach?
• Do you have problems that might be solved
more easily if people in multiple positions
helped?
What small experiment will YOU try?
Copyright 2012: Lisa Crispin
27
Some Agile Testing Resources
• lisacrispin.com
• janetgregory.ca
• exampler.com
• agile-testing@yahoogroups.com
• testobsessed.com
• testingreflections.com
• dhemery.com
• gojko.net
• shino.de
28
Agile Testing: A Practical Guide for Testers and Agile
Teams
By Lisa Crispin and Janet Gregory
www.agiletester.ca
29
Experiences of Test Automation
Dorothy Graham and Mark Fewster
Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire
30
Specification by Example
How successful teams deliver the right
software
Gojko Adzic
Case studies from > 50 teams
Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire
31
ATDD by Example
A practical guide to Acceptance Test-Driven
development
Markus Gaertner
Copyright 2012: Lisa Crispin32
All Proceeds to Charity!
Beautiful Testing: Leading Professionals Reveal How
They Improve Software
Edited by Tim Riley, Adam Goucher
Includes chapter by yours truly

More Related Content

What's hot

Minding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talkMinding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talklisacrispin
 
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012lisacrispin
 
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...lisacrispin
 
ACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect ManagementACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect Managementlisacrispin
 
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...lisacrispin
 
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...lisacrispin
 
Agile testing myths v5 final-
Agile testing myths v5 final-Agile testing myths v5 final-
Agile testing myths v5 final-lisacrispin
 
Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016Janet Gregory
 
What Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, othersWhat Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, otherslisacrispin
 
Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019Dane Weber
 
Agile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgsAgile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgsJanet Gregory
 
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017Maurizio Mancini
 
Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017Maurizio Mancini
 
10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master Interview10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master InterviewDavid Bland
 
FP adoption at REA
FP adoption at REAFP adoption at REA
FP adoption at REAkenbot
 
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...Atlassian
 
Agile Testing - What's that all about?
Agile Testing - What's that all about?Agile Testing - What's that all about?
Agile Testing - What's that all about?Maurizio Mancini
 
Building QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldBuilding QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldMaurizio Mancini
 
Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)Jesus Mendez
 
Refactoring Test Collaboration
Refactoring Test CollaborationRefactoring Test Collaboration
Refactoring Test CollaborationClaire Moss
 

What's hot (20)

Minding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talkMinding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talk
 
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
 
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
 
ACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect ManagementACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect Management
 
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
 
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
 
Agile testing myths v5 final-
Agile testing myths v5 final-Agile testing myths v5 final-
Agile testing myths v5 final-
 
Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016
 
What Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, othersWhat Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, others
 
Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019
 
Agile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgsAgile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgs
 
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
 
Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017
 
10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master Interview10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master Interview
 
FP adoption at REA
FP adoption at REAFP adoption at REA
FP adoption at REA
 
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
 
Agile Testing - What's that all about?
Agile Testing - What's that all about?Agile Testing - What's that all about?
Agile Testing - What's that all about?
 
Building QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldBuilding QA Team that matters for an Agile World
Building QA Team that matters for an Agile World
 
Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)
 
Refactoring Test Collaboration
Refactoring Test CollaborationRefactoring Test Collaboration
Refactoring Test Collaboration
 

Viewers also liked

Belgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile ProjectsBelgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile Projectslisacrispin
 
Developers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate riskDevelopers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate risklisacrispin
 
Growing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelGrowing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelMatt Barcomb
 
OPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV
 

Viewers also liked (7)

Belgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile ProjectsBelgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile Projects
 
Developers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate riskDevelopers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate risk
 
Oredev pairing
Oredev pairingOredev pairing
Oredev pairing
 
Pitch uCoz White Label
Pitch uCoz White LabelPitch uCoz White Label
Pitch uCoz White Label
 
Growing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelGrowing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus model
 
Ucoz Website Builder
Ucoz Website BuilderUcoz Website Builder
Ucoz Website Builder
 
OPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk Through
 

Similar to Whole Team Approach to Testing, Illustrated

Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012lisacrispin
 
Atd agile automation
Atd agile automationAtd agile automation
Atd agile automationlisacrispin
 
AgileTestingOverview
AgileTestingOverviewAgileTestingOverview
AgileTestingOverviewUmair Anis
 
DevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software DevelopersDevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software DevelopersGabriel Tudorica
 
Atd advanced topicsworkshop
Atd advanced topicsworkshopAtd advanced topicsworkshop
Atd advanced topicsworkshoplisacrispin
 
Lean, Kanban and TFS
Lean, Kanban and TFSLean, Kanban and TFS
Lean, Kanban and TFSImaginet
 
Agile engineering environment 50 minutes or less
Agile engineering environment   50 minutes or lessAgile engineering environment   50 minutes or less
Agile engineering environment 50 minutes or lessVernon Stinebaker
 
Lean, Kanban, and TFS
Lean, Kanban, and TFSLean, Kanban, and TFS
Lean, Kanban, and TFSImaginet
 
Open your mind for OpenSource
Open your mind for OpenSourceOpen your mind for OpenSource
Open your mind for OpenSourceCOMAQA.BY
 
AATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate GameAATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate GameDana Pylayeva
 
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...agil8 Ltd
 
How to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one roomHow to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one roomMatthias Luebken
 
Adapt your testing for Agile
Adapt your testing for AgileAdapt your testing for Agile
Adapt your testing for AgileEmma Armstrong
 
Kickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond ConferenceKickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond ConferenceDan Chuparkoff
 
Getting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPIGetting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPIWilliam Welder
 
AGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by SynerzipAGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by SynerzipSynerzip
 
Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1Hemant Elhence
 

Similar to Whole Team Approach to Testing, Illustrated (20)

Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012
 
Atd agile automation
Atd agile automationAtd agile automation
Atd agile automation
 
AgileTestingOverview
AgileTestingOverviewAgileTestingOverview
AgileTestingOverview
 
DevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software DevelopersDevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software Developers
 
Atd advanced topicsworkshop
Atd advanced topicsworkshopAtd advanced topicsworkshop
Atd advanced topicsworkshop
 
Lean, Kanban and TFS
Lean, Kanban and TFSLean, Kanban and TFS
Lean, Kanban and TFS
 
Agile engineering environment 50 minutes or less
Agile engineering environment   50 minutes or lessAgile engineering environment   50 minutes or less
Agile engineering environment 50 minutes or less
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
 
Lean, Kanban, and TFS
Lean, Kanban, and TFSLean, Kanban, and TFS
Lean, Kanban, and TFS
 
Open your mind for OpenSource
Open your mind for OpenSourceOpen your mind for OpenSource
Open your mind for OpenSource
 
What is DevOps
What is DevOpsWhat is DevOps
What is DevOps
 
AATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate GameAATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate Game
 
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
 
How to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one roomHow to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one room
 
Adapt your testing for Agile
Adapt your testing for AgileAdapt your testing for Agile
Adapt your testing for Agile
 
Kickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond ConferenceKickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond Conference
 
Getting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPIGetting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPI
 
AGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by SynerzipAGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by Synerzip
 
Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1
 

More from lisacrispin

Exploring Requirements for Shared Understanding
Exploring Requirements for Shared UnderstandingExploring Requirements for Shared Understanding
Exploring Requirements for Shared Understandinglisacrispin
 
Principles for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing PrinciplesPrinciples for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing Principleslisacrispin
 
BDD and CD - better together
BDD and CD - better togetherBDD and CD - better together
BDD and CD - better togetherlisacrispin
 
Get testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelinesGet testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelineslisacrispin
 
Thinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testingThinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testinglisacrispin
 
The Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous DeliveryThe Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous Deliverylisacrispin
 
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous DeliveryDeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous Deliverylisacrispin
 
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns QualityAgile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Qualitylisacrispin
 
Advanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on AutomationAdvanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on Automationlisacrispin
 
Morph your mindset for Continuous Delivery, Agile Roots 2014
Morph your mindset for Continuous Delivery,  Agile Roots 2014Morph your mindset for Continuous Delivery,  Agile Roots 2014
Morph your mindset for Continuous Delivery, Agile Roots 2014lisacrispin
 
Belgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetBelgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetlisacrispin
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshoplisacrispin
 
SQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for TestingSQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for Testinglisacrispin
 

More from lisacrispin (13)

Exploring Requirements for Shared Understanding
Exploring Requirements for Shared UnderstandingExploring Requirements for Shared Understanding
Exploring Requirements for Shared Understanding
 
Principles for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing PrinciplesPrinciples for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing Principles
 
BDD and CD - better together
BDD and CD - better togetherBDD and CD - better together
BDD and CD - better together
 
Get testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelinesGet testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelines
 
Thinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testingThinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testing
 
The Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous DeliveryThe Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous Delivery
 
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous DeliveryDeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
 
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns QualityAgile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
 
Advanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on AutomationAdvanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on Automation
 
Morph your mindset for Continuous Delivery, Agile Roots 2014
Morph your mindset for Continuous Delivery,  Agile Roots 2014Morph your mindset for Continuous Delivery,  Agile Roots 2014
Morph your mindset for Continuous Delivery, Agile Roots 2014
 
Belgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetBelgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindset
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshop
 
SQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for TestingSQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for Testing
 

Recently uploaded

Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfFIDO Alliance
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGDSC PJATK
 
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfBreaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfUK Journal
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireExakis Nelite
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...panagenda
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfFIDO Alliance
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsStefano
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge
 
TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024Stephen Perrenod
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Julian Hyde
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...FIDO Alliance
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FIDO Alliance
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyUXDXConf
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfFIDO Alliance
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Patrick Viafore
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandIES VE
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekCzechDreamin
 

Recently uploaded (20)

Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfBreaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024
 
TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 

Whole Team Approach to Testing, Illustrated

  • 1. 1 The Whole-Team Approach to Testing, Illustrated: Choosing a New GUI Test Tool ØREDEV 2012 Lisa Crispin Copyright 2012, Lisa Crispin
  • 2. Copyright 2012: Lisa Crispin 2 About me… Tester, agile team member
  • 3. Agile Testing: A Practical Guide for Testers and Agile Teams; Addison Wesley 2009
  • 4. Copyright 2012: Lisa Crispin Whole-Team Approach is: • Meaningful commitment to quality • Shared vision of product • Diversity of skills, experience, viewpoint
  • 5. Copyright 2012: Lisa Crispin Is this rebellion?What’s rebellious here? “Control is ultimately held by the doers”
  • 6. 6 A recent example from my last team…
  • 7. Copyright 2012: Lisa Crispin 7 A Problem: User Mistakes Users mis-type bank account numbers => many phone calls for Operations
  • 8. Copyright 2012: Lisa Crispin 8 A solution: Dojo Type-ahead select lists (& other features)
  • 9. Copyright 2012: Lisa Crispin A new problem We want to help users avoid mistakes, but we can’t have production code that’s not protected by automated tests
  • 10. Copyright 2012: Lisa Crispin Looking to the future… Dojo would improve UX on our new UI… Let’s research possible solutions.
  • 11. Copyright 2012: Lisa Crispin Team meeting Do we need training? Consulting?
  • 12. Copyright 2012: Lisa Crispin Sys admin volunteers to do a spike Selenium 2 Webdriver does the job!
  • 13. Copyright 2012: Lisa Crispin A framework spike • Testers research framework options • Sys admin spikes homegrown framework “George” • Architect spikes open-source framework “Geb”
  • 14. Copyright 2012: Lisa Crispin 14 First “Bake-off” “George” “Geb”
  • 15. Copyright 2012: Lisa Crispin 15 Proof of Concept with Geb • Developers write tests for new UI page •Testers and sys admin integrate tests into Jenkins CI • Pros: developers more involved in GUI test design • Cons: Learning curve for testers, result reporting
  • 16. Copyright 2012: Lisa Crispin 16 Time for another experiment
  • 17. Copyright 2012: Lisa Crispin 17 Another bake-off Robot Framework vs. Xebium • Xebium uses FitNesse framework • Robot Framework result reporting excellent
  • 18. Copyright 2012: Lisa Crispin 18 Proof of Concept with RF • Sys admin helps install, integrate w/ Jenkins, customize test results, example page objects • Testers write tests for same pages as Geb tests • Friends help with Se 2 keywords
  • 19. Copyright 2012: Lisa Crispin Next Steps Dojo training Test design & RF training Get started in a good direction
  • 20. Copyright 2012: Lisa Crispin Whole Team FTW! • Team commitment to improve site • Sys admin, architect, developers, testers, DBAs all worked on experiments • Gave us confidence to experiment, find the best solution for us • We could go forward with plans to improve UX, reduce user mistakes
  • 21. Copyright 2012: Lisa Crispin Another Experiment, Another Team: API Automation •Team wants to do SBE/ATDD for API •Also need better regression test coverage
  • 22. Copyright 2012: Lisa Crispin Slightly different approach •Tester/dev pair spiked 1 week •Presented results to team •Consensus – too much overlap w/ existing tests Should have
  • 23. Copyright 2012: Lisa Crispin Second automation spike • API console • Team consensus – explore, enhance, expand • Spike for doc generation • Team consensus – go with it • Continue to build on strategy
  • 24. Copyright 2012: Lisa Crispin Tips for Experimenting •Divide and conquer •Sub-teams •Time boxed •Pros and Cons •Pof concept •Rinse and repeat
  • 25. Copyright 2012: Lisa Crispin Your experiences & ideas? • Has your whole team pulled together to solve a problem? • Have you tried a “divide and conquer” approach? • Do you have problems that might be solved more easily if people in multiple positions helped?
  • 26. What small experiment will YOU try?
  • 27. Copyright 2012: Lisa Crispin 27 Some Agile Testing Resources • lisacrispin.com • janetgregory.ca • exampler.com • agile-testing@yahoogroups.com • testobsessed.com • testingreflections.com • dhemery.com • gojko.net • shino.de
  • 28. 28 Agile Testing: A Practical Guide for Testers and Agile Teams By Lisa Crispin and Janet Gregory www.agiletester.ca
  • 29. 29 Experiences of Test Automation Dorothy Graham and Mark Fewster
  • 30. Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire 30 Specification by Example How successful teams deliver the right software Gojko Adzic Case studies from > 50 teams
  • 31. Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire 31 ATDD by Example A practical guide to Acceptance Test-Driven development Markus Gaertner
  • 32. Copyright 2012: Lisa Crispin32 All Proceeds to Charity! Beautiful Testing: Leading Professionals Reveal How They Improve Software Edited by Tim Riley, Adam Goucher Includes chapter by yours truly

Editor's Notes

  1. Communication, Not “stepping on each other”,Pairing,Time zone differences,Staying motivated
  2. From the OredevwebsiteReallystanding up for quality takes a ot of courage, Learning the biz domain takes a lot of workIt can be uncomfortable to work with other roles – may be way out of comfort zone. Anyone here already doing a whole team approach?18:05
  3. Tell story of what pgmrs on my team said when we discussed what we’re looking for in a tester(explain why I say programmer instead of developer)
  4. And this is a testing conference, so… But do try to educate your teammates about testing!18:10
  5. And this is a testing conference, so… But do try to educate your teammates about testing!
  6. They work together
  7. They work together
  8. And this is a testing conference, so… But do try to educate your teammates about testing!
  9. I’m not trying to sell you on RF, or any other driver/framework. The point is that we tried different approaches til we found the optimal for us. This investment will pay off by allowing us to have maintainable regression tests, providing quick feedback & good ROI, which in turn allows us to implement a better UX.18:25
  10. Tester/dev pair to spike: 1 weekPresent results at brown bagTeam consensus: too much overlap with Rspec controller tests?Lesson learned:Should have done a bake-off
  11. Continue to find solutions for API automation strategy. Continued experiments and bakeoffs.18:30