SlideShare a Scribd company logo
1 of 32
1
The Whole-Team Approach to
Testing, Illustrated:
Choosing a New GUI Test Tool
ØREDEV 2012
Lisa Crispin
Copyright 2012, Lisa Crispin
Copyright 2012: Lisa Crispin
2
About me…
Tester, agile team member
Agile Testing: A Practical Guide for Testers and
Agile Teams; Addison Wesley 2009
Copyright 2012: Lisa Crispin
Whole-Team Approach is:
• Meaningful commitment to quality
• Shared vision of product
• Diversity of skills, experience, viewpoint
Copyright 2012: Lisa Crispin
Is this rebellion?What’s rebellious here?
“Control is ultimately held by the doers”
6
A recent example from my last team…
Copyright 2012: Lisa Crispin
7
A Problem: User Mistakes
Users mis-type bank
account numbers =>
many phone calls for
Operations
Copyright 2012: Lisa Crispin
8
A solution: Dojo
Type-ahead select lists (& other features)
Copyright 2012: Lisa Crispin
A new problem
We want to help users avoid
mistakes, but we can’t have production
code that’s not protected by automated
tests
Copyright 2012: Lisa Crispin
Looking to the future…
Dojo would improve UX on our
new UI…
Let’s research
possible
solutions.
Copyright 2012: Lisa Crispin
Team meeting
Do we need training? Consulting?
Copyright 2012: Lisa Crispin
Sys admin volunteers to do a spike
Selenium 2 Webdriver does the job!
Copyright 2012: Lisa Crispin
A framework spike
• Testers research framework options
• Sys admin spikes homegrown framework
“George”
• Architect spikes open-source framework “Geb”
Copyright 2012: Lisa Crispin
14
First “Bake-off”
“George” “Geb”
Copyright 2012: Lisa Crispin
15
Proof of Concept with Geb
• Developers write tests for new
UI page
•Testers and sys admin
integrate tests into Jenkins CI
• Pros: developers more
involved in GUI test design
• Cons: Learning curve for
testers, result reporting
Copyright 2012: Lisa Crispin
16
Time for another experiment
Copyright 2012: Lisa Crispin
17
Another bake-off
Robot Framework vs. Xebium
• Xebium uses FitNesse framework
• Robot Framework result reporting excellent
Copyright 2012: Lisa Crispin
18
Proof of Concept with RF
• Sys admin helps
install, integrate w/
Jenkins, customize test
results, example page objects
• Testers write tests for same
pages as Geb tests
• Friends help with Se 2
keywords
Copyright 2012: Lisa Crispin
Next Steps
Dojo training
Test design
& RF
training
Get started
in a good
direction
Copyright 2012: Lisa Crispin
Whole Team FTW!
• Team commitment to improve site
• Sys admin, architect, developers, testers,
DBAs all worked on experiments
• Gave us confidence to experiment, find the
best solution for us
• We could go forward with plans to improve
UX, reduce user mistakes
Copyright 2012: Lisa Crispin
Another Experiment, Another Team:
API Automation
•Team wants to do SBE/ATDD for API
•Also need better regression test coverage
Copyright 2012: Lisa Crispin
Slightly different approach
•Tester/dev pair spiked 1 week
•Presented results to team
•Consensus – too much overlap w/ existing
tests
Should
have
Copyright 2012: Lisa Crispin
Second automation spike
• API console
• Team consensus –
explore, enhance, expand
• Spike for doc generation
• Team consensus – go with it
• Continue to build on strategy
Copyright 2012: Lisa Crispin
Tips for Experimenting
•Divide and conquer
•Sub-teams
•Time boxed
•Pros and Cons
•Pof concept
•Rinse and repeat
Copyright 2012: Lisa Crispin
Your experiences & ideas?
• Has your whole team pulled together to
solve a problem?
• Have you tried a “divide and conquer”
approach?
• Do you have problems that might be solved
more easily if people in multiple positions
helped?
What small experiment will YOU try?
Copyright 2012: Lisa Crispin
27
Some Agile Testing Resources
• lisacrispin.com
• janetgregory.ca
• exampler.com
• agile-testing@yahoogroups.com
• testobsessed.com
• testingreflections.com
• dhemery.com
• gojko.net
• shino.de
28
Agile Testing: A Practical Guide for Testers and Agile
Teams
By Lisa Crispin and Janet Gregory
www.agiletester.ca
29
Experiences of Test Automation
Dorothy Graham and Mark Fewster
Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire
30
Specification by Example
How successful teams deliver the right
software
Gojko Adzic
Case studies from > 50 teams
Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire
31
ATDD by Example
A practical guide to Acceptance Test-Driven
development
Markus Gaertner
Copyright 2012: Lisa Crispin32
All Proceeds to Charity!
Beautiful Testing: Leading Professionals Reveal How
They Improve Software
Edited by Tim Riley, Adam Goucher
Includes chapter by yours truly

More Related Content

What's hot

Minding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talkMinding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talklisacrispin
 
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012lisacrispin
 
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...lisacrispin
 
ACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect ManagementACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect Managementlisacrispin
 
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...lisacrispin
 
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...lisacrispin
 
Agile testing myths v5 final-
Agile testing myths v5 final-Agile testing myths v5 final-
Agile testing myths v5 final-lisacrispin
 
Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016Janet Gregory
 
What Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, othersWhat Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, otherslisacrispin
 
Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019Dane Weber
 
Agile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgsAgile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgsJanet Gregory
 
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017Maurizio Mancini
 
Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017Maurizio Mancini
 
10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master Interview10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master InterviewDavid Bland
 
FP adoption at REA
FP adoption at REAFP adoption at REA
FP adoption at REAkenbot
 
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...Atlassian
 
Agile Testing - What's that all about?
Agile Testing - What's that all about?Agile Testing - What's that all about?
Agile Testing - What's that all about?Maurizio Mancini
 
Building QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldBuilding QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldMaurizio Mancini
 
Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)Jesus Mendez
 
Refactoring Test Collaboration
Refactoring Test CollaborationRefactoring Test Collaboration
Refactoring Test CollaborationClaire Moss
 

What's hot (20)

Minding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talkMinding your own business - TestBash 2 talk
Minding your own business - TestBash 2 talk
 
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
The Whole Team Approach, Illustrated. Keynote from Turku Agile Days 2012
 
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
Do testers have to code... to be useful? Janet Gregory and Lisa Crispin plena...
 
ACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect ManagementACCU Agile Approach to Defect Management
ACCU Agile Approach to Defect Management
 
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
Build Quality In, workshop with Janet Gregory and Lisa Crispin at Agile Roots...
 
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
Welcome to the Future! Preparing for our agile testing journeys, Agile Testin...
 
Agile testing myths v5 final-
Agile testing myths v5 final-Agile testing myths v5 final-
Agile testing myths v5 final-
 
Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016Key Success Factors for Agile Testing 2016
Key Success Factors for Agile Testing 2016
 
What Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, othersWhat Testers Can Learn to Collaborate Effectively with Programmers, others
What Testers Can Learn to Collaborate Effectively with Programmers, others
 
Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019Undercover Scrum Master - Agile2019
Undercover Scrum Master - Agile2019
 
Agile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgsAgile testing for distributed teams and large orgs
Agile testing for distributed teams and large orgs
 
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
Transforming Managers for an Agile Deployment - Agile Tour Montreal 2017
 
Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017Scaling Quality by Building it in - Agile Tour Ottawa 2017
Scaling Quality by Building it in - Agile Tour Ottawa 2017
 
10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master Interview10 Questions For Your Scrum Master Interview
10 Questions For Your Scrum Master Interview
 
FP adoption at REA
FP adoption at REAFP adoption at REA
FP adoption at REA
 
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
 
Agile Testing - What's that all about?
Agile Testing - What's that all about?Agile Testing - What's that all about?
Agile Testing - What's that all about?
 
Building QA Team that matters for an Agile World
Building QA Team that matters for an Agile WorldBuilding QA Team that matters for an Agile World
Building QA Team that matters for an Agile World
 
Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)Problem solving for agile teams part 1 (define + generate alternatives)
Problem solving for agile teams part 1 (define + generate alternatives)
 
Refactoring Test Collaboration
Refactoring Test CollaborationRefactoring Test Collaboration
Refactoring Test Collaboration
 

Viewers also liked

Belgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile ProjectsBelgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile Projectslisacrispin
 
Developers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate riskDevelopers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate risklisacrispin
 
Growing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelGrowing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelMatt Barcomb
 
OPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV
 

Viewers also liked (7)

Belgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile ProjectsBelgium Testing Days - Making Test Automation Work in Agile Projects
Belgium Testing Days - Making Test Automation Work in Agile Projects
 
Developers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate riskDevelopers who grok testing: why I love them and how they mitigate risk
Developers who grok testing: why I love them and how they mitigate risk
 
Oredev pairing
Oredev pairingOredev pairing
Oredev pairing
 
Pitch uCoz White Label
Pitch uCoz White LabelPitch uCoz White Label
Pitch uCoz White Label
 
Growing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus modelGrowing whole teams using the Dreyfus model
Growing whole teams using the Dreyfus model
 
Ucoz Website Builder
Ucoz Website BuilderUcoz Website Builder
Ucoz Website Builder
 
OPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk ThroughOPNFV Arno Installation and Validation Walk Through
OPNFV Arno Installation and Validation Walk Through
 

Similar to Whole Team Approach to Testing, Illustrated

Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012lisacrispin
 
Atd agile automation
Atd agile automationAtd agile automation
Atd agile automationlisacrispin
 
AgileTestingOverview
AgileTestingOverviewAgileTestingOverview
AgileTestingOverviewUmair Anis
 
DevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software DevelopersDevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software DevelopersGabriel Tudorica
 
Atd advanced topicsworkshop
Atd advanced topicsworkshopAtd advanced topicsworkshop
Atd advanced topicsworkshoplisacrispin
 
Lean, Kanban and TFS
Lean, Kanban and TFSLean, Kanban and TFS
Lean, Kanban and TFSImaginet
 
Agile engineering environment 50 minutes or less
Agile engineering environment   50 minutes or lessAgile engineering environment   50 minutes or less
Agile engineering environment 50 minutes or lessVernon Stinebaker
 
Lean, Kanban, and TFS
Lean, Kanban, and TFSLean, Kanban, and TFS
Lean, Kanban, and TFSImaginet
 
Open your mind for OpenSource
Open your mind for OpenSourceOpen your mind for OpenSource
Open your mind for OpenSourceCOMAQA.BY
 
AATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate GameAATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate GameDana Pylayeva
 
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...agil8 Ltd
 
How to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one roomHow to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one roomMatthias Luebken
 
Adapt your testing for Agile
Adapt your testing for AgileAdapt your testing for Agile
Adapt your testing for AgileEmma Armstrong
 
Kickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond ConferenceKickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond ConferenceDan Chuparkoff
 
Getting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPIGetting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPIWilliam Welder
 
AGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by SynerzipAGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by SynerzipSynerzip
 
Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1Hemant Elhence
 

Similar to Whole Team Approach to Testing, Illustrated (20)

Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012Making Test Automation Work in Agile Projects 2012
Making Test Automation Work in Agile Projects 2012
 
Atd agile automation
Atd agile automationAtd agile automation
Atd agile automation
 
AgileTestingOverview
AgileTestingOverviewAgileTestingOverview
AgileTestingOverview
 
DevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software DevelopersDevCoach - Solid Foundations for the New Wave of Software Developers
DevCoach - Solid Foundations for the New Wave of Software Developers
 
Atd advanced topicsworkshop
Atd advanced topicsworkshopAtd advanced topicsworkshop
Atd advanced topicsworkshop
 
Lean, Kanban and TFS
Lean, Kanban and TFSLean, Kanban and TFS
Lean, Kanban and TFS
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
 
Agile Engineering Environment – 2017
Agile Engineering Environment – 2017Agile Engineering Environment – 2017
Agile Engineering Environment – 2017
 
Agile engineering environment 50 minutes or less
Agile engineering environment   50 minutes or lessAgile engineering environment   50 minutes or less
Agile engineering environment 50 minutes or less
 
Lean, Kanban, and TFS
Lean, Kanban, and TFSLean, Kanban, and TFS
Lean, Kanban, and TFS
 
Open your mind for OpenSource
Open your mind for OpenSourceOpen your mind for OpenSource
Open your mind for OpenSource
 
What is DevOps
What is DevOpsWhat is DevOps
What is DevOps
 
AATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate GameAATC - Gamifying DevOps with Lego and Chocolate Game
AATC - Gamifying DevOps with Lego and Chocolate Game
 
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
Agile Software Development and Test Driven Development: Agil8's Dave Putman 3...
 
How to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one roomHow to scale product development when you no longer fit in one room
How to scale product development when you no longer fit in one room
 
Adapt your testing for Agile
Adapt your testing for AgileAdapt your testing for Agile
Adapt your testing for Agile
 
Kickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond ConferenceKickass Agile Development - Agile & Beyond Conference
Kickass Agile Development - Agile & Beyond Conference
 
Getting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPIGetting Stakeholder Buy-in for xAPI
Getting Stakeholder Buy-in for xAPI
 
AGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by SynerzipAGILE2017 Top 10 Takeaways by Synerzip
AGILE2017 Top 10 Takeaways by Synerzip
 
Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1Final synerzip-agile2017-top10-v1
Final synerzip-agile2017-top10-v1
 

More from lisacrispin

Exploring Requirements for Shared Understanding
Exploring Requirements for Shared UnderstandingExploring Requirements for Shared Understanding
Exploring Requirements for Shared Understandinglisacrispin
 
Principles for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing PrinciplesPrinciples for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing Principleslisacrispin
 
BDD and CD - better together
BDD and CD - better togetherBDD and CD - better together
BDD and CD - better togetherlisacrispin
 
Get testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelinesGet testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelineslisacrispin
 
Thinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testingThinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testinglisacrispin
 
The Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous DeliveryThe Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous Deliverylisacrispin
 
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous DeliveryDeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous Deliverylisacrispin
 
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns QualityAgile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Qualitylisacrispin
 
Advanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on AutomationAdvanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on Automationlisacrispin
 
Morph your mindset for Continuous Delivery, Agile Roots 2014
Morph your mindset for Continuous Delivery,  Agile Roots 2014Morph your mindset for Continuous Delivery,  Agile Roots 2014
Morph your mindset for Continuous Delivery, Agile Roots 2014lisacrispin
 
Belgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetBelgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetlisacrispin
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshoplisacrispin
 
SQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for TestingSQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for Testinglisacrispin
 

More from lisacrispin (13)

Exploring Requirements for Shared Understanding
Exploring Requirements for Shared UnderstandingExploring Requirements for Shared Understanding
Exploring Requirements for Shared Understanding
 
Principles for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing PrinciplesPrinciples for Agile Testers and Modern Testing Principles
Principles for Agile Testers and Modern Testing Principles
 
BDD and CD - better together
BDD and CD - better togetherBDD and CD - better together
BDD and CD - better together
 
Get testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelinesGet testing bottlenecks out of your pipelines
Get testing bottlenecks out of your pipelines
 
Thinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testingThinking Outside the Box: Cognitive bias and testing
Thinking Outside the Box: Cognitive bias and testing
 
The Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous DeliveryThe Whole Team Approach to Quality in Continuous Delivery
The Whole Team Approach to Quality in Continuous Delivery
 
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous DeliveryDeliveryConf - Whole Team Approach to Testing in Continuous Delivery
DeliveryConf - Whole Team Approach to Testing in Continuous Delivery
 
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns QualityAgile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
Agile 20015 Boot Camp: Intro to Agile Testing - Everyone Owns Quality
 
Advanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on AutomationAdvanced Topics in Agile Tsting: Focus on Automation
Advanced Topics in Agile Tsting: Focus on Automation
 
Morph your mindset for Continuous Delivery, Agile Roots 2014
Morph your mindset for Continuous Delivery,  Agile Roots 2014Morph your mindset for Continuous Delivery,  Agile Roots 2014
Morph your mindset for Continuous Delivery, Agile Roots 2014
 
Belgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindsetBelgium Testing Days: Shift your testing mindset
Belgium Testing Days: Shift your testing mindset
 
Code mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshopCode mashadvancedtopicsworkshop
Code mashadvancedtopicsworkshop
 
SQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for TestingSQuAD 2013: Team Collaboration for Testing
SQuAD 2013: Team Collaboration for Testing
 

Recently uploaded

Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfngoud9212
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 

Recently uploaded (20)

Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdf
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 

Whole Team Approach to Testing, Illustrated

  • 1. 1 The Whole-Team Approach to Testing, Illustrated: Choosing a New GUI Test Tool ØREDEV 2012 Lisa Crispin Copyright 2012, Lisa Crispin
  • 2. Copyright 2012: Lisa Crispin 2 About me… Tester, agile team member
  • 3. Agile Testing: A Practical Guide for Testers and Agile Teams; Addison Wesley 2009
  • 4. Copyright 2012: Lisa Crispin Whole-Team Approach is: • Meaningful commitment to quality • Shared vision of product • Diversity of skills, experience, viewpoint
  • 5. Copyright 2012: Lisa Crispin Is this rebellion?What’s rebellious here? “Control is ultimately held by the doers”
  • 6. 6 A recent example from my last team…
  • 7. Copyright 2012: Lisa Crispin 7 A Problem: User Mistakes Users mis-type bank account numbers => many phone calls for Operations
  • 8. Copyright 2012: Lisa Crispin 8 A solution: Dojo Type-ahead select lists (& other features)
  • 9. Copyright 2012: Lisa Crispin A new problem We want to help users avoid mistakes, but we can’t have production code that’s not protected by automated tests
  • 10. Copyright 2012: Lisa Crispin Looking to the future… Dojo would improve UX on our new UI… Let’s research possible solutions.
  • 11. Copyright 2012: Lisa Crispin Team meeting Do we need training? Consulting?
  • 12. Copyright 2012: Lisa Crispin Sys admin volunteers to do a spike Selenium 2 Webdriver does the job!
  • 13. Copyright 2012: Lisa Crispin A framework spike • Testers research framework options • Sys admin spikes homegrown framework “George” • Architect spikes open-source framework “Geb”
  • 14. Copyright 2012: Lisa Crispin 14 First “Bake-off” “George” “Geb”
  • 15. Copyright 2012: Lisa Crispin 15 Proof of Concept with Geb • Developers write tests for new UI page •Testers and sys admin integrate tests into Jenkins CI • Pros: developers more involved in GUI test design • Cons: Learning curve for testers, result reporting
  • 16. Copyright 2012: Lisa Crispin 16 Time for another experiment
  • 17. Copyright 2012: Lisa Crispin 17 Another bake-off Robot Framework vs. Xebium • Xebium uses FitNesse framework • Robot Framework result reporting excellent
  • 18. Copyright 2012: Lisa Crispin 18 Proof of Concept with RF • Sys admin helps install, integrate w/ Jenkins, customize test results, example page objects • Testers write tests for same pages as Geb tests • Friends help with Se 2 keywords
  • 19. Copyright 2012: Lisa Crispin Next Steps Dojo training Test design & RF training Get started in a good direction
  • 20. Copyright 2012: Lisa Crispin Whole Team FTW! • Team commitment to improve site • Sys admin, architect, developers, testers, DBAs all worked on experiments • Gave us confidence to experiment, find the best solution for us • We could go forward with plans to improve UX, reduce user mistakes
  • 21. Copyright 2012: Lisa Crispin Another Experiment, Another Team: API Automation •Team wants to do SBE/ATDD for API •Also need better regression test coverage
  • 22. Copyright 2012: Lisa Crispin Slightly different approach •Tester/dev pair spiked 1 week •Presented results to team •Consensus – too much overlap w/ existing tests Should have
  • 23. Copyright 2012: Lisa Crispin Second automation spike • API console • Team consensus – explore, enhance, expand • Spike for doc generation • Team consensus – go with it • Continue to build on strategy
  • 24. Copyright 2012: Lisa Crispin Tips for Experimenting •Divide and conquer •Sub-teams •Time boxed •Pros and Cons •Pof concept •Rinse and repeat
  • 25. Copyright 2012: Lisa Crispin Your experiences & ideas? • Has your whole team pulled together to solve a problem? • Have you tried a “divide and conquer” approach? • Do you have problems that might be solved more easily if people in multiple positions helped?
  • 26. What small experiment will YOU try?
  • 27. Copyright 2012: Lisa Crispin 27 Some Agile Testing Resources • lisacrispin.com • janetgregory.ca • exampler.com • agile-testing@yahoogroups.com • testobsessed.com • testingreflections.com • dhemery.com • gojko.net • shino.de
  • 28. 28 Agile Testing: A Practical Guide for Testers and Agile Teams By Lisa Crispin and Janet Gregory www.agiletester.ca
  • 29. 29 Experiences of Test Automation Dorothy Graham and Mark Fewster
  • 30. Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire 30 Specification by Example How successful teams deliver the right software Gojko Adzic Case studies from > 50 teams
  • 31. Copyright 2012: Lisa CrispinCopyright 2008 Janet Gregory, DragonFire 31 ATDD by Example A practical guide to Acceptance Test-Driven development Markus Gaertner
  • 32. Copyright 2012: Lisa Crispin32 All Proceeds to Charity! Beautiful Testing: Leading Professionals Reveal How They Improve Software Edited by Tim Riley, Adam Goucher Includes chapter by yours truly

Editor's Notes

  1. Communication, Not “stepping on each other”,Pairing,Time zone differences,Staying motivated
  2. From the OredevwebsiteReallystanding up for quality takes a ot of courage, Learning the biz domain takes a lot of workIt can be uncomfortable to work with other roles – may be way out of comfort zone. Anyone here already doing a whole team approach?18:05
  3. Tell story of what pgmrs on my team said when we discussed what we’re looking for in a tester(explain why I say programmer instead of developer)
  4. And this is a testing conference, so… But do try to educate your teammates about testing!18:10
  5. And this is a testing conference, so… But do try to educate your teammates about testing!
  6. They work together
  7. They work together
  8. And this is a testing conference, so… But do try to educate your teammates about testing!
  9. I’m not trying to sell you on RF, or any other driver/framework. The point is that we tried different approaches til we found the optimal for us. This investment will pay off by allowing us to have maintainable regression tests, providing quick feedback & good ROI, which in turn allows us to implement a better UX.18:25
  10. Tester/dev pair to spike: 1 weekPresent results at brown bagTeam consensus: too much overlap with Rspec controller tests?Lesson learned:Should have done a bake-off
  11. Continue to find solutions for API automation strategy. Continued experiments and bakeoffs.18:30