SlideShare a Scribd company logo
Agile QA 2.0
@aceconf
@mattphilip
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
3.  Work together to
come up
with better ways
So what have
we learned?
-- Barry Boehm (1981)
Eliminate the need for massive
inspection by building quality into the
product in the first place.
-- Edwards Deming (1982)
So what have
we learned?
”
“
Handoffs are waste.
-- Mary Poppendieck (2003)
So what have
we learned?
Move testing to the
front of the
development process
-- Agile Testing (2009)
So what have
we learned?
”
“
Kanban doesn’t mean a return to
waterfall.
-- David Anderson (paraphrase, 2013)
So what have
we learned?
So of course what do our card walls look like?
How did this happen?
We simply repeat the same process
that we've always done
QAs aren’t assertive enough to ask for change
We figure that, if we don’t, the QA
won't have anything to do (resource
efficiency)
#1
#2
#3
But why is this
a problem?
End-‐of-‐cycle testing (mini waterfalls)
#1 Creates too long a feedback loop
#2 Virtually ensures that our testing efforts are
misaligned with value 
#3 Reinforces gatekeeper role (oppositional)
#4 Creates inefficient test suite
But why is this
a problem?
Limits
options to
checking
through
GUI
Creates inefficient test suite
Which
leads to
this
So how do
we remedy
these problems?
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
Remedies QA and devs collaborate to determine the
right place to test#1 Bring QA forward
Many
here
Some
here
A few
here
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Acceptance-‐Test-‐Driven Development
Development
Iterations
Development
Engine
Write Story and Scenarios
Business Showcase
Story Testing
Story Planning Session
BA / QA Signoff on Dev Box
Daily BA/QA demo
Tester
Dev
BA
TesterDev
Tester BADev
Tester BADev
BABusiness
Tester
Start
Here
System
Testing
Implement Functionality
BABusiness
Implement Automated
Acceptance Tests
Dev
End Development Iteration
Start Development
Iteration
#1 Bring QA forward
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Testing efforts are aligned with business
needs and risk
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Re-‐start by mapping your done list to the wall
#1 Bring QA forward
#2 Map done list to the wall * Simple value-stream
* Lets the team take a conscious role in
defining its wall
Remedies Include QA in Work-‐In-‐Progress Limits
#1 Bring QA forward
#2 Map done list to the wall
#3 Include QA in WIP limits
Expand
this…… to
include this
* Encourages whole-team approach
Where do our biggest handoffs occur?
Here?Here?
Other considerations Quality Advocacy
Quality Advocacy
* Consultative
* Service provider
* Enabling and informing (not gatekeeping)
* Big picture-oriented
* Polyskilled and skill sharer
* Courageous
Other considerations Integrated QA:
QA is nowhere – and everywhereQuality Advocacy
Integrated QA * Remove Test/QA as a separate column altogether
* QA provides real-time, zero-cycle-time feedback
* Decouples what from who,
decreases bottleneck
* Commits devs and testers
toward same goal:
working, tested software
So do we have a place for
any kind of end-of-cycle testing?
Other considerations Exploratory Testing as First-‐Class Practice
Quality Advocacy
Integrated QA
Exploratory testing
* Not simply “clickin’ around” but
highly-skilled discipline
* Anyone with the right skill, independence can do it
* Model it on the wall
So what are you
going to do starting Wednesday?
References
§  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/
§  Barry Boehm, Software Engineering Economics
§  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html
§  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban
§  Deming Institute, http://deming.org/
mphilip@thoughtworks.com
@mattphilip

More Related Content

What's hot

Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
Kari Kakkonen
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
Original Software
 
How to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile TestingHow to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile Testing
Atlassian
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
Zbyszek Mockun
 
Agile testing
Agile testingAgile testing
Agile testing
Yogita patil
 
Agile testing - Testing From Day 1
Agile testing - Testing From Day 1Agile testing - Testing From Day 1
Agile testing - Testing From Day 1
Kaizenko
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
Tharinda Liyanage
 
Agile Testing Introduction
Agile Testing IntroductionAgile Testing Introduction
Agile Testing Introduction
Hai Tran Son
 
Optimizing Your Agile Testing Processes
Optimizing Your Agile Testing ProcessesOptimizing Your Agile Testing Processes
Optimizing Your Agile Testing Processes
Stanton Champion
 
Agile Testing Best Practices
Agile Testing Best PracticesAgile Testing Best Practices
Agile Testing Best Practices
Stephen Ritchie
 
Agile Testing and Test Automation
Agile Testing and Test AutomationAgile Testing and Test Automation
Agile Testing and Test Automation
Naveen Kumar Singh
 
Agile QA: Redefining Quality in the Wild West
Agile QA: Redefining Quality in the Wild WestAgile QA: Redefining Quality in the Wild West
Agile QA: Redefining Quality in the Wild West
Ford Prior
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
Raymond Adrian (Rad) Butalid
 
The Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test StrategyThe Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy
TechWell
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
vodQA
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about Certification
Michał Dudziak
 
Agile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroidsAgile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroidsVipul Gupta
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
suwalki24.pl
 
Agile Testing by Example
Agile Testing by ExampleAgile Testing by Example
Agile Testing by Example
Mikalai Alimenkou
 
Quality strategies in Agile Transformation
Quality strategies in Agile TransformationQuality strategies in Agile Transformation
Quality strategies in Agile Transformation
Kaali Dass PMP, PhD.
 

What's hot (20)

Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
 
How to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile TestingHow to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile Testing
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
 
Agile testing
Agile testingAgile testing
Agile testing
 
Agile testing - Testing From Day 1
Agile testing - Testing From Day 1Agile testing - Testing From Day 1
Agile testing - Testing From Day 1
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
 
Agile Testing Introduction
Agile Testing IntroductionAgile Testing Introduction
Agile Testing Introduction
 
Optimizing Your Agile Testing Processes
Optimizing Your Agile Testing ProcessesOptimizing Your Agile Testing Processes
Optimizing Your Agile Testing Processes
 
Agile Testing Best Practices
Agile Testing Best PracticesAgile Testing Best Practices
Agile Testing Best Practices
 
Agile Testing and Test Automation
Agile Testing and Test AutomationAgile Testing and Test Automation
Agile Testing and Test Automation
 
Agile QA: Redefining Quality in the Wild West
Agile QA: Redefining Quality in the Wild WestAgile QA: Redefining Quality in the Wild West
Agile QA: Redefining Quality in the Wild West
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
 
The Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test StrategyThe Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about Certification
 
Agile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroidsAgile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroids
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
 
Agile Testing by Example
Agile Testing by ExampleAgile Testing by Example
Agile Testing by Example
 
Quality strategies in Agile Transformation
Quality strategies in Agile TransformationQuality strategies in Agile Transformation
Quality strategies in Agile Transformation
 

Viewers also liked

Agile Qa Framework Jacky Wu
Agile Qa Framework Jacky WuAgile Qa Framework Jacky Wu
Agile Qa Framework Jacky Wu
Jacky Wu
 
Testing Best Practices
Testing Best PracticesTesting Best Practices
Testing Best Practices
Axway Appcelerator
 
Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)
Matthew Philip
 
Ugly Truths About Scaling Agile
Ugly Truths About Scaling AgileUgly Truths About Scaling Agile
Ugly Truths About Scaling Agile
Cprime
 
Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)
Vlad Mysla
 
Agile QA Process
Agile QA ProcessAgile QA Process
Agile QA Process
Anand Bagmar
 

Viewers also liked (6)

Agile Qa Framework Jacky Wu
Agile Qa Framework Jacky WuAgile Qa Framework Jacky Wu
Agile Qa Framework Jacky Wu
 
Testing Best Practices
Testing Best PracticesTesting Best Practices
Testing Best Practices
 
Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)
 
Ugly Truths About Scaling Agile
Ugly Truths About Scaling AgileUgly Truths About Scaling Agile
Ugly Truths About Scaling Agile
 
Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)
 
Agile QA Process
Agile QA ProcessAgile QA Process
Agile QA Process
 

Similar to Agile QA 2.0

Moving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by ExampleMoving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by Example
Steve Rogalsky
 
Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...
Yuval Yeret
 
Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development” Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development”
Dakiry
 
Ethan huang 全民qa
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qaOdd-e
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Tomas Riha
 
Developing Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CDDeveloping Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CD
Paul Hepworth
 
Test Improvement - Any place, anytime, any where
Test Improvement - Any place, anytime, any whereTest Improvement - Any place, anytime, any where
Test Improvement - Any place, anytime, any where
Ruud Teunissen
 
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
KMS Technology
 
Testing in a DevOps team
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps team
Laurent PY
 
Continuous delivery is more than dev ops
Continuous delivery is more than dev opsContinuous delivery is more than dev ops
Continuous delivery is more than dev ops
Agile Montréal
 
TDD and Getting Paid
TDD and Getting PaidTDD and Getting Paid
TDD and Getting Paid
Rowan Merewood
 
The DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It RightThe DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It Right
Inflectra
 
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
ColomboCampsCommunity
 
Testing Sap: Modern Methodology
Testing Sap: Modern MethodologyTesting Sap: Modern Methodology
Testing Sap: Modern Methodology
Ethan Jewett
 
Qa management in big agile teams
Qa management in big agile teamsQa management in big agile teams
Qa management in big agile teams
Vladimir Primakov (Volodymyr Prymakov)
 
Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?
Paul Gerrard
 
Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Keeping Your DevOps Transformation From Crushing Your Ops Capacity Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Rundeck
 
Release Management for Large Enterprises
Release Management for Large EnterprisesRelease Management for Large Enterprises
Release Management for Large EnterprisesSalesforce Developers
 
Beyond TDD: Enabling Your Team to Continuously Deliver Software
Beyond TDD: Enabling Your Team to Continuously Deliver SoftwareBeyond TDD: Enabling Your Team to Continuously Deliver Software
Beyond TDD: Enabling Your Team to Continuously Deliver Software
Chris Weldon
 
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Agile India
 

Similar to Agile QA 2.0 (20)

Moving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by ExampleMoving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by Example
 
Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...
 
Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development” Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development”
 
Ethan huang 全民qa
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qa
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
 
Developing Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CDDeveloping Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CD
 
Test Improvement - Any place, anytime, any where
Test Improvement - Any place, anytime, any whereTest Improvement - Any place, anytime, any where
Test Improvement - Any place, anytime, any where
 
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
 
Testing in a DevOps team
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps team
 
Continuous delivery is more than dev ops
Continuous delivery is more than dev opsContinuous delivery is more than dev ops
Continuous delivery is more than dev ops
 
TDD and Getting Paid
TDD and Getting PaidTDD and Getting Paid
TDD and Getting Paid
 
The DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It RightThe DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It Right
 
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
 
Testing Sap: Modern Methodology
Testing Sap: Modern MethodologyTesting Sap: Modern Methodology
Testing Sap: Modern Methodology
 
Qa management in big agile teams
Qa management in big agile teamsQa management in big agile teams
Qa management in big agile teams
 
Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?
 
Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Keeping Your DevOps Transformation From Crushing Your Ops Capacity Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Keeping Your DevOps Transformation From Crushing Your Ops Capacity
 
Release Management for Large Enterprises
Release Management for Large EnterprisesRelease Management for Large Enterprises
Release Management for Large Enterprises
 
Beyond TDD: Enabling Your Team to Continuously Deliver Software
Beyond TDD: Enabling Your Team to Continuously Deliver SoftwareBeyond TDD: Enabling Your Team to Continuously Deliver Software
Beyond TDD: Enabling Your Team to Continuously Deliver Software
 
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
 

More from Matthew Philip

Metrics at Every (Flight) Level
Metrics at Every (Flight) LevelMetrics at Every (Flight) Level
Metrics at Every (Flight) Level
Matthew Philip
 
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
Matthew Philip
 
The 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational LeaderThe 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational Leader
Matthew Philip
 
Strategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to VisionStrategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to Vision
Matthew Philip
 
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Matthew Philip
 
Stop writing stories, start validating working software
 Stop writing stories, start validating working software Stop writing stories, start validating working software
Stop writing stories, start validating working software
Matthew Philip
 
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
Matthew Philip
 
From Andon to Yokoten: Japanese for Agilists
From Andon to Yokoten: Japanese for AgilistsFrom Andon to Yokoten: Japanese for Agilists
From Andon to Yokoten: Japanese for Agilists
Matthew Philip
 
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
Matthew Philip
 
Leadership at every level [prdc2019]
Leadership at every level [prdc2019]Leadership at every level [prdc2019]
Leadership at every level [prdc2019]
Matthew Philip
 
No (Lab) Jacket Required [Agile Midwest Conference]
No (Lab) Jacket Required [Agile Midwest Conference]No (Lab) Jacket Required [Agile Midwest Conference]
No (Lab) Jacket Required [Agile Midwest Conference]
Matthew Philip
 
Leadership at Every Level: Practices for Aligned Autonomy
Leadership at Every Level: Practices for Aligned AutonomyLeadership at Every Level: Practices for Aligned Autonomy
Leadership at Every Level: Practices for Aligned Autonomy
Matthew Philip
 
Kanban Cadences for Santa
Kanban Cadences for SantaKanban Cadences for Santa
Kanban Cadences for Santa
Matthew Philip
 
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Portfolio kanban (St. Louis Agile Product Ownership Meetup)Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Matthew Philip
 
Culture add over culture fit [flowcon 2018]
Culture add over culture fit [flowcon 2018]Culture add over culture fit [flowcon 2018]
Culture add over culture fit [flowcon 2018]
Matthew Philip
 
The Service Delivery Review: The Missing Agile Feedback Loop
The Service Delivery Review: The Missing Agile Feedback LoopThe Service Delivery Review: The Missing Agile Feedback Loop
The Service Delivery Review: The Missing Agile Feedback Loop
Matthew Philip
 
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Matthew Philip
 
Leadership at Every Level: Intent-Based Leadership Practices
Leadership at Every Level: Intent-Based Leadership PracticesLeadership at Every Level: Intent-Based Leadership Practices
Leadership at Every Level: Intent-Based Leadership Practices
Matthew Philip
 
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Matthew Philip
 
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
Matthew Philip
 

More from Matthew Philip (20)

Metrics at Every (Flight) Level
Metrics at Every (Flight) LevelMetrics at Every (Flight) Level
Metrics at Every (Flight) Level
 
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
 
The 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational LeaderThe 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational Leader
 
Strategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to VisionStrategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to Vision
 
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
 
Stop writing stories, start validating working software
 Stop writing stories, start validating working software Stop writing stories, start validating working software
Stop writing stories, start validating working software
 
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
 
From Andon to Yokoten: Japanese for Agilists
From Andon to Yokoten: Japanese for AgilistsFrom Andon to Yokoten: Japanese for Agilists
From Andon to Yokoten: Japanese for Agilists
 
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
 
Leadership at every level [prdc2019]
Leadership at every level [prdc2019]Leadership at every level [prdc2019]
Leadership at every level [prdc2019]
 
No (Lab) Jacket Required [Agile Midwest Conference]
No (Lab) Jacket Required [Agile Midwest Conference]No (Lab) Jacket Required [Agile Midwest Conference]
No (Lab) Jacket Required [Agile Midwest Conference]
 
Leadership at Every Level: Practices for Aligned Autonomy
Leadership at Every Level: Practices for Aligned AutonomyLeadership at Every Level: Practices for Aligned Autonomy
Leadership at Every Level: Practices for Aligned Autonomy
 
Kanban Cadences for Santa
Kanban Cadences for SantaKanban Cadences for Santa
Kanban Cadences for Santa
 
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Portfolio kanban (St. Louis Agile Product Ownership Meetup)Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
 
Culture add over culture fit [flowcon 2018]
Culture add over culture fit [flowcon 2018]Culture add over culture fit [flowcon 2018]
Culture add over culture fit [flowcon 2018]
 
The Service Delivery Review: The Missing Agile Feedback Loop
The Service Delivery Review: The Missing Agile Feedback LoopThe Service Delivery Review: The Missing Agile Feedback Loop
The Service Delivery Review: The Missing Agile Feedback Loop
 
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
 
Leadership at Every Level: Intent-Based Leadership Practices
Leadership at Every Level: Intent-Based Leadership PracticesLeadership at Every Level: Intent-Based Leadership Practices
Leadership at Every Level: Intent-Based Leadership Practices
 
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
 
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
 

Recently uploaded

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 

Recently uploaded (20)

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 

Agile QA 2.0

  • 2.
  • 3.
  • 4. Why this talk? 1.  Agile QA 1.0 never made it past “staging”
  • 5. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice
  • 6. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice 3.  Work together to come up with better ways
  • 7. So what have we learned? -- Barry Boehm (1981)
  • 8. Eliminate the need for massive inspection by building quality into the product in the first place. -- Edwards Deming (1982) So what have we learned? ” “
  • 9. Handoffs are waste. -- Mary Poppendieck (2003) So what have we learned?
  • 10. Move testing to the front of the development process -- Agile Testing (2009) So what have we learned? ” “
  • 11. Kanban doesn’t mean a return to waterfall. -- David Anderson (paraphrase, 2013) So what have we learned?
  • 12. So of course what do our card walls look like?
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19. How did this happen? We simply repeat the same process that we've always done QAs aren’t assertive enough to ask for change We figure that, if we don’t, the QA won't have anything to do (resource efficiency) #1 #2 #3
  • 20. But why is this a problem? End-‐of-‐cycle testing (mini waterfalls) #1 Creates too long a feedback loop #2 Virtually ensures that our testing efforts are misaligned with value  #3 Reinforces gatekeeper role (oppositional) #4 Creates inefficient test suite
  • 21. But why is this a problem? Limits options to checking through GUI Creates inefficient test suite Which leads to this
  • 22. So how do we remedy these problems?
  • 23.
  • 24. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test
  • 25. Remedies QA and devs collaborate to determine the right place to test#1 Bring QA forward Many here Some here A few here
  • 26. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 27. Remedies Acceptance-‐Test-‐Driven Development Development Iterations Development Engine Write Story and Scenarios Business Showcase Story Testing Story Planning Session BA / QA Signoff on Dev Box Daily BA/QA demo Tester Dev BA TesterDev Tester BADev Tester BADev BABusiness Tester Start Here System Testing Implement Functionality BABusiness Implement Automated Acceptance Tests Dev End Development Iteration Start Development Iteration #1 Bring QA forward
  • 28. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Testing efforts are aligned with business needs and risk * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 29. Remedies Re-‐start by mapping your done list to the wall #1 Bring QA forward #2 Map done list to the wall * Simple value-stream * Lets the team take a conscious role in defining its wall
  • 30. Remedies Include QA in Work-‐In-‐Progress Limits #1 Bring QA forward #2 Map done list to the wall #3 Include QA in WIP limits Expand this…… to include this * Encourages whole-team approach
  • 31. Where do our biggest handoffs occur? Here?Here?
  • 32.
  • 33. Other considerations Quality Advocacy Quality Advocacy * Consultative * Service provider * Enabling and informing (not gatekeeping) * Big picture-oriented * Polyskilled and skill sharer * Courageous
  • 34. Other considerations Integrated QA: QA is nowhere – and everywhereQuality Advocacy Integrated QA * Remove Test/QA as a separate column altogether * QA provides real-time, zero-cycle-time feedback * Decouples what from who, decreases bottleneck * Commits devs and testers toward same goal: working, tested software
  • 35. So do we have a place for any kind of end-of-cycle testing?
  • 36.
  • 37. Other considerations Exploratory Testing as First-‐Class Practice Quality Advocacy Integrated QA Exploratory testing * Not simply “clickin’ around” but highly-skilled discipline * Anyone with the right skill, independence can do it * Model it on the wall
  • 38. So what are you going to do starting Wednesday?
  • 39. References §  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/ §  Barry Boehm, Software Engineering Economics §  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html §  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban §  Deming Institute, http://deming.org/ mphilip@thoughtworks.com @mattphilip