SlideShare a Scribd company logo
1 of 39
Download to read offline
Agile QA 2.0
@aceconf
@mattphilip
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
Why this talk?
1.  Agile QA 1.0 never
made it past “staging”
2.  Call-to-action to
reinvigorate the state
of the practice
3.  Work together to
come up
with better ways
So what have
we learned?
-- Barry Boehm (1981)
Eliminate the need for massive
inspection by building quality into the
product in the first place.
-- Edwards Deming (1982)
So what have
we learned?
”
“
Handoffs are waste.
-- Mary Poppendieck (2003)
So what have
we learned?
Move testing to the
front of the
development process
-- Agile Testing (2009)
So what have
we learned?
”
“
Kanban doesn’t mean a return to
waterfall.
-- David Anderson (paraphrase, 2013)
So what have
we learned?
So of course what do our card walls look like?
How did this happen?
We simply repeat the same process
that we've always done
QAs aren’t assertive enough to ask for change
We figure that, if we don’t, the QA
won't have anything to do (resource
efficiency)
#1
#2
#3
But why is this
a problem?
End-‐of-‐cycle testing (mini waterfalls)
#1 Creates too long a feedback loop
#2 Virtually ensures that our testing efforts are
misaligned with value 
#3 Reinforces gatekeeper role (oppositional)
#4 Creates inefficient test suite
But why is this
a problem?
Limits
options to
checking
through
GUI
Creates inefficient test suite
Which
leads to
this
So how do
we remedy
these problems?
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
Remedies QA and devs collaborate to determine the
right place to test#1 Bring QA forward
Many
here
Some
here
A few
here
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Acceptance-‐Test-‐Driven Development
Development
Iterations
Development
Engine
Write Story and Scenarios
Business Showcase
Story Testing
Story Planning Session
BA / QA Signoff on Dev Box
Daily BA/QA demo
Tester
Dev
BA
TesterDev
Tester BADev
Tester BADev
BABusiness
Tester
Start
Here
System
Testing
Implement Functionality
BABusiness
Implement Automated
Acceptance Tests
Dev
End Development Iteration
Start Development
Iteration
#1 Bring QA forward
Remedies Bring QA Forward
#1 Bring QA forward
* QA and devs collaborate to determine the
right places to test
* Testing efforts are aligned with business
needs and risk
* Specify acceptance tests up-front
(Acceptance-Test-Driven Development)
Remedies Re-‐start by mapping your done list to the wall
#1 Bring QA forward
#2 Map done list to the wall * Simple value-stream
* Lets the team take a conscious role in
defining its wall
Remedies Include QA in Work-‐In-‐Progress Limits
#1 Bring QA forward
#2 Map done list to the wall
#3 Include QA in WIP limits
Expand
this…… to
include this
* Encourages whole-team approach
Where do our biggest handoffs occur?
Here?Here?
Other considerations Quality Advocacy
Quality Advocacy
* Consultative
* Service provider
* Enabling and informing (not gatekeeping)
* Big picture-oriented
* Polyskilled and skill sharer
* Courageous
Other considerations Integrated QA:
QA is nowhere – and everywhereQuality Advocacy
Integrated QA * Remove Test/QA as a separate column altogether
* QA provides real-time, zero-cycle-time feedback
* Decouples what from who,
decreases bottleneck
* Commits devs and testers
toward same goal:
working, tested software
So do we have a place for
any kind of end-of-cycle testing?
Other considerations Exploratory Testing as First-‐Class Practice
Quality Advocacy
Integrated QA
Exploratory testing
* Not simply “clickin’ around” but
highly-skilled discipline
* Anyone with the right skill, independence can do it
* Model it on the wall
So what are you
going to do starting Wednesday?
References
§  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/
§  Barry Boehm, Software Engineering Economics
§  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html
§  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban
§  Deming Institute, http://deming.org/
mphilip@thoughtworks.com
@mattphilip

More Related Content

What's hot

Agile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroidsAgile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroids
Vipul Gupta
 

What's hot (20)

Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
 
Optimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile WorldOptimising Quality Assurance in an Agile World
Optimising Quality Assurance in an Agile World
 
How to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile TestingHow to Build in Quality from Day 1 using Lean QA and Agile Testing
How to Build in Quality from Day 1 using Lean QA and Agile Testing
 
Shift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality AssuranceShift left as first transformation step into Quality Assurance
Shift left as first transformation step into Quality Assurance
 
Agile testing
Agile testingAgile testing
Agile testing
 
Agile testing - Testing From Day 1
Agile testing - Testing From Day 1Agile testing - Testing From Day 1
Agile testing - Testing From Day 1
 
Testing strategy for agile projects updated
Testing strategy for agile projects updatedTesting strategy for agile projects updated
Testing strategy for agile projects updated
 
Agile Testing Introduction
Agile Testing IntroductionAgile Testing Introduction
Agile Testing Introduction
 
Optimizing Your Agile Testing Processes
Optimizing Your Agile Testing ProcessesOptimizing Your Agile Testing Processes
Optimizing Your Agile Testing Processes
 
Agile Testing Best Practices
Agile Testing Best PracticesAgile Testing Best Practices
Agile Testing Best Practices
 
Agile Testing and Test Automation
Agile Testing and Test AutomationAgile Testing and Test Automation
Agile Testing and Test Automation
 
Agile QA: Redefining Quality in the Wild West
Agile QA: Redefining Quality in the Wild WestAgile QA: Redefining Quality in the Wild West
Agile QA: Redefining Quality in the Wild West
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
 
The Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test StrategyThe Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy
 
Introduction to Agile Testing
Introduction to Agile TestingIntroduction to Agile Testing
Introduction to Agile Testing
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about Certification
 
Agile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroidsAgile tour ncr test360_degree - agile testing on steroids
Agile tour ncr test360_degree - agile testing on steroids
 
Agile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User GroupAgile Testing - presentation for Agile User Group
Agile Testing - presentation for Agile User Group
 
Agile Testing by Example
Agile Testing by ExampleAgile Testing by Example
Agile Testing by Example
 
Quality strategies in Agile Transformation
Quality strategies in Agile TransformationQuality strategies in Agile Transformation
Quality strategies in Agile Transformation
 

Viewers also liked (6)

Agile Qa Framework Jacky Wu
Agile Qa Framework Jacky WuAgile Qa Framework Jacky Wu
Agile Qa Framework Jacky Wu
 
Testing Best Practices
Testing Best PracticesTesting Best Practices
Testing Best Practices
 
Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)Workplay: The gamified future of agile development (Agile India 2012)
Workplay: The gamified future of agile development (Agile India 2012)
 
Ugly Truths About Scaling Agile
Ugly Truths About Scaling AgileUgly Truths About Scaling Agile
Ugly Truths About Scaling Agile
 
Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)Scaling Agile at Spotify (representation)
Scaling Agile at Spotify (representation)
 
Agile QA Process
Agile QA ProcessAgile QA Process
Agile QA Process
 

Similar to Agile QA 2.0

Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...
Yuval Yeret
 
Ethan huang 全民qa
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qa
Odd-e
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
Tomas Riha
 
Release Management for Large Enterprises
Release Management for Large EnterprisesRelease Management for Large Enterprises
Release Management for Large Enterprises
Salesforce Developers
 

Similar to Agile QA 2.0 (20)

Moving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by ExampleMoving Towards Zero Defects with Specification by Example
Moving Towards Zero Defects with Specification by Example
 
Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...Using flow approaches to effectively manage agile testing at the enterprise l...
Using flow approaches to effectively manage agile testing at the enterprise l...
 
Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development” Iakiv Kramarenko: “Quality Driven Development”
Iakiv Kramarenko: “Quality Driven Development”
 
Ethan huang 全民qa
Ethan huang   全民qaEthan huang   全民qa
Ethan huang 全民qa
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
 
Developing Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CDDeveloping Quality Products Quickly through a Culture of CI/CD
Developing Quality Products Quickly through a Culture of CI/CD
 
Test Improvement - Any place, anytime, any where
Test Improvement - Any place, anytime, any whereTest Improvement - Any place, anytime, any where
Test Improvement - Any place, anytime, any where
 
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps
 
Testing in a DevOps team
Testing in a DevOps teamTesting in a DevOps team
Testing in a DevOps team
 
Continuous delivery is more than dev ops
Continuous delivery is more than dev opsContinuous delivery is more than dev ops
Continuous delivery is more than dev ops
 
TDD and Getting Paid
TDD and Getting PaidTDD and Getting Paid
TDD and Getting Paid
 
The DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It RightThe DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It Right
 
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
'Stakeholder Engagement Shortcuts': Ilan Goldstein @ Colombo Agile Conference...
 
Testing Sap: Modern Methodology
Testing Sap: Modern MethodologyTesting Sap: Modern Methodology
Testing Sap: Modern Methodology
 
Qa management in big agile teams
Qa management in big agile teamsQa management in big agile teams
Qa management in big agile teams
 
Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?Will The Test Leaders Stand Up?
Will The Test Leaders Stand Up?
 
Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Keeping Your DevOps Transformation From Crushing Your Ops Capacity Keeping Your DevOps Transformation From Crushing Your Ops Capacity
Keeping Your DevOps Transformation From Crushing Your Ops Capacity
 
Release Management for Large Enterprises
Release Management for Large EnterprisesRelease Management for Large Enterprises
Release Management for Large Enterprises
 
Beyond TDD: Enabling Your Team to Continuously Deliver Software
Beyond TDD: Enabling Your Team to Continuously Deliver SoftwareBeyond TDD: Enabling Your Team to Continuously Deliver Software
Beyond TDD: Enabling Your Team to Continuously Deliver Software
 
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
Acceptance Testing for Continuous Delivery by Dave Farley at #AgileIndia2019
 

More from Matthew Philip

No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
Matthew Philip
 

More from Matthew Philip (20)

Metrics at Every (Flight) Level
Metrics at Every (Flight) LevelMetrics at Every (Flight) Level
Metrics at Every (Flight) Level
 
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
No (Lab) Jacket Required Workshop [Kanban Global Summit 2022]
 
The 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational LeaderThe 8 Stances of 
a Transformational Leader
The 8 Stances of 
a Transformational Leader
 
Strategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to VisionStrategy Deployment: Aligning Action to Vision
Strategy Deployment: Aligning Action to Vision
 
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
Metrics at Every (Flight) Level [2020 Agile Kanban Istanbul FlowConf]
 
Stop writing stories, start validating working software
 Stop writing stories, start validating working software Stop writing stories, start validating working software
Stop writing stories, start validating working software
 
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
No (Lab) Jacket Required: Designing Experiments for Learning [XP2020 Conference]
 
From Andon to Yokoten: Japanese for Agilists
From Andon to Yokoten: Japanese for AgilistsFrom Andon to Yokoten: Japanese for Agilists
From Andon to Yokoten: Japanese for Agilists
 
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
No (Lab) Jacket Required: Designing Experiments for Learning [2019 Flowcon]
 
Leadership at every level [prdc2019]
Leadership at every level [prdc2019]Leadership at every level [prdc2019]
Leadership at every level [prdc2019]
 
No (Lab) Jacket Required [Agile Midwest Conference]
No (Lab) Jacket Required [Agile Midwest Conference]No (Lab) Jacket Required [Agile Midwest Conference]
No (Lab) Jacket Required [Agile Midwest Conference]
 
Leadership at Every Level: Practices for Aligned Autonomy
Leadership at Every Level: Practices for Aligned AutonomyLeadership at Every Level: Practices for Aligned Autonomy
Leadership at Every Level: Practices for Aligned Autonomy
 
Kanban Cadences for Santa
Kanban Cadences for SantaKanban Cadences for Santa
Kanban Cadences for Santa
 
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Portfolio kanban (St. Louis Agile Product Ownership Meetup)Portfolio kanban (St. Louis Agile Product Ownership Meetup)
Portfolio kanban (St. Louis Agile Product Ownership Meetup)
 
Culture add over culture fit [flowcon 2018]
Culture add over culture fit [flowcon 2018]Culture add over culture fit [flowcon 2018]
Culture add over culture fit [flowcon 2018]
 
The Service Delivery Review: The Missing Agile Feedback Loop
The Service Delivery Review: The Missing Agile Feedback LoopThe Service Delivery Review: The Missing Agile Feedback Loop
The Service Delivery Review: The Missing Agile Feedback Loop
 
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
Forecasting with Less Effort and More Accuracy (Agile Camp NY 2018)
 
Leadership at Every Level: Intent-Based Leadership Practices
Leadership at Every Level: Intent-Based Leadership PracticesLeadership at Every Level: Intent-Based Leadership Practices
Leadership at Every Level: Intent-Based Leadership Practices
 
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
Thriving (Not Merely Surviving) the First Year: Redesigning the Onboarding Ex...
 
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
The Service-Delivery Review: The Missing Agile Feedback Loop [London Lean Kan...
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

Agile QA 2.0

  • 2.
  • 3.
  • 4. Why this talk? 1.  Agile QA 1.0 never made it past “staging”
  • 5. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice
  • 6. Why this talk? 1.  Agile QA 1.0 never made it past “staging” 2.  Call-to-action to reinvigorate the state of the practice 3.  Work together to come up with better ways
  • 7. So what have we learned? -- Barry Boehm (1981)
  • 8. Eliminate the need for massive inspection by building quality into the product in the first place. -- Edwards Deming (1982) So what have we learned? ” “
  • 9. Handoffs are waste. -- Mary Poppendieck (2003) So what have we learned?
  • 10. Move testing to the front of the development process -- Agile Testing (2009) So what have we learned? ” “
  • 11. Kanban doesn’t mean a return to waterfall. -- David Anderson (paraphrase, 2013) So what have we learned?
  • 12. So of course what do our card walls look like?
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19. How did this happen? We simply repeat the same process that we've always done QAs aren’t assertive enough to ask for change We figure that, if we don’t, the QA won't have anything to do (resource efficiency) #1 #2 #3
  • 20. But why is this a problem? End-‐of-‐cycle testing (mini waterfalls) #1 Creates too long a feedback loop #2 Virtually ensures that our testing efforts are misaligned with value  #3 Reinforces gatekeeper role (oppositional) #4 Creates inefficient test suite
  • 21. But why is this a problem? Limits options to checking through GUI Creates inefficient test suite Which leads to this
  • 22. So how do we remedy these problems?
  • 23.
  • 24. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test
  • 25. Remedies QA and devs collaborate to determine the right place to test#1 Bring QA forward Many here Some here A few here
  • 26. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 27. Remedies Acceptance-‐Test-‐Driven Development Development Iterations Development Engine Write Story and Scenarios Business Showcase Story Testing Story Planning Session BA / QA Signoff on Dev Box Daily BA/QA demo Tester Dev BA TesterDev Tester BADev Tester BADev BABusiness Tester Start Here System Testing Implement Functionality BABusiness Implement Automated Acceptance Tests Dev End Development Iteration Start Development Iteration #1 Bring QA forward
  • 28. Remedies Bring QA Forward #1 Bring QA forward * QA and devs collaborate to determine the right places to test * Testing efforts are aligned with business needs and risk * Specify acceptance tests up-front (Acceptance-Test-Driven Development)
  • 29. Remedies Re-‐start by mapping your done list to the wall #1 Bring QA forward #2 Map done list to the wall * Simple value-stream * Lets the team take a conscious role in defining its wall
  • 30. Remedies Include QA in Work-‐In-‐Progress Limits #1 Bring QA forward #2 Map done list to the wall #3 Include QA in WIP limits Expand this…… to include this * Encourages whole-team approach
  • 31. Where do our biggest handoffs occur? Here?Here?
  • 32.
  • 33. Other considerations Quality Advocacy Quality Advocacy * Consultative * Service provider * Enabling and informing (not gatekeeping) * Big picture-oriented * Polyskilled and skill sharer * Courageous
  • 34. Other considerations Integrated QA: QA is nowhere – and everywhereQuality Advocacy Integrated QA * Remove Test/QA as a separate column altogether * QA provides real-time, zero-cycle-time feedback * Decouples what from who, decreases bottleneck * Commits devs and testers toward same goal: working, tested software
  • 35. So do we have a place for any kind of end-of-cycle testing?
  • 36.
  • 37. Other considerations Exploratory Testing as First-‐Class Practice Quality Advocacy Integrated QA Exploratory testing * Not simply “clickin’ around” but highly-skilled discipline * Anyone with the right skill, independence can do it * Model it on the wall
  • 38. So what are you going to do starting Wednesday?
  • 39. References §  Alister Scott, http://watirmelon.com/2013/02/28/the-new-qa-the-quality-advocate/ §  Barry Boehm, Software Engineering Economics §  Martin Fowler, http://martinfowler.com/bliki/TestPyramid.html §  InfoQ, http://www.infoq.com/articles/David-Anderson-Kanban §  Deming Institute, http://deming.org/ mphilip@thoughtworks.com @mattphilip