SlideShare a Scribd company logo
1 of 24
Download to read offline
 
	
  
	
  
	
  
	
  
	
  
	
  
	
  
W16	
  
Agile	
  Testing	
  
5/10/17	
  15:00	
  
	
  
	
  
	
  
	
  
	
  
When	
  the	
  System	
  Creaks:	
  Lessons	
  
Learned	
  in	
  Agile	
  Maintenance	
  
	
  
Presented	
  by:	
  	
  
	
  
	
   Jim	
  Peers	
  
	
  
PQA	
  Testing	
  
	
  
Brought	
  to	
  you	
  by:	
  	
  
	
  	
  
	
  
	
  
	
  
	
  
350	
  Corporate	
  Way,	
  Suite	
  400,	
  Orange	
  Park,	
  FL	
  32073	
  	
  
888-­‐-­‐-­‐268-­‐-­‐-­‐8770	
  ·∙·∙	
  904-­‐-­‐-­‐278-­‐-­‐-­‐0524	
  -­‐	
  info@techwell.com	
  -­‐	
  http://www.starwest.techwell.com/	
  	
  	
  
 
	
  	
  
	
  
Jim	
  Peers	
  
	
  
A	
  QA	
  practitioner	
  with	
  PQA	
  Testing,	
  Jim	
  Peers	
  has	
  more	
  than	
  sixteen	
  years	
  of	
  
experience	
  in	
  software	
  development	
  and	
  testing	
  in	
  multiple	
  industry	
  verticals.	
  After	
  
working	
  in	
  the	
  scientific	
  research	
  realm	
  for	
  a	
  number	
  of	
  years,	
  Jim	
  moved	
  into	
  
software	
  development,	
  holding	
  roles	
  as	
  tester,	
  test	
  architect,	
  developer,	
  team	
  lead,	
  
project	
  manager,	
  and	
  product	
  manager.	
  A	
  trusted	
  technical	
  advisor	
  to	
  clients,	
  Jim	
  
creates	
  test	
  strategies,	
  and	
  mentors	
  and	
  assists	
  testers	
  on	
  multiple	
  projects.	
  
	
  
1
When the System Creaks
Lessons	
  Learned	
  in	
  Agile	
  Maintenance	
  
Jim	
  Peers	
  
2
© PQA Testing Ltd.
About Me
u  QA	
  Prac55oner	
  at	
  PQA	
  Tes5ng	
  in	
  Vancouver	
  
u  I	
  have	
  been:	
  
u  Developer	
  
u  Test	
  architect	
  
u  Team	
  lead	
  
u  Project	
  Manager	
  
u  Product	
  Manager	
  
3
© PQA Testing Ltd.
Agile in an Ideal World
u  Greenfield	
  –	
  no	
  maintenance	
  
u  Automated	
  tests	
  
4
© PQA Testing Ltd.
Mature Product Problems
u  Tech	
  debt	
  
u  Lack	
  of	
  con5nuity	
  of	
  team	
  knowledge	
  
u  Quality	
  not	
  built	
  in	
  
u  LiHle	
  (if	
  any)	
  automa5on	
  
5
© PQA Testing Ltd.
Mature Products can be Hard to Test
u  Code	
  is	
  rarely	
  removed	
  
u  Increased	
  complexity	
  
6
© PQA Testing Ltd.
Waiting for the Next Big Thing
u  Where	
  is	
  that	
  new	
  version	
  anyway?	
  
u  Your	
  product	
  is	
  longer-­‐lived	
  than	
  you	
  expect	
  
7
© PQA Testing Ltd.
Technical Debt
u  Example:	
  Upgrading	
  web	
  elements	
  -­‐-­‐	
  >1	
  person-­‐year	
  of	
  effort	
  
u  Whole	
  team,	
  including	
  the	
  business,	
  needs	
  to	
  understand	
  the	
  effects	
  
u  Changing	
  from	
  Flash	
  to	
  HTML5	
  controls	
  
8
© PQA Testing Ltd.
Security
u  Increasingly	
  complex	
  
u  Customers	
  demand	
  it	
  
u  Modern	
  frameworks	
  have	
  more	
  built-­‐in	
  security	
  
9
© PQA Testing Ltd.
Localization
u  Changes	
  to	
  strings	
  can	
  be	
  small	
  or	
  wholesale	
  
u  Example:	
  more	
  formal	
  level	
  of	
  address	
  desired	
  
10
© PQA Testing Ltd.
Data
u  Changing	
  data	
  structures	
  is	
  high	
  risk	
  
u  Some5mes	
  unavoidable	
  
11
© PQA Testing Ltd.
About Those Customers…
u  Might	
  need	
  to	
  do	
  a	
  fix	
  or	
  create	
  a	
  new	
  feature	
  to	
  retain	
  
u  Compe5ng	
  agendas	
  
12
© PQA Testing Ltd.
Scheduling
u  Need	
  to	
  be	
  flexible	
  
u  Sprinkle	
  bug	
  fixes,	
  security	
  fixes	
  in	
  
u  Build	
  in	
  slack	
  to	
  accommodate	
  urgent	
  fixes	
  
u  Fixes	
  may	
  take	
  several	
  sprints	
  
13
© PQA Testing Ltd.
Root Cause Analysis
u  Hold	
  a	
  session	
  a^er	
  any	
  cri5cal	
  bug	
  fix	
  
u  Use	
  the	
  5	
  Whys	
  
u  Not	
  about	
  blaming	
  
u  Output:	
  ac5ons,	
  people	
  assigned,	
  5meline	
  
14
© PQA Testing Ltd.
Tester Skillset
u  Good	
  to	
  have	
  senior	
  people	
  on	
  legacy	
  products	
  
u  Good	
  product	
  knowledge	
  a	
  plus	
  
u  Code	
  literacy	
  
u  Release	
  management	
  
u  Communica5on	
  
15
© PQA Testing Ltd.
Code Review
u  Important	
  for	
  testers	
  to	
  be	
  involved	
  
u  Think	
  about	
  risk,	
  regression	
  
u  Analysis	
  takes	
  more	
  focus	
  
u  Small	
  changes	
  may	
  have	
  big	
  implica5ons	
  
u  Issues	
  cannot	
  escape	
  into	
  the	
  wild	
  
16
© PQA Testing Ltd.
Automation
u  Anything	
  is	
  beHer	
  than	
  nothing	
  
u  Bugs	
  tend	
  to	
  cluster,	
  so	
  building	
  in	
  regression	
  tests	
  can	
  pay	
  off	
  
u  If	
  no	
  unit	
  tests	
  for	
  an	
  area	
  of	
  code	
  being	
  fixed,	
  add	
  them	
  
17
© PQA Testing Ltd.
Add Logging
u  A	
  good	
  5me	
  to	
  add	
  if	
  there	
  isn’t	
  any	
  
u  Helps	
  with	
  testability	
  
18
© PQA Testing Ltd.
Feature Flags
u  Cau5on:	
  may	
  cause	
  fragility	
  
u  Recommend	
  removing	
  them	
  once	
  fully	
  in	
  use	
  
u  Good	
  to	
  know	
  which	
  toggles	
  are	
  on	
  –	
  build	
  a	
  system	
  to	
  report	
  config	
  
19
© PQA Testing Ltd.
Team Morale
u  Good	
  to	
  move	
  people	
  on/off	
  maintenance	
  (unless	
  they	
  really	
  love	
  it!)	
  
u  Occasionally	
  crazy	
  hours	
  -­‐>	
  burnout	
  possibili5es	
  
20
© PQA Testing Ltd.
Retrospectives
u  Make	
  sure	
  they	
  are	
  produc5ve	
  
u  If	
  people	
  are	
  just	
  going	
  through	
  the	
  mo5ons,	
  consider	
  only	
  having	
  them	
  when	
  needed	
  
21
© PQA Testing Ltd.
Summary
u  Flexibility	
  is	
  key	
  
u  Add	
  automa5on	
  where	
  you	
  can	
  
u  Count	
  on	
  the	
  product	
  living	
  longer	
  than	
  you	
  expect	
  
22
© PQA Testing Ltd.

More Related Content

What's hot

Success Snapshot Webinar
Success Snapshot Webinar  Success Snapshot Webinar
Success Snapshot Webinar Gainsight
 
Assessing the business value of Agile Engineering Practices
Assessing the business value of Agile Engineering PracticesAssessing the business value of Agile Engineering Practices
Assessing the business value of Agile Engineering PracticesRob Myers
 
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Kees Blokland
 
Draft of final internship presentation
Draft of final internship presentationDraft of final internship presentation
Draft of final internship presentationArafat Zaman Anik
 
Lifestyles of the rich and frameworkless
Lifestyles of the rich and frameworklessLifestyles of the rich and frameworkless
Lifestyles of the rich and frameworklessEqual Experts
 
The Business Value of Agile Engineering Practices
The Business Value of Agile Engineering PracticesThe Business Value of Agile Engineering Practices
The Business Value of Agile Engineering PracticesRob Myers
 
Useful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandUseful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandKees Blokland
 
Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...
Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...
Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...XBOSoft
 
Lyndsay Prewer - Smoothing the continuous delivery path - a tale of two teams
Lyndsay Prewer - Smoothing the continuous delivery path - a tale of two teamsLyndsay Prewer - Smoothing the continuous delivery path - a tale of two teams
Lyndsay Prewer - Smoothing the continuous delivery path - a tale of two teamsAgile Lietuva
 
Moving Towards Operability & Organising for Continuous Delivery
Moving Towards Operability & Organising for Continuous DeliveryMoving Towards Operability & Organising for Continuous Delivery
Moving Towards Operability & Organising for Continuous DeliveryEqual Experts
 
Smoothing the continuous delivery path – a tale of two teams - Lyndsay Prewer
Smoothing the continuous delivery path – a tale of two teams - Lyndsay PrewerSmoothing the continuous delivery path – a tale of two teams - Lyndsay Prewer
Smoothing the continuous delivery path – a tale of two teams - Lyndsay PrewerJAXLondon_Conference
 
Jeremy Kaszycki_Intern Presentation
Jeremy Kaszycki_Intern PresentationJeremy Kaszycki_Intern Presentation
Jeremy Kaszycki_Intern PresentationJeremy Kaszycki
 
Future of Software Testing
Future of Software TestingFuture of Software Testing
Future of Software TestingKari Kakkonen
 
All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...
All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...
All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...Texavi Innovative Solutions
 
Come creare un progetto con pipeline CI/CD e con Kubernetes
Come creare un progetto con pipeline CI/CD e con KubernetesCome creare un progetto con pipeline CI/CD e con Kubernetes
Come creare un progetto con pipeline CI/CD e con KubernetesRaffaele Colace
 
dotnet3_A610635_aditiDalmia
dotnet3_A610635_aditiDalmiadotnet3_A610635_aditiDalmia
dotnet3_A610635_aditiDalmiaADITI DALMIA
 
Effective Generation Fleet Management
Effective Generation Fleet ManagementEffective Generation Fleet Management
Effective Generation Fleet ManagementScottMadden, Inc.
 

What's hot (20)

Success Snapshot Webinar
Success Snapshot Webinar  Success Snapshot Webinar
Success Snapshot Webinar
 
Assessing the business value of Agile Engineering Practices
Assessing the business value of Agile Engineering PracticesAssessing the business value of Agile Engineering Practices
Assessing the business value of Agile Engineering Practices
 
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.
 
Draft of final internship presentation
Draft of final internship presentationDraft of final internship presentation
Draft of final internship presentation
 
Lifestyles of the rich and frameworkless
Lifestyles of the rich and frameworklessLifestyles of the rich and frameworkless
Lifestyles of the rich and frameworkless
 
The Business Value of Agile Engineering Practices
The Business Value of Agile Engineering PracticesThe Business Value of Agile Engineering Practices
The Business Value of Agile Engineering Practices
 
Useful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandUseful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees Blokland
 
Continuous is great
Continuous is greatContinuous is great
Continuous is great
 
Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...
Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...
Leading from behind - FoxHedge XBOSoft - Acceptance Test Driven Development -...
 
Lyndsay Prewer - Smoothing the continuous delivery path - a tale of two teams
Lyndsay Prewer - Smoothing the continuous delivery path - a tale of two teamsLyndsay Prewer - Smoothing the continuous delivery path - a tale of two teams
Lyndsay Prewer - Smoothing the continuous delivery path - a tale of two teams
 
Moving Towards Operability & Organising for Continuous Delivery
Moving Towards Operability & Organising for Continuous DeliveryMoving Towards Operability & Organising for Continuous Delivery
Moving Towards Operability & Organising for Continuous Delivery
 
Smoothing the continuous delivery path – a tale of two teams - Lyndsay Prewer
Smoothing the continuous delivery path – a tale of two teams - Lyndsay PrewerSmoothing the continuous delivery path – a tale of two teams - Lyndsay Prewer
Smoothing the continuous delivery path – a tale of two teams - Lyndsay Prewer
 
Jeremy Kaszycki_Intern Presentation
Jeremy Kaszycki_Intern PresentationJeremy Kaszycki_Intern Presentation
Jeremy Kaszycki_Intern Presentation
 
Agile Management with ITPP
Agile Management with ITPPAgile Management with ITPP
Agile Management with ITPP
 
Future of Software Testing
Future of Software TestingFuture of Software Testing
Future of Software Testing
 
All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...
All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...
All about Agile, an Overview - Texavi Tech Bootcamp on How to be agile- Texav...
 
Come creare un progetto con pipeline CI/CD e con Kubernetes
Come creare un progetto con pipeline CI/CD e con KubernetesCome creare un progetto con pipeline CI/CD e con Kubernetes
Come creare un progetto con pipeline CI/CD e con Kubernetes
 
dotnet3_A610635_aditiDalmia
dotnet3_A610635_aditiDalmiadotnet3_A610635_aditiDalmia
dotnet3_A610635_aditiDalmia
 
Test Curriculum Vitae v3.2
Test Curriculum Vitae v3.2Test Curriculum Vitae v3.2
Test Curriculum Vitae v3.2
 
Effective Generation Fleet Management
Effective Generation Fleet ManagementEffective Generation Fleet Management
Effective Generation Fleet Management
 

Similar to When the System Creaks: Lessons Learned in Agile Maintenance

Making Numbers Count: Metrics That Matter
Making Numbers Count: Metrics That MatterMaking Numbers Count: Metrics That Matter
Making Numbers Count: Metrics That MatterTechWell
 
Exploratory Testing and Automated Testing: Create a Healthy Relationship
Exploratory Testing and Automated Testing: Create a Healthy RelationshipExploratory Testing and Automated Testing: Create a Healthy Relationship
Exploratory Testing and Automated Testing: Create a Healthy RelationshipTechWell
 
San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...
San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...
San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...Andrey Falko
 
Are Your Continuous Tests Too Fragile for Agile?
Are Your Continuous Tests Too Fragile for Agile?Are Your Continuous Tests Too Fragile for Agile?
Are Your Continuous Tests Too Fragile for Agile?Parasoft
 
SAP TechEd 2018 OPP103 – An Introduction to DevOps
SAP TechEd 2018 OPP103 – An Introduction to DevOpsSAP TechEd 2018 OPP103 – An Introduction to DevOps
SAP TechEd 2018 OPP103 – An Introduction to DevOpsSAP Cloud Platform
 
Introducing Keyword-driven Test Automation
Introducing Keyword-driven Test AutomationIntroducing Keyword-driven Test Automation
Introducing Keyword-driven Test AutomationTechWell
 
Reaching for Your Quality Stretch Goals: Testing at Realtor.com
Reaching for Your Quality Stretch Goals: Testing at Realtor.comReaching for Your Quality Stretch Goals: Testing at Realtor.com
Reaching for Your Quality Stretch Goals: Testing at Realtor.comKlaus Salchner
 
Test Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate ValueTest Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate ValueTechWell
 
Testing in a continuous delivery environment
Testing in a continuous delivery environmentTesting in a continuous delivery environment
Testing in a continuous delivery environmentStefan Verhoeff
 
Shifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test AutomationShifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test AutomationTechWell
 
When Testers Feel Left Out in the Cold
When Testers Feel Left Out in the ColdWhen Testers Feel Left Out in the Cold
When Testers Feel Left Out in the ColdTechWell
 
Moving to Continuous Delivery Without Breaking Your Code
Moving to Continuous Delivery Without Breaking Your CodeMoving to Continuous Delivery Without Breaking Your Code
Moving to Continuous Delivery Without Breaking Your CodeXebiaLabs
 
Deployment Best Practices: Open Identity Stack
Deployment Best Practices: Open Identity StackDeployment Best Practices: Open Identity Stack
Deployment Best Practices: Open Identity StackForgeRock
 
Helpful Practices in Agile Testing
Helpful Practices in Agile TestingHelpful Practices in Agile Testing
Helpful Practices in Agile TestingJosiah Renaudin
 
Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...
Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...
Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...IT Arena
 
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...Aggregage
 
How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycleDiUS
 
Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)Optimizely
 
Delivering A Great End User Experience
Delivering A Great End User ExperienceDelivering A Great End User Experience
Delivering A Great End User ExperienceTrevor Warren
 
The Holy Trinity of UI Testing by Diego Molina
The Holy Trinity of UI Testing by Diego MolinaThe Holy Trinity of UI Testing by Diego Molina
The Holy Trinity of UI Testing by Diego MolinaSauce Labs
 

Similar to When the System Creaks: Lessons Learned in Agile Maintenance (20)

Making Numbers Count: Metrics That Matter
Making Numbers Count: Metrics That MatterMaking Numbers Count: Metrics That Matter
Making Numbers Count: Metrics That Matter
 
Exploratory Testing and Automated Testing: Create a Healthy Relationship
Exploratory Testing and Automated Testing: Create a Healthy RelationshipExploratory Testing and Automated Testing: Create a Healthy Relationship
Exploratory Testing and Automated Testing: Create a Healthy Relationship
 
San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...
San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...
San Francisco Jenkins Area Meetup October 2016: Self-service secure test and ...
 
Are Your Continuous Tests Too Fragile for Agile?
Are Your Continuous Tests Too Fragile for Agile?Are Your Continuous Tests Too Fragile for Agile?
Are Your Continuous Tests Too Fragile for Agile?
 
SAP TechEd 2018 OPP103 – An Introduction to DevOps
SAP TechEd 2018 OPP103 – An Introduction to DevOpsSAP TechEd 2018 OPP103 – An Introduction to DevOps
SAP TechEd 2018 OPP103 – An Introduction to DevOps
 
Introducing Keyword-driven Test Automation
Introducing Keyword-driven Test AutomationIntroducing Keyword-driven Test Automation
Introducing Keyword-driven Test Automation
 
Reaching for Your Quality Stretch Goals: Testing at Realtor.com
Reaching for Your Quality Stretch Goals: Testing at Realtor.comReaching for Your Quality Stretch Goals: Testing at Realtor.com
Reaching for Your Quality Stretch Goals: Testing at Realtor.com
 
Test Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate ValueTest Metrics in Agile: A Powerful Tool to Demonstrate Value
Test Metrics in Agile: A Powerful Tool to Demonstrate Value
 
Testing in a continuous delivery environment
Testing in a continuous delivery environmentTesting in a continuous delivery environment
Testing in a continuous delivery environment
 
Shifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test AutomationShifting Left: The Evolution of Test Automation
Shifting Left: The Evolution of Test Automation
 
When Testers Feel Left Out in the Cold
When Testers Feel Left Out in the ColdWhen Testers Feel Left Out in the Cold
When Testers Feel Left Out in the Cold
 
Moving to Continuous Delivery Without Breaking Your Code
Moving to Continuous Delivery Without Breaking Your CodeMoving to Continuous Delivery Without Breaking Your Code
Moving to Continuous Delivery Without Breaking Your Code
 
Deployment Best Practices: Open Identity Stack
Deployment Best Practices: Open Identity StackDeployment Best Practices: Open Identity Stack
Deployment Best Practices: Open Identity Stack
 
Helpful Practices in Agile Testing
Helpful Practices in Agile TestingHelpful Practices in Agile Testing
Helpful Practices in Agile Testing
 
Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...
Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...
Learnings from Developing a New B2B SaaS Product (Suryaveer Lodha (Sunny) Pro...
 
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
Experiment Your Way to Product Success: How User Acceptance Testing Can Save ...
 
How to build confidence in your release cycle
How to build confidence in your release cycleHow to build confidence in your release cycle
How to build confidence in your release cycle
 
Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)Experimentation at Blue Apron (webinar)
Experimentation at Blue Apron (webinar)
 
Delivering A Great End User Experience
Delivering A Great End User ExperienceDelivering A Great End User Experience
Delivering A Great End User Experience
 
The Holy Trinity of UI Testing by Diego Molina
The Holy Trinity of UI Testing by Diego MolinaThe Holy Trinity of UI Testing by Diego Molina
The Holy Trinity of UI Testing by Diego Molina
 

More from TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 

More from TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Recently uploaded

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about usDynamic Netsoft
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️Delhi Call girls
 
Active Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfActive Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfCionsystems
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531
 
Clustering techniques data mining book ....
Clustering techniques data mining book ....Clustering techniques data mining book ....
Clustering techniques data mining book ....ShaimaaMohamedGalal
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerThousandEyes
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendArshad QA
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdfWave PLM
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsArshad QA
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providermohitmore19
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 

Recently uploaded (20)

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about us
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Active Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdfActive Directory Penetration Testing, cionsystems.com.pdf
Active Directory Penetration Testing, cionsystems.com.pdf
 
Hand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptxHand gesture recognition PROJECT PPT.pptx
Hand gesture recognition PROJECT PPT.pptx
 
Clustering techniques data mining book ....
Clustering techniques data mining book ....Clustering techniques data mining book ....
Clustering techniques data mining book ....
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and Backend
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 

When the System Creaks: Lessons Learned in Agile Maintenance

  • 1.                 W16   Agile  Testing   5/10/17  15:00             When  the  System  Creaks:  Lessons   Learned  in  Agile  Maintenance     Presented  by:         Jim  Peers     PQA  Testing     Brought  to  you  by:                 350  Corporate  Way,  Suite  400,  Orange  Park,  FL  32073     888-­‐-­‐-­‐268-­‐-­‐-­‐8770  ·∙·∙  904-­‐-­‐-­‐278-­‐-­‐-­‐0524  -­‐  info@techwell.com  -­‐  http://www.starwest.techwell.com/      
  • 2.         Jim  Peers     A  QA  practitioner  with  PQA  Testing,  Jim  Peers  has  more  than  sixteen  years  of   experience  in  software  development  and  testing  in  multiple  industry  verticals.  After   working  in  the  scientific  research  realm  for  a  number  of  years,  Jim  moved  into   software  development,  holding  roles  as  tester,  test  architect,  developer,  team  lead,   project  manager,  and  product  manager.  A  trusted  technical  advisor  to  clients,  Jim   creates  test  strategies,  and  mentors  and  assists  testers  on  multiple  projects.    
  • 3. 1 When the System Creaks Lessons  Learned  in  Agile  Maintenance   Jim  Peers  
  • 4. 2 © PQA Testing Ltd. About Me u  QA  Prac55oner  at  PQA  Tes5ng  in  Vancouver   u  I  have  been:   u  Developer   u  Test  architect   u  Team  lead   u  Project  Manager   u  Product  Manager  
  • 5. 3 © PQA Testing Ltd. Agile in an Ideal World u  Greenfield  –  no  maintenance   u  Automated  tests  
  • 6. 4 © PQA Testing Ltd. Mature Product Problems u  Tech  debt   u  Lack  of  con5nuity  of  team  knowledge   u  Quality  not  built  in   u  LiHle  (if  any)  automa5on  
  • 7. 5 © PQA Testing Ltd. Mature Products can be Hard to Test u  Code  is  rarely  removed   u  Increased  complexity  
  • 8. 6 © PQA Testing Ltd. Waiting for the Next Big Thing u  Where  is  that  new  version  anyway?   u  Your  product  is  longer-­‐lived  than  you  expect  
  • 9. 7 © PQA Testing Ltd. Technical Debt u  Example:  Upgrading  web  elements  -­‐-­‐  >1  person-­‐year  of  effort   u  Whole  team,  including  the  business,  needs  to  understand  the  effects   u  Changing  from  Flash  to  HTML5  controls  
  • 10. 8 © PQA Testing Ltd. Security u  Increasingly  complex   u  Customers  demand  it   u  Modern  frameworks  have  more  built-­‐in  security  
  • 11. 9 © PQA Testing Ltd. Localization u  Changes  to  strings  can  be  small  or  wholesale   u  Example:  more  formal  level  of  address  desired  
  • 12. 10 © PQA Testing Ltd. Data u  Changing  data  structures  is  high  risk   u  Some5mes  unavoidable  
  • 13. 11 © PQA Testing Ltd. About Those Customers… u  Might  need  to  do  a  fix  or  create  a  new  feature  to  retain   u  Compe5ng  agendas  
  • 14. 12 © PQA Testing Ltd. Scheduling u  Need  to  be  flexible   u  Sprinkle  bug  fixes,  security  fixes  in   u  Build  in  slack  to  accommodate  urgent  fixes   u  Fixes  may  take  several  sprints  
  • 15. 13 © PQA Testing Ltd. Root Cause Analysis u  Hold  a  session  a^er  any  cri5cal  bug  fix   u  Use  the  5  Whys   u  Not  about  blaming   u  Output:  ac5ons,  people  assigned,  5meline  
  • 16. 14 © PQA Testing Ltd. Tester Skillset u  Good  to  have  senior  people  on  legacy  products   u  Good  product  knowledge  a  plus   u  Code  literacy   u  Release  management   u  Communica5on  
  • 17. 15 © PQA Testing Ltd. Code Review u  Important  for  testers  to  be  involved   u  Think  about  risk,  regression   u  Analysis  takes  more  focus   u  Small  changes  may  have  big  implica5ons   u  Issues  cannot  escape  into  the  wild  
  • 18. 16 © PQA Testing Ltd. Automation u  Anything  is  beHer  than  nothing   u  Bugs  tend  to  cluster,  so  building  in  regression  tests  can  pay  off   u  If  no  unit  tests  for  an  area  of  code  being  fixed,  add  them  
  • 19. 17 © PQA Testing Ltd. Add Logging u  A  good  5me  to  add  if  there  isn’t  any   u  Helps  with  testability  
  • 20. 18 © PQA Testing Ltd. Feature Flags u  Cau5on:  may  cause  fragility   u  Recommend  removing  them  once  fully  in  use   u  Good  to  know  which  toggles  are  on  –  build  a  system  to  report  config  
  • 21. 19 © PQA Testing Ltd. Team Morale u  Good  to  move  people  on/off  maintenance  (unless  they  really  love  it!)   u  Occasionally  crazy  hours  -­‐>  burnout  possibili5es  
  • 22. 20 © PQA Testing Ltd. Retrospectives u  Make  sure  they  are  produc5ve   u  If  people  are  just  going  through  the  mo5ons,  consider  only  having  them  when  needed  
  • 23. 21 © PQA Testing Ltd. Summary u  Flexibility  is  key   u  Add  automa5on  where  you  can   u  Count  on  the  product  living  longer  than  you  expect