Agile Metrics: Velocity is NOT the Goal - Agile 2013 version

5,407 views

Published on

A newly formatted version of "Velocity is NOT the Goal" for Agile 2013. I've removed some details about standard deviation, added a few more thoughts around the "psychology" of setting targets for metrics, and show a bit more about how we do this at Groupon.

Agile Metrics: Velocity is NOT the Goal - Agile 2013 version

  1. 1. Velocity Is NOT the Goal Michael “Doc” Norton :: Groupon :: @DocOnDev Agile Metrics
  2. 2. Velocity Is NOT the Goal
  3. 3. Velocity
  4. 4. Velocity
  5. 5. What’s Velocity?
  6. 6. Work Units / Time
  7. 7. Lagging Indicator
  8. 8. Measure of a Complex System
  9. 9. Lagging Indicator for a Complex System
  10. 10. A Tale of Two Velocities
  11. 11. A 10, 11, 9 10 B 7, 14, 6, 10 Disclaimer
  12. 12. A 10, 11, 9 10 Yesterday’s Weather: 10 B 7, 14, 6, 10 Yesterday’s Weather: 10
  13. 13. A 10, 11, 9 10 Yesterday’s Weather: 10 Rolling Average: 10 B 7, 14, 6, 10 Yesterday’s Weather: 10 Rolling Average: 10
  14. 14. A 10, 11, 9 10 Yesterday’s Weather: 10 Rolling Average: 10 Std. Deviation: 0.7 B 7, 14, 6, 10 Yesterday’s Weather: 10 Rolling Average: 10 Std. Deviation: 3.1
  15. 15. A 10, 11, 9 10 Yesterday’s Weather: 10 Rolling Average: 10 Std. Deviation: 0.7 Next: 9.3-10.7 B 7, 14, 6, 10 Yesterday’s Weather: 10 Rolling Average: 10 Std. Deviation: 3.1 Next: 6.9-13.1
  16. 16. The Need for Speed
  17. 17. The Hawthorn Effect
  18. 18. That which is measured, will improve
  19. 19. That which is measured, will improve ... at a cost
  20. 20. Goodhart’s Law
  21. 21. When a measure becomes a target, it ceases to be a good measure
  22. 22. Perverse Incentives
  23. 23. ... an unintended result, contrary to interests of the incentive makers
  24. 24. Dr. Deming “What matters is not setting quantitative goals but fixing the method by which those goals are attained”
  25. 25. What causes variable Velocity?
  26. 26. Time Poorly Spent
  27. 27. Dependency on Other Teams
  28. 28. Poor Story Composition
  29. 29. Too Much Work In Progress
  30. 30. Scatter Diagrams
  31. 31. 0 5000 10000 15000 20000 0 2 4 6 8 Scatter Diagrams Auto Prices by Year
  32. 32. 0 12.5 25 37.5 50 0 25 50 75 100 Scatter Diagrams Velocity by Complexity
  33. 33. 0 12.5 25 37.5 50 0 10000 20000 30000 40000 Scatter Diagrams Velocity by Value
  34. 34. 0 12.5 25 37.5 50 0 22.5 45 67.5 90 Scatter Diagrams Velocity by Coverage
  35. 35. “Friedman’s Thermostat”
  36. 36. Correlation is not causation
  37. 37. Correlation is not causation but it sure is a hint
  38. 38. Cumulative Flow Diagrams
  39. 39. Backlog
  40. 40. Cumulative Flow Diagram
  41. 41. 0 5 10 15 20 1 2 3 4 5 6 7 8 9 10 Velocity Chart
  42. 42. Same Different Perspective Team & Data
  43. 43. CFD 0 25 50 75 100 1 2 3 4 5 6 7 8 9 10 Deployed Ready for Approval In Testing In Progress Ready To Start
  44. 44. Measure Many Things
  45. 45. Measure Many Things 0 4 8 12 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Velocity
  46. 46. Measure Many Things 0 4 8 12 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 0 5 10 15 20 Velocity Quality
  47. 47. Measure Many Things 0 4 8 12 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 0 12.5 25 37.5 50 Velocity Quality Avg. Hours
  48. 48. Measure Many Things 0 4 8 12 16 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 0 12.5 25 37.5 50 Velocity Quality Avg. Hours Team Joy
  49. 49. Real World Examples
  50. 50. Velocity w/Std. Deviation
  51. 51. Burn w/Std. Deviation
  52. 52. Cumulative Flow
  53. 53. Team Joy
  54. 54. Department Joy
  55. 55. One Last Thing
  56. 56. Metrics are not for Managers
  57. 57. Metrics are for Teams
  58. 58. Velocity Is NOT the Goal Michael “Doc” Norton Groupon Director of Engineering doc@groupon.com @DocOnDev http://www.docondev.com/ Thank You!

×