Fadi Stephan presented on Agile metrics at the 2022 Global Scrum
Gathering
Abstract:
There are more to Agile metrics than velocity and burn-down charts. However, most Agile teams just focus on velocity and target story points which leads to managers misusing the metric and teams gaming the system. Velocity should stay within the team and there are other metrics that can be shared with others that are outside the team. These metrics provide a more holistic view of the project’s overall health. The Agile Dashboard collects such metrics and acts as an information radiator giving us real time project updates on value, performance, schedule, scope, cost, quality, and team spirit.
Come learn what to measure and for how long. Learn how to read warning signs and what corrective actions to take. Learn to setup your own Agile dashboard to arm yourself with the right information and make careful and constant adjustments to ensure forward and safe progress towards your final deliverable.
2. The Agile Dashboard @fadistephan | kaizenko.com
Chat With Your
Neighbors
While we wait for the session to start,
chat with your neighbor
1. Are you on a Scrum team?
2. How many members are on your
team?
3. How long are your Sprints?
4. Do you estimate in story points?
5. What’s your team’s velocity?
3. The Agile Dashboard @fadistephan | kaizenko.com
“I like to say that I may have
invented story points,
and if I did, I’m sorry now.”
https://ronjeffries.com/articles/019-01ff/story-points/Index.html
- Ron Jefferies
4. The Agile Dashboard @fadistephan | kaizenko.com
Velocity
&
Story Points
Great tool if used correctly
Velocity is not an estimate and not a
target
Velocity is an empirical observation
of the team’s ability to deliver work in
a Sprint
Velocity is used for forecasting and
planning
When we have stable long-lived
teams
But…
8. The Agile Dashboard @fadistephan | kaizenko.com
Why Measure?
Plan and forecast
Provide visibility into our progress
Figure out if we are on schedule and
within our Budget?
Influence or reinforce behaviors
Fuel meaningful conversations
Increase learning
Make adjustments
9. The Agile Dashboard @fadistephan | kaizenko.com
“Just because you can
measure everything,
Doesn’t mean that you should”
- W. Edwards Deming
12. The Agile Dashboard @fadistephan | kaizenko.com
The Manifesto
For Agile Software
Development
Let’s look at the principles behind the
Manifesto for Agile Software
Development
For each principle, think about
1. What should be measured?
2. How to measure it?
13. The Agile Dashboard @fadistephan | kaizenko.com
1. Our highest priority is to satisfy the customer through early and continuous delivery of valuable software.
2. Welcome changing requirements, even late in development. Agile processes harness change for the
customer's competitive advantage.
3. Deliver working software frequently, from a couple of weeks to a couple of months, with a preference to the
shorter timescale.
4. Business people and developers must work together daily throughout the project.
5. Build projects around motivated individuals. Give them the environment and support they need, and trust
them to get the job done.
6. The most efficient and effective method of conveying information to and within a development team is face-
to-face conversation.
7. Working software is the primary measure of progress.
8. Agile processes promote sustainable development. The sponsors, developers, and users should be able to
maintain a constant pace indefinitely.
9. Continuous attention to technical excellence and good design enhances agility.
10. Simplicity--the art of maximizing the amount of work not done--is essential.
11. The best architectures, requirements, and designs emerge from self-organizing teams.
12. At regular intervals, the team reflects on how to become more effective, then tunes and adjusts its behavior
accordingly.
https://agilemanifesto.org/principles.html
14. The Agile Dashboard @fadistephan | kaizenko.com
1. Our highest priority is to satisfy the customer through early and
continuous delivery of valuable software.
2. Welcome changing requirements, even late in development. Agile
processes harness change for the customer's competitive advantage.
3. Deliver working software frequently, from a couple of weeks to a couple
of months, with a preference to the shorter timescale.
4. Business people and developers must work together daily throughout
the project.
5. Build projects around motivated individuals. Give them the environment
and support they need, and trust them to get the job done.
6. The most efficient and effective method of conveying information to
and within a development team is face-to-face conversation.
https://agilemanifesto.org/principles.html
15. The Agile Dashboard @fadistephan | kaizenko.com
7. Working software is the primary measure of progress.
8. Agile processes promote sustainable development. The sponsors,
developers, and users should be able to maintain a constant pace
indefinitely.
9. Continuous attention to technical excellence and good design enhances
agility.
10.Simplicity--the art of maximizing the amount of work not done--is
essential.
11.The best architectures, requirements, and designs emerge from self-
organizing teams.
12.At regular intervals, the team reflects on how to become more effective,
then tunes and adjusts its behavior accordingly.
https://agilemanifesto.org/principles.html
20. The Agile Dashboard @fadistephan | kaizenko.com
Our highest priority is to satisfy the
customer through early and continuous
delivery of valuable software.
Working software is the primary measure of
progress.
- Principles 1 and 7 from the Manifesto for Agile Software Development
21. The Agile Dashboard @fadistephan | kaizenko.com
Customer
Satisfaction Survey
How satisfied are you with the latest
release?
How likely are you to recommend the
product to others?
22. The Agile Dashboard @fadistephan | kaizenko.com
Business Value
Financial Data ($$$)
Value Points
Relative Weight
24. The Agile Dashboard @fadistephan | kaizenko.com
Value Quality
Delivery Collaboration
Continuous
Improvement
Customer Satisfaction Survey
Business Value Points
Financials
26. The Agile Dashboard @fadistephan | kaizenko.com
Welcome changing requirements, even late in
development. Agile processes harness change
for the customer's competitive advantage.
Continuous attention to technical
excellence and good design enhances
agility.
- Principles 2 and 9 from the Manifesto for Agile Software Development
27. The Agile Dashboard @fadistephan | kaizenko.com
Simplicity--the art of maximizing the
amount of work not done--is essential.
Working software is the primary measure of
progress.
- Principles 10 and 7 from the Manifesto for Agile Software Development
33. The Agile Dashboard @fadistephan | kaizenko.com
Value Quality
Delivery Collaboration
Continuous
Improvement
Customer Satisfaction Survey
Business Value Points
Financials
Production Bugs
Technical Debt
Running Tested
Features
35. The Agile Dashboard @fadistephan | kaizenko.com
Our highest priority is to satisfy the
customer through early and continuous
delivery of valuable software.
Deliver working software frequently, from a
couple of weeks to a couple of months, with
a preference to the shorter timescale.
- Principles 1 and 3 from the Manifesto for Agile Software Development
36. The Agile Dashboard @fadistephan | kaizenko.com
Agile processes promote sustainable development. The
sponsors, developers, and users should be able to
maintain a constant pace indefinitely.
Working software is the primary measure
of progress.
- Principles 8 and 7 from the Manifesto for Agile Software Development
38. The Agile Dashboard @fadistephan | kaizenko.com
0
2
4
6
8
10
12
14
1 2 3 4 5 6 7 8 9 10
CFD
Done Doing To Do
Lead Time
Cycle Time
WIP
39. The Agile Dashboard @fadistephan | kaizenko.com
0
2
4
6
8
10
12
14
1 2 3 4 5 6 7 8 9 10
CFD
Done Doing To Do
Lead Time
Cycle Time
WIP
40. The Agile Dashboard @fadistephan | kaizenko.com
0
50
100
150
200
250
CFD
Delivered Testing Doing ToDo Backlog
41. The Agile Dashboard @fadistephan | kaizenko.com
Value Quality
Delivery Collaboration
Continuous
Improvement
Customer Satisfaction Survey
Business Value Points
Financials
Product Bugs
Technical Debt
Running Tested
Features
CFD
WIP
Cycle Time
Lead Time
Story Cycle Time
43. The Agile Dashboard @fadistephan | kaizenko.com
Business people and developers must work
together daily throughout the project.
Build projects around motivated individuals.
Give them the environment and support they
need, and trust them to get the job done.
- Principles 4 and 5 from the Manifesto for Agile Software Development
44. The Agile Dashboard @fadistephan | kaizenko.com
The most efficient and effective method of
conveying information to and within a
development team is face-to-face conversation
The best architectures, requirements, and
designs emerge from self-organizing
teams.
- Principles 6 and 11 from the Manifesto for Agile Software Development
48. The Agile Dashboard @fadistephan | kaizenko.com
Team Dynamics
Survey
How was your day?
How satisfied are you with the latest
Sprint?
How satisfied are you with the code
you are about to check-in?
49. The Agile Dashboard @fadistephan | kaizenko.com
https://www.agilealliance.org/glossary/nikoniko/
Niko-Niko Calendar
50. The Agile Dashboard @fadistephan | kaizenko.com
Value Quality
Delivery Collaboration
Continuous
Improvement
Customer Satisfaction Survey
Business Value Points
Financials
Product Bugs
Technical Debt
Running Tested
Features
CFD
WIP
Lead Time
Lead Time
Story Cycle Time
Team
Dynamics
Survey
Niko-Niko Calendar
52. The Agile Dashboard @fadistephan | kaizenko.com
Delivering Business Value
Asking & Receiving Feedback
Responding to Change
Understanding Vision & Goal
Planning
Applying Technical Practices
Working as a Team
Continuously Improving
Sprint 1 Team Self Assessment
53. The Agile Dashboard @fadistephan | kaizenko.com
Delivering Business Value
Asking & Receiving Feedback
Responding to Change
Understanding Vision & Goal
Planning
Applying Technical Practices
Working as a Team
Continuously Improving
Sprint 5 Team Self Assessment
54. The Agile Dashboard @fadistephan | kaizenko.com
Value Quality
Delivery Collaboration
Continuous
Improvement
Customer Satisfaction Survey
Business Value Points
Financials
Product Bugs
Technical Debt
Running Tested
Features
CFD
WIP
Lead Time
Lead Time
Story Cycle Time
Team
Dynamics
Survey
Niko-Niko Calendar
55. The Agile Dashboard @fadistephan | kaizenko.com
Tips
Track 1 or 2 metrics per category
Assess effort collecting vs. value of
the metric
Focus on measuring outcomes not
outputs
Follow trend lines not numbers or
targets
Clarify how it can be gamed
Use as health check for feedback,
discussions, and improvements
Once behavior has changed drop it
56. The Agile Dashboard @fadistephan | kaizenko.com
Let’s Connect
@FadiStephan @Kaizenko
https://www.linkedin.com/in/fadistephan
https://www.linkedin.com/company/kaizenko
More Resources at
https://www.kaizenko.com/gsgden22
Effective communication
Self-organizing teams
Business and Developers working together
WIP, Cycle time, lead time, throughput, story cycle time,
Effective communication
Self-organizing teams
Business and Developers working together
Effective communication
Self-organizing teams
Business and Developers working together
Hope you found these tips helpful. You can find more resource on all this at my website www.kaizenko.com included the PBR canvas plus other templates as well as patterns for splitting user stories.
Please feel free to connect on social media. I’m most active on linkedIn.
I’m here through Wednesday. So if you are here please reach out. Otherwise hope to connect in person someday soon. Enjoy the rest of the gathering and have a great day!
https://dfwscrum.files.wordpress.com/2011/07/dfwscrum_20110726_jimhighsmith.pdf
https://theagileexecutive.com/tag/the-agile-triangle/