The document discusses metrics and how to use them effectively. It recommends starting with a clear goal and using the GQM (Goal Questions Metrics) technique to identify the right metrics. It warns of dangers like measuring the wrong things, focusing on individuals, or thinking metrics never expire. The document advocates measuring teams, understanding the risk/reward of metrics, using a balanced set of visual metrics, and regularly replacing outdated ones. The goal is to choose metrics that help decision making and support organizational goals.
4. Learn to choose metrics that further
organizational goals and how to use
them to coach teams
@everydaykanban
The Goal
5. @everydaykanban
Anyone who…
Gathers metrics
Does things that are
measured
Just wants to learn more
about metrics
Who should care
about this topic?
29. Your set of metrics should fit your unique context and problems.
No one has the perfect set of metrics that blindly apply to all teams.
@everydaykanban
33. Take your LeanKit data and
create reports in Tableau that
give insight into
your specific context
and help solve
your specific problems.
Custom Reporting
34. Summary
@everydaykanban
Know your problem & map the GQM (goals-questions-metrics)
Measure teams rather than individuals
Understand the risk/reward ratio of each metric
Choose & display a balanced set of metrics
Coach teams to make appropriate trade-offs
Regularly search for and replace expired metrics
Introduction
Mention adapted from a talk at DOES15 that I gave with Troy Magennis (or at least give Troy some props)
Teach 3 Types of analytics
Don’t measure everything
Clutter obscures items with real meaning
Cost/Benefit ratio - manual entry may not be worth it.
Start with a problem; measure only what you need to solve the problem
Dangers
Vanity metrics (blog post is building out in wordpress now on this for LK blog)
Measuring individuals
For props
Carmelo Anthony
Study on superstars/teams
For shaming
Feedback is something you seek to improve your own performance. Levers are used to influence others. The difference is in how you use the measure more than the measure itself. - See more at: https://www.rallydev.com/blog/agile/seven-deadly-sins-agile-measurement-introduction-and-sin-1#sthash.J59ycyfh.dpuf
What you measure shows what you value… (why it matters what you measure)
How to safely wield metrics…
Metrics must:
Pass the “So What?” Test
Answer questions that help you reach your goals
Measure team performance, not individual
Balanced other metrics you gather
Content
Trade-offs
Focus on trends over data points, but avoid the flaw of averages
Get the slide from Troy on statistician drowned in a river that was on average 3 ft deep.
Provide interaction and visual appeal
How LeanKit metrics can help
What questions do the in-app metrics answer?
How can you customize your metrics set with LeanKit data?
Identify goals : Policies/Strategies • Description of process/product • Model of the organization •
Derive questions : How to characterize the object? • How to characterize the attributes? • How to evaluate the characteristics?
Specify metrics : Amount and quality of data • Maturity of objects • Learning process
Its not that these are inherently evil, but we need to recognize what they actually tell us – and, more importantly, what they don’t.
Comp photo
Comp photo, have to decide what thing that people would say should go into the thought bubble. (or, the better picture might be a superstar set away from the rest of the team. However, this picture represents multiple superstars in one hand (aka team). So maybe that is better. People try to cultivate a team of individual superstars thinking the sum is a crack team. But with human dynamics, unlike mathematics, 2+2 does not equal 4.
Carmelo anthony story here (pull from Larry Maccherone content and from my does talk).
Study of superstars that I bought. Stacking the deck of your team with ace superstars has a diminishing, and sometimes negative, return on team goals.
JULIA’s slide -
restaurant table.
Do It Fast: are we keeping page with the business?
Do It Right: are people happy with our work
Do It On Time: when we promise, do we deliver?
Keep Doing It: can we do the other three at the same time, consistently - WHOLE > SUM OF PARTS
** coaching comes in when you want to change one without killing another.
F5 balanced metrics
Visualization matters – bullet points.
What questions do they answer
How you can customize your metrics
The LeanKit Custom Reporting Tool has two core components: Tableau Server 8.3 and the LeanKit data sources that we import into Tableau.
So, if you have experience with Tableau you have a significant head start and a lot of this may be review until we get to the portion that deals more with the LeanKit data itself.
As we walk through the tool today, we’re talking about the capabilities of Tableau Server 8.3, which is a light weight, browser based data visualization tool. We’ve taken that core tool and then imported your LeanKit data sources, allowing you to create reports based on the activity from your LeanKit instance.
LeanKit is all about visualizing your work and we consider ourselves the expert in Visual Work Management Systems
Tableau is known to be the experts in Data Visualization…this partnership and marriage aligns heavily with LeanKits emphasis on Visual Management
Please note that the version that we use, version 8.3, is not the latest version of Tableau Server and we’re considering timelines for upgrading the version we use for our custom reporting tool. If you have experience with Tableau Desktop, which is a separate application from Tableau Server, please be aware that Tableau Desktop is not included by default in our Custom Reporting Tool solution. But, if you have a desktop license, you can make use of it to increase the complexity of reports you can view in your LeanKit Custom Reporting Instance. I will show you how to connect your Tableau 8.3 application to the LeanKit data sources later on in today’s session.
One trivia tidbit is that our in-app reports that you just interacted with are all powered by Tableau as well.