SlideShare a Scribd company logo
1 of 25
Download to read offline
© 2015 Accenture. All rights reserved. Accenture, its logo, and 'High Performance. Delivered.' are trademarks of Accenture.
Agile Day Riga 2015
Alex Birke, May 23, 2015
Essential Metrics for Agile Project
Management
Why Metrics?
“they help […] to make decisions”
(Eric Ries, Lean Startup)
2© 2015 Accenture. All rights reserved.
What makes a good metric?
As many as required, as less as possible
Leading indicators over trailing indicators
Measure results, not activity
Assess trends, not snapshots
Easy to collect
4© 2015 Accenture. All rights reserved.
But wait!
What about Scrum’s metrics as
the Burndown and the Velocity!
5© 2015 Accenture. All rights reserved.
A Set of Core Metrics for Agile Project management*
Scope Cost
Schedule Productivity
Story Point Effort
Performance IndicatorScope Volatility
Release Slippage Risk
Indicator
Sprint Burndown
Performance Indicator
Release Burnchart
Performance Indicator
Quality
Sprint Productivity
Required Productivity
© 2015 Accenture. All rights reserved.
*) Metrics are agnostic of technology or domain where Agile Project Management is used
Running Tested
Features
Delivered
Defect Rate
Sprint Productivity (P)
Definition
Productivity is measured as generated value in story points that can be completed per person
day.
Calculation
# story points [SP] of a sprint
P =
# person days of a sprint
8© 2015 Accenture. All rights reserved.
Required Productivity (RP)
Definition
RP is the productivity that the team would require in the remaining sprints, to complete at
least remaining “Must-Have” user stories, so that a Minimal Viable Release (MVR) can be
deployed to production.
Calculation
# of SP estimate of remaining “Must-Have” stories
RP =
Total planned effort in remaining sprints
9© 2015 Accenture. All rights reserved.
Required Productivity
10© 2015 Accenture. All rights reserved.
Required Velocity =
(
3 [SP] + 3 [SP] +
8 [SP] + 3 [SP]
)
/ 3
= 5.66 [SP]
Assuming 105 hours per upcoming Sprint:
RP = 5.66 [SP] / 105 [hours] = 0.054 [SP / hours]
Release Slippage Risk Indicator (RSRI)
Definition
RSRI indicates whether at least a minimal viable release (MVR) can be deployed to
production on the scheduled date.
Calculation
“Past” Sprint Productivity (P)
RSRI =
Required Sprint Productivity for release date (RP)
= 1 : as planned
RSRI < 1 : delayed
> 1 : ahead of plan
11© 2015 Accenture. All rights reserved.
Release Slippage Risk Indicator
12© 2015 Accenture. All rights reserved.
Required Productivity = ( 3 [SP] + 3 [SP] + 8 [SP] + 3 [SP] ) / (3 [Sprints] * 105 [hours] ) =
= 0.054 [SP / hours]
Past Productivity = 5 [SP] / 90 [hours] = 0.055 [SP / hours]
Release Slippage Risk = 1.02
What makes a good metric?
As many as required, as less as possible
Leading indicators over trailing indicators
Measure results, not activity
Assess trends, not snapshots
Easy to collect
4© 2015 Accenture. All rights reserved.
0 20 60
160
280
400
560
720
820
920
1015
1110
1210
1330
490
0
200
400
600
800
1000
1200
1400
1600
1800
0 1 2 3 4 5 6 7 8 9 10 11 12 13
Work(StoryPoints)
Sprint #
Release Burn Up Chart
Must-Have Scope Must-Have + Should-Have Scope
Planned Dev Complete or Accenture Scope Complete
Ideal Burn-Up Required Burn
2 new “Billing” epics added
“Summary Reports” added
“Rating” epics de-scoped
In the example above, at the end of Sprint 7: RBPI = 490 / 720 = 0.68,
which indicates that the amount of user stories done was less than expected.
Release BurnChart Performance Indicator
© 2015 Accenture. All rights reserved.
Sprint Burndown Performance Indicator (SBPI)
Definition
SBPI shows the deviation in completed work compared to work planned, for the current
sprint.
Calculation
Ideal remaining work
SBPI =
Actual remaining work
= 1: as planned
SBPI < 1: delayed
> 1: ahead of plan
15© 2015 Accenture. All rights reserved.
Sprint Burndown Performance Indicator
= 120 [hours] / 160 [hours]
= .75
(i.e. -25% deviation)
Sprint Burndown Performance Indicator
= 40 [SP] / 50 [SP]
= .80
Fig. 1: Task Burndown (effort based) Fig. 2: User Story Burndown (Story Point based)
Sprint Burndown Performance Indicator
© 2015 Accenture. All rights reserved.
Scope Volatility (SV)
Definition
Scope Volatility depicts the amount of change in size of the release scope, comparing the
release scope size measured at start of the release and after the last completed sprint.
Calculation
Current Size of Must-Have Scope – Initial Size of Must-Have Scope
SV = * 100
Initial Size of Must-Have Scope
> 0: Scope creep
SV < 0: Scope drop
= 0: Planned scope size retained (often corridor)
17© 2015 Accenture. All rights reserved.
1143
1228
Must-Have Scope 1237
1273 1330
0
200
400
600
800
1000
1200
1400
1600
1800
0 1 2 3 4 5 6 7 8 9 10 11 12 13
Work(StoryPoints)
Sprint #
Release Burn Up Chart
Must-Have Scope Must-Have + Should-Have Scope
Planned Dev Complete or Accenture Scope Complete
Ideal Burn-Up Required Burn
2 new “Billing” epics added
“Rating” epics de-scoped
In the example above, Scope Volatility = (1273 [SP] – 1143 [SP] ) / 1143 [SP] * 100 = .11
Scope Volatility
© 2015 Accenture. All rights reserved.
Story Point Effort Performance Indicator (SPEPI)
Definition
SPEPI (aka CPI, sprint-wise) indicates if the ongoing project release is currently on budget,
depicting deviation in planned effort per story point to the actual effort per story point.
Calculation
Planned Effort to be spent in the release so far
Planned Story points delivered in the release so far
SPEPI =
Actual Effort spent on the release so far
Actual Story points delivered in the release so far
= 1 : as planned
SPEPI < 1 : cost overrun
> 1 : under budget
19© 2015 Accenture. All rights reserved.
Story Point Effort Performance Indicator
“per”
20
Value
Effort /
money
SPEPI = (875 / 630 ) / ( 957 / 490 ) = 0.71, which indicates a cost overrun.
© 2015 Accenture. All rights reserved.
Running Tested Features* (RTF)
Definition
RTF depicts the variance of working (running) features over total features built to date.
Calculation
# completed user stories that still pass all acceptance tests
RTF = x 100
total # of completed user stories to date
21© 2015 Accenture. All rights reserved.
*) “A Metric leading to Agility”, Ron Jeffries
But wait!
What about Scrum’s metrics as
the Burndown and the Velocity!
5© 2015 Accenture. All rights reserved.
Delivered Defect Rate (DDR)
Definition
DDR indicates the effectiveness of the review and testing activities, thus ensuring that fewer
defects are identified on the delivered product (increment).
Calculation
Defects identified after Done-ness of user stories
DDR =
Total effort spent in all tasks till date
Alternative metric: Defect Density is # of defects identified in completed user stories per size
of Done user stories.
23© 2015 Accenture. All rights reserved.
Delivered Defect Rate
24© 2015 Accenture. All rights reserved.
DDR Sprint 1 Sprint 2 Sprint 3 Sprint 4
Defects Identified 7 12 19 25
SPE Effort 400 831 1262 1685
Defect Rate 0,018 0,014 0,015 0,015
Engineering effort
includes effort from Agile
Lifecycle tool for design,
build, test, defect fix
tasks. Includes PO & SM
time as % of completed
stories
Count only the
defects logged after
the story is marked
complete by the
developer
In the example above, DDR trend is stable. Therefore the delivered quality is stable.
A Set of Core Metrics for Agile Project management*
Scope Cost
Schedule Productivity
Story Point Effort
Performance IndicatorScope Volatility
Release Slippage Risk
Indicator
Sprint Burndown
Performance Indicator
Release Burnchart
Performance Indicator
Quality
Sprint Productivity
Required Productivity
© 2015 Accenture. All rights reserved.
*) Metrics are agnostic of technology or domain where Agile Project Management is used
Running Tested
Features
Delivered
Defect Rate
Some further sometimes helpful metrics
26
% Stories accepted
Stakeholder Involvement Index
% Changed Scope
Average Time to Market
(Retrospective)
Process
improvement
Customer Satisfaction
Test Automation
Coverage
Employee Engagement
Epic Progress Report
A Set of Core Metrics for Agile Project management*
Scope Cost
Schedule Productivity
Story Point Effort
Performance IndicatorScope Volatility
Release Slippage Risk
Indicator
Sprint Burndown
Performance Indicator
Release Burnchart
Performance Indicator
Quality
Sprint Productivity
Required Productivity
© 2015 Accenture. All rights reserved.
*) Metrics are agnostic of technology or domain where Agile Project Management is used
Running Tested
Features
Delivered
Defect Rate

More Related Content

What's hot

Successful Agile Transformation - The NCS Story
Successful Agile Transformation - The NCS StorySuccessful Agile Transformation - The NCS Story
Successful Agile Transformation - The NCS StoryNUS-ISS
 
Agile project inception workshop
Agile project inception workshopAgile project inception workshop
Agile project inception workshopBill Bourne
 
Introducing SAFe 5.0 the operating system for Business Agility
Introducing SAFe 5.0 the operating system for Business AgilityIntroducing SAFe 5.0 the operating system for Business Agility
Introducing SAFe 5.0 the operating system for Business AgilityLeanwisdom
 
Agile Metrics : A seminal approach for calculating Metrics in Agile Projects
Agile Metrics : A seminal approach for calculating Metrics in Agile ProjectsAgile Metrics : A seminal approach for calculating Metrics in Agile Projects
Agile Metrics : A seminal approach for calculating Metrics in Agile ProjectsPrashant Ram
 
Anypoint platform architecture and components
Anypoint platform architecture and componentsAnypoint platform architecture and components
Anypoint platform architecture and componentsD.Rajesh Kumar
 
Remote PI Planning Tips & Tricks - Agile en Seine 2020
Remote PI Planning Tips & Tricks - Agile en Seine 2020Remote PI Planning Tips & Tricks - Agile en Seine 2020
Remote PI Planning Tips & Tricks - Agile en Seine 2020Agile En Seine
 
AGILE@DELOITTE AGILE LANDSCAPE v02
AGILE@DELOITTE AGILE LANDSCAPE v02AGILE@DELOITTE AGILE LANDSCAPE v02
AGILE@DELOITTE AGILE LANDSCAPE v02Chris Webb
 
SRE 101 (Site Reliability Engineering)
SRE 101 (Site Reliability Engineering)SRE 101 (Site Reliability Engineering)
SRE 101 (Site Reliability Engineering)Hussain Mansoor
 
Agile Metrics...That Matter
Agile Metrics...That MatterAgile Metrics...That Matter
Agile Metrics...That MatterErik Weber
 
Agile Training: Roles and Expectations
Agile Training: Roles and ExpectationsAgile Training: Roles and Expectations
Agile Training: Roles and ExpectationsMike Wienold
 
Agile Center of Excellence : Presented by Rahul Sudame
Agile Center of Excellence : Presented by Rahul Sudame Agile Center of Excellence : Presented by Rahul Sudame
Agile Center of Excellence : Presented by Rahul Sudame oGuild .
 
SRE (service reliability engineer) on big DevOps platform running on the clou...
SRE (service reliability engineer) on big DevOps platform running on the clou...SRE (service reliability engineer) on big DevOps platform running on the clou...
SRE (service reliability engineer) on big DevOps platform running on the clou...DevClub_lv
 
Agile Release Planning
Agile Release PlanningAgile Release Planning
Agile Release PlanningAdnan Aziz
 
An Introduction to Scaled Agile Framework (SAFe)
An Introduction to Scaled Agile Framework (SAFe)An Introduction to Scaled Agile Framework (SAFe)
An Introduction to Scaled Agile Framework (SAFe)CA Technologies
 
Repositioning the Value of the Architecture Practice
Repositioning the Value of the Architecture PracticeRepositioning the Value of the Architecture Practice
Repositioning the Value of the Architecture PracticeEnterprise Architects
 
DevOps Evolution - The Next Generation ?
DevOps Evolution - The Next Generation ?DevOps Evolution - The Next Generation ?
DevOps Evolution - The Next Generation ?Marc Hornbeek
 
OpenTelemetry Introduction
OpenTelemetry Introduction OpenTelemetry Introduction
OpenTelemetry Introduction DimitrisFinas1
 

What's hot (20)

Successful Agile Transformation - The NCS Story
Successful Agile Transformation - The NCS StorySuccessful Agile Transformation - The NCS Story
Successful Agile Transformation - The NCS Story
 
Agile project inception workshop
Agile project inception workshopAgile project inception workshop
Agile project inception workshop
 
Introducing SAFe 5.0 the operating system for Business Agility
Introducing SAFe 5.0 the operating system for Business AgilityIntroducing SAFe 5.0 the operating system for Business Agility
Introducing SAFe 5.0 the operating system for Business Agility
 
Agile Metrics : A seminal approach for calculating Metrics in Agile Projects
Agile Metrics : A seminal approach for calculating Metrics in Agile ProjectsAgile Metrics : A seminal approach for calculating Metrics in Agile Projects
Agile Metrics : A seminal approach for calculating Metrics in Agile Projects
 
Anypoint platform architecture and components
Anypoint platform architecture and componentsAnypoint platform architecture and components
Anypoint platform architecture and components
 
Remote PI Planning Tips & Tricks - Agile en Seine 2020
Remote PI Planning Tips & Tricks - Agile en Seine 2020Remote PI Planning Tips & Tricks - Agile en Seine 2020
Remote PI Planning Tips & Tricks - Agile en Seine 2020
 
AGILE@DELOITTE AGILE LANDSCAPE v02
AGILE@DELOITTE AGILE LANDSCAPE v02AGILE@DELOITTE AGILE LANDSCAPE v02
AGILE@DELOITTE AGILE LANDSCAPE v02
 
An introduction to DevOps
An introduction to DevOpsAn introduction to DevOps
An introduction to DevOps
 
Essential SAFe® 4.0
Essential SAFe® 4.0Essential SAFe® 4.0
Essential SAFe® 4.0
 
SRE 101 (Site Reliability Engineering)
SRE 101 (Site Reliability Engineering)SRE 101 (Site Reliability Engineering)
SRE 101 (Site Reliability Engineering)
 
Agile Metrics...That Matter
Agile Metrics...That MatterAgile Metrics...That Matter
Agile Metrics...That Matter
 
Agile Training: Roles and Expectations
Agile Training: Roles and ExpectationsAgile Training: Roles and Expectations
Agile Training: Roles and Expectations
 
Agile Center of Excellence : Presented by Rahul Sudame
Agile Center of Excellence : Presented by Rahul Sudame Agile Center of Excellence : Presented by Rahul Sudame
Agile Center of Excellence : Presented by Rahul Sudame
 
Agile portfolio management
Agile portfolio managementAgile portfolio management
Agile portfolio management
 
SRE (service reliability engineer) on big DevOps platform running on the clou...
SRE (service reliability engineer) on big DevOps platform running on the clou...SRE (service reliability engineer) on big DevOps platform running on the clou...
SRE (service reliability engineer) on big DevOps platform running on the clou...
 
Agile Release Planning
Agile Release PlanningAgile Release Planning
Agile Release Planning
 
An Introduction to Scaled Agile Framework (SAFe)
An Introduction to Scaled Agile Framework (SAFe)An Introduction to Scaled Agile Framework (SAFe)
An Introduction to Scaled Agile Framework (SAFe)
 
Repositioning the Value of the Architecture Practice
Repositioning the Value of the Architecture PracticeRepositioning the Value of the Architecture Practice
Repositioning the Value of the Architecture Practice
 
DevOps Evolution - The Next Generation ?
DevOps Evolution - The Next Generation ?DevOps Evolution - The Next Generation ?
DevOps Evolution - The Next Generation ?
 
OpenTelemetry Introduction
OpenTelemetry Introduction OpenTelemetry Introduction
OpenTelemetry Introduction
 

Similar to Agile metrics what is... riga-version

Top Metrics for Agile @Agile NCR2011
Top Metrics for Agile @Agile NCR2011Top Metrics for Agile @Agile NCR2011
Top Metrics for Agile @Agile NCR2011Priyank Pathak
 
PMI-ACP Lesson 10 Agile Metrics
PMI-ACP Lesson 10 Agile MetricsPMI-ACP Lesson 10 Agile Metrics
PMI-ACP Lesson 10 Agile MetricsThanh Nguyen
 
What to expect in 30 60-90 days in agile transformation journey?
What to expect in 30 60-90 days in agile transformation journey?What to expect in 30 60-90 days in agile transformation journey?
What to expect in 30 60-90 days in agile transformation journey?SwatiKapoor43
 
Performance Engineering Masterclass: Efficient Automation with the Help of SR...
Performance Engineering Masterclass: Efficient Automation with the Help of SR...Performance Engineering Masterclass: Efficient Automation with the Help of SR...
Performance Engineering Masterclass: Efficient Automation with the Help of SR...ScyllaDB
 
Cs 568 Spring 10 Lecture 5 Estimation
Cs 568 Spring 10  Lecture 5 EstimationCs 568 Spring 10  Lecture 5 Estimation
Cs 568 Spring 10 Lecture 5 EstimationLawrence Bernstein
 
Agile process with a fixed cost
Agile process with a fixed costAgile process with a fixed cost
Agile process with a fixed costRalph Johnson
 
Ac2017 6. output based contracting
Ac2017   6. output based contractingAc2017   6. output based contracting
Ac2017 6. output based contractingNesma
 
Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...
Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...
Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...Tarun Singh
 
Metrics For Agile @CSI SPIN Mumbai Mar2011
Metrics For Agile @CSI SPIN Mumbai Mar2011Metrics For Agile @CSI SPIN Mumbai Mar2011
Metrics For Agile @CSI SPIN Mumbai Mar2011Priyank Pathak
 
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...Nesma
 
DevOPs Transformation Workshop
DevOPs Transformation WorkshopDevOPs Transformation Workshop
DevOPs Transformation WorkshopJules Pierre-Louis
 
What is Test Matrix?
What is Test Matrix?What is Test Matrix?
What is Test Matrix?QA InfoTech
 
Earned value
Earned valueEarned value
Earned valueOliver
 
Overview of Rational Services Offerings
Overview of Rational Services OfferingsOverview of Rational Services Offerings
Overview of Rational Services OfferingsIBM Rational software
 
Lean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templatesLean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templatesSteven Bonacorsi
 
Scrum Process Overview
Scrum Process OverviewScrum Process Overview
Scrum Process OverviewPaul Nguyen
 
РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...
РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...
РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...GoQA
 

Similar to Agile metrics what is... riga-version (20)

Top Metrics for Agile @Agile NCR2011
Top Metrics for Agile @Agile NCR2011Top Metrics for Agile @Agile NCR2011
Top Metrics for Agile @Agile NCR2011
 
PMI-ACP Lesson 10 Agile Metrics
PMI-ACP Lesson 10 Agile MetricsPMI-ACP Lesson 10 Agile Metrics
PMI-ACP Lesson 10 Agile Metrics
 
Agile Metrics
Agile MetricsAgile Metrics
Agile Metrics
 
What to expect in 30 60-90 days in agile transformation journey?
What to expect in 30 60-90 days in agile transformation journey?What to expect in 30 60-90 days in agile transformation journey?
What to expect in 30 60-90 days in agile transformation journey?
 
Performance Engineering Masterclass: Efficient Automation with the Help of SR...
Performance Engineering Masterclass: Efficient Automation with the Help of SR...Performance Engineering Masterclass: Efficient Automation with the Help of SR...
Performance Engineering Masterclass: Efficient Automation with the Help of SR...
 
Cs 568 Spring 10 Lecture 5 Estimation
Cs 568 Spring 10  Lecture 5 EstimationCs 568 Spring 10  Lecture 5 Estimation
Cs 568 Spring 10 Lecture 5 Estimation
 
Agile process with a fixed cost
Agile process with a fixed costAgile process with a fixed cost
Agile process with a fixed cost
 
Ac2017 6. output based contracting
Ac2017   6. output based contractingAc2017   6. output based contracting
Ac2017 6. output based contracting
 
Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...
Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...
Benzne Webinar : What to expect in 30-60-90 days in Agile Transformation Jour...
 
Metrics For Agile @CSI SPIN Mumbai Mar2011
Metrics For Agile @CSI SPIN Mumbai Mar2011Metrics For Agile @CSI SPIN Mumbai Mar2011
Metrics For Agile @CSI SPIN Mumbai Mar2011
 
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
 
DevOPs Transformation Workshop
DevOPs Transformation WorkshopDevOPs Transformation Workshop
DevOPs Transformation Workshop
 
What is Test Matrix?
What is Test Matrix?What is Test Matrix?
What is Test Matrix?
 
Earned value
Earned valueEarned value
Earned value
 
Scaled agile meets the ground
Scaled agile meets the groundScaled agile meets the ground
Scaled agile meets the ground
 
Overview of Rational Services Offerings
Overview of Rational Services OfferingsOverview of Rational Services Offerings
Overview of Rational Services Offerings
 
Lean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templatesLean six sigma executive overview (case study) templates
Lean six sigma executive overview (case study) templates
 
Platinum card for agile ev mr4
Platinum card for agile ev mr4Platinum card for agile ev mr4
Platinum card for agile ev mr4
 
Scrum Process Overview
Scrum Process OverviewScrum Process Overview
Scrum Process Overview
 
РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...
РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...
РАМЕЛЛА БАСЕНКО «ROI of automation or how to sell your automation ideas to cu...
 

Recently uploaded

MAGNET: Senior Thesis Storyboard Excerpt
MAGNET: Senior Thesis Storyboard ExcerptMAGNET: Senior Thesis Storyboard Excerpt
MAGNET: Senior Thesis Storyboard Excerptdcobb11
 
The lady in Surtout, an old story that happened in our neighbourhood
The lady in Surtout, an old story  that happened in our neighbourhoodThe lady in Surtout, an old story  that happened in our neighbourhood
The lady in Surtout, an old story that happened in our neighbourhoodazuremorn
 
MAGNET: Storyboard Excerpt Version Three
MAGNET: Storyboard Excerpt Version ThreeMAGNET: Storyboard Excerpt Version Three
MAGNET: Storyboard Excerpt Version Threedcobb11
 
Transform Your Space with Poster Memorabilia's Collection
Transform Your Space with Poster Memorabilia's CollectionTransform Your Space with Poster Memorabilia's Collection
Transform Your Space with Poster Memorabilia's CollectionPoster Memorabilia Reviews
 
WWW - World Wide Web presentation.pptx
WWW - World Wide Web   presentation.pptxWWW - World Wide Web   presentation.pptx
WWW - World Wide Web presentation.pptxdomainkillerlinux
 
Atm HTML GAMES collection of games .pdf
Atm HTML GAMES collection of  games .pdfAtm HTML GAMES collection of  games .pdf
Atm HTML GAMES collection of games .pdfATM HTML Games
 
Why is yoga important in modern life.pdf
Why is yoga important in modern life.pdfWhy is yoga important in modern life.pdf
Why is yoga important in modern life.pdfYoga Entertainment
 
The Old Man and the Earthquake, a story for entertainment
The Old Man and the Earthquake, a story for entertainmentThe Old Man and the Earthquake, a story for entertainment
The Old Man and the Earthquake, a story for entertainmentazuremorn
 
Get started with Ekarma institute ppt.pptx
Get started with Ekarma institute ppt.pptxGet started with Ekarma institute ppt.pptx
Get started with Ekarma institute ppt.pptxYoga Entertainment
 
DePaul-Nickelodeon Storyboard Workshop Project
DePaul-Nickelodeon Storyboard Workshop ProjectDePaul-Nickelodeon Storyboard Workshop Project
DePaul-Nickelodeon Storyboard Workshop Projectmariazephan
 
Cabin by the azure lake, the story of a lady and a crocodile
Cabin by the azure lake, the story of a lady and a crocodileCabin by the azure lake, the story of a lady and a crocodile
Cabin by the azure lake, the story of a lady and a crocodileazuremorn
 
Sheila Ortega's Unfortunate Exit – Cut Down in Her Prime
Sheila Ortega's Unfortunate Exit – Cut Down in Her PrimeSheila Ortega's Unfortunate Exit – Cut Down in Her Prime
Sheila Ortega's Unfortunate Exit – Cut Down in Her Primeget joys
 

Recently uploaded (12)

MAGNET: Senior Thesis Storyboard Excerpt
MAGNET: Senior Thesis Storyboard ExcerptMAGNET: Senior Thesis Storyboard Excerpt
MAGNET: Senior Thesis Storyboard Excerpt
 
The lady in Surtout, an old story that happened in our neighbourhood
The lady in Surtout, an old story  that happened in our neighbourhoodThe lady in Surtout, an old story  that happened in our neighbourhood
The lady in Surtout, an old story that happened in our neighbourhood
 
MAGNET: Storyboard Excerpt Version Three
MAGNET: Storyboard Excerpt Version ThreeMAGNET: Storyboard Excerpt Version Three
MAGNET: Storyboard Excerpt Version Three
 
Transform Your Space with Poster Memorabilia's Collection
Transform Your Space with Poster Memorabilia's CollectionTransform Your Space with Poster Memorabilia's Collection
Transform Your Space with Poster Memorabilia's Collection
 
WWW - World Wide Web presentation.pptx
WWW - World Wide Web   presentation.pptxWWW - World Wide Web   presentation.pptx
WWW - World Wide Web presentation.pptx
 
Atm HTML GAMES collection of games .pdf
Atm HTML GAMES collection of  games .pdfAtm HTML GAMES collection of  games .pdf
Atm HTML GAMES collection of games .pdf
 
Why is yoga important in modern life.pdf
Why is yoga important in modern life.pdfWhy is yoga important in modern life.pdf
Why is yoga important in modern life.pdf
 
The Old Man and the Earthquake, a story for entertainment
The Old Man and the Earthquake, a story for entertainmentThe Old Man and the Earthquake, a story for entertainment
The Old Man and the Earthquake, a story for entertainment
 
Get started with Ekarma institute ppt.pptx
Get started with Ekarma institute ppt.pptxGet started with Ekarma institute ppt.pptx
Get started with Ekarma institute ppt.pptx
 
DePaul-Nickelodeon Storyboard Workshop Project
DePaul-Nickelodeon Storyboard Workshop ProjectDePaul-Nickelodeon Storyboard Workshop Project
DePaul-Nickelodeon Storyboard Workshop Project
 
Cabin by the azure lake, the story of a lady and a crocodile
Cabin by the azure lake, the story of a lady and a crocodileCabin by the azure lake, the story of a lady and a crocodile
Cabin by the azure lake, the story of a lady and a crocodile
 
Sheila Ortega's Unfortunate Exit – Cut Down in Her Prime
Sheila Ortega's Unfortunate Exit – Cut Down in Her PrimeSheila Ortega's Unfortunate Exit – Cut Down in Her Prime
Sheila Ortega's Unfortunate Exit – Cut Down in Her Prime
 

Agile metrics what is... riga-version

  • 1. © 2015 Accenture. All rights reserved. Accenture, its logo, and 'High Performance. Delivered.' are trademarks of Accenture. Agile Day Riga 2015 Alex Birke, May 23, 2015 Essential Metrics for Agile Project Management
  • 2. Why Metrics? “they help […] to make decisions” (Eric Ries, Lean Startup) 2© 2015 Accenture. All rights reserved.
  • 3. What makes a good metric? As many as required, as less as possible Leading indicators over trailing indicators Measure results, not activity Assess trends, not snapshots Easy to collect 4© 2015 Accenture. All rights reserved.
  • 4. But wait! What about Scrum’s metrics as the Burndown and the Velocity! 5© 2015 Accenture. All rights reserved.
  • 5. A Set of Core Metrics for Agile Project management* Scope Cost Schedule Productivity Story Point Effort Performance IndicatorScope Volatility Release Slippage Risk Indicator Sprint Burndown Performance Indicator Release Burnchart Performance Indicator Quality Sprint Productivity Required Productivity © 2015 Accenture. All rights reserved. *) Metrics are agnostic of technology or domain where Agile Project Management is used Running Tested Features Delivered Defect Rate
  • 6. Sprint Productivity (P) Definition Productivity is measured as generated value in story points that can be completed per person day. Calculation # story points [SP] of a sprint P = # person days of a sprint 8© 2015 Accenture. All rights reserved.
  • 7. Required Productivity (RP) Definition RP is the productivity that the team would require in the remaining sprints, to complete at least remaining “Must-Have” user stories, so that a Minimal Viable Release (MVR) can be deployed to production. Calculation # of SP estimate of remaining “Must-Have” stories RP = Total planned effort in remaining sprints 9© 2015 Accenture. All rights reserved.
  • 8. Required Productivity 10© 2015 Accenture. All rights reserved. Required Velocity = ( 3 [SP] + 3 [SP] + 8 [SP] + 3 [SP] ) / 3 = 5.66 [SP] Assuming 105 hours per upcoming Sprint: RP = 5.66 [SP] / 105 [hours] = 0.054 [SP / hours]
  • 9. Release Slippage Risk Indicator (RSRI) Definition RSRI indicates whether at least a minimal viable release (MVR) can be deployed to production on the scheduled date. Calculation “Past” Sprint Productivity (P) RSRI = Required Sprint Productivity for release date (RP) = 1 : as planned RSRI < 1 : delayed > 1 : ahead of plan 11© 2015 Accenture. All rights reserved.
  • 10. Release Slippage Risk Indicator 12© 2015 Accenture. All rights reserved. Required Productivity = ( 3 [SP] + 3 [SP] + 8 [SP] + 3 [SP] ) / (3 [Sprints] * 105 [hours] ) = = 0.054 [SP / hours] Past Productivity = 5 [SP] / 90 [hours] = 0.055 [SP / hours] Release Slippage Risk = 1.02
  • 11. What makes a good metric? As many as required, as less as possible Leading indicators over trailing indicators Measure results, not activity Assess trends, not snapshots Easy to collect 4© 2015 Accenture. All rights reserved.
  • 12. 0 20 60 160 280 400 560 720 820 920 1015 1110 1210 1330 490 0 200 400 600 800 1000 1200 1400 1600 1800 0 1 2 3 4 5 6 7 8 9 10 11 12 13 Work(StoryPoints) Sprint # Release Burn Up Chart Must-Have Scope Must-Have + Should-Have Scope Planned Dev Complete or Accenture Scope Complete Ideal Burn-Up Required Burn 2 new “Billing” epics added “Summary Reports” added “Rating” epics de-scoped In the example above, at the end of Sprint 7: RBPI = 490 / 720 = 0.68, which indicates that the amount of user stories done was less than expected. Release BurnChart Performance Indicator © 2015 Accenture. All rights reserved.
  • 13. Sprint Burndown Performance Indicator (SBPI) Definition SBPI shows the deviation in completed work compared to work planned, for the current sprint. Calculation Ideal remaining work SBPI = Actual remaining work = 1: as planned SBPI < 1: delayed > 1: ahead of plan 15© 2015 Accenture. All rights reserved.
  • 14. Sprint Burndown Performance Indicator = 120 [hours] / 160 [hours] = .75 (i.e. -25% deviation) Sprint Burndown Performance Indicator = 40 [SP] / 50 [SP] = .80 Fig. 1: Task Burndown (effort based) Fig. 2: User Story Burndown (Story Point based) Sprint Burndown Performance Indicator © 2015 Accenture. All rights reserved.
  • 15. Scope Volatility (SV) Definition Scope Volatility depicts the amount of change in size of the release scope, comparing the release scope size measured at start of the release and after the last completed sprint. Calculation Current Size of Must-Have Scope – Initial Size of Must-Have Scope SV = * 100 Initial Size of Must-Have Scope > 0: Scope creep SV < 0: Scope drop = 0: Planned scope size retained (often corridor) 17© 2015 Accenture. All rights reserved.
  • 16. 1143 1228 Must-Have Scope 1237 1273 1330 0 200 400 600 800 1000 1200 1400 1600 1800 0 1 2 3 4 5 6 7 8 9 10 11 12 13 Work(StoryPoints) Sprint # Release Burn Up Chart Must-Have Scope Must-Have + Should-Have Scope Planned Dev Complete or Accenture Scope Complete Ideal Burn-Up Required Burn 2 new “Billing” epics added “Rating” epics de-scoped In the example above, Scope Volatility = (1273 [SP] – 1143 [SP] ) / 1143 [SP] * 100 = .11 Scope Volatility © 2015 Accenture. All rights reserved.
  • 17. Story Point Effort Performance Indicator (SPEPI) Definition SPEPI (aka CPI, sprint-wise) indicates if the ongoing project release is currently on budget, depicting deviation in planned effort per story point to the actual effort per story point. Calculation Planned Effort to be spent in the release so far Planned Story points delivered in the release so far SPEPI = Actual Effort spent on the release so far Actual Story points delivered in the release so far = 1 : as planned SPEPI < 1 : cost overrun > 1 : under budget 19© 2015 Accenture. All rights reserved.
  • 18. Story Point Effort Performance Indicator “per” 20 Value Effort / money SPEPI = (875 / 630 ) / ( 957 / 490 ) = 0.71, which indicates a cost overrun. © 2015 Accenture. All rights reserved.
  • 19. Running Tested Features* (RTF) Definition RTF depicts the variance of working (running) features over total features built to date. Calculation # completed user stories that still pass all acceptance tests RTF = x 100 total # of completed user stories to date 21© 2015 Accenture. All rights reserved. *) “A Metric leading to Agility”, Ron Jeffries
  • 20. But wait! What about Scrum’s metrics as the Burndown and the Velocity! 5© 2015 Accenture. All rights reserved.
  • 21. Delivered Defect Rate (DDR) Definition DDR indicates the effectiveness of the review and testing activities, thus ensuring that fewer defects are identified on the delivered product (increment). Calculation Defects identified after Done-ness of user stories DDR = Total effort spent in all tasks till date Alternative metric: Defect Density is # of defects identified in completed user stories per size of Done user stories. 23© 2015 Accenture. All rights reserved.
  • 22. Delivered Defect Rate 24© 2015 Accenture. All rights reserved. DDR Sprint 1 Sprint 2 Sprint 3 Sprint 4 Defects Identified 7 12 19 25 SPE Effort 400 831 1262 1685 Defect Rate 0,018 0,014 0,015 0,015 Engineering effort includes effort from Agile Lifecycle tool for design, build, test, defect fix tasks. Includes PO & SM time as % of completed stories Count only the defects logged after the story is marked complete by the developer In the example above, DDR trend is stable. Therefore the delivered quality is stable.
  • 23. A Set of Core Metrics for Agile Project management* Scope Cost Schedule Productivity Story Point Effort Performance IndicatorScope Volatility Release Slippage Risk Indicator Sprint Burndown Performance Indicator Release Burnchart Performance Indicator Quality Sprint Productivity Required Productivity © 2015 Accenture. All rights reserved. *) Metrics are agnostic of technology or domain where Agile Project Management is used Running Tested Features Delivered Defect Rate
  • 24. Some further sometimes helpful metrics 26 % Stories accepted Stakeholder Involvement Index % Changed Scope Average Time to Market (Retrospective) Process improvement Customer Satisfaction Test Automation Coverage Employee Engagement Epic Progress Report
  • 25. A Set of Core Metrics for Agile Project management* Scope Cost Schedule Productivity Story Point Effort Performance IndicatorScope Volatility Release Slippage Risk Indicator Sprint Burndown Performance Indicator Release Burnchart Performance Indicator Quality Sprint Productivity Required Productivity © 2015 Accenture. All rights reserved. *) Metrics are agnostic of technology or domain where Agile Project Management is used Running Tested Features Delivered Defect Rate