SlideShare a Scribd company logo
A Replicated Study on Correlating Agile Team 
Velocity in Function and Story Points 
Hennie Huijgens 
Delft University of Technology and Goverdson 
The Netherlands
A Learning Cycle for Software Engineering Projects 
Project 
Estimate 
Project 
Control 
Project 
Close 
Benchmark & 
Analysis Measurement 
Repository
In 2013 we published a paper on 
Best-in-Class Software Releases
We focused at 26 software releases that outperformed in 
comparison with our measurement repository 
-100% 
100% 
300% 
500% 
Cost / Duration Matrix 
300% 200% 100% 0% -100% 
% Cost Deviation from Mean 
Cost over Time 
Bad Practice 
Good 
Practice 
Time over Cost 
% Duration Deviation from Mean
14 Of these releases were counted in both 
Function Points and Story Points 
Period FP SP 
A Aug 11 22 - 
A Sep 11 26 - 
A Oct 11 49 - 
A Nov 11 31 - 
A Dec 11 47 - 
A Jan 12 16 - 
A Feb 12 14 26 
A Mar 12 21 57 
A Apr 12 13 75 
A May 12 48 48 
A Jun 12 41 29 
A Jul 12 32 45 
A Aug 12 55 27 
Period FP SP 
B Aug 11 52 - 
B Sep 11 28 - 
B Oct 11 30 - 
B Nov 11 9 - 
B Dec 11 30 - 
B Jan 12 5 43 
B Feb 12 18 35 
B Mar 12 24 25 
B Apr 12 20 51 
B May 12 25 45 
B Jun 12 41 21 
B Jul 12 57 14 
B Aug 12 10 -
Function Points versus Story Points 
Function Points (FP) Story Points (SP) 
FP is a Size Metric SP is an Effort Estimate 
Objective (ISO standard for Functional 
Size Measurement) 
Relative (e.g. Fibonacci sequence) 
FPs cover functionality only SPs covers both functionality and NFR’s
In 2011 a paper by a group of Brazilian researchers was 
published on a comparison between FPs and SPs 
• ‘It was also realized a statistical 
correlation between FP and SP using 
2191 stories and 18 iterations in a 
Brazilian public agency. 
• The conclusion drawn from this study 
was that function points, in that 
particular case, could be related with the 
initial value of the Story Points (…)’ 
• ‘The result cannot be generalized, but it 
supports an idea that Product Size = 
Functional Size + Non-Functional Size + 
Environments Variables Size, Story 
Points = Function Points + Non- 
Functional Size + Environments 
Variables Size.’
A comparison of FPs versus SPs in both studies 
900 
800 
700 
600 
500 
400 
300 
200 
100 
0 
0 20 40 60 80 100 120 140 160 180 
Santana et al. 
Bank Data A 
Bank Data B 
Function Points 
Story Points 
Where Santana et al. concluded a strong positive linear relation between FPs and 
SPs, we found a moderate negative one. 
It appears too early to make generic claims on the relation between FPs and SPs; 
in fact FSM-theory seems to underpin that such a relationship is a spurious one.
‘Can we compare FPs with SPs?’ 
• The results of our study support the often heard saying that SPs 
cannot be (or should not be) compared with functional size 
measurements such as FPs. 
• FPs are assumed to be objective functional size measurements, based 
on standardized guidelines. FPs cover functionality only. 
• SPs are at best reliable within the scope of one software development 
team; results cannot be compared with other teams or companies. 
SPs cover both functional and non-functional requirements.
‘Okay, if we can’t compare them, 
which ones do we throw away?’ 
• None! You need both… 
• Use SPs to estimate the work to be done and for communication to 
the business. They are a great tool for developers to describe the 
effort of a feature or user story in comparison to another within the 
scope of a development team. 
• Use FPs to track progress in portfolio management and for 
benchmarking purposes. FPs are an industry standard with proper 
guidelines and can be used worldwide across companies.
Thank you 
Hennie Huijgens 
h.k.m.huijgens@tudelft.nl 
www.goverdson.com

More Related Content

Similar to A replicated study on agile team velocity in story and function points

1a. PROBLEM 1Millar Company has the following cost rec.docx
1a. PROBLEM 1Millar Company has the following cost rec.docx1a. PROBLEM 1Millar Company has the following cost rec.docx
1a. PROBLEM 1Millar Company has the following cost rec.docx
felicidaddinwoodie
 
Running head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docx
Running head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docxRunning head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docx
Running head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docx
todd271
 
Argument Papers (5-7 pages in length)1. Do schools perpe.docx
Argument Papers (5-7 pages in length)1. Do schools perpe.docxArgument Papers (5-7 pages in length)1. Do schools perpe.docx
Argument Papers (5-7 pages in length)1. Do schools perpe.docx
fredharris32
 
How Can I Use SNAP to Improve My Estimation Practices?
How Can I Use SNAP to Improve My Estimation Practices?How Can I Use SNAP to Improve My Estimation Practices?
How Can I Use SNAP to Improve My Estimation Practices?
DCG Software Value
 
Agile Estimation & Capacity Planning
Agile Estimation & Capacity PlanningAgile Estimation & Capacity Planning
Agile Estimation & Capacity Planning
Mazhar Khan
 
A GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESS
A GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESSA GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESS
A GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESS
ijseajournal
 
Top down
Top downTop down
Top down
Nino Ho
 
The Use of Story Point and Sprint Report in Agile Project Methodology.pdf
The Use of Story Point and Sprint Report in Agile Project Methodology.pdfThe Use of Story Point and Sprint Report in Agile Project Methodology.pdf
The Use of Story Point and Sprint Report in Agile Project Methodology.pdf
Orangescrum
 
PLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docx
PLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docxPLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docx
PLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docx
janekahananbw
 
Recommending Scientific Papers: Investigating the User Curriculum
Recommending Scientific Papers: Investigating the User CurriculumRecommending Scientific Papers: Investigating the User Curriculum
Recommending Scientific Papers: Investigating the User Curriculum
Jonathas Magalhães
 
Running head Measuring Performance .docx
Running head Measuring Performance                         .docxRunning head Measuring Performance                         .docx
Running head Measuring Performance .docx
cowinhelen
 
RESUME_ZEYU XIE
RESUME_ZEYU XIERESUME_ZEYU XIE
RESUME_ZEYU XIE
Zeyu Xie
 
Module 8 presenter notes
Module 8 presenter notesModule 8 presenter notes
Module 8 presenter notes
Tony
 
D0704014018
D0704014018D0704014018
D0704014018
IJERD Editor
 
Are we there yet? Rev up your productivity with project management tools
Are we there yet? Rev up your productivity with project management toolsAre we there yet? Rev up your productivity with project management tools
Are we there yet? Rev up your productivity with project management tools
Margot
 
Are we there yet? Rev up your productivity with project management tools
Are we there yet?  Rev up your productivity with project management toolsAre we there yet?  Rev up your productivity with project management tools
Are we there yet? Rev up your productivity with project management tools
Annis Lee Adams
 
Highlight OpenStack survey
Highlight OpenStack surveyHighlight OpenStack survey
Highlight OpenStack survey
Carlos Cervigón Ávila
 
Analytics and Data as a Keystone Technology for Translation Companies, Doron ...
Analytics and Data as a Keystone Technology for Translation Companies, Doron ...Analytics and Data as a Keystone Technology for Translation Companies, Doron ...
Analytics and Data as a Keystone Technology for Translation Companies, Doron ...
TAUS - The Language Data Network
 
Logic Model Workbook
Logic Model WorkbookLogic Model Workbook
Logic Model Workbook
Innovation Network
 
General Tips to Fast-Track Your Quantitative Methodology
General Tips to Fast-Track Your Quantitative MethodologyGeneral Tips to Fast-Track Your Quantitative Methodology
General Tips to Fast-Track Your Quantitative Methodology
Statistics Solutions
 

Similar to A replicated study on agile team velocity in story and function points (20)

1a. PROBLEM 1Millar Company has the following cost rec.docx
1a. PROBLEM 1Millar Company has the following cost rec.docx1a. PROBLEM 1Millar Company has the following cost rec.docx
1a. PROBLEM 1Millar Company has the following cost rec.docx
 
Running head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docx
Running head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docxRunning head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docx
Running head DATA ANALYSIS PLAN 1DATA ANALYSIS PLAN.docx
 
Argument Papers (5-7 pages in length)1. Do schools perpe.docx
Argument Papers (5-7 pages in length)1. Do schools perpe.docxArgument Papers (5-7 pages in length)1. Do schools perpe.docx
Argument Papers (5-7 pages in length)1. Do schools perpe.docx
 
How Can I Use SNAP to Improve My Estimation Practices?
How Can I Use SNAP to Improve My Estimation Practices?How Can I Use SNAP to Improve My Estimation Practices?
How Can I Use SNAP to Improve My Estimation Practices?
 
Agile Estimation & Capacity Planning
Agile Estimation & Capacity PlanningAgile Estimation & Capacity Planning
Agile Estimation & Capacity Planning
 
A GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESS
A GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESSA GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESS
A GROUNDED THEORY OF THE REQUIREMENTS ENGINEERING PROCESS
 
Top down
Top downTop down
Top down
 
The Use of Story Point and Sprint Report in Agile Project Methodology.pdf
The Use of Story Point and Sprint Report in Agile Project Methodology.pdfThe Use of Story Point and Sprint Report in Agile Project Methodology.pdf
The Use of Story Point and Sprint Report in Agile Project Methodology.pdf
 
PLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docx
PLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docxPLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docx
PLEASE READ BACKGROUND INFO BELOW.  TURNIT IN IS USEDModule 4 .docx
 
Recommending Scientific Papers: Investigating the User Curriculum
Recommending Scientific Papers: Investigating the User CurriculumRecommending Scientific Papers: Investigating the User Curriculum
Recommending Scientific Papers: Investigating the User Curriculum
 
Running head Measuring Performance .docx
Running head Measuring Performance                         .docxRunning head Measuring Performance                         .docx
Running head Measuring Performance .docx
 
RESUME_ZEYU XIE
RESUME_ZEYU XIERESUME_ZEYU XIE
RESUME_ZEYU XIE
 
Module 8 presenter notes
Module 8 presenter notesModule 8 presenter notes
Module 8 presenter notes
 
D0704014018
D0704014018D0704014018
D0704014018
 
Are we there yet? Rev up your productivity with project management tools
Are we there yet? Rev up your productivity with project management toolsAre we there yet? Rev up your productivity with project management tools
Are we there yet? Rev up your productivity with project management tools
 
Are we there yet? Rev up your productivity with project management tools
Are we there yet?  Rev up your productivity with project management toolsAre we there yet?  Rev up your productivity with project management tools
Are we there yet? Rev up your productivity with project management tools
 
Highlight OpenStack survey
Highlight OpenStack surveyHighlight OpenStack survey
Highlight OpenStack survey
 
Analytics and Data as a Keystone Technology for Translation Companies, Doron ...
Analytics and Data as a Keystone Technology for Translation Companies, Doron ...Analytics and Data as a Keystone Technology for Translation Companies, Doron ...
Analytics and Data as a Keystone Technology for Translation Companies, Doron ...
 
Logic Model Workbook
Logic Model WorkbookLogic Model Workbook
Logic Model Workbook
 
General Tips to Fast-Track Your Quantitative Methodology
General Tips to Fast-Track Your Quantitative MethodologyGeneral Tips to Fast-Track Your Quantitative Methodology
General Tips to Fast-Track Your Quantitative Methodology
 

Recently uploaded

socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
SOCRadar
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke
 
Hand Rolled Applicative User Validation Code Kata
Hand Rolled Applicative User ValidationCode KataHand Rolled Applicative User ValidationCode Kata
Hand Rolled Applicative User Validation Code Kata
Philip Schwarz
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Łukasz Chruściel
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptxLORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
lorraineandreiamcidl
 
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
Alina Yurenko
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Shane Coughlan
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsUI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
Peter Muessig
 
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissancesAtelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Neo4j
 
E-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet DynamicsE-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet Dynamics
Hornet Dynamics
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOMLORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
lorraineandreiamcidl
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, FactsALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
Green Software Development
 
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR SolutionsTransform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
TheSMSPoint
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
mz5nrf0n
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
Aftab Hussain
 

Recently uploaded (20)

socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
 
Hand Rolled Applicative User Validation Code Kata
Hand Rolled Applicative User ValidationCode KataHand Rolled Applicative User ValidationCode Kata
Hand Rolled Applicative User Validation Code Kata
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
 
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket ManagementUtilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
Utilocate provides Smarter, Better, Faster, Safer Locate Ticket Management
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptxLORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
LORRAINE ANDREI_LEQUIGAN_HOW TO USE WHATSAPP.pptx
 
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)GOING AOT WITH GRAALVM FOR  SPRING BOOT (SPRING IO)
GOING AOT WITH GRAALVM FOR SPRING BOOT (SPRING IO)
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling ExtensionsUI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
UI5con 2024 - Boost Your Development Experience with UI5 Tooling Extensions
 
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissancesAtelier - Innover avec l’IA Générative et les graphes de connaissances
Atelier - Innover avec l’IA Générative et les graphes de connaissances
 
E-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet DynamicsE-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet Dynamics
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOMLORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, FactsALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
 
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR SolutionsTransform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
 

A replicated study on agile team velocity in story and function points

  • 1. A Replicated Study on Correlating Agile Team Velocity in Function and Story Points Hennie Huijgens Delft University of Technology and Goverdson The Netherlands
  • 2. A Learning Cycle for Software Engineering Projects Project Estimate Project Control Project Close Benchmark & Analysis Measurement Repository
  • 3. In 2013 we published a paper on Best-in-Class Software Releases
  • 4. We focused at 26 software releases that outperformed in comparison with our measurement repository -100% 100% 300% 500% Cost / Duration Matrix 300% 200% 100% 0% -100% % Cost Deviation from Mean Cost over Time Bad Practice Good Practice Time over Cost % Duration Deviation from Mean
  • 5. 14 Of these releases were counted in both Function Points and Story Points Period FP SP A Aug 11 22 - A Sep 11 26 - A Oct 11 49 - A Nov 11 31 - A Dec 11 47 - A Jan 12 16 - A Feb 12 14 26 A Mar 12 21 57 A Apr 12 13 75 A May 12 48 48 A Jun 12 41 29 A Jul 12 32 45 A Aug 12 55 27 Period FP SP B Aug 11 52 - B Sep 11 28 - B Oct 11 30 - B Nov 11 9 - B Dec 11 30 - B Jan 12 5 43 B Feb 12 18 35 B Mar 12 24 25 B Apr 12 20 51 B May 12 25 45 B Jun 12 41 21 B Jul 12 57 14 B Aug 12 10 -
  • 6. Function Points versus Story Points Function Points (FP) Story Points (SP) FP is a Size Metric SP is an Effort Estimate Objective (ISO standard for Functional Size Measurement) Relative (e.g. Fibonacci sequence) FPs cover functionality only SPs covers both functionality and NFR’s
  • 7. In 2011 a paper by a group of Brazilian researchers was published on a comparison between FPs and SPs • ‘It was also realized a statistical correlation between FP and SP using 2191 stories and 18 iterations in a Brazilian public agency. • The conclusion drawn from this study was that function points, in that particular case, could be related with the initial value of the Story Points (…)’ • ‘The result cannot be generalized, but it supports an idea that Product Size = Functional Size + Non-Functional Size + Environments Variables Size, Story Points = Function Points + Non- Functional Size + Environments Variables Size.’
  • 8. A comparison of FPs versus SPs in both studies 900 800 700 600 500 400 300 200 100 0 0 20 40 60 80 100 120 140 160 180 Santana et al. Bank Data A Bank Data B Function Points Story Points Where Santana et al. concluded a strong positive linear relation between FPs and SPs, we found a moderate negative one. It appears too early to make generic claims on the relation between FPs and SPs; in fact FSM-theory seems to underpin that such a relationship is a spurious one.
  • 9. ‘Can we compare FPs with SPs?’ • The results of our study support the often heard saying that SPs cannot be (or should not be) compared with functional size measurements such as FPs. • FPs are assumed to be objective functional size measurements, based on standardized guidelines. FPs cover functionality only. • SPs are at best reliable within the scope of one software development team; results cannot be compared with other teams or companies. SPs cover both functional and non-functional requirements.
  • 10. ‘Okay, if we can’t compare them, which ones do we throw away?’ • None! You need both… • Use SPs to estimate the work to be done and for communication to the business. They are a great tool for developers to describe the effort of a feature or user story in comparison to another within the scope of a development team. • Use FPs to track progress in portfolio management and for benchmarking purposes. FPs are an industry standard with proper guidelines and can be used worldwide across companies.
  • 11. Thank you Hennie Huijgens h.k.m.huijgens@tudelft.nl www.goverdson.com

Editor's Notes

  1. Together with many colleagues from several software companies I collected historic data from finalized software projects, and stored all this information in a measurement repository. And once every month or quarter we analyzed our data and looked for trends on a portfolio level or organization level. And we learned from the knowledge that we collected as an estimate for newly started projects.
  2. Besides my work as measurement expert I started off doing a PhD at Delft University of Technology, and we published a study on the IWSM-Mensura 2013 conference on 26 best-in-class software releases that we identified in our repository.
  3. These 26 releases outperformed in comparison with all other software projects in our repository. We found that they scored better than average for both cost and duration, ending up in the good practice quadrant of this matrix.
  4. There was something interesting in these projects that we did not use in our IWSM-Mensura paper. During the measurement period of the 26 software releases, performed by two teams on different, yet comparable software systems, a transition was made from waterfall to scrum as the delivery approach. Meaning that for both teams we had 7 releases measured in both function points and story points. And we’d liked to find out whether we could find any correlation between both size metrics.
  5. Comparison function points versus story points.
  6. Yet when starting up this study, I found that there was already another paper on this subject, published by a group of Brazilian researchers on the XP 2011 conference. This study included a comparison of function points and story points, showing that – however not to be generalized – a strong positive linear relation occurred between both metrics. The researchers even suggested that in future automated translation from function points to story points, or the other way around, might be thinkable. We decided to replicate this study with our data of the 14 best-in-class software releases.
  7. And however our data showed a moderate relation, we found no match with the Brazilian study. Where they reported a strong, positive linear relation, we found a moderate, negative linear one. We wrote things down in a paper and send it to WETSoM 2014. And then something interesting happened. We got a reply from the organizers that our paper was accepted, followed by 8 pages of peer review remarks, stating among other things that in fact a relationship between function points and story points is a spurious one. We dived again in the FSM-theory, and indeed we do have to agree we missed a point here.
  8. So, to summarize the outcome of our study; it supports the idea that story points cannot be (or should not be) compared to function points. Function points are objective, based on formal counting guidelines and they cover functionality only. Story points on the other hand are to be used within the scope of a software engineering team. They should not be used for comparison with other teams or even with other organizations.
  9. So to finalize; if comparison is not an option, why don’t we throw away one of them? And it is good to realize that this is happening in many software companies nowadays. Since many companies go agile, I see a trend to opt for story points – often considered as modern and fancy – and to get rid of function points, together with its old-fashioned measurement dinosaurs. However, keep in mind that we need both. In many companies story points prove to be a reliable and easy to use instrument to support the estimation process. Function points on the other hands, are a good source for quantified portfolio management and internal and external benchmarking.
  10. So, however both metrics might be from different planets, maybe next time when you hear measurement guys talking about all sorts of points, performance improvements, dashboards and so on, remember my colorful paintings about raga’s. And realize that the golden mean is always ‘that what’s creating passion’.