SlideShare a Scribd company logo
From dashboard management To an improvement index for the teams 
Amir Arooni, October 2014 
Head of Global Digital Channels&Payments Services
Introduction…. 
As of 2001 employed by ING: 
Director ING CB Global Digital Channels & Payments Services 
Director ING IT Solution Delivery Centre Channels NL 
Senior manager ING IT-Finance, Marketing & Sales support NL 
VP IT-Securities, IT-Investment Management, IT-Generic Systems 
Before 2001: 
Various leadership roles at KPN, TPG, Cap Gemini, Sun Microsystems 
Education: 
Msc Consulting & Coaching for Change (Oxford/HEC) 
MBA, RSM Erasmus University 
IT- Business & Information Modeling, Managing Complex projects 
Accountancy, BA, University of Teheran 
Amir Arooni MBA
6 oktober 2014 
3 
After 10 years of remodelling, renovation and restoration: the opening of the new Rijksmuseum on April 13th 2013. Costs 375M euro
The IT Department is out of sync with our company's needs….. 
We don't understand why we are spending so much in IT… 
Our IT department is not responsive… 
Difficulty to align many IT departments…
M& A: “without data, We only have opinions….” 
5
Components: DRTC AARB GTRD SOLL GREC TTPC URTB SDLI KLBT S2BT MEYT 
Components: DRTC AARB GTRD SOLL GREC TTPC URTB SDLI KLBT S2BT MEYT
What are the targets? Which data do we need and how to analyze them? 
6 oktober 2014 
7
Our vision is 
to deliver 
strategic advantage 
•8
The superior 
customer 
experience 
is our strategic differentiator 
9 
Wow! 
Wow! 
Wow!
Time to 
market 
10
11 
Collaborative community
12
We use the methods that are the most valued by engineers. 
 We follow the agile manifesto 
 We work based on Scrum Framework 
 We build, test, and deploy using continuous delivery principles 
 We are fully organized in DevOps teams.
Common DevOps Measurements 
•Cycle Time 
•Time from feature requested to available in production 
•Time from issue reported to fixed in production
Common DevOps Measurements 
•Team Velocity and Predictability of Sprint 
6 oktober 2014 
15 
Predictability 
Productivity
Common DevOps Measurements 
•Software Quality 
•Complexity, structure of the code 
•Design, layering of software components 
•Documentation, right comments and readability 
•Duplications, multiple places 
•Defects, number of issues during development and production 
•Size, manageable size of components 
•Tests, the level of automation and code covrage
Operational measurement is done with automatic tools. 
Simple dashboards, Automate every repetitive task in metrics gathering Built & maintained by ING 
•Results in agility in metrics 
•Take as needed while maturing Data from Product Backlogs 
•Enterprise Product Backlog Mgmt process Data from the DevOps Teams 
•Feedback from Scrum Masters 
•Continuous Integration process 
•Test Automation process 
•Continuous Delivery process 
•Incident tracking (HPC) 
•Monitoring All data for a DevOps Team is gathered by the DevOps Team Stay ‘lean and mean’ 
17
But these measurements are all about… 
6 oktober 2014 
18
There are 4 valuable areas which we start to measure to improve teams capabilities. 
Operational Excellence 
-# Defects per Release per Product Defect = Root cause of Incident + Bugs discovered by a user 
-Cycle Time per Product From ‘Prepare’ status to ‘Production’ Prepare = team spends effort on making user story Ready 
-Indexed Velocity Increase per Team Velocity / Velocity of first Sprint User story points indexed on reference user story 
Business Value 
-Business Value (EUR) Calculated per feature by Product Owner 
-# Outages per Product Per Release 
-# Open Risks per Product Per Release 
Customer Orientation 
-User Feedback (1-5 stars) Simple: Hands-up at demo (1-5 fingers up) Advanced: User Feedback Form 
Future Orientation 
-People Engagement Happy, OK, Sad / end of each Sprint 
-People skills Novice – Expert per individual & skill set Novice – Expert per team across skill sets 
-Simplified architecture TCO reduction 
19
We are also measuring the impact of our transition and resulting improvements of the teams. 
1) In our Agile transformation, we want to 
•Inspect whether the intended change is actually taking place 
•Inspect whether the change manifests itself in terms of our objectives 2) To give useful and positive feedback for self- improvement to teams about: 
•Continuous Delivery practices 
•Improving or adding practices 
6 oktober 2014 
20
We agree on the need for a simple set of metrics. 
21 
•Business Value 
•People Engagement 
•Service Quality 
•Time to market 
•Productivity
Why were we not successful in M&A in the past? 
KPI driven not improvement oriented, not from the teams for the teams. 
Matrices did not reflect the business objectives 
Most of standard measurements were: 
•Incomplete 
•Inconsistent 
•Infrequent Many manual data collection activities Differences in objectives led to confusion: 
•Cost, productivity, quality 
•Testable requirements , #faults been found, future 
22
Develop measurements which help the teams and add value to our business… 
-Right functionality for the customers 
-Skills and capabilities 
-Continuous Delivery 
-Collaboration and High Performance 
23
Metrics we use must be lightweight, valuable, simple and comparable. 
Lightweight: Data collection and - processing may not slow or burden DevOps teams or Management Teams Valuable: Metrics must have a strong relation to either our objectives or to our change. Metrics must help making decisions. If we collect metrics without using them – stop! Simple: Collectable by the DevOps Teams in the course of their own work, or generated automatically by continuous delivery tooling Comparable: DevOps Team A in Domain X to DevOps Team B in Domain Y Not as a KPI, but to feed the learning cycle. 
24
•Thank you for your attention! 
• : Amir Arooni 
• amir.arooni@mail.ing.nl

More Related Content

What's hot

Iasi code camp 12 october 2013 corneliu rimboiu - bridging java and .net
Iasi code camp 12 october 2013   corneliu rimboiu - bridging java and .netIasi code camp 12 october 2013   corneliu rimboiu - bridging java and .net
Iasi code camp 12 october 2013 corneliu rimboiu - bridging java and .netCodecamp Romania
 
CMS Computer- Where Technology Begins.
CMS Computer- Where Technology Begins.CMS Computer- Where Technology Begins.
CMS Computer- Where Technology Begins.
CMS Computer - Where Technology Begins
 
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
Gene Kim
 
Agile Metrics That Matter
Agile Metrics That MatterAgile Metrics That Matter
Agile Metrics That Matter
Clint Edmonson
 
How we became lean
How we became leanHow we became lean
How we became lean
Lean India Summit
 
Agile Development with Agile Contract
Agile Development with Agile ContractAgile Development with Agile Contract
Agile Development with Agile Contract
NUS-ISS
 
Corporate profile
Corporate profileCorporate profile
Corporate profile
Elsner Technologies
 
Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016
Jacques Quereau
 
Nevpro Business Solutions
Nevpro Business SolutionsNevpro Business Solutions
Nevpro Business SolutionsRohit Tripathi
 
DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...
DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...
DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...
Gene Kim
 
Aravinda Nadig - Business Analyst
Aravinda Nadig - Business AnalystAravinda Nadig - Business Analyst
Aravinda Nadig - Business AnalystAravinda Nadig
 
IFPL - AS9100c Quality Overview
IFPL - AS9100c Quality OverviewIFPL - AS9100c Quality Overview
IFPL - AS9100c Quality Overview
IFPL
 
Contributors for Delivering a Successful Testing Project Seminar
Contributors for Delivering a Successful Testing Project SeminarContributors for Delivering a Successful Testing Project Seminar
Contributors for Delivering a Successful Testing Project Seminar
KMS Technology
 
Vertigus Corporate Presentation 2008
Vertigus Corporate Presentation 2008Vertigus Corporate Presentation 2008
Vertigus Corporate Presentation 2008Carlos Eugenio Torres
 
IT Operations - Queue Approach
IT Operations - Queue ApproachIT Operations - Queue Approach
IT Operations - Queue Approach
Agron Fazliu
 
What is Agile
What is Agile What is Agile
What is Agile
Ebin John Poovathany
 
Agile vs devops : Learn The Differences Between Agile & Devops
Agile vs devops : Learn The Differences Between Agile & DevopsAgile vs devops : Learn The Differences Between Agile & Devops
Agile vs devops : Learn The Differences Between Agile & Devops
TestingXperts
 

What's hot (18)

Iasi code camp 12 october 2013 corneliu rimboiu - bridging java and .net
Iasi code camp 12 october 2013   corneliu rimboiu - bridging java and .netIasi code camp 12 october 2013   corneliu rimboiu - bridging java and .net
Iasi code camp 12 october 2013 corneliu rimboiu - bridging java and .net
 
CMS Computer- Where Technology Begins.
CMS Computer- Where Technology Begins.CMS Computer- Where Technology Begins.
CMS Computer- Where Technology Begins.
 
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
DOES16 London - Gebrian uit de Bulten & Vincent van Kooten - The Road to Enab...
 
Agile Metrics That Matter
Agile Metrics That MatterAgile Metrics That Matter
Agile Metrics That Matter
 
How we became lean
How we became leanHow we became lean
How we became lean
 
Agile Development with Agile Contract
Agile Development with Agile ContractAgile Development with Agile Contract
Agile Development with Agile Contract
 
Corporate profile
Corporate profileCorporate profile
Corporate profile
 
Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016Jacques+g+official+cv+05 07-2016
Jacques+g+official+cv+05 07-2016
 
Nevpro Business Solutions
Nevpro Business SolutionsNevpro Business Solutions
Nevpro Business Solutions
 
DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...
DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...
DOES16 London - Philippe Guenet - G3 Model –A Practical Lean Approach to Impr...
 
Aravinda Nadig - Business Analyst
Aravinda Nadig - Business AnalystAravinda Nadig - Business Analyst
Aravinda Nadig - Business Analyst
 
IFPL - AS9100c Quality Overview
IFPL - AS9100c Quality OverviewIFPL - AS9100c Quality Overview
IFPL - AS9100c Quality Overview
 
Contributors for Delivering a Successful Testing Project Seminar
Contributors for Delivering a Successful Testing Project SeminarContributors for Delivering a Successful Testing Project Seminar
Contributors for Delivering a Successful Testing Project Seminar
 
Agile con2014ver4
Agile con2014ver4Agile con2014ver4
Agile con2014ver4
 
Vertigus Corporate Presentation 2008
Vertigus Corporate Presentation 2008Vertigus Corporate Presentation 2008
Vertigus Corporate Presentation 2008
 
IT Operations - Queue Approach
IT Operations - Queue ApproachIT Operations - Queue Approach
IT Operations - Queue Approach
 
What is Agile
What is Agile What is Agile
What is Agile
 
Agile vs devops : Learn The Differences Between Agile & Devops
Agile vs devops : Learn The Differences Between Agile & DevopsAgile vs devops : Learn The Differences Between Agile & Devops
Agile vs devops : Learn The Differences Between Agile & Devops
 

Similar to Iwsm2014 dev ops measurements (amir arooni)

The Need for Speed
The Need for SpeedThe Need for Speed
The Need for Speed
Capgemini
 
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma
 
Practical experiences of portfolio management
Practical experiences of portfolio managementPractical experiences of portfolio management
Practical experiences of portfolio management
Association for Project Management
 
MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes
MuleSoft
 
English digital business 2.1.pptx
English digital business 2.1.pptxEnglish digital business 2.1.pptx
English digital business 2.1.pptx
Juanjo MARTINEZ PAGAN
 
Agile Introduction
Agile IntroductionAgile Introduction
Agile Introduction
Guy Winterbotham CSM,PMP
 
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Tasktop
 
MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes
MuleSoft
 
Nippon Data Systems - An Overview
Nippon Data Systems - An OverviewNippon Data Systems - An Overview
Nippon Data Systems - An Overview
Asit Ranjan Mishra
 
IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3
IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3
IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3
Mirco Hering
 
ICS - Introduction
ICS - IntroductionICS - Introduction
ICS - Introduction
ICube Systems Pvt Ltd
 
Psp Tsp Agile 3 1 En
Psp Tsp Agile 3 1 EnPsp Tsp Agile 3 1 En
Psp Tsp Agile 3 1 En
Frederick Lussier
 
BVDs and Your Data - Combined to Drive Success
BVDs and Your Data - Combined to Drive SuccessBVDs and Your Data - Combined to Drive Success
BVDs and Your Data - Combined to Drive Success
ResultsPositive Business Technology Solutions
 
IBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOpsIBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOps
Sanjeev Sharma
 
Zero Defect Initiative - Quality Index Generator
Zero Defect Initiative - Quality Index GeneratorZero Defect Initiative - Quality Index Generator
Zero Defect Initiative - Quality Index Generator
QuEST Forum
 
APIdays Paris 2019 - Customer First Strategy through API-led Connectivity by...
APIdays Paris 2019 - Customer First Strategy  through API-led Connectivity by...APIdays Paris 2019 - Customer First Strategy  through API-led Connectivity by...
APIdays Paris 2019 - Customer First Strategy through API-led Connectivity by...
apidays
 
Taller Technologies: Our experience with iso 9001 2008 and Agile
Taller Technologies: Our experience with iso 9001 2008 and AgileTaller Technologies: Our experience with iso 9001 2008 and Agile
Taller Technologies: Our experience with iso 9001 2008 and Agile
Taller Technologies
 
ElectroNeek Partner - AAPNA Infotech
ElectroNeek Partner - AAPNA InfotechElectroNeek Partner - AAPNA Infotech
ElectroNeek Partner - AAPNA Infotech
Aapna Infotech
 
My Curriculum Vitæ
My Curriculum VitæMy Curriculum Vitæ
My Curriculum Vitæ
Lucas Souza
 

Similar to Iwsm2014 dev ops measurements (amir arooni) (20)

The Need for Speed
The Need for SpeedThe Need for Speed
The Need for Speed
 
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...Nesma event June '23 - How to use objective metrics as a basis for agile cost...
Nesma event June '23 - How to use objective metrics as a basis for agile cost...
 
Practical experiences of portfolio management
Practical experiences of portfolio managementPractical experiences of portfolio management
Practical experiences of portfolio management
 
MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes
 
English digital business 2.1.pptx
English digital business 2.1.pptxEnglish digital business 2.1.pptx
English digital business 2.1.pptx
 
Agile Introduction
Agile IntroductionAgile Introduction
Agile Introduction
 
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
Making Work Product-Centric: A Journey at Nationwide Insurance | Tasktop Conn...
 
MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes MuleSoft's Approach to Driving Customer Outcomes
MuleSoft's Approach to Driving Customer Outcomes
 
Agile dashboard
Agile dashboardAgile dashboard
Agile dashboard
 
Nippon Data Systems - An Overview
Nippon Data Systems - An OverviewNippon Data Systems - An Overview
Nippon Data Systems - An Overview
 
IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3
IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3
IBM Innovate - Adoption of Continuous Delivery at Scale at a large telco v0 3
 
ICS - Introduction
ICS - IntroductionICS - Introduction
ICS - Introduction
 
Psp Tsp Agile 3 1 En
Psp Tsp Agile 3 1 EnPsp Tsp Agile 3 1 En
Psp Tsp Agile 3 1 En
 
BVDs and Your Data - Combined to Drive Success
BVDs and Your Data - Combined to Drive SuccessBVDs and Your Data - Combined to Drive Success
BVDs and Your Data - Combined to Drive Success
 
IBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOpsIBM Innovate - Uderstanding DevOps
IBM Innovate - Uderstanding DevOps
 
Zero Defect Initiative - Quality Index Generator
Zero Defect Initiative - Quality Index GeneratorZero Defect Initiative - Quality Index Generator
Zero Defect Initiative - Quality Index Generator
 
APIdays Paris 2019 - Customer First Strategy through API-led Connectivity by...
APIdays Paris 2019 - Customer First Strategy  through API-led Connectivity by...APIdays Paris 2019 - Customer First Strategy  through API-led Connectivity by...
APIdays Paris 2019 - Customer First Strategy through API-led Connectivity by...
 
Taller Technologies: Our experience with iso 9001 2008 and Agile
Taller Technologies: Our experience with iso 9001 2008 and AgileTaller Technologies: Our experience with iso 9001 2008 and Agile
Taller Technologies: Our experience with iso 9001 2008 and Agile
 
ElectroNeek Partner - AAPNA Infotech
ElectroNeek Partner - AAPNA InfotechElectroNeek Partner - AAPNA Infotech
ElectroNeek Partner - AAPNA Infotech
 
My Curriculum Vitæ
My Curriculum VitæMy Curriculum Vitæ
My Curriculum Vitæ
 

More from Nesma

The Use of Functional Size in the Industry.pdf
The Use of Functional Size in the Industry.pdfThe Use of Functional Size in the Industry.pdf
The Use of Functional Size in the Industry.pdf
Nesma
 
2024-04 - Nesma webinar - Benchmarking.pdf
2024-04 - Nesma webinar - Benchmarking.pdf2024-04 - Nesma webinar - Benchmarking.pdf
2024-04 - Nesma webinar - Benchmarking.pdf
Nesma
 
Agile Team Performance Measurement webinar
Agile Team Performance Measurement webinarAgile Team Performance Measurement webinar
Agile Team Performance Measurement webinar
Nesma
 
Software Cost Estimation webinar January 2024.pdf
Software Cost Estimation webinar January 2024.pdfSoftware Cost Estimation webinar January 2024.pdf
Software Cost Estimation webinar January 2024.pdf
Nesma
 
Nesma event June '23 - NEN Practice Guideline - NPR.pdf
Nesma event June '23 - NEN Practice Guideline - NPR.pdfNesma event June '23 - NEN Practice Guideline - NPR.pdf
Nesma event June '23 - NEN Practice Guideline - NPR.pdf
Nesma
 
Nesma event June '23 - Easy Function Sizing - Introduction.pdf
Nesma event June '23 - Easy Function Sizing - Introduction.pdfNesma event June '23 - Easy Function Sizing - Introduction.pdf
Nesma event June '23 - Easy Function Sizing - Introduction.pdf
Nesma
 
Automotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
Automotive Software Cost Estimation - The UCE Approach - Emmanuel MaryAutomotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
Automotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
Nesma
 
The COSMIC battle between David and Goliath - Paul Hussein
The COSMIC battle between David and Goliath - Paul HusseinThe COSMIC battle between David and Goliath - Paul Hussein
The COSMIC battle between David and Goliath - Paul Hussein
Nesma
 
Succesful Estimating - It's how you tell the story - Amritpal Singh Agar
Succesful Estimating - It's how you tell the story - Amritpal Singh AgarSuccesful Estimating - It's how you tell the story - Amritpal Singh Agar
Succesful Estimating - It's how you tell the story - Amritpal Singh Agar
Nesma
 
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
Nesma
 
CEBoK for Software Past Present Future - Megan Jones
CEBoK for Software Past Present Future - Megan JonesCEBoK for Software Past Present Future - Megan Jones
CEBoK for Software Past Present Future - Megan Jones
Nesma
 
Agile Development and Agile Cost Estimation - A return to basic principles - ...
Agile Development and Agile Cost Estimation - A return to basic principles - ...Agile Development and Agile Cost Estimation - A return to basic principles - ...
Agile Development and Agile Cost Estimation - A return to basic principles - ...
Nesma
 
Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...
Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...
Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...
Nesma
 
Project Succes is a Choice - Joop Schefferlie
Project Succes is a Choice - Joop SchefferlieProject Succes is a Choice - Joop Schefferlie
Project Succes is a Choice - Joop Schefferlie
Nesma
 
Afrekenen met functiepunten
Afrekenen met functiepuntenAfrekenen met functiepunten
Afrekenen met functiepunten
Nesma
 
Agile teams get a grip - martijn groenewegen
Agile teams   get a grip - martijn groenewegenAgile teams   get a grip - martijn groenewegen
Agile teams get a grip - martijn groenewegen
Nesma
 
The fact that your poject is agile is not (necessarily) a cost driver arlen...
The fact that your poject is agile is not (necessarily) a cost driver   arlen...The fact that your poject is agile is not (necessarily) a cost driver   arlen...
The fact that your poject is agile is not (necessarily) a cost driver arlen...
Nesma
 
Software sizing as an essential measure past present and future - Dan Galorat...
Software sizing as an essential measure past present and future - Dan Galorat...Software sizing as an essential measure past present and future - Dan Galorat...
Software sizing as an essential measure past present and future - Dan Galorat...
Nesma
 
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
Nesma
 
Software sizing the cornerstone for iceaa's scebok - Carol Dekkers
Software sizing the cornerstone for iceaa's scebok - Carol DekkersSoftware sizing the cornerstone for iceaa's scebok - Carol Dekkers
Software sizing the cornerstone for iceaa's scebok - Carol Dekkers
Nesma
 

More from Nesma (20)

The Use of Functional Size in the Industry.pdf
The Use of Functional Size in the Industry.pdfThe Use of Functional Size in the Industry.pdf
The Use of Functional Size in the Industry.pdf
 
2024-04 - Nesma webinar - Benchmarking.pdf
2024-04 - Nesma webinar - Benchmarking.pdf2024-04 - Nesma webinar - Benchmarking.pdf
2024-04 - Nesma webinar - Benchmarking.pdf
 
Agile Team Performance Measurement webinar
Agile Team Performance Measurement webinarAgile Team Performance Measurement webinar
Agile Team Performance Measurement webinar
 
Software Cost Estimation webinar January 2024.pdf
Software Cost Estimation webinar January 2024.pdfSoftware Cost Estimation webinar January 2024.pdf
Software Cost Estimation webinar January 2024.pdf
 
Nesma event June '23 - NEN Practice Guideline - NPR.pdf
Nesma event June '23 - NEN Practice Guideline - NPR.pdfNesma event June '23 - NEN Practice Guideline - NPR.pdf
Nesma event June '23 - NEN Practice Guideline - NPR.pdf
 
Nesma event June '23 - Easy Function Sizing - Introduction.pdf
Nesma event June '23 - Easy Function Sizing - Introduction.pdfNesma event June '23 - Easy Function Sizing - Introduction.pdf
Nesma event June '23 - Easy Function Sizing - Introduction.pdf
 
Automotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
Automotive Software Cost Estimation - The UCE Approach - Emmanuel MaryAutomotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
Automotive Software Cost Estimation - The UCE Approach - Emmanuel Mary
 
The COSMIC battle between David and Goliath - Paul Hussein
The COSMIC battle between David and Goliath - Paul HusseinThe COSMIC battle between David and Goliath - Paul Hussein
The COSMIC battle between David and Goliath - Paul Hussein
 
Succesful Estimating - It's how you tell the story - Amritpal Singh Agar
Succesful Estimating - It's how you tell the story - Amritpal Singh AgarSuccesful Estimating - It's how you tell the story - Amritpal Singh Agar
Succesful Estimating - It's how you tell the story - Amritpal Singh Agar
 
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
(Increasing) Predictability of large Government ICT Projects - Koos Veefkind
 
CEBoK for Software Past Present Future - Megan Jones
CEBoK for Software Past Present Future - Megan JonesCEBoK for Software Past Present Future - Megan Jones
CEBoK for Software Past Present Future - Megan Jones
 
Agile Development and Agile Cost Estimation - A return to basic principles - ...
Agile Development and Agile Cost Estimation - A return to basic principles - ...Agile Development and Agile Cost Estimation - A return to basic principles - ...
Agile Development and Agile Cost Estimation - A return to basic principles - ...
 
Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...
Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...
Resolving Cost Management and Key Pitfalls of Agile Software Development - Da...
 
Project Succes is a Choice - Joop Schefferlie
Project Succes is a Choice - Joop SchefferlieProject Succes is a Choice - Joop Schefferlie
Project Succes is a Choice - Joop Schefferlie
 
Afrekenen met functiepunten
Afrekenen met functiepuntenAfrekenen met functiepunten
Afrekenen met functiepunten
 
Agile teams get a grip - martijn groenewegen
Agile teams   get a grip - martijn groenewegenAgile teams   get a grip - martijn groenewegen
Agile teams get a grip - martijn groenewegen
 
The fact that your poject is agile is not (necessarily) a cost driver arlen...
The fact that your poject is agile is not (necessarily) a cost driver   arlen...The fact that your poject is agile is not (necessarily) a cost driver   arlen...
The fact that your poject is agile is not (necessarily) a cost driver arlen...
 
Software sizing as an essential measure past present and future - Dan Galorat...
Software sizing as an essential measure past present and future - Dan Galorat...Software sizing as an essential measure past present and future - Dan Galorat...
Software sizing as an essential measure past present and future - Dan Galorat...
 
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
A benchmark based approach to determine language verbosity - Hans Kuijpers - ...
 
Software sizing the cornerstone for iceaa's scebok - Carol Dekkers
Software sizing the cornerstone for iceaa's scebok - Carol DekkersSoftware sizing the cornerstone for iceaa's scebok - Carol Dekkers
Software sizing the cornerstone for iceaa's scebok - Carol Dekkers
 

Recently uploaded

Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
WSO2
 
Graphic Design Crash Course for beginners
Graphic Design Crash Course for beginnersGraphic Design Crash Course for beginners
Graphic Design Crash Course for beginners
e20449
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
Tier1 app
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Globus
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdf
Cyanic lab
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Mind IT Systems
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
Philip Schwarz
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus
 
2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx
Georgi Kodinov
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Anthony Dahanne
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
kalichargn70th171
 

Recently uploaded (20)

Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
Accelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with PlatformlessAccelerate Enterprise Software Engineering with Platformless
Accelerate Enterprise Software Engineering with Platformless
 
Graphic Design Crash Course for beginners
Graphic Design Crash Course for beginnersGraphic Design Crash Course for beginners
Graphic Design Crash Course for beginners
 
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERRORTROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
 
Vitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume MontevideoVitthal Shirke Microservices Resume Montevideo
Vitthal Shirke Microservices Resume Montevideo
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
Cyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdfCyaniclab : Software Development Agency Portfolio.pdf
Cyaniclab : Software Development Agency Portfolio.pdf
 
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...
 
A Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of PassageA Sighting of filterA in Typelevel Rite of Passage
A Sighting of filterA in Typelevel Rite of Passage
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024Globus Connect Server Deep Dive - GlobusWorld 2024
Globus Connect Server Deep Dive - GlobusWorld 2024
 
2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx2024 RoOUG Security model for the cloud.pptx
2024 RoOUG Security model for the cloud.pptx
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
 

Iwsm2014 dev ops measurements (amir arooni)

  • 1. From dashboard management To an improvement index for the teams Amir Arooni, October 2014 Head of Global Digital Channels&Payments Services
  • 2. Introduction…. As of 2001 employed by ING: Director ING CB Global Digital Channels & Payments Services Director ING IT Solution Delivery Centre Channels NL Senior manager ING IT-Finance, Marketing & Sales support NL VP IT-Securities, IT-Investment Management, IT-Generic Systems Before 2001: Various leadership roles at KPN, TPG, Cap Gemini, Sun Microsystems Education: Msc Consulting & Coaching for Change (Oxford/HEC) MBA, RSM Erasmus University IT- Business & Information Modeling, Managing Complex projects Accountancy, BA, University of Teheran Amir Arooni MBA
  • 3. 6 oktober 2014 3 After 10 years of remodelling, renovation and restoration: the opening of the new Rijksmuseum on April 13th 2013. Costs 375M euro
  • 4. The IT Department is out of sync with our company's needs….. We don't understand why we are spending so much in IT… Our IT department is not responsive… Difficulty to align many IT departments…
  • 5. M& A: “without data, We only have opinions….” 5
  • 6. Components: DRTC AARB GTRD SOLL GREC TTPC URTB SDLI KLBT S2BT MEYT Components: DRTC AARB GTRD SOLL GREC TTPC URTB SDLI KLBT S2BT MEYT
  • 7. What are the targets? Which data do we need and how to analyze them? 6 oktober 2014 7
  • 8. Our vision is to deliver strategic advantage •8
  • 9. The superior customer experience is our strategic differentiator 9 Wow! Wow! Wow!
  • 12. 12
  • 13. We use the methods that are the most valued by engineers.  We follow the agile manifesto  We work based on Scrum Framework  We build, test, and deploy using continuous delivery principles  We are fully organized in DevOps teams.
  • 14. Common DevOps Measurements •Cycle Time •Time from feature requested to available in production •Time from issue reported to fixed in production
  • 15. Common DevOps Measurements •Team Velocity and Predictability of Sprint 6 oktober 2014 15 Predictability Productivity
  • 16. Common DevOps Measurements •Software Quality •Complexity, structure of the code •Design, layering of software components •Documentation, right comments and readability •Duplications, multiple places •Defects, number of issues during development and production •Size, manageable size of components •Tests, the level of automation and code covrage
  • 17. Operational measurement is done with automatic tools. Simple dashboards, Automate every repetitive task in metrics gathering Built & maintained by ING •Results in agility in metrics •Take as needed while maturing Data from Product Backlogs •Enterprise Product Backlog Mgmt process Data from the DevOps Teams •Feedback from Scrum Masters •Continuous Integration process •Test Automation process •Continuous Delivery process •Incident tracking (HPC) •Monitoring All data for a DevOps Team is gathered by the DevOps Team Stay ‘lean and mean’ 17
  • 18. But these measurements are all about… 6 oktober 2014 18
  • 19. There are 4 valuable areas which we start to measure to improve teams capabilities. Operational Excellence -# Defects per Release per Product Defect = Root cause of Incident + Bugs discovered by a user -Cycle Time per Product From ‘Prepare’ status to ‘Production’ Prepare = team spends effort on making user story Ready -Indexed Velocity Increase per Team Velocity / Velocity of first Sprint User story points indexed on reference user story Business Value -Business Value (EUR) Calculated per feature by Product Owner -# Outages per Product Per Release -# Open Risks per Product Per Release Customer Orientation -User Feedback (1-5 stars) Simple: Hands-up at demo (1-5 fingers up) Advanced: User Feedback Form Future Orientation -People Engagement Happy, OK, Sad / end of each Sprint -People skills Novice – Expert per individual & skill set Novice – Expert per team across skill sets -Simplified architecture TCO reduction 19
  • 20. We are also measuring the impact of our transition and resulting improvements of the teams. 1) In our Agile transformation, we want to •Inspect whether the intended change is actually taking place •Inspect whether the change manifests itself in terms of our objectives 2) To give useful and positive feedback for self- improvement to teams about: •Continuous Delivery practices •Improving or adding practices 6 oktober 2014 20
  • 21. We agree on the need for a simple set of metrics. 21 •Business Value •People Engagement •Service Quality •Time to market •Productivity
  • 22. Why were we not successful in M&A in the past? KPI driven not improvement oriented, not from the teams for the teams. Matrices did not reflect the business objectives Most of standard measurements were: •Incomplete •Inconsistent •Infrequent Many manual data collection activities Differences in objectives led to confusion: •Cost, productivity, quality •Testable requirements , #faults been found, future 22
  • 23. Develop measurements which help the teams and add value to our business… -Right functionality for the customers -Skills and capabilities -Continuous Delivery -Collaboration and High Performance 23
  • 24. Metrics we use must be lightweight, valuable, simple and comparable. Lightweight: Data collection and - processing may not slow or burden DevOps teams or Management Teams Valuable: Metrics must have a strong relation to either our objectives or to our change. Metrics must help making decisions. If we collect metrics without using them – stop! Simple: Collectable by the DevOps Teams in the course of their own work, or generated automatically by continuous delivery tooling Comparable: DevOps Team A in Domain X to DevOps Team B in Domain Y Not as a KPI, but to feed the learning cycle. 24
  • 25. •Thank you for your attention! • : Amir Arooni • amir.arooni@mail.ing.nl