This document discusses various metrics that can be used to measure process and project performance, including time deviation, post-production defects, effort deviation, change requests, and non-conformities. It provides definitions and formulas for calculating each metric. Examples of analysis criteria and variations are also described. The document emphasizes measuring performance at an organizational level and consolidating metrics to get an overall view of responsiveness, stability, and quality. It concludes by inviting questions about getting started with measurement.

1. Portugal
Measurement & Analysis
How do you start?
Enrique Morey
Senior Consultant & SCAMPI Lead Appraiser
Process Quality Engineering (ProQua)
2011-10-03

2. Process or metrics?
2

3. What do companies want?
3

4. Deliver on time
No failures
4

5. Increase incomes
Reduce costs
5

6. Impact of changes
Non-conformities
6

7. more
profitability
increase reduce
incomes costs
customer
satisfaction without
over-costs
deliver without
on time defects
changes non
requests conformities
7

8. time deviation
post-production defects
effort deviation
change requests
non-conformities
8

9. time deviation
9

10. time deviation
Percentage deviation in time respect
Description the estimated date, for completion of Type Schedule
milestones and / or project
Measurement Are we accomplished the scheduled
Unit Percentage
objective dates?
Schedule / Project Plan Collection
Data source Counting
Proposal method
Frequency Weekly / Biweekly / Monthly Goal 0%
Formula (real date – estimate date) / estimate date
• < 0, project is executing below the planning
Analysis
• = 0, project is executing on time
criteria
• > 0, project is executing with deviation
Variations Counting the delayed days in absolute terms
10

11. post-production defects
11

12. post-production defects
Defects reported by the customer Product
Description Type
once the product has been delivered quality
Measurement Have we delivered the product
Unit Defects
objective without defects and / or mistakes?
Collection
Data source Client’s incidents Counting
method
Frequency Monthly Goal 0
Formula N.A.
= 0, product has no detected defects
Analysis
criteria > 0, product was delivered with defects, and corrections have not
an estimated/planned effort
Variations Counting effort to correct defects (hours, days)
12

13. effort deviation
13

14. effort deviation
Percentage deviation in hours/date
respect the estimated effort, for
Description Type Cost
completion of tasks, milestones and /
or project
Measurement Are we performing the project with
Unit Percentage
objective over-effort?
Schedule / Project Plan Collection Effort
Data source
Effort estimation method timesheet
Frequency Weekly / Biweekly / Monthly Goal 0%
Formula (real hours/days – estimate hours/days) / estimate hours/days
< 0, project is executing below the estimation
Analysis
= 0, project is executing according to the estimation
criteria
> 0, project is executing with over-effort
Variations Counting the over-effort (hours/days) in absolute terms
14

15. change requests
15

16. change requests
Change request from customers Product
Description Type
(external) and project team (internal) stability
Measurement Have we kept the scope and / or Change
Unit
objective initial estimates of the project? requests
Change request from customers and Collection
Data source Counting
project team method
Frequency Monthly Goal 0
Formula N.A.
= 0, product has no change requests
Analysis
criteria > 0, product has change requests that could impact project
parameters (size, effort, dates)
Counting effort to implement change requests (hours, days)
Variations
Comparing changed requirements vs. initial requirements
16

17. non-conformities
17

18. non-conformities
Defects, errors and non conformities
Product
Description detected by project team, before Type
quality
delivery of the products to the client
Measurement Are we performing our processes and
Unit Defects
objective developing products as established?
Quality audits / Test Plans / Identified Collection
Data source Counting
defects method
Frequency Monthly Goal 0
Formula N.A.
= 0, there have not identified defects or non conformities
Analysis
criteria > 0, there have identified defects or non conformities, and
corrective actions has an impact in the project parameters
Counting effort to correct defects (hours, days)
Variations
Categorize them by project phase, defect type, etc.
18

19. Consolidation at organizational level
19

20. Remind…
Responsibility
Continuous definition
Stability
Storage
20

21. Let’s start to measure!
21

22. Questions?
22

23. Thank you for your attention…
Enrique Morey Matos
Consultor Senior
C/ Santa María 17, Oficina B
28231 Las Rozas
Madrid España
T +34 911 299 529
M +34 600 516 439
emorey@proqua.es
www.proqua.es
23