This document discusses software quality and improving defect removal efficiency. It provides principles of software quality, including that defects should be found early as they are cheaper to fix. It discusses measuring defect potential and defect removal efficiency. Finally, it provides recommendations for teams to find defects in early work products like requirements and design, strengthen inspection practices, and help their team get stronger at quality. The overall message is that high quality software results from injecting fewer defects and finding more defects early.

1. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Moving from Testing to Quality
Feb 19, 2019
Jeff Van Fleet, President & CEO

2. “It is not the critic who counts;
not the man who points out
how the strong man stumbles,
or where the doer of deeds
could have done them better.
2

3. The credit belongs to the man
who is actually in the arena,
whose face is marred by dust
and sweat and blood; who
strives valiantly; who errs, who
comes short again and again,
3

4. because there is no effort
without error and shortcoming;
but who does actually strive to
do the deeds; who knows
great enthusiasms, the great
devotions, who spends himself
in a worthy cause;
4

5. who at the best knows in the end
the triumph of high achievement,
and who at the worst, if he fails,
at least fails
while daring greatly…”
-- Theodore Roosevelt
Paris, France April 23, 1910
5

6. who at the best knows in the
end the triumph of high
achievement, and who at the
worst, if he fails, at least fails
while daring greatly…”
-- Theodore Roosevelt
Paris, France April 23, 1910
Are you daring greatly?
6

7. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Why should we care?
7

8. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
“Where is our Quality –
Is it good or bad?”
– VP, Development
8

9. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
“I want to improve our
team’s sense of fulfillment”
– CTO
9

10. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL 10
2
-20%
Any idea what these mean?
Talk to your partner
10

11. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL 11
2x – In our first software improvement effort,
we doubled productivity
AND, we reduced the team’s work load
from 55-60 hrs/week to 40-45 hrs/week
RESULT – Work/life balance, more fun, everyone
working together, and high employee satisfaction
Any idea what these mean?
11

12. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Why you and your company care
• Annual SW Spend:
$13.5M*
• Potential savings/
reinvestment:
$2.0-$4.1M
(15%-30%)
* Based on a development team of 100
12

13. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Before we get started –
a few principles
13

14. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
• High-quality software results in lower cost and
shorter schedule
• Defects found early save 5x cost
• All work products contain defects
• Strong teams inject fewer and find more defects
• Quality has two main measures
• Defect potential
• Defect removal efficiency (DRE)
• Smaller systems have higher quality
• Smaller teams have higher quality
• Simpler systems have higher quality
Software Quality Principles
14

15. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
It varies exponentially based on size of the thing being built
Remember …
• Smaller is better
• All work products contain defects
How many defects are injected?
Defect Potential
15

16. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
How many defects are injected?
Defect Potential
Defects/60 lines of code
Lines of code Best Average Worst
60 0.60 1.50 2.55
600 1.25 2.50 4.25
6,000 1.75 3.25 6.13
60,000 2.14 4.25 8.55
600,000 3.38 6.50 12.03
6,000,000 4.13 8.25 14.19
16
1 Function Point (FP) = approx. 60 lines of Java or C# code
Data adapted from Capers Jones’ work

17. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
How many defects are injected?
Defect Potential
Defects/60 lines of code
Lines of code Best Average Worst
60 0.60 1.50 2.55
600 1.25 2.50 4.25
6,000 1.75 3.25 6.13
60,000 2.14 4.25 8.55
600,000 3.38 6.50 12.03
6,000,000 4.13 8.25 14.19
17
1 Function Point (FP) = approx. 60 lines of Java or C# code
Data adapted from Capers Jones’ work

18. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Defect Potential
18
60,000 LOC
system
Industry Avg
(defects/
60 LOC)
Agile Avg
(defects/
60 LOC)
Requirements 0.70 0.53
Architecture 0.10 0.08
Design 0.95 0.72
Code 1.15 0.87
Security 0.25 0.19
Documents 0.45 0.34
Bad Fixes* 0.65 0.49
Total 4.25 3.20
* At Lighthouse, we see Bad
Fix rate as high as 35%
Data adapted from Capers Jones’ work

19. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
How many are removed -- prior to production?
Defect Removal Efficiency (DRE)
19
It varies exponentially based on size of the thing being built
Remember …
• Smaller is better
• All work products contain defects

20. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Easy peasy
Defect Removal Efficiency (DRE)
20
# defects found prior to production
# defects found prior to production + 1st 90 days of production
DRE =

21. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
It’s exponential
Defect Removal Efficiency (DRE)
21
Lines of code Best Average Worst
60 99.9% 97.0% 94.0%
600 99.0% 96.5% 92.5%
6,000 98.5% 95.0% 90.0%
60,000 96.5% 94.5% 87.0%
600,000 94.0% 89.5% 83.5%
6,000,000 91.0% 86.0% 78.0%
Data adapted from Capers Jones’ work

22. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
What you can do
22

23. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
• High-quality software results in lower cost and
shorter schedule
• Defects found early save 5x cost
• All work products contain defects
• Strong teams inject fewer and find more defects
• Quality has two main measures
• Defect potential
• Defect removal efficiency (DRE)
• Smaller systems have higher quality
• Smaller teams have higher quality
• Simpler systems have higher quality
Software Quality Principles
23
Find defects in early work
products

24. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Defect Potential
24
60,000 LOC
system
Industry Avg
(defects/
60 LOC)
Agile Avg
(defects/
60 LOC)
Requirements 0.70 0.53
Architecture 0.10 0.08
Design 0.95 0.72
Code 1.15 0.87
Security 0.25 0.19
Documents 0.45 0.34
Bad Fixes* 0.65 0.49
Total 4.25 3.20
Data adapted from Capers Jones’ work
* At Lighthouse, we see Bad
Fix rate as high as 35%
Are you engaged in these
work products?
Talk to your partner

25. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Assuring quality in work products
25
• Requirements
• Inspections – Measure effort and results
• Architecture
• Inspections (assure there is independent
architecture review)
• Design
• Focus on interfaces – ensure you have IDDs
• Data quality
• Standards
• Inspections (assure they are occurring)

26. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Assure quality in all work products
26
• Code
• McCabe complexity – Simple is better
• Code Analysis (SonarCube, CAST)
• Assure sufficient unit tests
• White box testing will find many defects that
are very difficult to find with black box testing

27. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
• Tests
• Functional and non-functional testing
• RTM
• Peer review test case design/headers
• Test automation for Agile and regression
• Track and report defect metrics
• Consider risk-based testing
Assure quality in all work products
27

28. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Assure quality in all work products
28
• Security
• Assure security best practices apply to the
custom development, not just infrastructure
and network access
• Documentation
• Inspection
• Ex. CMS in e-commerce

29. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
• High-quality software results in lower cost and shorter
schedule
• Defects found early save 5x cost
• All work products contain defects
• Strong teams inject fewer and find more defects
• Quality has two main measures
• Defect potential
• Defect removal efficiency (DRE)
• Smaller systems have higher quality
• Smaller teams have higher quality
• Simpler systems have higher quality
Software Quality Principles
29
Help your team
get stronger

30. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Benchmarking a high performing team – 60,000 LOCs
30
Reqmt Design / Code Test Production
# defects injected 600
Removal Rate 95% 95% 95%
# defects leaked 30 2 0
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
Model developed by Lighthouse

31. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Benchmarking a high performing team – 60,000 LOCs
31
Reqmt Design / Code Test Production
# defects injected 600
Removal Rate 95% 95% 95%
# defects leaked 30 2 0
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
600 requirements defects injected
95% removal = only 32 defects leaked
Unplanned rework = $49,500
Model developed by Lighthouse

32. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
High vs. low performing team – 60,000 LOCs
32
Reqmt Design / Code Test Production
# defects injected 600
Removal Rate 95% 95% 95%
# defects leaked 30 2 0
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
Reqmt Design / Code Test Production
# defects injected 1200
Removal Rate 65% 65% 65%
# defects leaked 420 147 51
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
1200 requirements defects injected
65% removal = 618 leaked
Unplanned rework = $2.4M !!
600 requirements defects injected
95% removal = only 32 leaked
Unplanned rework = $49,500
Model developed by Lighthouse

33. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
High vs. low performing team – 60,000 LOCs
33
Reqmt Design / Code Test Production
# defects injected 600
Removal Rate 95% 95% 95%
# defects leaked 30 2 0
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
Reqmt Design / Code Test Production
# defects injected 1200
Removal Rate 65% 65% 65%
# defects leaked 420 147 51
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
1200 requirements defects injected
65% removal = 618 leaked
Unplanned rework = $2.4M !!
600 requirements defects injected
95% removal = only 32 leaked
Unplanned rework = $49,500
Model developed by Lighthouse

34. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Help team improve
34
• Establish baseline (1-2 projects)
• People
• Motivation and belief
• Skills
• Process
• Documented, trained, used consistently
• Technology and Tools
• Are they meeting your needs now? Future?
• Measure KPIs and benchmark to industry
• Size, cost, schedule, quality, satisfaction

35. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Key Performance Indicators (KPIs)
KPI Improvement
Cost Effort Schedule Quality
Annual Savings
(assuming $5M spend)
Initial Baseline $3000/FP 60 hrs/FP 9 months/1000 FPs 2 defects/FP $0
Milestone 1
Milestone 2
… Milestone n
Possibility $1800/FP 36 hrs/FP 6 months/1000 FPs 0.5 defects/FP $2M
35

36. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Key Performance Indicators (KPIs)
KPI Improvement
Cost Effort Schedule Quality
Annual Savings
(assuming $5M spend)
Initial Baseline $3000/FP 60 hrs/FP 9 months/1000 FPs 2 defects/FP $0
Milestone 1
Milestone 2
… Milestone n
Possibility $1800/FP 36 hrs/FP 6 months/1000 FPs 0.5 defects/FP $2M
36
Are you measuring these?
Show of hands

37. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Key Performance Indicators (KPIs)
KPI Improvement
Cost Effort Schedule Quality
Annual Savings
(assuming $5M spend)
Initial Baseline $3000/FP 60 hrs/FP 9 months/1000 FPs 2 defects/FP $0
Milestone 1
Milestone 2
… Milestone n
Possibility $1800/FP 36 hrs/FP 6 months/1000 FPs 0.5 defects/FP $2M
37

38. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Help team improve
• Develop “Get Strong” roadmap
• Present potential value to leadership and all stakeholders
• Get grass roots buy-in and involvement
• Execute
• Measure 1-2 active projects
• People, process, tools/technology
• Size, cost, schedule, quality, satisfaction
• Learn, adjust, continuously measure
• Re-assess
• Publish value (KPIs) to all stakeholders
38

39. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
• High-quality software results in lower cost and shorter
schedule
• Defects found early save 5x cost
• All work products contain defects
• Strong teams inject fewer and find more defects
• Quality has two main measures
• Defect potential
• Defect removal efficiency (DRE)
• Smaller systems have higher quality
• Smaller teams have higher quality
• Simpler systems have higher quality
Software Quality Principles
39
Measure quality

40. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Track quality metrics
40
• Select simple metrics that give insight
• Move from reactive to proactive
• Track over time to see trends
• Learn and apply learnings

41. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
High vs. low performing team – 60,000 LOCs
41
Reqmt Design / Code Test Production
# defects injected 600
Removal Rate 95% 95% 95%
# defects leaked 30 2 0
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
Reqmt Design / Code Test Production
# defects injected 1200
Removal Rate 65% 65% 65%
# defects leaked 420 147 51
Cost to find and fix a
defect
$250 $1,250 $6,000 $30,000
1200 requirements defects injected
618 leaked
Unplanned rework = $2.4M !!
600 requirements defects injected
Only 32 leaked
Unplanned rework = $49,500
Track actuals to forecast
Defect Potential

42. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Agile - Defect Discovery Trend
42
0
5
10
15
20
25
30
35
40
0 5 10 15 20 25 30 35
#ofDefects
Sprint #
Pre-Prod Bugs Prod Issues Log. (Pre-Prod Bugs) Log. (Prod Issues)
Model developed by Lighthouse

43. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL 43
0
5
10
15
20
25
30
35
40
0 5 10 15 20 25 30 35
#ofDefects
Sprint #
Pre-Prod Bugs Prod Issues Log. (Pre-Prod Bugs) Log. (Prod Issues)
• If pre-prod and prod defects both
trend down = lower defect
potential and product stabilizing
• Prod defects are slightly trending
upwards
Model developed by Lighthouse

44. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Agile - Defect Removal Efficiency (DRE)
0%
20%
40%
60%
80%
100%
120%
0 5 10 15 20 25 30 35
DRE By Sprint
44
Model developed by Lighthouse

45. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALLIF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Other metrics to help -> proactive
45

46. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Key Takeaways
46
• Learn and embody the software principles
• Smaller is better
• Find defects in early work products
• Assess team and establish baseline
• Measure projects
• Size, cost, schedule, quality, satisfaction
• Learn, adjust, report, re-assess
• Use key partners to provide guidance and
independence
• Make this fun, create value and work/life
balance

47. who at the best knows in the
end the triumph of high
achievement, and who at the
worst, if he fails, at least fails
while daring greatly…”
-- Theodore Roosevelt
Paris, France April 23, 1910
Are you daring greatly?
47

48. IF YOU SEE THIS, GO TO THE “INSERT” TAB, CLICK “HEADER & FOOTER”, CHECK “FOOTER” AND “SLIDE NUMBER”, AND APPLY TO ALL
Jeff Van Fleet
jvanfleet@lighthousetechnologies.com
937.458.0055
48
Thanks for attending!