The document discusses the importance of standardizing software quality and productivity measurement, emphasizing the need for automation and defined standards through the Consortium for IT Software Quality (CISQ). It outlines various levels of measuring software quality, including unit, component, and system levels, and highlights the critical nature of system-level measurement for addressing architectural complexities. The document also details how CISQ measures relate to business value, helping IT executives and app managers set quality thresholds and goals.

1. Standardize Software Quality and
Productivity Measurement
Dr. Bill Curtis
Director, Consortium for IT Software Quality

2. Mayans  Apocalypse Will Occur This Dec. 21
User interface Interrupt controller
Network bus
Graphics
card
ALU
Data Cache
Memory
Memory
Register bank
2

3. The IT Apocalypse Has Already Started
3

4. Measuring Software Quality Is Imperative
For software measurement to become common practice, two
capabilities must be achieved:
Automation Vendors
Vendors
Standards CISQ
4

5. Levels of Measuring Software Quality
Unit Level
 Basic coding standards
 Code style & layout
 Code documentation
 Cyclomatic complexity
Component Level
 In-technology architecture
 Intra-layer dependencies
 Inter-program invocation
 Security vulnerabilities
System Level
 Architectural compliance
 Application security
 Resiliency checks
 Transaction integrity
5

6. System Level Measurement Is Critical
A structural flaw involving interactions
Architecturally
among multiple components that
Complex Defect
reside in different application layers
% of total
% of total repair
app defects effort
48%
Component-
92
%
level violations 20x as
52%
many
fixes to
Architecturally correct
Complex Defects 8%
80% of architecturally complex defects Architectural hotspots provide a
touch an Architectural Hotspot—a badly roadmap for remediating the worst
designed component causing problems risk, rework, and cost drivers
6

7. Consortium for IT Software Quality
Co-sponsorship
IT Executives
CISQ Technical
experts
www.it-cisq.org 7

8. CISQ Standards
8

9. CISQ Measures Relate to Business Value
CISQ Measure Operational Business
problems Measure
Reliability Outages Availability
Performance Degraded response Work efficiency
Security Breaches, Theft Data loss
Changeability Excessive effort Agility
9

10. IT Execs  Establish Policy & Priorities
Quality Corporate purpose Training
Policy Expected behavior Reporting
Audit
Reliability
Performance
Security
Quality Customer-facing Maintainability
Priorities Internal business Reliability
Performance
Security
Maintainability
10

11. App Managers  Set Quality Thresholds
Reliability 3.8
Performance 3.9
Product information Security 2.5
Maintainability 3.0
Retail Reliability
Performance
3.5
3.5
Online purchase
Website Security
Maintainability
3.9
2.5
Reliability 3.5
Performance 3.0
Delivery scheduling Security 3.9
Maintainability 2.5
11

12. App Teams Plan Quality Goals & Take Action
3.9 Quality Score
3.7 Target by Release
3.5
3.3 Reliability
Score
3.1 Performance
2.9 Security
2.7 Maintainability
2.5
12

13. Join the CISQ Community
13