Agile Mumbai 2023

1. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 1
About This Deck for Agile Mumbai, 2023
Meta
Synopsis
The session outlines the importance of clear metrics in
guiding and measuring successful organizational
transformation. It introduces EEBO Metrics as a tool to
connect engineering excellence to business outcomes,
emphasizing key metrics and the need for continuous
monitoring. The talk stresses goals based tracking of
Transformation and tracking deviation from goals as a
way to ensure stickiness to transformation.
Key Takeaway
1. The session highlights the importance of having clear and
intentional metrics to guide and measure the success of
organizational transformation efforts
2. EEBO Metrics provide a bridge between engineering excellence
and desired business outcomes, helping teams understand the
impact of their work on the organization's goals
3. Effective transformation requires continuous monitoring and
improvement, focusing on metrics such as test coverage, technical
debt, deployment frequency, and lead time
4. Business outcome metrics should be systematically shared with
product teams to provide insight into how technology influences
business success
5. To succeed in transformation, tracking deviations from
Transformation time goals is important

2. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 2
EEBO Metrics to Drive
Enterprise Transformation

3. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 3
Will it be a sticky
transformation?
Will transformation
scale in hybrid WoW?
Is the transformation
progressing well?
“Are we there yet?”

4. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 4
Co-sourcing based Assets based
Change agent based
Runs the risk of locking experts in low
yield engagement
Lacks clear and intentional outcomes
and approach
Consistent, predictable & demonstrate
value via fitness metrics
Transformation paradigms

5. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 5
How to monitor and improve the efficiency &
effectiveness of the transformation
How to deliver a low-touch, highly scalable
tool-assisted transformation
“Are we there yet?”

6. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 6
Test Coverage
Technical Debt
Velocity
Lead Time
Deployment
Frequency
MTTR
Passing Tests
Security
Violations
Cyclomatic
Complexity
Change Fail %
Security
Incidents
Production
Issues
Defects Count
Unique visitors
per month
Session duration
Infrastructure
Spend
UAT Issues
Availability
Excellence in Software
Development
Excellence in Deployment into
Production
Progress towards desired
business outcomes
Emergence of a structure
Need for coverage from software development to deployment-in-production resulting
in achieving transformation outcome

7. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 7
Using Metrics to establish a correlation
Metrics reflecting
excellence in software
development
Metrics reflecting
excellence in
production deployment
Metrics categories
reflecting progress
towards desired
business outcomes

8. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 8
Characteristics of a good fitness metrics
Fitness Metric is
multivariate (calculated
from multiple data points)
Fitness Metric measures
an activity against its
desired goal
Fitness Metrics should
make success & failure
criteria clear
Fitness Metrics
are Fully Modeled
& agreed upon

9. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 9
Industry Reference
Remediation Plan
Ready
Threshold of Failure
Success Marker
Baselining Period Time
Monitoring Period
Face
Value Ownership Matrix
Fully Modelled Metrics: More than a number
Measurement

10. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 10
EEBO Metrics act as clear
value articulation of the
benefit of engineering
excellence
EEBO Metrics provide
guardrails for long-running
programs by acting as
fitness metrics
EEBO Metrics offer team
members connection
between their work and the
ultimate benefits
EEBO Metrics
Engineering Excellence to Business Outcomes

11. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 11
3 key metrics of excellence in
software development
4 key metrics of excellence in
production deployment
4 key categories for business
outcomes
Build failure rate
Security warnings
Tech debt
Deployment frequency
Mean time to restore
Change fail percentage
Lead time
Market sensing
Improvement in efficiency &
effectiveness
Improvement in experience
Increase in influence
Using Metrics to establish a correlation

12. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 12
• Establish consensus on
Fitness Metrics & their
computation
• Establish desired value
ranges for each Fitness
Function
Inception
• Customize & contextualize
assets to client’s
environment
• Connect to Data Sources
& data pipelines for
computing metrics
Development
• Work with Tech, Ops and
Business in achieving target
value
• Maintain state as the
product, scale and
requirements change
Run
A Great Value Articulator and Guardrail

13. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 13
Use EEBO Metrics to
establish a correlation
between Tech & Business
Use EEBO Metrics to assign
and track goals during
transformation
Use EEBO Metrics to track
deviations from goals &
remediate
Closing the loop

14. © 2023 Thoughtworks | eebo.org | agilemumbai.com | 14
Dinker Charak
dinkerc@thoughtworks.com | www.eebo.org | www.dinker.in