Metrics That Matter: How to Measure Digital Transformation Success

| © Digital.ai.2020© Digital.ai.2020
Metrics that Matter
How to Measure Digital Transformation Success

| © Digital.ai.20202
Metrics that Matter
How to Measure Digital Transformation Success
Andreas Prins
VP of Product Strategy
XebiaLabs – Now Digital.ai
Amy Johnston
Director of Product Marketing
XebiaLabs – Now Digital.ai

The foundation of the Digital.ai Value Stream Platform
Enterprise Agile
Planning &
Collaborative
Development
Release
Orchestration &
Deployment
Automation
In-Application
Protection &
Threat Analytics
Mobile App &
Cross-Browser
Testing
AI-Powered IT
Business
Analytics

What we’ll talk about today
•Putting metrics in context
•Focusing on what matters
•Four tips to get you started

Putting metrics in context
5

Metrics provide more value in context
Agile Journey Atmosphere Ecosystem Live Environment

Agile Journey
7

The Agile Journey requires continuous planning, observation and
adjustment (1/3)
Discover where to go with your digital transformation and Agile Journey. This can be done through explorer
maps.
• http://www.ideetotit.nl/uncategorized/explorer-maps-krachtig-instrument-strategie-naar-executie/
Open source available at: http://ryxz.nl

adjustment (2/3)
Using a visual instrument such as an Obeya will drive the right conversations to lead an entire company, give
a clear understanding of the current state, and allow adjustment when needed.

adjustment (3/3)
Using a visual instrument such as a team board will drive the conversations in daily team meetings, give a
clear understanding of the current state, and allow adjustment when needed.
The discovery of the
metrics that matter to
your team is a never-
ending process of
adjustment and
improvements

Atmosphere
12

The importance of psychological safety
Source: https://rework.withgoogle.com/blog/five-keys-to-a-successful-google-team

The Smell-O-Meter

Ecosystem
15

Examples of ecosystem metrics
• Lead time
• Story points
• Team velocity
• Sprint burndown
• Broken builds
• Automated test failure rate
• Manual test failure rate
• Cycle time
• Deployment frequency
• Deployment duration
• Deployment failure rate
• Defect escape ratio
• Field incidents
• Customer tickets
16

Focus on breaking down silos

• Lead time
• Story points
• Team velocity
• Sprint burndown
• Broken builds
• Cycle time
• Field incidents
18

Invest in automation at every point

• Lead time
• Story points
• Team velocity
• Sprint burndown
• Broken builds
• Cycle time
• Field incidents
20

Live Environment
21

Decide what really matters

Observe applications in the real world

Imagine a team’s journey...
Agile Journey Atmosphere Ecosystem Live Environment

Focus on what matters
25

Before you start, understand where you want to go
Use “impact mapping for business outcomes” as a technique to determine the goals to achieve.

Using data from outputs to measure outcomes

Four Tips to Get You Started
29

Four tips to get
you started
1. Extend your view to post-deployment
2. Discuss the success of an initiative with your
business partner
3. Take bottlenecks seriously
4. Exercise: Map IT activities to your company
objectives
30

Extend your view to post-deployment
Digital.ai continuumDigital.ai versionone Digital.ai release Digital.ai deployDigital.ai app protect
Strategic
Theme
Epic/Capability/
Features/Story
Story DeployRelease Protect
Digital.ai releaseDigital.ai versionone
Measure
Pivot or
Persevere
Continuous Operational Telemetry
Motley Bank
Mortgage App
Strategic
Theme
Epic/Capability/
Features/Story
Measure
Pivot or
Persevere
Strategic
Theme
Epic/Capability/
Features/Story
Measure
Pivot or
Persevere
Continuous
Vulnerability
Telemetry
Development Value Stream Iterations
Customer Fulfilment Process

Discuss the success of an initiative with your business partner
• Every discipline involved in the definition and creation of an initiative has its own view
• Clear articulation and established connections between practices allow value flow in your organization
Lens Value Capture Value Creation Value delivery
CEO of the Enterprise Serving our customers with a
new product
Strategy statement Rollout of new product offering
Line of business Roadmap and portofolio
changes
Well articulated epics Set of customer facing features,
measures of business
performance
Product Manager Customer investigation,
prototypes
Well defined Features New version of software in prod
Team Stories, architecture diagrams Tens of stories marked
as done
Artifact
Engineer Line of code, test defenitions Code commit Merge to master
Digital.ai Planning allows you to cascade and structure your initiatives

Spend time with your teams discovering bottlenecks
Bottlenecks have many
appearances:
• Backlog laziness
• Agenda craziness
• Pipeline haziness
• Delivery bumpiness

Exercise: Map IT activities to your company objectives
Impact Outcome MappingExplorer Maps
Improvement starts with alignment and adjustment to a shared direction!
Open source available at: http://ryxz.nl

Conclusion
35

• Dashboards
• Security / Compliance
• Automated Audits
• Value Stream Metrics
• Predictive Analytics (AI/ML)
DEPLOYMENT AUTOMATION
DigitalTransformation with the Digital.aiValue Stream Platform
Business Value Stream
ENTERPRISE AGILE PLANNING
strategies portfolios epics features
A P P P R O T E C T
Common Data
Model
Business
Outcomes
Concept
work
item
……
I N - A P P S E C U R I T Y
SECURITY
MONITORING AND INTELLIGENCE (AI/ML)
RELEASE ORCHESTRATION
Development Value Stream

Questions?
Follow us on Twitter @digitalaisw
37

Metrics That Matter: How to Measure Digital Transformation Success

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Metrics That Matter: How to Measure Digital Transformation Success

Similar to Metrics That Matter: How to Measure Digital Transformation Success (20)

More from XebiaLabs

More from XebiaLabs (20)

Recently uploaded

Recently uploaded (20)

Metrics That Matter: How to Measure Digital Transformation Success