E5 is a consulting and training company that specializes in aligning business processes to international standards, with experience servicing over 35 clients and conducting 230 training sessions. The document elaborates on the Objectives and Key Results (OKR) framework, outlining its significance in goal-setting and measuring progress across various business sectors, especially in agile transformations. Additionally, it highlights specific OKRs for a portfolio focused on autonomous delivery, emphasizing key results in market positioning, customer satisfaction, and operational efficiency.

1. OKR, KPI and measuring
in SAFe
E5

2. Consulting and Training Company E5
E5 - consulting and training company that brings business processes in the company to international
standards
The E5 portfolio includes more
than 35 clients for whom we
conducted consulting or Agile
transformation and improved
business results
Each consultant of the E5
team is a practising expert
with more
than 15 years of experience
in top IT companies
We conducted more than 230
training which attended 5800
specialists. We organize open
events, webinars on regular
basis and develop Ukrainian IT
community

3. Some
of
our
clients

4. ● Consultant on Agile Transformation and SAFe injection
● Working in software development since 2005, working as
a manager since 2006 in outsourcing, outstaffing and
product companies
● Launched software development office of Swiss
outsource company in Kyiv.
● Organizer of ITKaiZenClub meetings, speaker on multiple
software development and project management
conferences.
Delivery Manager with more than 15 years of experience
improve yourself CONTINUOUSLY
About the consultant
CEO & SAFe Program Consultant @E5
Helen Lubchak
see detailed info on LinkedIn

5. Please, share in the chat:
- Your location
- Your role

6. 2 Flow metrics
1 OKR & KPI
Inspect & Adapt workshop

8. improve yourself CONTINUOUSLY
OKR & KPI
?

10. OKR (Objectives and Key Results) is a
goal setting system.
Objectives are memorable qualitative
descriptions of what you want to achieve.
Objectives should be short, inspirational
and engaging. An Objective should
motivate and challenge the team.
Key Results are a set of metrics that
measure your progress towards the
Objective. For each Objective, you should
have a set of 2 to 5 Key Results.

11. © Scaled Agile, Inc.
Objective Key Results
Achieve a dominant position within
the autonomous delivery market
Increase serviceable market to 75% within 18 months
Increase Net Promoter score from 35 to 60
Improve repeat business rates from 60% to 80%
Acquire 15% new customers over the next 12 months
Example of OKR

12. OKR in SAFe: Strategic Themes, Epics, Agile Transformation

13. © Scaled Agile, Inc.
Objective Key Results Q1 Q2 Q3 Q4
Achieve a dominant
position within
the autonomous
delivery market
Increase serviceable market to
75% within 18 months
45% 55% 47% 52%
Increase Net Promoter score from
35 to 60
35 49 54 57
Improve repeat business rates
from 60% to 80%
60% 64% 67% 72%
Acquire 15% new customers over
the next 12 months
2% 7% 4% 10%
OKR in SAFe: Strategic Themes

14. OKR Epic Ideas
Objective:
Achieve a dominant position within the
autonomous delivery market
Key Results:
• Increase serviceable market to 75%
within 18 months
• Increase Net Promoter score from
35 to 60
• Improve repeat business rates from
60% to 80%
• Acquire 15% new customers over the
next 12 months
Provide a
3-tier
subscription -
based service
Leverage delivery
data to identify
locations for a new
advertisement
campaign
Obtain a
license for
late night
deliveries
Integrate with
online
delivery apps
Develop a fulfilment
platform to support
customized delivery
notifications and
communications
© Scaled Agile, Inc.
OKR in SAFe: Epics

15. Epic Hypothesis Statement
Epic Name: Fulfilment platform to support customized delivery notifications and communications
Epic Description: The Fulfillment Platform will provide TTC teams the ability to create delivery notifications and omnichannel communications as
needed in support of multiple customer segments, personas, languages and location
-based segments.
For TTC internal teams and future re-sale opportunities
who develop customer-facing solutions
the TTC Fulfillment Platform
is a platform with reusable components
that enables developers to create customized delivery notifications and communications
unlike off-the-shelf messaging tools
our solution understands our unique personas within TTC as well as the geolocational segments of our customers
Business Outcomes: Objective 1: Reduce the development overhead associated with creating delivery notifications and communications
Key Results:
• Team flow velocity for stream-aligned teams within the Fulfillment Train is increased by 15% as it relates to
notifications and communications
• Enabler features related to notifications and communications are reduced by 20%
• Ongoing target of 75% test automation on the new fulfilment platform
Objective 2: Increase the effectiveness of delivery notifications and communications
Key Results:
• Support customized notifications for our 5 current geographies
• Support customized notifications for 4 customer personas
• Open rate of 75% on all delivery notifications over the next 18 months
• Reduce missed deliveries by 15% over the next 12 months
• Reduce recalled notifications and communications by 25%
Objective 3: Messaging, brand and tone are aligned across all TTC solutions
Key Results:
• 80% of notifications and communications use the new fulfilment platform within the next 12 months
• 60% of notifications and communications use the new brand guidelines within the next 18 months
• Integration of Grammarly to ensure 100% of notifications and communications align with the editorial
guidelines on tone
© Scaled Agile, Inc.
OKR
in
SAFe:
Epics

16. Overall transformation outcomes
• Improve Time to Market
• Increase Employee Engagement and Job Satisfaction
• Increase Quality
© Scaled Agile, Inc.
Transformation outcomes for a specific SAFe portfolio:
Autonomous Delivery Portfolio
• Reduce mean time to resolution (MTTR) for delivery vehicle problems
• Improve customer satisfaction ratings
• Improve the quality of the delivery vehicle software
Specifying success measures for ARTs that are being launched:
Fulfilment ART
• Achieve and maintain adequate test coverage across the fulfillment platform
• Reduce the manual overhead related to build and deploy activities
• Develop industry leading skills in validation and maintain verification
OKR in SAFe: Agile Transformation

17. © Scaled Agile, Inc.
Objective Key Results
Improve time to market
Reduce approval time for new portfolio level initiatives by 30%
Increase major update release schedule from 2 times a year to
4 times a year
Retire all non-supported solutions within the next 12 months
Reduce time to market for new solutions by 6 months
OKR in SAFe: Agile Transformation

18. KPIs
Value Stream KPIs
create the feedback
loop back to the
portfolio.
KPIs may include
outputs, outcomes,
employee satisfaction,
Agile Team
performance and
more.
© Scaled Agile, Inc.
Development Value Streams
Strategic
Themes
#1
• Key result 1
• Key result 2
#2
• Key result 1
• Key result 2
#3
• Key result 1
• Key result 2
• Key result 3
• Key result 4
#4
• Key result 1
• Key result 2
Strategic Themes
Value Stream KPIs
• KPI Measure 1
• KPI Measure 2
• KPI Measure 3
• KPI Measure 4
• KPI Measure 5
• KPI Measure 1
• KPI Measure 2
• KPI Measure 3
• KPI Measure 4
Theme Key Result
OKRs
OKRs
KPI in SAFe

19. Example KPIs
Operational Value Stream Type
AARRR (‘Pirate Metrics’): Acquisition, Activation,
Revenue, Retention, Referrals
Software product
(Consumer facing web site example)
Conversion funnel analytics, average time to decision,
automated approval rate, Net Promoter Score, default
rate, customer lifetime value
Fulfillment
(Consumer loan example)
Tickets outstanding, NetPromoter Score, first response
time, mean time to resolution, cost per ticket, customer
experience score
Supporting
(Customer support example)
Units sold, cost of goods sold, Supplier health,
throughput, cycle time, inventory turns,cash-to-cash
cycle time
Manufacturing
(USB streaming microphone example)
© Scaled Agile, Inc.
KPI in SAFe

20. improve yourself CONTINUOUSLY
Flow metrics
?

22. Flow Distribution Proportion of work items by type in a system
Flow Velocity Number of completed work items over a time period
Flow Time Time elapsed from start to completion for a given work item
Flow Load Number of work items currently in progress (active or waiting)
Flow Efficiency
Ratio of the total time spent in value-added work activities divided
by the total flow time
Flow Predictability
How consistently teams, ARTs, and portfoliosare able to meet
their commitments
Metric Description
© Scaled Agile, Inc.
Flow Metrics

23. 0%
20%
40%
60%
80%
100%
20.1.1 20.1.2 20.1.3 20.1.4 20.1.5 20.2.1 20.2.2 20.2.3 20.2.4 20.2.5 20.3.1 20.3.2
Flow Distribution
Stories Enablers Maintenance
© Scaled Agile, Inc.
Flow Metrics: Disctribution

24. Story
Points
Velocity Chart
Iteration
1
Iteration
2
Iteration
3
Iteration
4
Iteration
5
Iteration
6
Iteration
7
Iteration
8
Iteration
9
30
40
20
10
0
© Scaled Agile, Inc.
25
29
27
35
33
29 31
38
30
Average Velocity: 31 pts
Flow Metrics: Velocity

25. Feature
Count
Flow Time Histogram
5 10 15 20 25 30 35 40 45
© Scaled Agile, Inc.
Flow Time (days)
50 65 70 75 80 85 90 95 100 105 110
Average Flow Time: 36.4 days
0
5
10
15
20
25
Flow Metrics: Time

26. PI1 – IT1 PI1 – IT2 PI1 – IT3 PI1 – IT4 PI1 – IT5 PI2 – IT1 PI2 – IT2 PI2 – IT3 PI2 – IT4 PI2 – IT5 PI3 – IT1 PI3 – IT2 PI3 – IT3 PI3 – IT4 PI3 – IT5
Done Releasing Deploying to Production Validating on Staging Implementing Backlog Analyzing Funnel
Features
Flow Load
(WIP)
250
200
150
100
50
0
Flow Metrics: Load

27. Flow Metrics: Efficiency

28. Plan
Objectives for PI 3
BusinessValue
Totals
% Achievement: 90%
Actual
7
8
8
10
10
7
7
4
50
7
8
6
5
8
7
0
4
45
120
100
80
60
40
20
0
PI 1 PI 2 PI 3 PI 4 PI 5
Team PI Performance Reports
Structured locations and
validation of locations
Build and demonstrate a proof
of concept for context images
Implement negative triangulation
by: tags, companies and people
Speed up indexing by 50%
Index 1.2 billion more web pages
Extract and build URL abstracts
Fuzzy search by full name
Improve tag quality to 80%
relevance
Uncommitted Objectives
ART Predictability Measure
Predictability Measure
Target: Effective process
control range
Predictability sufficient
to run the business
Handles common
variations
Special causes may still
Cause excess variation
Objectives
Achieved
Team A:Out-of-control development
Team B: Controlled development
ART
© Scaled Agile, Inc.
Flow Metrics: Predictability

29. 🕮🕮 Doerr, John. Measure What
Matters: How Google, Bono, and
the Gates Foundation Rock the
World with OKRs.
🕮🕮 Castro, Felipe. The Beginner’s Guide
to OKR

30. Questions?
helen@e5.consulting
+38 (096) 798 77 88
www.e5.consulting
E5ConsultingAndTraining
E5
EFive Training