Are you delivering the right product? Focusing on delivering is a key cornerstone in Agile but how do you know if you have delivered the right thing for your customers and your organisation. Do you feel overwhelmed when dealing with Key Performance Indicators and Critical success factors? Have you got a validated learning loop within your team?

1. Measuring the success
of your product
@Rohelaraouf

2. @Rohelaraouf

3. Ice breaker
Draw making the process of making toast 🍞
Gamestorming
@Rohelaraouf

5. Why
What’s the goal? What are we aiming for?’
“Without data, you’re just another person with an
opinion- Edward Deming’s
@Rohelaraouf

6. Validate learning loop
@Rohelaraouf
next.amsterdam

7. Validated learning loop
Customer Discovery:
● This is all about proving the problem/solution fit.
● It starts off with exploring the customer segments, validating there is a real problem
and deciding on a solution.
Customer Validation phase:
● Validate this solution offer and optimise this into something that people will actually use/ pay for it
● If you can also grow the number of those users rapidly 🥳
@Rohelaraouf

8. Business science
@Rohelaraouf
next.amsterdam

9. @Rohelaraouf

10. 7 ways to measure product success
1. Profitability
2. Number of Customers:
3. Satisfaction Level of Those Customers
4. Employee Satisfaction
5. Defects in the final product
6. Features delivered
7. Backlog growth
@Rohelaraouf
Team
focus

11. What happens….
If you work in an area where you are not generating money for an
organisation:
● Cost per transaction - how much it costs the government each time someone
completes the task your service provides
● User satisfaction - what percentage of users are satisfied with their experience
of using your service
● Completion rate - what percentage of transactions users successfully complete
● Digital take-up - what percentage of users choose your digital service to
complete their task over non-digital channels**
**GDS
@Rohelaraouf

12. @Rohelaraouf

13. RACE
REACH: Who are your customers
ACT: How are they interacting with you
CONVERT: Conversion to sale
ENGAGE: Building customer loyalty
@Rohelaraouf

14. Pitfalls of Product Success Measurement
“When a measure becomes a target, it ceases to be a good measure.”
Pitfall 1: Conflicting criteria
Pitfall 2: Too few criteria
Pitfall 3: Too many criteria
Pitfall 4: Ambiguous criteria
Pitfall 5: Static criteria
Pitfall 6: Evaluating success in a binary way
Avoid Data overload!!
@Rohelaraouf

15. Agile principles
● Individuals and Interactions Over Processes and
Tools
● Working Software Over Comprehensive
Documentation
● Customer Collaboration Over Contract
Negotiation
● Responding to Change Over Following a Plan

16. Key Performance Indicators
A Key Performance Indicator (KPI) is a measurable value that
demonstrates how effectively a team is achieving key product
objectives. Organizations use KPIs to evaluate their success at
reaching targets.
● Selecting the right one will depend on your industry and which
part of the business you are looking to track.
● Once you’ve selected your key business metrics, you will want to
track them in a real-time reporting tool.
@Rohelaraouf

17. Things to be aware of ….
Defining key performance indicators can be tricky business
● KPIs are often confused with business metrics
● Every key performance indicator (KPI) you define must have a target or goal
associated with it
● KPIs that never get updated can quickly become obsolete
● KPIs aren’t static. They always need to evolve, update and change as needed. If you’re
setting and forgetting your KPIs, you risk chasing objectives that are no longer
relevant to your business
● Share your KPIs with your stakeholders

18. SMART
@Rohelaraouf

19. Critical Success Factors
● A critical success factor is not a key Performance Indicator (KPI). Critical
success factors are elements that are vital for a strategy to be successful.
KPI’s are measures that quantify objectives and enable the measurement
of strategic performance.
● Critical success factors (CSFs) refer to specific activities, procedures or
areas that a business or organization depends on for its continued
survival.
● Critical success factors are unique to each organization, and will reflect
the current business and future goals. An organization’s critical success
factors can be identified by applying business analytics.
@Rohelaraouf

20. OKRs
I will ________ as measured by ____________.
A proper goal has to describe both what you will achieve and how you
are going to measure its achievement.
The key words here are “as measured by,” since measurement is what
makes a goal a goal. Without it, you do not have a goal, all you have is
a desire.
@Rohelaraouf

21. Example
@Rohelaraouf

22. Measuring success
@Rohelaraouf

23. Tools to measure
Google analytics: is a web analytics service offered by Google that tracks and reports
website traffic, currently as a platform inside the Google Marketing Platform brand
-Wikipedia
Hotjar: Hotjar is a powerful tool that reveals the online behavior and voice of your users.
By combining both Analysis and Feedback tools, Hotjar gives you the ‘big picture’ of how
to improve your site's user experience and performance/conversion rates.
The Analysis tools allow you to measure and observe user behavior (see what users do)
while the Feedback tools enable you to "hear" what your users have to say (the Voice of
User). To improve your site's user experience and performance/conversion rates
Control chart: Measuring cycle time is an efficient and flexible way to improve a team's
processes because the results of changes are discernable almost immediately, allowing
them to make any further adjustments right away
@Rohelaraouf

24. Key observations
● well - defined measurement is vital
● Get feedback from everyone
● Achievable Targets
● Feel comfortable with failure
@Rohelaraouf

25. @Rohelaraouf