Main Takeaways: -Why and what to consider -Your product might not directly speak about how it's doing, and so your customers, however, there are various options to measure how your product might be performing. -You can ask for feedback or do this without asking your customers. In this session

1. Measuring Success of Data Platforms
by Booking.com Product Leader
www.productschool.com

2. CERTIFICATES
Your Product Management Certificate Path
Product Leadership
Certificate™
Full Stack Product
Management Certificate™
Product Management
Certificate™
20 HOURS
40 HOURS
40 HOURS

3. Corporate
Training
Level up your team’s Product
Management skills

4. Free Product Management Resources
BOOKS
EVENTS
JOB PORTAL
COMMUNITIES
bit.ly/product_resources
COURSES

5. How to measure success of
data platforms
By Prachi Mishra
October 2021 5

6. 6
Group product manager- data
services @booking.com

7. Agenda
● What data platforms are covered in this section?
● Why is it so important to measure success?
● An Introduction to success framework
● Thinking about stakeholders first
● Measures (1 to 4) with quantitative & qualitative data
7

8. What DAta platforms are we talking about in
this session?
Platforms that enable acquisition, storage, preparation, delivery, and
governance of your data
e.g. big data platforms, customer data platforms, analytical data warehouses, storage platforms like
MySQL, MongoDB etc.
These platforms can be either on-premise or in cloud
8

9. Why is it so important to measure the success
of a platform?
1. Keep your cash flow healthy
2. To achieve business goals
3. Make decisions that benefit the organization
4. To get better
5. Employee motivation
9

10. An introduction to
SUCCESS FRAMEWORK
FOR DATA PLATFORMS
(PLATFORM CENTRIC KPI TOOLKIT)
10

11. Before measuring
think about your stakeholders
1. Platform users
2. Platform adopters
3. Business units
4. Influencers
5. Sponsors
11

12. My story
12

13. A data platform is key to unlocking the value of your data
Measurement toolkit
Provides value to
the users
Measure 1
Adds value to your
organization
Measure 2
Is flexible to
change
Measure 3
How is the
adoption when
adding a new
feature
Measure 4
Success Measures
13

14. Measure 1
Is it delivering value to your users?
14

15. Measure 1 (Quantitative)
Is it delivering value to your users?
15
Total number
of users
Number of
active
producers and
consumers of
data
Number of
users added
weekly
Number of
users leaving
the platform
Cycle time for
onboarding new
data
Speed
(performance
of queries,
algorithms
etc.)
Interaction
failures per
day
(errors/issues)
Meets defined
SLAs, SLOs, SLIs
Volume of data
CPU Utilization
Trends
Number of
transactions per day
Data
Discoverability
(Number of
searches)
Data Quality
(accuracy indicators,
completeness,
reliability, relevance
and timeliness)
Data Security
(number of
compliance
failures)
MATURITY
GROWTH
Data
ownership

16. Measure 1 (qualitative)
Is it delivering value to your users?
16
User Evaluation
1. Does it help you to do your work (daily)?
2. How well do you understand the on-boarding process to our platform?
3. Do you understand the data?
4. How easy/user friendly do you find to interact with the platform?
5. How is satisfied are you with the support we provide?
6. Documentation feedback
7. Overall rating/Net promoter score/CSAT score
8. How easy is it to analyse data?

17. Measure 2
Adds value to your organization?
17

18. Measure 2 (Quantitative)
Adds value to your organisation?
18
Cost of user
Acquisition
Number of
business
users using
the platform
Number of
business
teams added
Customer
lifetime value
using the
platform
The break
even point
Improvement
figures in the
business processes
using the platform
Revenue/profit to
the org through
the data assets
produced
MATURITY
GROWTH
Sales
indicators
Contribution to organization
commercial targets e.g. save
operational cost

19. Measure 2 (Qualitative)
Adds value to your organisation?
19
User Evaluation
1. How well do you understand the on-boarding process to our platform?
2. What business challenges are you trying to solve?
3. Did the platform help solve your problem/achieve your goal?
4. What triggers prompted you to use the platform?
5. Which features/capabilities of the platform are most/least important to you?
6. How will it impact your business stream if the platform is unavailable for 5
minutes?

20. Measure 3
Flexible to change?
20

21. Measure 3(Quantitative)
Flexible to change?
21
Number of
new data
sources
Number of
new data
assets or data
products
created
Number of enterprise
applications
connected
Number of
automations created
vs required
Number of sophisticated
tools like artificial
intelligence and machine
learning
Incoming demands
for new assets in
pipeline
Number of new
greenfield applications
created using the
platform
MATURITY
GROWTH
Observations of
behavioral
changes of users
Cycle time to support
cloud native
technologies
Cycle time to add new
data assets and sources

22. Measure 3(qualitative)
Flexible to change?
22
User Evaluation
1. Do you think you can innovate using our existing platform
2. Is it easier to create something new using our platform
3. Can you do things faster than before?
4. What is leading you to continue to use the platform?
5. What prompts to look for other options than this platform?
6. Are your requirements met on a timely basis?

23. Measure 4
How is the adoption when adding a new feature?
23

24. Measure 4(quantitative)
How is the adoption when adding a new feature?
24
New digital
services created or
capabilities added
Investment in
building new
capability
Number of processes
that now run on a new
software
Number of users and teams
acquired as a result of new
capability
Usage and
utilization reports
of new capability
Cost reduced
with addition of
new capability
MATURITY
GROWTH
Investment in
implementing
new capability vs
return
Cycle time from demand
of a new technology to
onboarding first user
Training
participation
Productivity improvement
with new capability e.g. hours
saved

25. Measure 4(Qualitative)
How is the adoption when adding a new feature?
25
User Evaluation
1. How well can you navigate through the new changes?
2. Do you have trouble understanding the processes?
3. Do you think you have enough documentation to understand the changes?
4. Was the communication regarding changes appropriate to get started?
5. Do you understand what actions are expected from you now?
6. Did the new change improve your developer time and velocity?
7. How do you feel about these new capabilities?

26. Other measures
Functional and Non-Functional
Measures
● Platform performance
● Platform Growth Sustainability
● Functional Measures-
Scalability, elasticity,
efficiency, reliability, etc.
26

27. Thank you
27

28. www.productschool.com
Part-time Product Management Training Courses
and
Corporate Training