7. Selecting data points is difficult in the social
sector because a lot of data points are
proxies
Example
We trackWe care about
Graduation ratesEducation
Job placementsEconomic
independence
8. Tracking the wrong data points leads to the
wrong decisions
Example
We trackWe care about
Arrest ratesCrime reduction
Public perceptionFeeling safe
13. Before diving into data, we need to be
explicit about our own utility frameworks
Likely overly simplistic
14. A utility framework is how we value data
points, including interactions therein
15. The vulnerability index is a good example of
a utility framework in homeless services
Prioritizes those most likely to die on the street
16. Without establishing an organizational utility
framework, everyone makes decisions
according to their own values
Different utility functions + same data
=
Different decisions
18. Utility elicitation is common in the
business world
Model a decision maker’s risk reward preferences through
a series of hypothetical investment scenarios
19. The key is to find points of indifference
Housing one chronically homeless person is equivalent to
placing three people into jobs
Points of indifference allow us to compare unlike indicators
20. Developing a utility framework enforces
consistent investment decisions
Makes investment priorities clear
Can be tested and refined through time
21. • Select (likely a series) of data points that approximate
what we really care about
• Build a model that assigns value to data points, and
update it through time
Before diving into data: