These slides were one part of the program "Rethinking Patron Engagement: Making Data-Driven Decisions" which was given on June 26, 2015 at the American Library Association Conference in San Francisco. Public libraries are looking past circulation statistics and program counts to gather richer, more holistic information about present (and potential) users. In this session, learn how Brooklyn Public Library's "Power User" program, Seattle Public Library's "Millennial Factor Project" and Chicago Public Library’s “Outcome Based Measurements” have attempted to engage patrons more intimately by translating data into targeted programs and services.

1. Outcome Based
Measurement
Mark Andersen
Director of Learning and
Economic Advancement
Chicago Public Library

2. Agenda
• Who we are
• The problem
– Why we focus on outcomes
• The Solution: The Logic Model
• Example
• Wrap up and conclusion

3. Who are we?

4. Chicago Public Library

5. Our mission
We welcome and support all people in
their enjoyment of reading and
lifelong learning. Working together,
we strive to provide equal access to
information, ideas and knowledge
through books, programs and other
resources. We believe in the freedom
to read, to learn, to discover.

6. systemwidemap

7. 2014 Statistics
 Branches: 80
 Active cardholders: 1,117,772
 Visitors: 9,968,256
 WiFi sessions: 3,046,636
 Items circulated: 10,022,785
 Public computer sessions: 2.8 million
 Public-access computers: approx 2,800
 Website visits: 13,807,482

8. The Problem

9. 1.We have a finite number of
resources.
why are we focused on
outcomes?

10. 1.We have a finite number of
resources.
2.We have specific goals we
are trying to achieve with a
specific program or service.
why are we focused on
outcomes?

12. 1.We have a finite number of
resources.
1.We have specific goals we are
trying to achieve with a
specific program or service.
3.We need to make sure we’re
putting our time & talent to
its best use.
why are we focused on
outcomes?

13. 52,165

14. 1. What did they do?
2. What did they learn?
3. Are they better off?
what we don’t know

15. 3,782

16. 1. What did they do?
2. What did they learn?
3. Are they better off?
what we can begin to
understand

17. The Solution

19. Outcome Based Measurement
Step 1: Define results to be
measured
Step 2: Identify data required and
sources
Step 3: Review existing assessment
methods
Step 4: Define additional methods
and measures
Step 5: Implement and evaluate

20. GOAL:
INPUTS → OUTPUTS → OUTCOMES INDICATORS
(KPIs)
Logic Model

21. goal
what you hope to achieve
with the new program or
service.

22. input
resources devoted to a
program or service
Examples:
 librarians
 Computers
 classroom
 supplies

23. outputs
something that happens as a
result of an activity or
process.
Examples:
 # of participants
 # of classes taught
 # of items
created

24. outcomes
what happens to the participant
as a result of participating in
the activity or process.

25. outcomes
Examples:
 a new skill is developed
 new knowledge is learned
 change in attitude
 modification of behavior

26. KPI(Key Performance
Indicator)
a sign that shows that what
you want to accomplish did or
did not happen.

27. KPI
Example:
 Objective: user has gained a
digital literacy skill
 Indicator: patron uses
software to create a design
which they then print on the
3D printer.

28. If …. Then
Input
Output
Outcomes
KPIs
Outcome is achieved (Y/N)

29. GOAL: Foster and inspire creativity while building 21st
century digital learning skills.
INPUTS → OUTPUTS → OUTCOMES INDICATORS
(KPIs)
maker lab

30. GOAL: Foster and inspire creativity while building 21st
century digital learning skills.
INPUTS → OUTPUTS → OUTCOMES INDICATORS
(KPIs)
patron graphic
file
a new digital
literacy skill is
developed
Printed object
of a
personalized
or original
design
patron graphic
file
creativity is
unleashed
Personalized
and / or
original
graphic file
maker lab

32. Thank You