Recommended
More Related Content
Viewers also liked
Viewers also liked (16)
Similar to Determining & Demonstrating Value with the Logic Model
Similar to Determining & Demonstrating Value with the Logic Model (20)
Determining & Demonstrating Value with the Logic Model
- 1. Determining & Demonstrating Value with the Logic Model Adapted from a Presentation by Mohamed Hosseini-Ara of City of Markham Rebecca Jones of Dysart & Jones
- 2. The logic of the old model … Determining & Demonstrating Value With the Logic Model - Paul Burry 2
- 3. Demonstrate to Whom? Determining & Demonstrating Value With the Logic Model - Paul Burry 3
- 4. The Framework Understand the Context Align Strategies & Objectives Identify Services & Programs Define Measures Manage Measurement Data Translate Data Into Outcomes & Impacts Communicate the Results Determining & Demonstrating Value With the Logic Model - Paul Burry 4
- 5. Understand the Context How is value defined, measured & communicated? Know your stakeholders—who are they? How do they measure their progress? Determining & Demonstrating Value With the Logic Model - Paul Burry 5
- 6. Stakeholders Identifying and illustrating value requires relationships/conversations with stakeholders Determining & Demonstrating Value With the Logic Model - Paul Burry 6
- 7. Determining & Demonstrating Value With the Logic Model - Paul Burry 7
- 8. Start With Stakeholders Determining & Demonstrating Value With the Logic Model - Paul Burry 8
- 9. Start With Stakeholders Determining & Demonstrating Value With the Logic Model - Paul Burry 9
- 10. Determining & Demonstrating Value With the Logic Model - Paul Burry 10
- 11. Determining & Demonstrating Value With the Logic Model - Paul Burry 11
- 12. Determining & Demonstrating Value With the Logic Model - Paul Burry 12
- 13. Determining & Demonstrating Value With the Logic Model - Paul Burry 13
- 14. Clear Identity & Pride, Supportive/Engaged Community, Equity & Inclusion, Cultural Richness Determining & Demonstrating Value With the Logic Model - Paul Burry 14
- 15. Clear Identity & Pride, Supportive/Engaged Community, Equity & Inclusion, Cultural Richness Enhance Community Well- Being & Engagement, Create Welcoming Physical & Virtual Spaces Determining & Demonstrating Value With the Logic Model - Paul Burry 15
- 16. Clear Identity & Pride, Supportive/Engaged Community, Equity & Inclusion, Cultural Richness Enhance Community Well- Being & Engagement, Create Welcoming Physical & Virtual Spaces Local History Collections & Speaker Series, Teen Queer/Straight Alliance Program, Locally Sourced Food/Farming Programs, Accessibility Initiatives Determining & Demonstrating Value With the Logic Model - Paul Burry 16
- 17. Defining Measures What Measures Do We Currently Use? Operations Customer Satisfaction Value or Impact Determining & Demonstrating Value With the Logic Model - Paul Burry 17
- 18. Defining Measures What Measures Do We Currently Use? Operations Customer Satisfaction Value or Impact Circulation Open Hours People Count Program Attendance Internet Use Reference Queries Determining & Demonstrating Value With the Logic Model - Paul Burry 18
- 19. Defining Measures What Measures Do We Currently Use? Operations Customer Satisfaction Value or Impact Circulation Focus Groups Open Hours Surveys People Count Program Evaluations Program Attendance Internet Use Reference Queries Determining & Demonstrating Value With the Logic Model - Paul Burry 19
- 20. Defining Measures What Measures Do We Currently Use? Operations Customer Satisfaction Value or Impact Circulation Focus Groups ? Open Hours Surveys ? People Count Program Evaluations Program Attendance Internet Use Reference Queries Determining & Demonstrating Value With the Logic Model - Paul Burry 20
- 21. Meaningful Measures… Matter to you AND your stakeholders Are conveyed in stakeholders’ language Focus attention on what is most important for the organization Are critical for managing, planning, & decision-making Are organization- dependent Determining & Demonstrating Value With the Logic Model - Paul Burry 21
- 22. Problems with Conventional Approaches to Measurement Not a “culture of assessment” Many measures convey only past performance Often measures don’t align with stakeholder goals and concerns Measuring impact/value can be complex What does success look like? Determining & Demonstrating Value With the Logic Model - Paul Burry 22
- 23. Measuring Impact/Value You’re measuring a change in the human condition: Behaviour Awareness Skill Motivation Knowledge Condition Attitude Status Circumstance Determining & Demonstrating Value With the Logic Model - Paul Burry 23
- 24. The Logic Model Goes beyond documenting what you did, and measures what difference you made in the life of your target audience. How have they changed? Determining & Demonstrating Value With the Logic Model - Paul Burry 24
- 25. The Logic Model Input Resource Perspective Output Operational Perspective Outcome User Perspective Impact Stakeholder Perspective Determining & Demonstrating Value With the Logic Model - Paul Burry 25
- 26. The Logic Model Input Resource Perspective Output Operational Perspective Outcome User Perspective Impact Stakeholder Perspective • Equipment • Space • Supplies • Funding • Staff Determining & Demonstrating Value With the Logic Model - Paul Burry 26
- 27. The Logic Model Input Resource Perspective Output Operational Perspective Outcome User Perspective Impact Stakeholder Perspective • Training Module • Program • Report • # of Programs • # of Attendees Determining & Demonstrating Value With the Logic Model - Paul Burry 27
- 28. The Logic Model Input Resource Perspective Output Operational Perspective Outcome User Perspective Impact Stakeholder Perspective • Increased Skill • Increased Knowledge • Change in Status • Change in Behaviour or Attitude • Satisfaction level Determining & Demonstrating Value With the Logic Model - Paul Burry 28
- 29. The Logic Model Input Resource Perspective Output Operational Perspective Outcome User Perspective Impact Stakeholder Perspective • Long-term Effects • Lower Dropout Rate • Increased Literacy Level • Increased Recovery Rate Determining & Demonstrating Value With the Logic Model - Paul Burry 29
- 30. If we do this Input Resource Perspective Output Operational Perspective Outcome User Perspective Impact Stakeholder Perspective The Logic Model Determining & Demonstrating Value With the Logic Model - Paul Burry 30
- 31. If we do this This should happen Input Resource Perspective Output Operational Perspective Outcome User Perspective Impact Stakeholder Perspective The Logic Model Determining & Demonstrating Value With the Logic Model - Paul Burry 31
- 32. Begin With the End in Mind Determining & Demonstrating Value With the Logic Model - Paul Burry 32
- 33. STEM Program for Girls Input (resources) Output (operations) Outcome (user) Impact (stakeholder) Determining & Demonstrating Value With the Logic Model - Paul Burry 33
- 34. STEM Program for Girls Input (resources) Output (operations) Outcome (user) Impact (stakeholder) • Girls ages 10-12 are interested in pursuing STEM careers (short-term) • Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term) • Girls pursue careers in STEM and become scientists programmers, doctors (long-term) Determining & Demonstrating Value With the Logic Model - Paul Burry 34
- 35. STEM Program for Girls Input (resources) Output (operations) Outcome (user) • Girls ages 10-12 increase understanding of STEM careers • Increased interest in STEM course options • Positive response to questionnaire regarding appropriate careers for girls (engineers, scientists) Impact (stakeholder) • Girls ages 10-12 are interested in pursuing STEM careers (short-term) • Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term) • Girls pursue careers in STEM and become scientists programmers, doctors (long-term) Determining & Demonstrating Value With the Logic Model - Paul Burry 35
- 36. STEM Program for Girls Input (resources) Output (operations) • 6 week program offered twice per year • 25 girls ages 10-12 complete each session • Pre and Post session questionnaires (permission to follow up in 3 years) Outcome (user) • Girls ages 10-12 increase understanding of STEM careers • Increased interest in STEM course options • Positive response to questionnaire regarding appropriate careers for girls (engineers, scientists) Impact (stakeholder) • Girls ages 10-12 are interested in pursuing STEM careers (short-term) • Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term) • Girls pursue careers in STEM and become scientists programmers, doctors (long-term) Determining & Demonstrating Value With the Logic Model - Paul Burry 36
- 37. STEM Program for Girls Input (resources) • Staffing; program design; marketing materials, facilities, equipment, speakers (6 female STEM professionals) • $1,500 to pay for honorariums and supplies Output (operations) • 6 week program offered twice per year • 25 girls ages 10-12 complete each session • Pre and Post session questionnaires (permission to follow up in 3 years) Outcome (user) • Girls ages 10-12 increase understanding of STEM careers • Increased interest in STEM course options • Positive response to questionnaire regarding appropriate careers for girls (engineers, scientists) Impact (stakeholder) • Girls ages 10-12 are interested in pursuing STEM careers (short-term) • Girls take math, science, computer courses in high school and pursue STEM university degrees (mid-term) • Girls pursue careers in STEM and become scientists programmers, doctors (long-term) Determining & Demonstrating Value With the Logic Model - Paul Burry 37
- 38. The Framework Understand the Context Align Strategies & Objectives Identify Services & Programs Define Measures Manage Measurement Data Translate Data Into Outcomes & Impacts Communicate the Results Determining & Demonstrating Value With the Logic Model - Paul Burry 38
- 39. The Framework Understand the Context Align Strategies & Objectives Identify Services & Programs Define Measures Manage Measurement Data Translate Data Into Outcomes & Impacts Communicate the Results Determining & Demonstrating Value With the Logic Model - Paul Burry 39
- 40. Manage Measurement Data Plan/schedule data Collection Who is responsible? What other work areas need to be involved? Are you currently collecting data that is no longer relevant? How long do you need to keep your data? Determining & Demonstrating Value With the Logic Model - Paul Burry 40
- 41. Translate Data into Outcomes & Impacts Define Success: what will it look like? How will you get there? Remember: You’re measuring social impact, not library performance/success Be aware of possible confounding variables Impact can be inferred, even when your data/measurement isn’t perfect Determining & Demonstrating Value With the Logic Model - Paul Burry 41
- 42. Translate Data into Outcomes & Impacts What does the data say? What does it not say? No one organization is going to solve any major social issue: partner with other community organizations Nobody said it would be easy! Totally killing it! Determining & Demonstrating Value With the Logic Model - Paul Burry 42
- 43. Communicate the Results Begins at the “Understand the Context” stage Dear stakeholder: we contribute X toward your goals You DID build that! Determining & Demonstrating Value With the Logic Model - Paul Burry 43
- 44. What Should You Stop Doing? Determining & Demonstrating Value With the Logic Model - Paul Burry 44
- 45. Thank You! Paul Burry: pburry@pgpl.ca More at: http://www.metricsandlibraries.org/program.html Determining & Demonstrating Value With the Logic Model - Paul Burry 45