Show Me the Outcomes - United States

1,070 views

Published on

Show Me the Outcomes!
Evaluating and Proving Your Impact on the Community

Learn how to:
1. Understand how to build a successful outcomes plan for your nonprofit organization

2. Increase your funding by proving your program success to your funders

3. Make informed decisions about future programming and resource allocation

You will also receive an inside view of the Apricot Outcomes Palette™, a dynamic outcomes reporting tool

Presented by:

Kathryn Engelhardt-Cronk
Founder/CEO/President
Community TechKnowledge, Inc.

Published in: Self Improvement
2 Comments
4 Likes
Statistics
Notes
No Downloads
Views
Total views
1,070
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
38
Comments
2
Likes
4
Embeds 0
No embeds

No notes for slide

Show Me the Outcomes - United States

  1. 1. Show Me the Outcomes! Evaluating and Proving Your Impact on the Community Kathryn Engelhardt-Cronk Founder/CEO/President Community TechKnowledge, Inc. kec@communitytech.net
  2. 2. Why Are You Here Today?   How am I going to continue to raise funds to keep my nonprofit running?   How am I going to prove that our services are a success?   How do I keep my staff focused on what works?   How can I save money, while increasing our capacity to serve?   How do I keep my board and other volunteers informed of our organization’s progress   How do I engage and empower our consumers in their progress
  3. 3. Solution to Your “Pain”- #1 You Will Need Technology Tools to Support Your New Outcomes/ Evaluation Plan
  4. 4. Benefits of Technology in Implementing an Outcomes Model 1.  Provide a simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service
  5. 5. Benefits of Technology in Implementing an Outcomes Model 1.  Simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service 2.  Provide sophisticated, visually clear and attractive, informative reports in a variety of color-coded, graphic formats
  6. 6. Benefits of Technology in Implementing an Outcomes Model 1.  Simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service 2.  Sophisticated, visually clear and attractive, informative reports in a variety of color- coded, graphic formats 3.  Allow you to provide consumers, policy makers, staff and funders with timely critical information re: your mission, progress & success
  7. 7. Benefits of Technology in Implementing an Outcomes Model 1.  Simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service 2.  Sophisticated, visually clear and attractive, informative reports in a variety of color- coded, graphic formats 3.  Consumers, policy makers, staff and funders receive critical information re: your mission, progress & success 4.  You won’t have to be Archimedes to track your data
  8. 8. You (or me) Tracking Outcomes Without Technology
  9. 9. You Reporting Outcomes WITH Technology Permanent Senior Access Green Arts Access Increased Pre-School Decrease Housing to Health Care Strategy for School Voter Readiness School Education Age Children Registration Drop Out %
  10. 10. Solution to Your “Pain” - #2 Develop an Outcomes/ Evaluation Plan!
  11. 11. At Least 5 Good Reasons … 1.  To define program/project success
  12. 12. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success
  13. 13. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success 3.  To prove program/project success
  14. 14. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success 3.  To prove program/project success 4.  To make informed decisions about future programming and resource allocation
  15. 15. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success 3.  To prove program/project success 4.  To make informed decisions about future programming and resource allocation 5.  To qualify for more and larger grants and for other funding
  16. 16. In a Perfect World … Outcome/Evaluation models are implemented as a part of a total community-wide Impact Strategy
  17. 17. 5 Step Impact/Outcomes Framework Impact Strategy/Statement Impact Area/s Outcomes (Where YOU, the Service Provider, Gain Focus and Indicators Begin Planning) Milestones Target Achievement
  18. 18. Step 1: What is an Impact Strategy Statement? MANY stakeholders develop a community-wide, long-term strategy that includes the relevant universe and that results in a quality of life-based statement.
  19. 19. In Other Words… Most service provider organizations DO NOT create or sustain community-wide Impact Strategies.
  20. 20. Sample Impact Strategy Statements Build vibrant and tolerant democracies whose governments are accountable to their citizens. Promote community-wide wellness
  21. 21. Step 1 Promote community-wide wellness Impact Area/s Outcomes (Where YOU, the Service Provider, Gain Focus and Indicators Begin Planning) Milestones Target Achievement
  22. 22. Step 2: Impact Areas This is where strategic thinking begins to focus on the specific needs of a community or special demographic Tip #1. Allows Service Providers and Funders to begin to understand where their organizations and programs “fit” within the strategy and how they can make a measureable difference.
  23. 23. Sample Impact Areas The Open Society Institute works to build vibrant and tolerant democracies whose governments are accountable to their citizens. Impact Area: Health Promote community-wide wellness Impact Area: Housing
  24. 24. Promote community-wide wellness Step 2 Housing Outcomes Indicators Milestones Target Achievement
  25. 25. Step 3: Outcomes …where your work begins But first, let’s create a fictitious organization that needs an Outcomes/Evaluation Plan.
  26. 26. The Nonprofit: “Life Skills Housing Access” Mission: “To provide effective and enhanced housing options that meet the needs of all community members.” Program for which funding is needed: Homeless Housing Services
  27. 27. Outcomes Definition Outcomes are benefits or changes for individuals or populations during or after participating in program activities and/or influenced by a program's outputs. (a.k.a. Objectives; Strategic Themes)
  28. 28. Outcome Attributes   Can be measured
  29. 29. Outcome Attributes   Can be measured   Are directly related to Impact Areas
  30. 30. Outcome Attributes   Can be measured   Are directly related to Impact Areas   Acts to define performance goals of Impact Strategy
  31. 31. Outcome Attributes   Can be measured   Are directly related to Impact Areas   Acts to define performance goals of Impact Strategy   Requires periodic review Tip #2. Individual or multiple Outcome/s can be collaboratively imposed by funders OR developed by the service provider or a communicating consortium of providers.
  32. 32. Sample Outcome “Permanent Housing Access for Homeless Individuals in Our Community”
  33. 33. Outcomes Statement
  34. 34. Promote community-wide wellness Housing Step 3 Permanent Housing For Our Homeless Indicators Milestones Target Achievement
  35. 35. Step 4: Indicators   Specific, measure-able performance goals, consisting of individual outputs, inputs and milestones/targets.
  36. 36. What Are Indicators?, con’d.…   Specific, measure-able performance goals, consisting of individual outputs, inputs and milestones/targets.   These Indicators are tracked to measure how well a program is achieving an Outcome.
  37. 37. Indicator Attributes   Definable, quantifiable, measure- able
  38. 38. Indicator Attributes   Definable, quantifiable, measure- able   Metrics are drawn upon analysis of available national /regional information
  39. 39. Indicator Attributes   Definable, quantifiable, measure- able   Metrics are drawn upon analysis of available national /regional information   Aligns Outcomes with your services’ relevance
  40. 40. Two (2) Sample Indicators Indicator #1: 80% of program Participants Will Successfully Acquire Permanent Housing
  41. 41. Two (2) Sample Indicators Indicator #1: 80% of program Participants Will Successfully Acquire Permanent Housing Indicator #2: 85% of Enrollees Will Report a Better Understanding of Available Housing Options
  42. 42. Promote community-wide wellness Housing Permanent Housing for Our Homeless Step 4 80% of program Participants Will Successfully Acquire Permanent Housing Milestones Target Achievements
  43. 43. Indicator/s Statement
  44. 44. Step 5: The Evaluation Plan Now comes the hardest (and the most satisfying) component of Outcomes Modeling.
  45. 45. What is Performance Evaluation? The Definition: Strategies and objectives for a program's, client’s/consumer’s or group of clients’/consumers’ level of achievement and how you will prove success. a.k.a Service or Consumer Goals; Results
  46. 46. Performance Evaluation / Measurement Attributes   Definition of target population/s
  47. 47. Performance Evaluation / Measurement Attributes   Definition of target population/s   Identification of service/program inputs, and outputs and goals that tie to each Indicator
  48. 48. Performance Evaluation / Measurement Attributes   Definition of target population/s   Identification of service/program inputs, and outputs and goals that tie to each Indicator   Expectations defined that directly correlate with analysis of what constitutes successful performance
  49. 49. Performance Evaluation / Measurement Attributes   Definition of target population/s   Identification of service/program inputs, and outputs and goals that tie to each Indicator   Expectations defined that directly correlate with analysis of what constitutes successful performance   Progress is monitored via defined methodologies to measure Indicator fulfillment
  50. 50. Promote community-wide wellness Housing Permanent Housing for Our Homeless Step 4 80% of program Participants Will Successfully Acquire Permanent Housing Milestones Target Achievements: Evaluation Plan
  51. 51. Unique Performance Milestones
  52. 52. Homeless Housing Services: Performance Measurement Example …   Target Population: 50 males and females, aged 18+ who are currently homeless or living in temporary quarters
  53. 53. Plan Description   Target Population: 50 males and females, aged 18+ who are currently homeless or living in temporary quarters   Service Description: Counseling and one-to- one support to prepare and place homeless individuals for permanent housing access
  54. 54. Plan Description   Target Population: 50 males and females, aged 18+ who are currently homeless or living in temporary quarters   Service Description: Counseling and one-to- one support to prepare and place homeless individuals for permanent housing access   Inputs: Three full-time staff counselors; Life Skills Housing Funds - total $20,000; resource lists of local AA and NA groups; bus vouchers for transportation to groups: total $500; furniture vouchers for each successfully placed participant: total $4,500
  55. 55. Performance Measurement Example: Outputs   50 homeless individuals recruited
  56. 56. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers
  57. 57. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)
  58. 58. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)
  59. 59. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)   Each participant applies for Life Skills Housing Fund assistance of $500
  60. 60. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)   Each participant applies for Life Skills Housing Fund assistance of $500   Each successful participant receives Re-Use Network voucher for furniture assistance – each participant $100
  61. 61. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)   Each participant applies for Life Skills Housing Fund assistance of $500   Each successful participant receives Re-Use Network voucher for furniture assistance – each participant $100   Each applicant receives moving assistance
  62. 62. Demographic/Output Data Collection
  63. 63. Client Demographics
  64. 64. Client Demographics: Age
  65. 65. Output Tracking Form
  66. 66. Sample Program Output Report
  67. 67. Performance Measurement Example – Program Goals Consumer/Program Goals   40 of all 50 of program enrollees successfully placed in permanent housing for at least 60 days
  68. 68. Performance Measurement Example – Program Goals Consumer/Program Goals   40 of all 50 of program enrollees successfully placed in permanent housing for at least 60 days   47 of 50 enrollees self-report that they understand more about planning for and finding housing
  69. 69. The Completed Impact Strategy Outcomes Framework Promote community-wide wellness Basic Needs/Housing Permanent Housing Access for Homeless 80% of Participants Will Successfully Acquire Permanent Housing Homeless Housing Evaluation Plan
  70. 70. Consumer Program Goals
  71. 71. 60 Day Follow Up--by Program
  72. 72. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance
  73. 73. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application
  74. 74. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing
  75. 75. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided
  76. 76. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided   Move-in date and event are documented by counselor
  77. 77. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided   Move-in date and event are documented by counselor   Counselor schedules 60-day follow-up visit to assess housing permanence
  78. 78. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided   Move-in date and event are documented by counselor   Counselor schedules 60-day follow-up visit to assess housing permanence   Counselor contacts both unsuccessful enrollees and successful enrollees to request self-report on knowledge gained and assesses interest in renewed attempt
  79. 79. Consumer Measurements
  80. 80. Attendance Measurement
  81. 81. Program Measurements
  82. 82. Individual Milestone Tracking to Achieve Indicator/Outcome
  83. 83. Individual Breaching Milestones Unmet
  84. 84. Aggregated Milestone Tracking to Achieve Program Indicator/Outcome
  85. 85. Q&A

×