Show Me the Outcomes - United States

  • 803 views
Uploaded on

Show Me the Outcomes! …

Show Me the Outcomes!
Evaluating and Proving Your Impact on the Community

Learn how to:
1. Understand how to build a successful outcomes plan for your nonprofit organization

2. Increase your funding by proving your program success to your funders

3. Make informed decisions about future programming and resource allocation

You will also receive an inside view of the Apricot Outcomes Palette™, a dynamic outcomes reporting tool

Presented by:

Kathryn Engelhardt-Cronk
Founder/CEO/President
Community TechKnowledge, Inc.

More in: Self Improvement
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
  • Great outline of the value of data management in communicating outcomes and enhancing performance in the nonprofit environment.
    Are you sure you want to
    Your message goes here
  • For best results, view in full screen mode.
    Are you sure you want to
    Your message goes here
No Downloads

Views

Total Views
803
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
30
Comments
2
Likes
3

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Show Me the Outcomes! Evaluating and Proving Your Impact on the Community Kathryn Engelhardt-Cronk Founder/CEO/President Community TechKnowledge, Inc. kec@communitytech.net
  • 2. Why Are You Here Today?   How am I going to continue to raise funds to keep my nonprofit running?   How am I going to prove that our services are a success?   How do I keep my staff focused on what works?   How can I save money, while increasing our capacity to serve?   How do I keep my board and other volunteers informed of our organization’s progress   How do I engage and empower our consumers in their progress
  • 3. Solution to Your “Pain”- #1 You Will Need Technology Tools to Support Your New Outcomes/ Evaluation Plan
  • 4. Benefits of Technology in Implementing an Outcomes Model 1.  Provide a simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service
  • 5. Benefits of Technology in Implementing an Outcomes Model 1.  Simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service 2.  Provide sophisticated, visually clear and attractive, informative reports in a variety of color-coded, graphic formats
  • 6. Benefits of Technology in Implementing an Outcomes Model 1.  Simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service 2.  Sophisticated, visually clear and attractive, informative reports in a variety of color- coded, graphic formats 3.  Allow you to provide consumers, policy makers, staff and funders with timely critical information re: your mission, progress & success
  • 7. Benefits of Technology in Implementing an Outcomes Model 1.  Simple, completely secure and straightforward, easy and efficient, unique data entry at the point of service 2.  Sophisticated, visually clear and attractive, informative reports in a variety of color- coded, graphic formats 3.  Consumers, policy makers, staff and funders receive critical information re: your mission, progress & success 4.  You won’t have to be Archimedes to track your data
  • 8. You (or me) Tracking Outcomes Without Technology
  • 9. You Reporting Outcomes WITH Technology Permanent Senior Access Green Arts Access Increased Pre-School Decrease Housing to Health Care Strategy for School Voter Readiness School Education Age Children Registration Drop Out %
  • 10. Solution to Your “Pain” - #2 Develop an Outcomes/ Evaluation Plan!
  • 11. At Least 5 Good Reasons … 1.  To define program/project success
  • 12. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success
  • 13. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success 3.  To prove program/project success
  • 14. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success 3.  To prove program/project success 4.  To make informed decisions about future programming and resource allocation
  • 15. At Least 5 Good Reasons … 1.  To define program/project success 2.  To understand the components and process of success 3.  To prove program/project success 4.  To make informed decisions about future programming and resource allocation 5.  To qualify for more and larger grants and for other funding
  • 16. In a Perfect World … Outcome/Evaluation models are implemented as a part of a total community-wide Impact Strategy
  • 17. 5 Step Impact/Outcomes Framework Impact Strategy/Statement Impact Area/s Outcomes (Where YOU, the Service Provider, Gain Focus and Indicators Begin Planning) Milestones Target Achievement
  • 18. Step 1: What is an Impact Strategy Statement? MANY stakeholders develop a community-wide, long-term strategy that includes the relevant universe and that results in a quality of life-based statement.
  • 19. In Other Words… Most service provider organizations DO NOT create or sustain community-wide Impact Strategies.
  • 20. Sample Impact Strategy Statements Build vibrant and tolerant democracies whose governments are accountable to their citizens. Promote community-wide wellness
  • 21. Step 1 Promote community-wide wellness Impact Area/s Outcomes (Where YOU, the Service Provider, Gain Focus and Indicators Begin Planning) Milestones Target Achievement
  • 22. Step 2: Impact Areas This is where strategic thinking begins to focus on the specific needs of a community or special demographic Tip #1. Allows Service Providers and Funders to begin to understand where their organizations and programs “fit” within the strategy and how they can make a measureable difference.
  • 23. Sample Impact Areas The Open Society Institute works to build vibrant and tolerant democracies whose governments are accountable to their citizens. Impact Area: Health Promote community-wide wellness Impact Area: Housing
  • 24. Promote community-wide wellness Step 2 Housing Outcomes Indicators Milestones Target Achievement
  • 25. Step 3: Outcomes …where your work begins But first, let’s create a fictitious organization that needs an Outcomes/Evaluation Plan.
  • 26. The Nonprofit: “Life Skills Housing Access” Mission: “To provide effective and enhanced housing options that meet the needs of all community members.” Program for which funding is needed: Homeless Housing Services
  • 27. Outcomes Definition Outcomes are benefits or changes for individuals or populations during or after participating in program activities and/or influenced by a program's outputs. (a.k.a. Objectives; Strategic Themes)
  • 28. Outcome Attributes   Can be measured
  • 29. Outcome Attributes   Can be measured   Are directly related to Impact Areas
  • 30. Outcome Attributes   Can be measured   Are directly related to Impact Areas   Acts to define performance goals of Impact Strategy
  • 31. Outcome Attributes   Can be measured   Are directly related to Impact Areas   Acts to define performance goals of Impact Strategy   Requires periodic review Tip #2. Individual or multiple Outcome/s can be collaboratively imposed by funders OR developed by the service provider or a communicating consortium of providers.
  • 32. Sample Outcome “Permanent Housing Access for Homeless Individuals in Our Community”
  • 33. Outcomes Statement
  • 34. Promote community-wide wellness Housing Step 3 Permanent Housing For Our Homeless Indicators Milestones Target Achievement
  • 35. Step 4: Indicators   Specific, measure-able performance goals, consisting of individual outputs, inputs and milestones/targets.
  • 36. What Are Indicators?, con’d.…   Specific, measure-able performance goals, consisting of individual outputs, inputs and milestones/targets.   These Indicators are tracked to measure how well a program is achieving an Outcome.
  • 37. Indicator Attributes   Definable, quantifiable, measure- able
  • 38. Indicator Attributes   Definable, quantifiable, measure- able   Metrics are drawn upon analysis of available national /regional information
  • 39. Indicator Attributes   Definable, quantifiable, measure- able   Metrics are drawn upon analysis of available national /regional information   Aligns Outcomes with your services’ relevance
  • 40. Two (2) Sample Indicators Indicator #1: 80% of program Participants Will Successfully Acquire Permanent Housing
  • 41. Two (2) Sample Indicators Indicator #1: 80% of program Participants Will Successfully Acquire Permanent Housing Indicator #2: 85% of Enrollees Will Report a Better Understanding of Available Housing Options
  • 42. Promote community-wide wellness Housing Permanent Housing for Our Homeless Step 4 80% of program Participants Will Successfully Acquire Permanent Housing Milestones Target Achievements
  • 43. Indicator/s Statement
  • 44. Step 5: The Evaluation Plan Now comes the hardest (and the most satisfying) component of Outcomes Modeling.
  • 45. What is Performance Evaluation? The Definition: Strategies and objectives for a program's, client’s/consumer’s or group of clients’/consumers’ level of achievement and how you will prove success. a.k.a Service or Consumer Goals; Results
  • 46. Performance Evaluation / Measurement Attributes   Definition of target population/s
  • 47. Performance Evaluation / Measurement Attributes   Definition of target population/s   Identification of service/program inputs, and outputs and goals that tie to each Indicator
  • 48. Performance Evaluation / Measurement Attributes   Definition of target population/s   Identification of service/program inputs, and outputs and goals that tie to each Indicator   Expectations defined that directly correlate with analysis of what constitutes successful performance
  • 49. Performance Evaluation / Measurement Attributes   Definition of target population/s   Identification of service/program inputs, and outputs and goals that tie to each Indicator   Expectations defined that directly correlate with analysis of what constitutes successful performance   Progress is monitored via defined methodologies to measure Indicator fulfillment
  • 50. Promote community-wide wellness Housing Permanent Housing for Our Homeless Step 4 80% of program Participants Will Successfully Acquire Permanent Housing Milestones Target Achievements: Evaluation Plan
  • 51. Unique Performance Milestones
  • 52. Homeless Housing Services: Performance Measurement Example …   Target Population: 50 males and females, aged 18+ who are currently homeless or living in temporary quarters
  • 53. Plan Description   Target Population: 50 males and females, aged 18+ who are currently homeless or living in temporary quarters   Service Description: Counseling and one-to- one support to prepare and place homeless individuals for permanent housing access
  • 54. Plan Description   Target Population: 50 males and females, aged 18+ who are currently homeless or living in temporary quarters   Service Description: Counseling and one-to- one support to prepare and place homeless individuals for permanent housing access   Inputs: Three full-time staff counselors; Life Skills Housing Funds - total $20,000; resource lists of local AA and NA groups; bus vouchers for transportation to groups: total $500; furniture vouchers for each successfully placed participant: total $4,500
  • 55. Performance Measurement Example: Outputs   50 homeless individuals recruited
  • 56. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers
  • 57. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)
  • 58. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)
  • 59. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)   Each participant applies for Life Skills Housing Fund assistance of $500
  • 60. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)   Each participant applies for Life Skills Housing Fund assistance of $500   Each successful participant receives Re-Use Network voucher for furniture assistance – each participant $100
  • 61. Performance Measurement Example: Outputs   50 homeless individuals recruited   Each applicant receives $10 in bus vouchers   Each participant attends three AA or NA meetings prior to apt application (150 meetings)   Each participant applies for, and views, at least three available apartments (150 views)   Each participant applies for Life Skills Housing Fund assistance of $500   Each successful participant receives Re-Use Network voucher for furniture assistance – each participant $100   Each applicant receives moving assistance
  • 62. Demographic/Output Data Collection
  • 63. Client Demographics
  • 64. Client Demographics: Age
  • 65. Output Tracking Form
  • 66. Sample Program Output Report
  • 67. Performance Measurement Example – Program Goals Consumer/Program Goals   40 of all 50 of program enrollees successfully placed in permanent housing for at least 60 days
  • 68. Performance Measurement Example – Program Goals Consumer/Program Goals   40 of all 50 of program enrollees successfully placed in permanent housing for at least 60 days   47 of 50 enrollees self-report that they understand more about planning for and finding housing
  • 69. The Completed Impact Strategy Outcomes Framework Promote community-wide wellness Basic Needs/Housing Permanent Housing Access for Homeless 80% of Participants Will Successfully Acquire Permanent Housing Homeless Housing Evaluation Plan
  • 70. Consumer Program Goals
  • 71. 60 Day Follow Up--by Program
  • 72. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance
  • 73. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application
  • 74. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing
  • 75. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided
  • 76. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided   Move-in date and event are documented by counselor
  • 77. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided   Move-in date and event are documented by counselor   Counselor schedules 60-day follow-up visit to assess housing permanence
  • 78. Methodology Examples Evaluation Methodology:   Enrollees self-report AA/NA Attendance   Counselors document Life Skills Housing Fund application   Counselors document 3 apartment applications and viewing   Counselors document apartment acceptance and furniture voucher is provided   Move-in date and event are documented by counselor   Counselor schedules 60-day follow-up visit to assess housing permanence   Counselor contacts both unsuccessful enrollees and successful enrollees to request self-report on knowledge gained and assesses interest in renewed attempt
  • 79. Consumer Measurements
  • 80. Attendance Measurement
  • 81. Program Measurements
  • 82. Individual Milestone Tracking to Achieve Indicator/Outcome
  • 83. Individual Breaching Milestones Unmet
  • 84. Aggregated Milestone Tracking to Achieve Program Indicator/Outcome
  • 85. Q&A