Introduction To Evaluation


Published on

Presentation by Shauna Hayward

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Introduction To Evaluation

  1. 1. FUNDING RESOURCES FACE TO FACE: INTRODUCTION TO EVALUATION Presented By: Shuna K. Hayward Youth Development Commission
  3. 3. Evaluation is a Mindset… <ul><li>We are all evaluators </li></ul><ul><li>Evaluation is continuous </li></ul><ul><li>Evaluation looks forward, not just backward </li></ul><ul><li>Involves organizational learning </li></ul><ul><li>Means people working together </li></ul>
  4. 4. Working Definitions <ul><li>1) Evaluation is the systematic collection of information about the activities and outcomes of a program to improve effectiveness . </li></ul>
  5. 5. Working Definitions <ul><li>2) Evaluation is asking good questions and using the answers to strengthen your program </li></ul>
  6. 6. Working Definitions <ul><li>3) Evaluation is using information to: </li></ul><ul><ul><ul><ul><li>Make or guide decisions </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Improve what you do </li></ul></ul></ul></ul>
  7. 7. Working Definitions <ul><li>KEY ASPECTS </li></ul><ul><ul><li>Systematic Collection </li></ul></ul><ul><ul><li>Asking Good Questions </li></ul></ul><ul><ul><li>Using Information </li></ul></ul><ul><li>COMMON GROUND </li></ul><ul><ul><li>Improve Effectiveness (Outcomes) </li></ul></ul><ul><ul><li>Improve what you do (Process) </li></ul></ul><ul><ul><li>Strengthen Program </li></ul></ul>
  8. 8. Evaluation Allows you to examine… <ul><li>What is working well </li></ul><ul><li>What is not </li></ul><ul><li>How to Improve </li></ul><ul><li>There is no bad news, only news! </li></ul>
  10. 10. Reasons for Evaluation <ul><li>1) Program Design/Planning </li></ul><ul><ul><li>Helps determine how resources should be used </li></ul></ul><ul><ul><li>Helps determine what should be done and for whom </li></ul></ul><ul><ul><li>Helps clarify program goals and objectives </li></ul></ul>
  11. 11. 2 SIDES OF THE SAME COIN <ul><li>Strong Evaluation </li></ul><ul><li>Strong Planning </li></ul>Depends On Depends On
  12. 12. Reasons for Evaluation <ul><li>2) Program Improvement </li></ul><ul><ul><li>Helps determine what you are doing well </li></ul></ul><ul><ul><li>Helps determine what you are not doing so well </li></ul></ul><ul><ul><li>Helps determine what you should change </li></ul></ul>
  13. 13. Reasons for Evaluation <ul><li>3) Program Justification/Validation </li></ul><ul><ul><li>Provides qualitative and quantitative information for funders </li></ul></ul><ul><ul><li>Provides Credibility </li></ul></ul><ul><ul><li>Provides Accountability </li></ul></ul><ul><ul><li>Let’s you know if you’ve achieved your goals </li></ul></ul>
  14. 14. Reasons for Evaluation <ul><li>4) Involves Other Perspectives as </li></ul><ul><li> well as your own </li></ul>
  15. 15. Who is the Evaluation for? <ul><li>Who are the Key Stakeholders? </li></ul><ul><li>What are some things they probably want to know about your program? </li></ul><ul><li>What are some of the questions they might ask? </li></ul>
  17. 17. Develop a Plan <ul><li>Decide on the following: </li></ul><ul><ul><li>Who will collect the information (internal/external?) </li></ul></ul><ul><ul><li>What information will be collected </li></ul></ul><ul><ul><li>Who will it be collected from </li></ul></ul><ul><ul><li>What tools will be used </li></ul></ul><ul><ul><li>When (set a reasonable timeline) </li></ul></ul><ul><ul><li>What will be done with the information </li></ul></ul>
  18. 18. Key Evaluation Steps <ul><li>Clarify Program Mission and Goals </li></ul><ul><li>Establish Measures (Objectives) </li></ul><ul><li>Collect Data (Questions/Participants/Tools) </li></ul><ul><li>Analyze Data </li></ul><ul><li>Prepare Reports </li></ul><ul><li>Improve Program </li></ul>
  19. 19. Step 1: Clarify Mission and Goals <ul><li>Identify MISSION/PURPOSE </li></ul><ul><li>-Why the program exists </li></ul><ul><li>-Who the program serves </li></ul><ul><li>-What the program does </li></ul><ul><li>Identify/Clarify GOALS </li></ul><ul><li>-What you want to accomplish </li></ul><ul><li>-What success looks like </li></ul>
  20. 20. Sample Goals <ul><li>Youth Employment Program </li></ul><ul><li>Provide a creative, innovative program that exposes young people to the world of work and prepares them for entry level positions. </li></ul><ul><li>Involve young people in work and/or community service activities that develop positive work habits and skills needed to get and keep a job. </li></ul><ul><li>Expose youth to various career possibilities by engaging them in career exploration activities </li></ul>
  21. 21. Step 2: Establish Measures <ul><li>Identify OBJECTIVES </li></ul><ul><li>-Must be quantifiable </li></ul><ul><li>-Data must be available, reliable </li></ul><ul><li>and valid </li></ul><ul><li>- Process (what happened) </li></ul><ul><li>- Outcome (what changed) </li></ul>
  22. 22. Good Objectives are SMART <ul><li>S pecific </li></ul><ul><li>M easurable </li></ul><ul><li>A ction- oriented </li></ul><ul><li>R ealistic </li></ul><ul><li>T imed </li></ul>
  23. 23. Sample Objectives <ul><li>Process Objective: </li></ul><ul><li>50 youth will be placed at job sites by 6/30/07. </li></ul><ul><li>Outcome Objective : </li></ul><ul><li>80% of youth will show improved employment skills by the end of the program. </li></ul>
  24. 24. Step 3: Collect Data <ul><li>Identify questions to be asked </li></ul><ul><li>Identify participants </li></ul><ul><li>Identify tools/instruments </li></ul><ul><li>Gather data systematically and periodically </li></ul><ul><li>Record data </li></ul>
  25. 25. Types of Questions <ul><li>Needs Questions </li></ul><ul><ul><li>provide information on the demand </li></ul></ul><ul><ul><li>tell you what’s needed </li></ul></ul><ul><li>Process Questions </li></ul><ul><ul><li>provide information on the implementation </li></ul></ul><ul><ul><li>tell you what happened </li></ul></ul><ul><li>Outcome Questions </li></ul><ul><ul><li>provide information on the impact </li></ul></ul><ul><ul><li>tell you what changed </li></ul></ul>
  26. 26. Who Should be Included <ul><li>Participants (recipients of services) </li></ul><ul><li>Staff </li></ul><ul><li>Parents </li></ul><ul><li>Teachers </li></ul><ul><li>Community members at large </li></ul>
  27. 27. Tools to use <ul><li>Surveys/Questionnaires </li></ul><ul><li>Pre & Post Tests </li></ul><ul><li>Interviews/Focus Groups </li></ul><ul><li>Participant Journals </li></ul><ul><li>Observations </li></ul><ul><li>Attendance Rosters/Other Records </li></ul>
  28. 28. Step 4: Analyze the Data <ul><li>Organize the data </li></ul><ul><li>Examine the data from all sources </li></ul><ul><li>Conduct analysis looking for </li></ul><ul><ul><li>Changes over time </li></ul></ul><ul><ul><li>Progress relative to goals and objectives </li></ul></ul><ul><ul><li>Differences between groups </li></ul></ul><ul><li>Interpret Results </li></ul>
  29. 29. Step 5: Prepare Reports <ul><li>Determine Reporting Schedule </li></ul><ul><li>Develop Reporting Products </li></ul><ul><li>Report Findings to Key Stakeholders </li></ul>
  30. 30. Step 6: Improve Program <ul><li>Share the information/reports internally </li></ul><ul><li>Incorporate information into planning </li></ul><ul><li>Use the information to make decisions, changes and improvements </li></ul>
  31. 31. Good Luck! For additional information or other training opportunities please contact us at: Youth Development Commission (313) 963-8916 [email_address] or visit