Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

2011 Distinguished Evaluator: The Health Foundation of Greater Cincinnati


Published on

Dr. Ann McCracken's presentation from the Distinguished Evaluator workshop at the Health Foundation of Greater Cincinnati 6/14/2011

Published in: Education
  • Be the first to comment

  • Be the first to like this

2011 Distinguished Evaluator: The Health Foundation of Greater Cincinnati

  1. 1. Distinguished Evaluator SeriesBuilding Evaluation Capacity<br />June 14, 2011<br />
  2. 2. An Invitation <br />to tell it <br />Like it is<br />
  3. 3. Evaluation<br />HOOP?<br />HELP?<br />NOT-FOR PROFIT<br />
  4. 4. In what ways is evaluation a hoop to jump through for not-for-profits?<br />
  5. 5. In what ways is evaluation a help for not-for-profits?<br />
  6. 6. How did HFGC evaluation get from 1998 to 2011?<br />
  7. 7. We had some lofty evaluation thoughts<br />Funder and NFP <br />on the same page<br />Increase Sustainability<br />Data Driven Decision Making<br />Empowering<br />
  8. 8. How Do For-Profits and Not-For-Profits Differ?<br />For-Profits<br />Not-For-Profits<br />Care <br />Center<br />Cost <br />Center<br />Care Center<br />Cost Center<br />
  9. 9. How are Research and Evaluation Designs Different?<br />Basic Research<br />Applied Research<br />Evidence Based -Practice<br />Evaluation<br />
  10. 10. Who should do the evaluating?<br />External Evaluator<br />Internal Evaluator (build internal capabilities)<br />
  11. 11. Lots of Reading on Evaluation State-of the Art<br />
  12. 12. Learned from Grantees<br />
  13. 13. KaZammmm<br />
  14. 14. Logic Model<br />Process Evaluations (What you do)<br />Formative Stuff<br />Outcome Evaluations (What happens because you do it)<br />Summative Stuff<br />
  15. 15. Logic Model (Logical Framework)<br />Activities and Outcomes Approach <br />Project theory<br />Story Approach<br />Story of why and how the project works<br />Demonstrates connections between program science, the program operations, and expected outcomes<br />
  16. 16.
  17. 17. What We Sort of Knew and Where We Didn’t Know Much<br />Problem<br />Intervention<br />Outcomes<br />
  18. 18. Problem<br />Intervention<br />Goal<br />Objectives<br /><ul><li>Infrastructure
  19. 19. Implementation
  20. 20. Sustainability</li></ul>Outcomes<br />
  21. 21. Created a mutually agreeable evaluation plan<br />HFGC created the boxes (evaluation forms) <br />Grantees filled boxes in a way that worked for them<br />HFGC shared the wisdom learned over time from successful and unsuccessful projects<br /> Evaluation plan part of mutual expectations in contract<br />
  22. 22. Evaluation Use<br />Grantees asked to review plan quarterly<br />Make changes if needed<br />Review next quarter<br />Get assistance from Program Officer if needed<br />HFGC learned that groups of similar grantees helped one another established grantee groups <br />Grantees provided input and plan simplified<br />
  23. 23. We Learned that to truly be useful that grantmaking was more than $$$<br />Workshops<br />Evaluation<br />Communications<br />Business Plan<br />Many others<br />Policy and advocacy work<br />Individual and Group consultation<br />Technical Assistance<br />
  24. 24. We evaluated our approaches to evaluation<br />Grantee Perception Study<br />Sustainability Study<br />Workshop Evaluations<br />
  25. 25. Revisit Use of Evaluation (2011-????)<br />
  26. 26. So for the rest of the day we will<br />Look at how others around the country are evaluating (PBS film)<br />Reflect on evaluation in our organizations<br />Hear a panel of experts and the wisdom of the audience<br />