Using Logic Models for Program Planning and Evaluation

788
-1

Published on

Published in: Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
788
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Using Logic Models for Program Planning and Evaluation

  1. 1. Using Logic Models for Program Planning and Evaluation Wali Memon1 Wali Memon
  2. 2. The Logic Model A picture of your program: what you are putting into the program, what you are doing, and what you are trying to achieve Clarifies the strategy underlying your program Builds common understanding, especially about the relationship between actions and results Communicates what your program is (and is not) about Forms a basis for evaluation2 Wali Memon
  3. 3. The Logic ModelProgram Goal: overall aim or intended impactResources Activities Outputs OutcomesThe inputs The actions The The benefitsdedicated that the measurable to clients,to or program products of a communities,consumed takes to program’s systems, orby the achieve activities organizationsprogram desired outcomes 3 Wali Memon How? Why? So what?
  4. 4. The Logic Model: Different Looks, Additional Components Can be a graphic, table, flow chart, narrative Can also include information about assumptions, externalities/contextual issues, theories of change But, fundamentally, the logic model is a way to communicate what your program is about4 Wali Memon
  5. 5. Example Logic Model Program Goal: To improve the oral health of low-income children who receive primary care in a community health center Resources Activities Outputs OutcomesDental Clinic Training Training Medical providersCoordinator •Develop curriculum # of two-hour trainings demonstrate accurate oral •Two one-hour didacticCommunity Health held health assessment, trainings to medicalDirector # of one-on-one education and prevention providers in oral health trainings held activitiesStaff dentist assessment # of medical providers •One-on-one training to More children receive high-Staff pediatrician trained medical providers on quality oral healthMedical providers oral health assessment, education and prevention activities duringMoney for supplies well-child visits Outreach Outreach Parents/children are more •Order dental supplies # of parents/children knowledgeable about oral for packets receiving packets health and caring for •Make up packets children’s teeth •Distribute to parents at end of each visit Reduced incidence of caries in children at the community health center 5 Wali Memon
  6. 6. The Logic Model: A Series of “If-Then” StatementsResources Activities Outputs Outcomes Certain IF you have IF you can IF you have resources access to accomplish delivered the are needed them, THEN these services as to run your you can activities planned program accomplish THEN you THEN there your will have will be activities delivered benefits for the services clients, you planned communities, systems or organizations6 Wali Memon
  7. 7. Before the Logic Model, clarify the program’s rationale Continuation of existing program Expansion of existing program Existing program with modifications New program7 Wali Memon
  8. 8. A Program Rationale Understanding of: the need or problem the nature and extent of the need or problem the causes of the problem and the social, economic, political and policy contexts the current and past efforts to address the need or problem and lessons learned from these efforts8 (Adapted from: Hunter, D.E.K. Program Life-Cycles at the Edna McConnell Clark Foundation) Wali Memon
  9. 9. Logic Model: Your Proposed Program to Address the Need or Problem Logic Model Timeframe A program cycle A calendar year A grant period The time you believe it will take to show meaningful results Logic Model Scope Geographic area Service area Client population9 Wali Memon
  10. 10. Program Goal: What is your overall aim or intended impact? To improve access to health care for people with limited English proficiency in the service area To reduce the incidence of repeat infections and further oral hygiene problems among clients of the community health center10 Wali Memon
  11. 11. Resources: What inputs are dedicated to orconsumed by the program? Human resources Facilities Equipment/supplies Partners Technology11 Wali Memon
  12. 12. Activities: What is the program doing? Think first about components: Outreach Training Consultation Staff Development Partnership Development12 Wali Memon
  13. 13. Activities: What is the program doing? Think second about details: Outreach Develop and distribute flyers Meet with community agencies Write articles for local newspapers Develop press packet Identify media contacts Send press packet out to media contacts Training Hire curriculum development team Develop training curriculum Recruit training team Recruit participants Provide training sessions13 Wali Memon
  14. 14. Example Logic Model Program Goal: To improve the oral health of low-income children who receive primary care in a community health center Resources Activities Outputs Outcomes TrainingDental Clinic •Develop curriculumCoordinator •Two one-hour didacticCommunity Health trainings to medicalDirector providers in oral health assessmentStaff dentist •One-on-one training toStaff pediatrician medical providers on oral healthMedical providersMoney for supplies Outreach •Order dental supplies for packets •Make up packets •Distribute to parents at end of each visit 14 Wali Memon
  15. 15. Outputs: What is the program producing? # of training workshops held # of participants attending each workshop # of partnerships formed # of policy briefings conducted # of press packets disseminated15 Wali Memon
  16. 16. Example Logic Model Project Goal: To improve the oral health of low-income children who receive primary care in a community health center Resources Activities Outputs OutcomesDental Clinic Training TrainingCoordinator •Develop curriculum # of two-hour trainings •Two one-hour didacticCommunity Health held trainings to medicalDirector # of one-on-one providers in oral health trainings heldStaff dentist assessment # of medical providers •One-on-one training toStaff pediatrician trained medical providers onMedical providers oral healthMoney for supplies Outreach Outreach # of parents/children •Order dental supplies receiving packets for packets •Make up packets •Distribute to parents at end of each visit 16 Wali Memon
  17. 17. Outcomes: What difference is theprogram making? Outcomes are about change: New knowledge Increased skills Changed attitudes or values Modified behavior/practice Changed conditions17 Wali Memon
  18. 18. Example Logic Model Project Goal: To improve the oral health of low-income children who receive primary care in a community health center Resources Activities Outputs Outcomes Training TrainingDental Clinic •Develop curriculum # of two-hour trainings Medical providersCoordinator •Two one-hour didactic held demonstrate accurate oralCommunity Health trainings to medical # of one-on-one health assessment,Director providers in oral health trainings held education and prevention assessment # of medical providers activitiesStaff dentist •One-on-one training to trainedStaff pediatrician medical providers on More children receive high- oral health quality oral healthMedical providers assessment, education and prevention activities duringMoney for supplies well-child visits Outreach Outreach •Order dental supplies # of parents/children Parents/children are more for packets receiving packets knowledgeable about oral •Make up packets health and caring for •Distribute to parents children’s teeth at end of each visit Reduced incidence of caries in children at the community health center 18 Wali Memon
  19. 19. Types of Outcomes Client/individual Family/community Systemic Organizational19 Wali Memon
  20. 20. Chain of Outcomes Short term: are the most direct results of activities and outputs, generally achievable in one year. Intermediate: link a program’s short-term outcomes to long-term outcomes. Long term: result from the achievement of short and intermediate term outcomes and often take a longer time to achieve.20 Wali Memon
  21. 21. Chain of Outcomes Project Goal: To improve the oral health of low-income children who receive primary care in a community health centerActivities Outputs Short- Inter.- Long-Training Training Term Term Term•Develop # of two-hour Outcomes Outcomes Outcomescurriculum trainings held•Two one-hour # of one-on-onedidactic trainings trainings held Medical providers More children Reduced incidence demonstrate receive high- of caries into medical # of medical accurate oral health quality oral health children receivingproviders in oral providers trained assessment, assessment, care from thehealth education and education and community healthassessment Outreach prevention activities prevention center•One-on-one # of activities duringtraining to parents/children Parents/children well-child visitsmedical providers receiving packets are moreon oral health knowledgeable about oral health andOutreach caring for children’s•Order dental teethsupplies forpackets•Make up packets•Distribute toparents at end of 21 Wali Memoneach visit
  22. 22. What is a reasonable level of ambition for an outcome? Consider your timeframe Consider the scope of your resources and activities Consider what other factors might influence the achievement of outcomesBe ambitious but don’t set yourself up!!22 Wali Memon
  23. 23. The Value of the Logic Model Process Engages stakeholders. Clarifies program theory and fills in the gaps. Builds ownership of the program. Builds common understanding about the program, especially about the relationship between actions and results.23 Wali Memon
  24. 24. Using Your Logic Model for Evaluation Evaluation is the process of asking—and answering—questions: What did you do? How well did you do it? What did you achieve?24 Wali Memon
  25. 25. Outcome Indicators Indicators are the specific, measurable characteristics or changes that represent achievement of an outcome. Indicators are measurable and observable and answer the question: How will I know it?25 Wali Memon
  26. 26. Indicators Direct Meaningful Useful Practical to collect Sometimes more than one is necessary26 Wali Memon
  27. 27. Outcome Indicator Medical providers #/% of medical providers demonstrate accurate health observed by participating assessment, education and dentist to demonstrate prevention activities these things accurately Increased access to primary #/% increase in clients who care physicians have a PCP Increased provider # and type of providers in participation in network network27 Wali Memon
  28. 28. Putting Together an Evaluation Plan The “what”: the indicators The “how”: the data collection instruments and evaluation design The “when” and the “who”: the data collection plan28 Wali Memon
  29. 29. Using Your Logic Model for Grant Applications To describe your program—using a picture! To make the case for your program To articulate outcomes and how they connect to your program To articulate your evaluation29 Wali Memon
  30. 30. Logic Model Resources Online course on developing logic models and evaluation plans. Offered by University of Wisconsin, Extension and designed for the beginner. (www1.uwex.edu/ces/lmcourse/) Logic Model Overview. Also from University of Wisconsin, includes links to workbooks, PowerPoint presentations, etc. (www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html) W.K.Kellogg Foundation Logic Model Development Guide. Clear and concise discussion of the use of logic models. (www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf) Logic Model Tools. A comprehensive list provided by the CDC. (www.cdc.gov/eval/resources.htm#logic%20model) Innovation Network’s Workstation: an online workstation with evaluation and planning tools designed specifically for nonprofit organizations. (www.innonet.org) Community Tool Box. ctb.ku.edu/tools/en/sub_section_examples_1877.htm30 Wali Memon
  31. 31. THANK YOU!31 Wali Memon

×