Published on

Published in: Health & Medicine, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Examples Formative assessment will identify who the target population is, where they live, lifestyles, culture etc. Anything that gives insight into the lives of the target audience that will help us to design an appropriate intervention Process: We are looking at how the actual implementation was done. If we had planned to recruit 20 peer educators, did we manage that, how did we do the recruitment, what were the challenges. Outcome: Did knowledge on HIV/AIDS increase because of our intervention, are more people using condoms, are people having less casual partners etc. You have to have had a baseline. If KAPB was conducted, it is repeating it and comparing results from before and after intervention. Impact: Did the program reduce the number of new infections, have we stopped or reduced the number of STIs, has the health of target population improved because of our program. The measurements for these require biological data which is not easy to collect. The required data may also need an experiment or long study. It is scientifically verified.
  • Examples: Inputs: are things we put in the program such as the money to run the program, the human resources, training, equipment and any other resources we have put in to make the intervention possible. Outputs: are the activities or service we provided. How many peer educators did we recruit, train, how many meeting did we conduct, how many condoms did we distribute, how many people did we reach, how many information sessions did we conduct, what pamphlets or posters did we give etc Outcomes: have people changed their behaviors. Are people now using condoms, do they have less casual partners, are they abstaining, can they now insist on condom use, has their knowledge improved compare to before the program? Impact: Did the program reduce the number of new infections, have we stopped or reduced the number of STIs, has the health of target population improved because of our program?. The measurements for these require biological data which is not easy to collect. The required data may also need an experiment or long study. It is scientifically verified
  • M&e+for+ifc+clients+jan+2006

    1. 1. IFC Against AIDS Protecting People and Profitability
    2. 2. Monitoring and Evaluation (M&E) <ul><li>Day-to-day follow up of activities during implementation to measure progress and identify deviations </li></ul><ul><li>Routine follow up to ensure activities are proceeding as planned and are on schedule </li></ul><ul><li>Routine assessment of activities and results </li></ul><ul><li>Answers the question, “what are we doing?” </li></ul>What is monitoring?
    3. 3. Monitoring and Evaluation (M&E) <ul><li>Tracks inputs and outputs and compares them to plan </li></ul><ul><li>Identifies and addresses problems </li></ul><ul><li>Ensures effective use of resources </li></ul><ul><li>Ensures quality and learning to improve activities and services </li></ul><ul><li>Strengthens accountability </li></ul><ul><li>Program management tool </li></ul>Why monitor activities?
    4. 4. Monitoring and Evaluation (M&E) <ul><li>Episodic assessment of overall achievement and impacts </li></ul><ul><li>Systematic way of learning from experience to IMPROVE current activities and promote better planning for future action </li></ul><ul><li>Designed specifically with intention to attribute changes to intervention itself </li></ul><ul><li>Answers the question, “what have we achieved and what impact have we made” </li></ul>What is evaluation?
    5. 5. Monitoring and Evaluation (M&E) <ul><li>Determines program effectiveness </li></ul><ul><li>Shows impact </li></ul><ul><li>Strengthens financial responses and accountability </li></ul><ul><li>Promotes a learning culture focused on service improvement </li></ul><ul><li>Promotes replication of successful interventions </li></ul>Why evaluate activities?
    6. 6. Monitoring and Evaluation (M&E) Types of evaluation Gauges the program’s overall impact and effectiveness. Aims to strengthen design and replication of effective programs and strategies Impact Examines specific program outcomes and accomplishments. What changes were observed, what does it mean, and if changes are a result of the interventions? Outcome Seeks to identify the extent to which planned activities have been achieved and assesses the quality of the activities/services Process Initial assessment of the target populations and contextual environment. Determines concept and design Formative Purpose Type
    7. 7. Monitoring and Evaluation (M&E) Monitoring vs evaluation External analysis Self-assessment Provides managers with strategy and policy options Alerts managers to problems Focuses on outcomes and impacts Focuses on inputs and outputs In-depth analysis of achievements Documents progress Periodic: important milestones Continuous: day-to-day Evaluation Monitoring
    8. 8. Monitoring and Evaluation (M&E) M&E Framework 3-5 years (long term) Measurable changes in health status, particularly reduced STI/HIV transmission and reduced AIDS impact. Impact results are effects of the intervention Impacts 2-3 years (short to medium term) Changes in behaviors or skills as a result of the implemented project. Outcomes are anticipated to lead to impacts Outcomes Quarterly Activities or services that the project is providing. Outputs lead to outcomes Outputs Continuous Resources that are put into the project. Lead to the achievement of the outputs Inputs Frequency Description Level
    9. 9. Monitoring and Evaluation (M&E) How IFC Against AIDS integrates M&E <ul><li>Internal client satisfaction survey </li></ul><ul><li>External client satisfaction survey </li></ul><ul><li>Database with all client data </li></ul>IFC Against AIDS <ul><li>Client engagement process </li></ul><ul><li>M&E guide with tools attached </li></ul><ul><li>Train clients/service providers on M&E </li></ul><ul><li>Database for client monitoring data </li></ul>Client Description Level
    10. 10. Pre-engagement Client identification: nature of deal, sector, country, internal stakeholders Mapping out IFC team & value-add <ul><li>Foundations of an HIV/AIDS program </li></ul><ul><li>Infrastructure and assessment: </li></ul><ul><li>Assessment of programmatic conditions </li></ul><ul><li>Senior management buy-in </li></ul><ul><li>Partnership with service providers </li></ul><ul><li>Implementation and partnering </li></ul><ul><li>Program execution and consolidation of partnership: </li></ul><ul><li>Client and NGO implement the program </li></ul><ul><li>Eventually IFC Against AIDS develops supervisory role </li></ul><ul><li>Feedback to management </li></ul><ul><li>Sustainability and maintenance </li></ul><ul><li>M&E and program transition: </li></ul><ul><li>Consolidation of lessons learned </li></ul><ul><li>M&E and program evaluation </li></ul><ul><li>Bridge plan of action </li></ul><ul><li>Feedback to management </li></ul>IFC Against AIDS Client Engagement and M&E Process Months 0-6 Months 6-12 Months 12-18 <ul><li>Monitoring & Evaluation </li></ul><ul><li>Meetings with senior managers </li></ul><ul><li>AIDS committees set up </li></ul><ul><li>Focal persons identified </li></ul><ul><li>Policy </li></ul><ul><li>Implementation plan </li></ul><ul><li>Budgets for programs </li></ul><ul><li>MoUs with service providers </li></ul><ul><li>This is tracked through program monitoring forms </li></ul><ul><li>Monitoring & Evaluation </li></ul><ul><li>KAP survey </li></ul><ul><li>Choose appropriate intervention and monitor using M&E guide and indicators </li></ul><ul><li>Contract service provider </li></ul><ul><li>Monthly reports to management </li></ul><ul><li>Quarterly reports to IFC for database </li></ul><ul><li>Participate in IFC workshops </li></ul><ul><li>This is tracked through program monitoring forms </li></ul><ul><li>Monitoring & Evaluation </li></ul><ul><li>Client </li></ul><ul><li>Analyze monitoring data </li></ul><ul><li>Conduct evaluation </li></ul><ul><li>Re-plan using results of both </li></ul><ul><li>IFC </li></ul><ul><li>Analyze monitoring database </li></ul><ul><li>Analyze client evaluation reports </li></ul><ul><li>Client satisfaction survey </li></ul><ul><li>Re-plan for new year </li></ul><ul><li>This is tracked through program monitoring and evaluation forms </li></ul>
    11. 11. Monitoring and Evaluation (M&E) <ul><li>M&E should be part of the design of a program </li></ul><ul><li>Ensures systematic reporting </li></ul><ul><li>Communicates results and accountability </li></ul><ul><li>Measures efficiency and effectiveness </li></ul><ul><li>Provides information for improved decision making </li></ul><ul><li>Ensures effective allocation of resources </li></ul><ul><li>Promotes continuous learning and improvement </li></ul>Conclusion: Why M&E?
    12. 12. Monitoring and Evaluation (M&E) <ul><li>Monitoring </li></ul><ul><ul><li>Appendix 1 Coordinator’s Workplace Peer Educator Training Form (M1) </li></ul></ul><ul><ul><li>Appendix 2 Coordinator’s Community Peer Educator Training Form (M2) </li></ul></ul><ul><ul><li>Appendix 3 Workplace Peer Educator Activity Form (M3) </li></ul></ul><ul><ul><li>Appendix 4 Workplace Peer Educator Community Activity Form (M4) </li></ul></ul><ul><ul><li>Appendix 5 Community Peer Educator Activity Form (M5) </li></ul></ul><ul><ul><li>Appendix 6 Workplace Peer Educator Monthly Activity Summary (M6) </li></ul></ul><ul><ul><li>Appendix 7 Workplace Peer Educator Monthly Community Summary (M7) </li></ul></ul><ul><ul><li>Appendix 8 Community Peer Educator Monthly Activity Summary (M8) </li></ul></ul><ul><ul><li>Appendix 9 Coordinator’s Monthly Activity Summary (M9) </li></ul></ul><ul><ul><li>Appendix 10 Planned vs Achieved Matrix (E1) </li></ul></ul><ul><li>Evaluation </li></ul><ul><ul><li>Appendix 11 Process Evaluation: Structured Interview (E2) </li></ul></ul><ul><ul><li>Appendix 12 Process Evaluation: Focus Group Discussion Guide (E3) </li></ul></ul><ul><ul><li>Appendix 13 Outcome Evaluation: KAPB Survey Questionnaire (E4) </li></ul></ul><ul><ul><li>Appendix 14 Outcome Evaluation: KAPB Focus Group Discussion Guide (E5) </li></ul></ul>Practical exercise on IFC Against AIDS M&E tools
    13. 13. IFC Against AIDS http://www.ifc.org/ifcagainstaids Sabine Durier - Program Leader Tel: +1-202-473-4176, Email: SDurier@ifc.org Gillette Conner - Program Officer Tel: +1-202-473-4040, Email: GConner@ifc.org Tish Enslin - Program Officer (Johannesburg) Tel: +27-11-731-3062, Email: LEnslin@ifc.org Noleen Dube - Program Officer (Johannesburg) Tel: +27-11-731-3059, Email: NDube@ifc.org Martin Lutalo - Program Analyst Tel: +1-202-458-1406, Email: MLutalo@ifc.org Ilídio Silva - Consultant (Maputo) Tel: +1-258-84-3070-360, Email: IDasilva1@ifc.org