Where Are We Now


Published on

MEASURE Evaluation's contribution to the global M&E agenda

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • The goals of this presentation are to provide a broad overview of the contributions of the MEASURE Evaluation project focusing on this phase but building on the progress and contributions of earlier years that Jane has presented, and to place those contributions into the current global M&E and HIS context. I hope that this will inspire you to participate in the panel sessions that will follow which will provide the opportunity for more discussion of specific topics.
  • Where Are We Now

    1. 1. Si ân Curtis Project Director Where are we now? MEASURE Evaluation’s Contribution to the Global M&E Agenda
    2. 2. What is different in Phase II? <ul><li>Greatly increased funding and emphasis on HIV </li></ul><ul><li>Many global players, especially in HIV </li></ul><ul><ul><li>“ Three Ones” </li></ul></ul><ul><li>High demand for information for accountability and emphasis on targets </li></ul><ul><ul><li>MDGs, PEPFAR 2-7-10, WHO 3 by 5 </li></ul></ul><ul><li>Growing interest in M&E for other disease-specific programs (malaria, TB, avian influenza) </li></ul>
    3. 3. MEASURE Evaluation Conceptual Framework
    4. 4. Data Demand and Information Use <ul><li>Conceptual framework </li></ul><ul><ul><li>Embeds the decision-making process within the information use cycle </li></ul></ul><ul><li>Participatory approach to strengthen decision-maker involvement integrated from the beginning </li></ul><ul><ul><li>“ Start with the use in mind” </li></ul></ul><ul><li>Tools & approaches with field applications </li></ul><ul><ul><li>Decision calendar, assessment of data use constraints, information use mapping, stakeholder engagement </li></ul></ul>
    5. 5. Improving Data Collection: Global Level <ul><li>New/updated guidelines and standards </li></ul><ul><ul><li>Population, health & environment, avian influenza </li></ul></ul><ul><ul><li>Monitoring of patients on ART </li></ul></ul><ul><li>Data quality improvement tools </li></ul><ul><ul><li>M&E System Strengthening Tool, Data Quality Assurance Tool for Program Level Indicators, Data Quality Assessment Tool </li></ul></ul><ul><ul><li>Performance of Routine Information System Management (PRISM) toolkit </li></ul></ul><ul><li>Development of improved data collection methods </li></ul><ul><ul><li>Sample Vital Registration with Verbal Autopsy (SAVVY) </li></ul></ul>
    6. 6. Improving Data Collection in the Field <ul><li>Global initiatives have to be implemented in the field to improve data collection in practice </li></ul><ul><li>Opportunities to implement field interventions to improve country level M&E and health information systems </li></ul><ul><ul><li>C ôte d’Ivoire – incorporate HIV/AIDS data into RHIS – first ever HIV/AIDS national report in 2005 </li></ul></ul><ul><ul><li>Nigeria – Nigeria National Response Information Management System – 10 states able to produce state-level reports </li></ul></ul><ul><li>Improving data collection and quality takes time </li></ul>
    7. 7. Making Information More Available <ul><li>Ongoing data collection and analysis to provide actionable findings </li></ul><ul><ul><li>Improved information systems, discrete surveys, secondary analysis </li></ul></ul><ul><li>Effective and appropriate communication of information </li></ul><ul><ul><li>Mapping </li></ul></ul><ul><ul><li>Use-oriented dissemination </li></ul></ul><ul><li>Emerging technologies </li></ul>
    8. 8. Capacity Building <ul><li>M&E and HIS capacity almost universally low </li></ul><ul><li>Gains made do not keep pace with rising demand for M&E and HIS expertise </li></ul><ul><li>Building individual and institutional M&E and HIS capacity is an intervention itself and takes time </li></ul><ul><li>Increasing attention to national M&E capacity </li></ul><ul><ul><li>M&E and HIS capacity assessments </li></ul></ul>
    9. 9. Capacity Building in the Field: Are we making any difference? <ul><li>National M&E plans now exist for many national programs, particularly HIV </li></ul><ul><ul><li>Increasingly accompanied by operational plans </li></ul></ul><ul><ul><li>M&E units now common in many national institutions </li></ul></ul><ul><li>USG Strategic information teams established in PEPFAR focus countries </li></ul><ul><li>Improved capacity of PEPFAR implementing partners to provide data for PEPFAR </li></ul>
    10. 10. Training Partners <ul><li>Five regional training partners </li></ul><ul><ul><li>INSP, Mexico; CESAG, Senegal; Mahidol University, Thailand; University of Addis Ababa, Ethiopia; University of Pretoria, South Africa </li></ul></ul><ul><li>Most sessions in regional M&E short courses taught by partner faculty </li></ul><ul><li>Partners now holding workshops independently </li></ul><ul><li>Partners involved in field TA </li></ul><ul><ul><li>TA in West Africa, ASAP partnership, Coverage Plus survey </li></ul></ul>
    11. 11. Coordination and Collaboration: Global Level <ul><li>Several joint publications with global agencies </li></ul><ul><ul><li>ART patient tracking guidelines, UNAIDS M&E Guide for Concentrated epidemics, etc. </li></ul></ul><ul><li>Participation/leadership in global networks </li></ul><ul><ul><li>Health Metrics Network, UNAIDS MERG, RBM MERG, RHINO, International Health Facility Assessment Network </li></ul></ul><ul><li>Participation in global harmonization efforts </li></ul><ul><ul><li>M&E capacity assessment tools </li></ul></ul><ul><ul><li>Indicators (e.g. HIV/AIDS, malaria) </li></ul></ul>
    12. 12. <ul><li>A lot of emphasis on M but E is important too </li></ul><ul><li>Need to think about evaluation at the beginning not at the end, but it is hard to attract attention at that point </li></ul><ul><li>Timing – projects are already underway and it is hard to incorporate a strong evaluation design </li></ul><ul><li>Scale – many projects are too small to expect to be able to demonstrate impact </li></ul><ul><li>Pressure for rapid results to inform programs now </li></ul><ul><li>Expectations of multiple stakeholders – scope, competing objectives </li></ul><ul><li>Political will – need someone in a position of authority to buy in and advocate for evaluation </li></ul>Where is the E in M&E?
    13. 13. Conclusions <ul><li>There is rapidly growing demand for health information and M&E </li></ul><ul><li>More and better quality data than before but still a long way to go </li></ul><ul><li>Progress on tools to strengthen information & M&E systems and data quality </li></ul><ul><li>M&E guidance now exists for several program areas that did not have such guidance </li></ul><ul><li>Progress in some measurement areas such as vital events </li></ul><ul><li>More strategic thinking on data demand and use but needs more evaluation </li></ul><ul><li>More attention needed to evaluating what works </li></ul>
    14. 14. MEASURE Evaluation is funded by the U.S. Agency for International Development Through Cooperative Agreement GPO-A-00-03-00003-00 and is implemented by the Carolina Population Center at the University of North Carolina in partnership with Constella Futures, John Snow, Inc., Macro International Inc., and Tulane University.