Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Assessment of Constraints to Data Use

3,703 views

Published on

Assessment of Constraints to Data Use is a rapid assessment tool designed to identify barriers and constraints that inhibit effective practices in data use.
http://www.cpc.unc.edu/measure/publications/ms-11-46-a

  • Be the first to comment

Assessment of Constraints to Data Use

  1. 1. Data Demand & Use: Assessment of Data Use Constraints Webinar Series - #1 Tuesday, January 17, 2012 Presenters: Molly Cannon and Tara Nutley
  2. 2. Agenda <ul><li>Welcome – webinar tips </li></ul><ul><li>Brief overview of Data Demand and Use </li></ul><ul><li>Presentation of tool - Assessment of Data Use Constraints </li></ul><ul><li>Questions and answers </li></ul><ul><li>Wrap up </li></ul>
  3. 3. Why improve data-informed decision making? Pressing need to develop health policies, strategies, and interventions
  4. 4. “… without information, things are done arbitrarily and one becomes unsure of whether a policy or program will fail or succeed. If we allow our policies to be guided by empirical facts and data, there will be a noticeable change in the impact of what we do.” National-level Policymaker, Nigeria
  5. 5. Definitions <ul><li>Data use – Using data in the decision making process </li></ul><ul><ul><li>create or revise a program or strategic plan </li></ul></ul><ul><ul><li>develop or revise a policy </li></ul></ul><ul><ul><li>advocate for a policy or program </li></ul></ul><ul><ul><li>allocate resources </li></ul></ul><ul><ul><li>monitor a program </li></ul></ul><ul><ul><li>review must be linked to a specific decision making process </li></ul></ul><ul><li>Data Demand - decision makers specify what kind of information they want & seek it out </li></ul>
  6. 6. Data-informed Decision Making Cycle
  7. 7. Improving Data-informed Decision Making
  8. 8. MEASURE Materials/Resources Tools <ul><li>Quick Guide and Tool Kit </li></ul><ul><li>Assessment to Data Use Constraints </li></ul><ul><li>Information Use Map </li></ul><ul><li>Stakeholder Engagement </li></ul><ul><li>PRISM </li></ul><ul><li>Framework for Linking Data with Action </li></ul>Training <ul><li>Training Tool Kit (3 days) </li></ul><ul><li>Introduction to Basic Data Analysis and Interpretation for Health Programs </li></ul><ul><li>Integrating DDU into an M&E workshop </li></ul><ul><li>Pre-Service Nursing Education </li></ul><ul><li>High Impact Research </li></ul>Guidance Documents & Publications <ul><li>Seven Steps Guide </li></ul><ul><li>Case Study Series </li></ul><ul><li>Other papers </li></ul>
  9. 9. ASSESSMENT OF DATA USE CONSTRAINTS
  10. 10. What determines Data Demand & Use? * Based on PRISM analytical framework (LaFond, Fields et al. (2005). The PRISM: An analytical framework for understanding performance of health information systems in developing countries. MEASURE Evaluation). ORGANIZATIONAL TECHNICAL BEHAVIORAL
  11. 11. What determines Data Demand & Use? POLITICS CULTURE SOCIETY * Based on PRISM analytical framework (LaFond, Fields et al. 2005 The PRISM: An Analytical Framework for Understanding Performance of Health Information Systems in Developing Countries. MEASURE Evaluation). ORGANIZATIONAL TECHNICAL BEHAVIORAL
  12. 12. Assessment of data use constraints tool <ul><li>Purpose </li></ul><ul><ul><li>To improve understanding of the demand for data and the constraints on data use. Designed for a rapid assessment of constraints to data use and overview of macro constraints </li></ul></ul><ul><li>Description </li></ul><ul><ul><li>Key informant interview guide designed to identify constraints in three categories: organizational, technical, and individual – two versions </li></ul></ul><ul><ul><li>Identifies effective practices in data use </li></ul></ul><ul><ul><li>Culminates with a planning matrix for addressing barriers to data use </li></ul></ul>
  13. 13. Assessment Versions <ul><li>National and sub-national assessment </li></ul><ul><ul><li>Provides a broad view of constraints at national and sub-national levels by collecting information from decision-makers on their current use of data and on their perceptions of the constraints to data use for evidence-based decision making. </li></ul></ul><ul><li>Facility level assessment </li></ul><ul><ul><li>Provides an understanding of constraints to both generating and using data at lower levels of the health system – and uses two different interview guides (one for data producers and other for data users). </li></ul></ul>
  14. 14. Both Versions - Interview and analysis process <ul><li>Conduct assessments </li></ul><ul><li>Analyze information </li></ul><ul><li>Identify priority barriers </li></ul><ul><li>Use the planning matrix template </li></ul><ul><li>Monitor progress on the planning matrix developed </li></ul>
  15. 15. NATIONAL AND SUB-NATIONAL ASSESSMENT <ul><li>Version 1 </li></ul>
  16. 16. Key Informants <ul><li>Interview between 20 and 25 individuals </li></ul><ul><ul><li>2/3 from national level </li></ul></ul><ul><ul><li>1/3 from provincial or district level </li></ul></ul><ul><ul><li>½ from the public sector </li></ul></ul><ul><ul><li>½ should include decision-makers from the NGO and private sector </li></ul></ul><ul><ul><li>Should include policymakers and program managers in the health sector or a related position in finance or planning. </li></ul></ul>
  17. 17. Six Sections of Key Informant Interview <ul><li>Logistical information and informed consent </li></ul><ul><li>Introductory questions – relative to last decision made in the organization </li></ul><ul><li>Technical constraints </li></ul><ul><li>Individual constraints </li></ul><ul><li>Organizational constraints </li></ul><ul><li>Closing questions – other contextual factors </li></ul>
  18. 18. Assessment of data use constraints tool Technical Constraints Technical constraints are related to the ability to generate high-quality data and analyses. RA8 Have you ever had an experience while making a policy or program-related decision when you were concerned about the quality of the information being used? RA9 Are there multiple sources of information or statistics for issues of importance to you, and have you experienced any problems caused by having different estimates? RA10 I am interested in knowing about technical capacity for collecting and using information. Does your agency have the technical capacity to produce reliable information without a lot of external technical assistance? RA11 Does your agency have the technical capacity to ensure access to and availability of reliable data? RA12 Has there been an occasion when data quality or local technical capacity made it difficult for you to use information in making a decision? RA13 How would you have gone about preventing this situation?
  19. 19. Assessment of data use constraints tool Individual Constraints Individual constraints are related to the skills, attitudes, values, and motivation of individuals . RA14 What specific challenges have you experienced among your staff when it comes to using data? Probe respondent for the following items following their response: awareness of data sources, technical skill, motivation, time and workload, lack of incentives or knowledge of the benefit to using data for policy change and program management.
  20. 20. Assessment of data use constraints tool Organizational Constraints Organizational constraints are related to challenges in using information that are due to how your organization functions . RA 15 How does your organization support having the necessary information to make decisions? RA 16 How does your organization support the prioritization and use of information in decision making? RA 17 How does your organization support training of staff in skills for using information in decision making? RA 20 What are the challenges your organization/agency experiences in sharing survey and research data? RA 22 Are there risks associated with sharing information? If so what are they? Record the response and the respondent’s openness or reluctance to answering this question.
  21. 21. FACILITY ASSESSMENT <ul><li>Version 2 </li></ul>
  22. 22. Key Informants <ul><li>Has 2 interview guides – one for data producers and one for data users </li></ul><ul><li>Determine clinical area of interest (e.g., HIV/AIDS, malaria) </li></ul><ul><li>Interview at least 5 individuals from each facility </li></ul><ul><li>Include staff working in positions with a range of data production and use responsibilities, such as senior managers, clinicians, laboratory and pharmacy staff, counselors, and health information officers </li></ul>
  23. 23. Sections of Key Informant Interview Guide Data Users Data Producers Logistics/Background Logistics/Background Information Use for Decision Making Data Information and Flow Technical Barriers to Information Use Data Utilization Organizational Barriers to Information Use Barriers to Data Use Other Barriers to Information Use Other Barriers to Data Use
  24. 24. Planning Matrix for addressing barriers to data use # Barrier Proposed Intervention Steps Involved Person Responsible Other Stake-holders Gen. Time-line
  25. 25. Planning Matrix for addressing barriers to data use # Barrier Proposed Intervention Steps Involved Person Responsible Other Stake-holders Gen. Time-line 1 Lack of capacity at the facility level to produce quality and accurate data To build capacity of relevant key players in collecting, collating, and reporting data On the job training <ul><li>M&E specialist </li></ul><ul><li>Training coordinator </li></ul><ul><li>Chief of party </li></ul><ul><li>SACAs </li></ul>Oct 2012 2 Lack of computerized database at IP level to analyze and interpret data To develop a user-friendly and secure database at the IP level Training on the use of software <ul><li>Database consultants </li></ul><ul><li>Training coordinator </li></ul><ul><li>M&E specialist </li></ul><ul><li>Project manager </li></ul>Sept 2013
  26. 26. Adaptation to Key Informant Interviews <ul><li>Use Assessment materials in a workshop setting to identify the key constraints (1 to 3). </li></ul><ul><li>May also use it informally to stimulate understanding of usefulness of tool which can lead to a commitment to more formal use of tool </li></ul>
  27. 27. Assessment of Data Use Constraints Resources <ul><li>Tool is available on the MEASURE Evaluation website: www.measureevaluation.org/ddu-toolkit </li></ul><ul><ul><li>Instructions for use </li></ul></ul><ul><ul><li>Key informant interview guides </li></ul></ul><ul><ul><li>Planning matrix template </li></ul></ul><ul><ul><li>Implementation checklist </li></ul></ul><ul><li>Case examples from Kenya and Nigeria also on website: </li></ul><ul><ul><li>www.measureevaluation.org/ddu-publications </li></ul></ul>
  28. 28. Questions and Answers
  29. 29. MEASURE Evaluation DDU Resources <ul><li>www.measureevaluation.org/ddu </li></ul><ul><ul><li>Data Demand and Use Tool Kit </li></ul></ul><ul><ul><li>Data Demand and Use Training Resources </li></ul></ul><ul><li>Next webinar will be on January 24, 2012 at 9:00 am EST…Information Use Map </li></ul><ul><li>To sign up for Data Use Net, send an email to  [email_address] . Leave the subject field blank and in the body of the message type ‘subscribe DataUseNet’ </li></ul>
  30. 30. Presenter Contact Information <ul><li>Molly Cannon – mcannon@futuresgroup.com </li></ul><ul><li>Tara Nutley - TNutley@futuresgroup.com </li></ul>
  31. 31. <ul><li>MEASURE Evaluation is a MEASURE project funded by the </li></ul><ul><li>U.S. Agency for International Development and implemented by </li></ul><ul><li>the Carolina Population Center at the University of North Carolina </li></ul><ul><li>at Chapel Hill in partnership with Futures Group International, </li></ul><ul><li>ICF Macro, John Snow, Inc., Management Sciences for Health, </li></ul><ul><li>and Tulane University. Views expressed in this presentation do not </li></ul><ul><li>necessarily reflect the views of USAID or the U.S. Government. </li></ul><ul><li>MEASURE Evaluation is the USAID Global Health Bureau's </li></ul><ul><li>primary vehicle for supporting improvements in monitoring and </li></ul><ul><li>evaluation in population, health and nutrition worldwide. </li></ul>

×