Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Data sources and  collection methods Ken Mease  Cairo, June 2009
What types of Data? <ul><li>A thorough assessment may well include: </li></ul><ul><li>Archival and secondary data </li></u...
Qualitative and Quantitative data <ul><li>There are basically two types of data: qualitative and quantitative  </li></ul><...
Qualitative Data and Approaches <ul><li>Qualitative approaches provide text data, but increasingly audio, video and images...
Quantitative Data and Approaches <ul><li>Quantitative approaches provide increased rigor by investigating relationships at...
Sources and Types of  Governance Data <ul><li>Country reports/desk studies  </li></ul><ul><li>Cross-country (region)compar...
Combining different sources  and methods <ul><li>Combining methodologies and types of data often provides the most useful ...
Administrative, archival  and secondary  <ul><li>These data, both qualitative and quantitative, objective, reported events...
Data Mapping <ul><li>It is the best way to identify existing data -  accessibility, quality and gaps  </li></ul><ul><li>On...
Survey Data  <ul><li>Qualitative and Quantitative </li></ul><ul><li>Sample sizes can range from 20 to 20,000 or more </li>...
Different Types of Interviewing  <ul><li>Structured interviews  use an identical instrument for each respondent,  </li></u...
Types of Interviewing <ul><li>Semi-structured  interviews use a written list of questions that need to be covered  in a pa...
Types of surveys and  data collection methods <ul><li>Face-to-face  data collection is likely the best option in most deve...
Mail surveys  <ul><li>Work well only if the postal system is reliable  </li></ul><ul><li>The questionnaire must be careful...
Internet surveys  <ul><li>Require special planning and design  </li></ul><ul><li>Very good for certain populations </li></...
Telephone surveys  <ul><li>May have coverage issues in most countries.  </li></ul><ul><li>In many countries, people do not...
Focus groups  <ul><li>Can generate information about the background conditions surrounding governance issues.  </li></ul><...
Focus groups <ul><li>Make individual ratings insignificant  </li></ul><ul><li>Accuracy can suffer, as some individuals may...
Who collects the data <ul><li>Outside contractors – surveys and desk studies </li></ul><ul><li>Local survey researchers </...
Data collection and  dissemination exercise <ul><li>Pick  a   Governance  issue in your country </li></ul><ul><li>Choose t...
Upcoming SlideShare
Loading in …5
×

Data sources and collection methods

31,991 views

Published on

With the help of this powerpoint presentation, Ken Mease, discusses the advantages of various types of data sources and collection methods, including archival and secondary data, survey data, quantitative and qualitative approaches and data, and finally de jure and de facto information. The presentation was held at the Workshop on Governance Assessment Methods and Applications of Governance Data in Policy-Making (June 2009)

Published in: Technology, Business

Data sources and collection methods

  1. 1. Data sources and collection methods Ken Mease Cairo, June 2009
  2. 2. What types of Data? <ul><li>A thorough assessment may well include: </li></ul><ul><li>Archival and secondary data </li></ul><ul><li>Survey data </li></ul><ul><li>Quantitative and qualitative approaches and data </li></ul><ul><li>It also will likely include de jure and de facto information </li></ul>
  3. 3. Qualitative and Quantitative data <ul><li>There are basically two types of data: qualitative and quantitative </li></ul><ul><li>Qualitative data are usually text or words and quantitative data - numbers </li></ul><ul><li>Qualitative approaches, if conducted in a rigorous manner, require more skill than most quantitative approaches </li></ul>
  4. 4. Qualitative Data and Approaches <ul><li>Qualitative approaches provide text data, but increasingly audio, video and images </li></ul><ul><li>They are more time consuming to analyze </li></ul><ul><li>Text management software, such as NVIVO, AtlasTI and AnSWR (available free at http://www.cdc.gov) </li></ul><ul><li>Coding is a very subjective process and open to various problems, such as investigator bias or a lack of inter-coder reliability </li></ul>
  5. 5. Quantitative Data and Approaches <ul><li>Quantitative approaches provide increased rigor by investigating relationships at known levels of probability </li></ul><ul><li>They are easier to analyze because researchers use standard, replicable techniques </li></ul><ul><li>Common software includes SPSS, Stata and SAS </li></ul><ul><li>  </li></ul>
  6. 6. Sources and Types of Governance Data <ul><li>Country reports/desk studies </li></ul><ul><li>Cross-country (region)comparative surveys </li></ul><ul><li>Expert assessments </li></ul><ul><li>Government data </li></ul><ul><li>Household surveys </li></ul><ul><li>Mass opinion surveys </li></ul><ul><li>Key Stakeholder Surveys </li></ul><ul><li>Media Indicators </li></ul><ul><li>Business surveys </li></ul>
  7. 7. Combining different sources and methods <ul><li>Combining methodologies and types of data often provides the most useful results. </li></ul><ul><li>Combining archival information and administrative data with original qualitative and quantitative survey data allows for triangulation </li></ul><ul><li>This approach can increase the level of professionalism, credibility and legitimacy. </li></ul>
  8. 8. Administrative, archival and secondary <ul><li>These data, both qualitative and quantitative, objective, reported events, perception and proxies come from a variety of sources: </li></ul><ul><li>Narrative reports, administrative data and other information routinely collected by government ministries </li></ul><ul><li>The constitution, laws, policies and legislation </li></ul><ul><li>Statistics and data gathered by NGOs, international organizations and academics. </li></ul>
  9. 9. Data Mapping <ul><li>It is the best way to identify existing data - accessibility, quality and gaps </li></ul><ul><li>One tool available to assist with this process is the IMF’s Data Quality Assessment Framework </li></ul><ul><li>A senior academic conducted the data mapping exercise in Zambia and was very valuable </li></ul>
  10. 10. Survey Data <ul><li>Qualitative and Quantitative </li></ul><ul><li>Sample sizes can range from 20 to 20,000 or more </li></ul><ul><li>Costs can range accordingly </li></ul><ul><li>There are a range of options for who collects the data – independent surveys firms, academics, NSOs </li></ul><ul><li>Perception and reported events data </li></ul>
  11. 11. Different Types of Interviewing <ul><li>Structured interviews use an identical instrument for each respondent, </li></ul><ul><li>Interviewers are trained and have explicit instructions. </li></ul><ul><li>This technique uses primarily structured questions with fixed response sets and very few open-ended questions </li></ul>
  12. 12. Types of Interviewing <ul><li>Semi-structured interviews use a written list of questions that need to be covered in a particular order </li></ul><ul><li>The questions are often developed from informal discussions and focus groups. </li></ul><ul><li>They can include open-ended and/or more structured questions </li></ul><ul><li>Ideal when working with elites, managers, bureaucrats and other people who have limited time </li></ul>
  13. 13. Types of surveys and data collection methods <ul><li>Face-to-face data collection is likely the best option in most developing countries </li></ul><ul><li>It is also the most expensive and time-consuming </li></ul><ul><li>It requires professional management of trained interviewers, sampling and other aspects of the study </li></ul>
  14. 14. Mail surveys <ul><li>Work well only if the postal system is reliable </li></ul><ul><li>The questionnaire must be carefully designed for self-administration, and there should not be too many language issues </li></ul><ul><li>The cost is usually quite reasonable </li></ul><ul><li>It misses the homeless and other vulnerable groups who may not have a valid mailing address </li></ul>
  15. 15. Internet surveys <ul><li>Require special planning and design </li></ul><ul><li>Very good for certain populations </li></ul><ul><li>These surveys can suffer from low response rates. </li></ul><ul><li>Developing and implementing internet surveys has become very reasonable in terms of cost </li></ul><ul><li>Very reasonably priced internet services are available - Survey Gizmo at www.surveygizmo.com </li></ul>
  16. 16. Telephone surveys <ul><li>May have coverage issues in most countries. </li></ul><ul><li>In many countries, people do not have a phone in their home, and if they do have a phone, it is usually a mobile or cell phone </li></ul><ul><li>Most cell phone providers do not make telephone numbers available for use in random-digit-dial surveys. </li></ul>
  17. 17. Focus groups <ul><li>Can generate information about the background conditions surrounding governance issues. </li></ul><ul><li>Focus groups are usually efficient in terms of time and money. </li></ul><ul><li>They are highly participatory and have the potential of generating solutions to the problems identified by the group members </li></ul><ul><li>It is very demanding and requires highly skilled coordinators. </li></ul>
  18. 18. Focus groups <ul><li>Make individual ratings insignificant </li></ul><ul><li>Accuracy can suffer, as some individuals may not feel comfortable to speak up in public, while others are hard to keep quiet </li></ul><ul><li>Focus groups yield less systematic results </li></ul><ul><li>Focus groups are best used to identify issues and develop surveys rather than as the only source of data </li></ul>
  19. 19. Who collects the data <ul><li>Outside contractors – surveys and desk studies </li></ul><ul><li>Local survey researchers </li></ul><ul><li>Local academics for desk studies </li></ul><ul><li>National Statistical Offices </li></ul><ul><li>Government ministries </li></ul><ul><li>NGOs/CSOs </li></ul>
  20. 20. Data collection and dissemination exercise <ul><li>Pick a Governance issue in your country </li></ul><ul><li>Choose the levels and types of the data you will collect – Macro, Micro, De jure and De facto </li></ul><ul><li>Identify the types and sources of data </li></ul><ul><li>Choose the data collection method/s </li></ul><ul><li>Identify who will collect the data </li></ul><ul><li>Select several options for sharing the results with different audiences </li></ul>

×