Data Collection Tools: Validity & Reliability. Objectives: Discuss types of measurement tools for collecting data for quantitative, qualitative and outcome research. Differentiate between interview guide and interview schedule Discuss reliability and validity of questionnaires. Data: The set of values collected for the variable of each of the elements belonging to the sample Data sources include (Quantitative) Surveys where there are a large number of respondents (esp where you have used a Likert scale) Questionnaires, data collection tools/ instruments Observations (counts of numbers and/or coding data into numbers) Secondary data (government data; SATs scores etc) Analysis techniques include hypothesis testing, correlations and cluster analysis. Data sources include (Qualitative) Interviews (structured, semi-structured or unstructured) Focus groups Questionnaires or surveys Secondary data, including diaries, self-reporting, written accounts of past events/archive data and company reports; Direct observations – may also be recorded (video/audio) Ethnography Data analysis; thematic or content analysis . Data Collection: “The process of gathering and measuring information on variables of interest, in an established systematic fashion that enables one to answer queries, stated research questions, test hypotheses, and evaluate outcomes.” Data Collection Methods: Surveys, quizzes, and questionnaires Interviews Focus groups Direct observations Documents and records. Data Collection Tools for Quantitative Research: Closed-ended Surveys and Online Quizzes Closed-ended surveys and online quizzes are based on questions that give respondents predefined answer options to opt for. There are two main types of closed-ended surveys – those based on categorical and those based on interval/ratio questions. Categorical survey questions can be further classified into dichotomous (‘yes/no’), multiple-choice questions, or checkbox questions and can be answered with a simple “yes” or “no” or a specific piece of predefined information. Interval/ratio questions, on the other hand, can consist of rating-scale, Likert-scale, or matrix questions and involve a set of predefined values to choose from on a fixed scale. Data Collection Tools for Qualitative Research: 1. Open-Ended Surveys and Questionnaires Opposite to closed-ended are open-ended surveys and questionnaires. The main difference between the two is the fact that closed-ended surveys offer predefined answer options the respondent must choose from, whereas open-ended surveys allow the respondents much more freedom and flexibility when providing their answers. 2. In-depth Interviews/ Face to Face Interviews One-on-one (or face-to-face) interviews are one of the most common types of data collection methods in qualitative research. Here, the interviewer collects data directly from the interviewee.