Recommended
More Related Content
What's hot
What's hot (20)
Similar to Research methodology tools design
Similar to Research methodology tools design (20)
Recently uploaded
Recently uploaded (20)
Research methodology tools design
- 1. Research Methodology Tools Design Nonso Onwudinjo Preston Associates for International Development 15th February 2019
- 2. Pretest Remember: Allowed Time: 10 Minutes.
- 3. Introduction Steps taken in Designing Tools Variance & Bias Standardized Interviewing Concept Specification Response Process Questions & Conclusion
- 4. Learning Outcome To critically evaluate the theoretical perspectives of questionnaire design concepts. To demonstrate critical insight into the practical use of principles and standard tips in designing questionnaires.
- 5. What is a Questionnaire A questionnaire is a research instrument consisting of a series of questions (or other types of prompts) for the purpose of gathering information from respondents. The questionnaire was invented by the Statistical Society of London in 1838.
- 6. Introduction Steps taken in Designing Tools Variance & Bias Standardized Interviewing Concept Specification Response Process Questions & Conclusion
- 7. Define the problem Plan how it will be administered Write the questionnaire Desk check Pilot survey Steps to take in Designing a Questionnaire
- 8. Define the Problem What is the purpose Who is the target population What is the information going to be used for What exactly do we want to find out
- 9. Plan how it will be administered Telephone interview Post online In person interview Written interview Affects type of questions that can be asked (Budget, reach more people, defined target)
- 10. Write the questionnaire Interesting question in the beginning (capture interest). Sensible grouping (by question type or topics) make the question easy to answer. Interesting, respectful (Ethical). Informative title, introduction (Purpose & for whom, confidentiality, etc.) Thank you
- 11. Desk Check Seeing your questionnaire for the first time. Read instructions and fill out the answers. See what can be confusing. Identify irrelevant questions. Look out for Grammar and spelling errors Correct questionnaire.
- 12. Pilot Get a group of people to answer your questionnaire Highlight questions that are confusing And questions that are annoying or boring. Quick analysis to see responses.
- 13. Good Survey Question Tips All respondents interpret question the same. Willing to answer the question. One respondent will answer truthfully. Can answer. Knowledge or information. Not double barreled. Avoid biased terms. Pretest your questions.
- 14. Type of Questions Simple question Running Prompt Monitoring the Future (2005) Grade 12, Form 1.
- 15. Type of Questions Closed – One Choice / Mark all that apply Open-ended questions
- 16. Type of Questions Filter Questions
- 17. Introduction Steps taken in Designing Tools Variance & Bias Standardized Interviewing Concept Specification Response Process Questions & Conclusion
- 18. Bias & Variance The general concept is to minimize bias and variance. In other to get the best measurement possible.
- 19. Larger sample size Eliminating ambiguity Variance
- 20. Bias
- 21. Class Exercise
- 22. Examples of Bias & Variance Variance – “Last week, were you a victim of a serious crime?” Bias – “NPOWER supports families through financial empowerment; Are you in favor of the NPOWER programme?”
- 23. Sources of Bias & Variance Respondent ItemInterviewer
- 24. Introduction Steps taken in Designing Tools Variance & Bias Standardized Interviewing Concept Specification Response Process Questions & Conclusion
- 25. Standardized Interviewing The goal of standardization is that each respondent is exposed to the same question experience and that the recording of the answer be the same too. So that any difference in answers can be correctly interpreted as reflecting differences in respondents and not differences in the process that produced the answers. Assumption – Interviewer & Wording adequate
- 26. Standardized Interviewing Wording of items. Neutral or non-directive probe – Let me repeat, whatever it means to you, yes or no, be more specific. You can not paraphrase or engage in grounding Answers should reflect what respondents say No feedback is allowed, no personal information on topic preference
- 28. Conversational Interviewing Standardization of meaning instead of standardization of wording. Allow Interviewer to say what ever is required to ensure that the respondent understands the meaning of the question. First read the question as worded, then can paraphrase Suchman & Jordan 1990
- 31. Conversational Interviewing Conrad & Schober (2000)
- 32. Introduction Steps taken in Designing Tools Variance & Bias Standardized Interviewing Concept Specification Response Process Questions & Conclusion
- 33. Concept Specification How much social capital do you have? Social Capital Spatial location Quality of relations Civic Structure of relations Type of structureSize ReciprocityTrust SocialFormal Informal
- 35. Introduction Steps taken in Designing Tools Variance & Bias Standardized Interviewing Concept Specification Response Process Questions & Conclusion
- 36. Response Process Comprehension of Question Reporting an answer Judgement and estimation Retrieval of Information
- 37. Comprehension of Question Lexical General vs Specific – Healthy and Fit
- 38. Comprehension of Question Semantic – Floor lamp example
- 39. Comprehension of Question Pragmatic – Can you pass the salt? Not at all successful Extremely successful -5 +5
- 40. Comprehension of Question Pragmatic – Can you pass the salt? Not at all successful Extremely successful 0 10
- 41. Retrieval of Information Episodic Memory Semantic Memory Forgetting - inference & Decay Retrieval Cues Encoding Matching context of their recall – Divers – Imagine the context.
- 42. Judgement and Estimation Availability Heuristic – can not recall so must be rare (e.g. Words with first R or third letter R. Famous male and female names) Frequency estimation – Every 8 weeks so 6 times a year. I do this a lot so 10 times a year.
- 43. Reporting the answer Mapping and Reporting Stage May not be expressed precisely. Lack of response option – Transformation. Primacy, recency effect. Order and positioning.
- 44. Introduction Steps taken in Designing Tools Variance & Bias Standardized Interviewing Concept Specification Response Process Questions & Conclusion
- 45. No survey can achieve success without a well-designed questionnaire. Fortunately, questionnaire design is gaining more focus to guide researchers in developing a flawless questionnaire. Data collected through a well designed questionnaires are less likely to suffer from interviewer and respondent bias.
- 47. References • Google images. Available at: https://www.google.com.ng/imghp • Monitoring the Future about Drug Abuse (2005) Grade 12, Form 1. • British Crime Survey 2002 – https://www.data-archive.ac.uk/ • Foddy, W. H. (1994). Constructing questions for interviews and questionnaires: Theory and practice in social research (New ed.). Cambridge, UK: Cambridge University Press. • Gillham, B. (2008). Developing a questionnaire (2nd ed.). London, UK: Continuum International Publishing Group Ltd. • University of Michigan. Questionnaire Design for Social Surveys. Video Series • Suchman and Jordan (1990) Conversational Interviewing.