T6 questionnaire


Published on

Published in: Spiritual, Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Vorteile: Nicht direktiv : Befragte werden nicht in eine Richtung gedrängt Zur Hypothesen-Generierung : wenn mehrere Menschen ähnliche (unerwartete) Antworten haben, allgemeine Tendenz? Abfrage von Wissen oder Einstellungen Detaillierte, auch unerwartete Antworten möglich Erforscht, wie Menschen über ein Problem sprechen: sprachlich Nachteile: Antwort Interviewer-abhängig: Interviewer schreibt nicht alles genau so hin sondern interpretiert auch hinein Zeit- und arbeitsintensiv: Lange Antworten, Redefluss, aber auch Auswertung Kodierprobleme Schwierig zu analysieren: welche Einteilungen wählen? Vergleiche zwischen Gruppen problematisch
  • T6 questionnaire

    1. 1. QuestionnaireBy Rama Krishna Kompella
    2. 2. OBJECTIVESTo understand:• Objectives of questionnaires• Advantages and disadvantages• Design of questionnaires• Type of questions used• Common problems and pitfalls
    3. 3. WHAT IS A QUESTIONNAIRE?• An instrument (form) to – collect answers to questions – collect factual data • gathers information or measures• A series of written questions/items in a fixed, rational order
    4. 4. WHY USING A QUESTIONNAIRE?A well designed questionnaire:• Gives accurate and relevant information to your research question• Minimizes potential sources of bias• Will more likely be completed⇒As simple and focused as possible
    5. 5. ADVANTAGES OF QUESTIONNAIRES• Can reach a large number of people relatively easily and economically• Provide quantifiable answers• Relatively easy to analyse
    6. 6. DISADVANTAGES OF QUESTIONNAIRES • Provides only limited insight into problem – Limited response allowed by questions – Maybe not the right questions are asked • Varying response – Misunderstanding/misinterpretation • Need to get it right first time – Hard to chase after missing data
    7. 7. TYPES OF QUESTIONNAIRE • Face to face • TelephoneInterviewer -administrated• By mail• E-mail/InternetSelf-administrated
    8. 8. SELF-ADMINISTERED QUESTIONNAIRE • Advantages: – Cheap and easy to administer – Preserves confidentiality – Completed at respondents convenience – No influence by interviewer
    9. 9. SELF-ADMINISTERED QUESTIONNAIRE • Disadvantages: – Low response rate – Questions can be misunderstood – No control by interviewer – Time and resouces loss
    10. 10. INTERVIEW-ADMINISTERED QUESTIONNAIRE• Advantages: – Participation by illiterate people – Clarification of ambiguity – Quick answers
    11. 11. INTERVIEW-ADMINISTERED QUESTIONNAIRE• Disadvantages: – Interviewer bias – Needs more resources – Only short questionnaires possible • Especially on telephone – Difficult for sensitive issues
    12. 12. Basic Survey ProcessSteps: 1. Deciding on a mechanism  Drawing a sample  Designing the questionnaire  Fielding a survey and collecting the data  Analysis  Reporting
    13. 13. STAGES IN DESIGNING A QUESTIONNAIRE (1)Planning the study:• Decide on goals – Identify risk factors for getting bitten by dogs• Know the subject – Literature, experts on dog bites• Formulate a hypothesis – Postmen more likely to get bitten by dogs than the normal population• Define information needed to test hypothesis – Occupation, owning dog, outdoor activities, attitude towards dogs
    14. 14. STAGES IN DESIGNING A QUESTIONNAIRE (2)Determine study population:• Know the respondents – Occupation – Special sensitivities – Education – Ethnic – Language⇒Questionnaire needs to be adapted to your population, not the opposite!
    15. 15. STAGES IN DESIGNING A QUESTIONNAIRE (3)Design questions: – Content of the questions – Format of the questions – Presentation and layout – Coding schedule (if appropriate)• Pilot and refine questionnaire
    16. 16. WHAT MAKES A WELL DESIGNED QUESTIONNAIRE?• Good appearance → easy on the eye• Short and simple• Relevant and logical⇒ High response rate⇒ Easy data summarisation and analysis
    17. 17. QUESTION ORDER• Decide on order of items/questions – Easy → difficult – General → particular – Factual → abstract• Where to place sensitive questions?Be aware of ordering effects!
    18. 18. QUESTION ORDER• Questions should be ordered so as to seem logical to the respondent• First questions should be relevant and easy• Questions are effectively ordered from most salient to least salient• Demographic questions should not be covered at the beginning• Potentially objectionable questions are placed near the end
    19. 19. QUESTION ORDER• Group questions by topic/ response options• Starting questions – Simple – With closed format – Relevant to main subject – Non-offending – Neither demographic nor personal questions• Don’t put most important item last
    20. 20. QUESTIONNAIRE INTRODUCTION• Survey/interview introduction – Who you are/ what is your thesis topic – Why you are investigating – Where you obtained the respondent’s name – How and where you can be contacted – Guarantee of confidentiality – Length of interview (be honest)⇒ Usefulness of study should be clear to all respondents
    21. 21. CONTENT OF QUESTIONS• Clear focus on research question – Avoid sidetracking – Avoid unnecessary information• Demographic information• Contact information (if non-anonymised)
    22. 22. DO:• Use simple wording• Be brief• Be specific
    23. 23. DO NOT:• Be vague• Be condescending or talk down to respondent• Use biased wording• Use abbreviations or scientific jargon• Use objectionable questions• Be redundant
    24. 24. FORMAT OF QUESTIONS• Adjust to responding audience – Professionals vs. public• Keep sentences simple and short• Define key words• Remember option “don’t know”
    25. 25. FORMAT OF QUESTIONS• Ask for one information at a time Do you own a car or frequently travelled in cars? Yes Y No N• Use mutually exclusive and exhaustive answer options• Vertical order of answer options
    26. 26. BE ACCURATEDo you often travel in cars?Yes YNo Nvs.How often did you travel in cars during thepast 3 months?OnceTwiceThree times or moreNot at all oDon´t know o
    27. 27. BE APPROPRIATEAre you a drunk?Yes YNo Nvs.How often have you consumed alcoholicbeverages during the past 6 months?Daily2-6 times/weekOnce a weekLess than once a week eDon´t know o
    28. 28. BE OBJECTIVEDid you drink the strange brownish drink in Prague?YesYNo NVs.Which beverage did you consume?WaterBeerWineKarkadé KNone of them NDon´t know D
    29. 29. BE SIMPLEDid you smoke not less than a mean amountof 7 cigarettes/2 days from 2009 onwards?Yes YNo Nvs.Did you smoke an average of 2 pack of cigarettes/week for the last 5 years?Yes YNo NDon´t know D
    30. 30. BIASBias = systematic differences in the measurement of a response
    31. 31. INFORMATION BIAS• Recall bias – Cases more likely to remember than controls• Observer bias – Different interviewer – different interpretations – Different interpretation of similar questions – Reduce by structured questionnaire
    32. 32. NON-RESPONSE BIAS• Those who respond are different from those who do not – Telephone interviews: more females, elderly• Reduce – Ensure high response rate – Random choice of interview partners – Correct during analysis (eg age, sex)
    33. 33. FORMAT OF QUESTIONSTwo main question formats• Closed format → forced choice Yes Always No Sometimes Don’t know Never• Open format → free text What is your most distressing symptom? Please describe: ________________________________________________ ________________________________________________
    34. 34. OPEN OR CLOSED?Closed• Advantages: – Simple and quick – Reduces discrimination against less literate – Easy to code, record, analyze – Easy to compare – Easy to report results
    35. 35. CLOSED QUESTIONS• Disadvantages: – Restricted number of possible answers – Loss of information• Possible compromise: – Insert field “others”
    36. 36. OPEN QUESTIONS• Advantages: – Not directive – Allows exploration of issues to generate hypothesis • qualitative research, focus groups, trawling questionnaires – Used even if no comprehensive range of alternative choices – Good for exploring knowledge and attitudes – Detailed and unexpected answers possible
    37. 37. OPEN QUESTIONS• Disadvantages: – Interviewer bias – Time-consuming – Coding problems – Difficult to analyze! – Difficult to compare groups
    38. 38. CLOSED QUESTIONS1. Straightforward response What is your age in years? ___ years How long have you owned a dog? ___ years What is your sex (gender)? Male Female Did you stay in Hotel X on 23/7/05? Yes No Don’t know
    39. 39. CLOSED QUESTIONS2. Checklist Which of the following outdoor activities did you do last week? • Running • Walking • Hiking • Cycling • Swimming
    40. 40. CLOSED QUESTIONS3. Rating scaleDid you do use sunscreen during the followingoutdoor activities during the past six months? Always Sometimes Seldomly Never Running Walking Cycling
    41. 41. CLOSED QUESTIONS4. Rating scale Numerical How useful would you think that information on the risk of biting from stray dogs would be? (please circle) 1 2 3 4 5 6 7 Not at all useful Very useful Analogue How much is your pain severe (put the tick on the line) 0 10
    42. 42. CLOSED QUESTIONS5. Scales for measuring attitude (Likert) Old cars have a high environmental impact No, I strongly disagree No, I disagree quite a lot No, I disagree just a little I’m not sure about this Yes, I agree just a little Yes, I agree quite a lot Yes, I strongly agree
    43. 43. PROBLEMS AND PITFALLS• Avoid questions that ask two things at once - you won’t know which ‘bit’ people are answering: Do you know driving and have you driven cars in the recent past?• Ambiguity..... Do you drive a lot?
    44. 44. PROBLEMS AND PITFALLS• Avoid jargon/abbreviations/slang What do you feel about 4Ps of Apple? Did you ever feel post-purchase dissonance?• Avoid not mutually exclusive options What age are you? 16-20 20-25 25-30 35-40
    45. 45. PROBLEMS AND PITFALLS• Avoid leading questions Do you think that the food in the hotel made you sick? Did the hotel staff seem unhygenic to you? Do you agree that the hospital staff were close to exhaustion?• Avoid making questionnaire too long• Typographical / spelling errors
    46. 46. PILOTING AND EVALUATION• Pilot with a similar group of people to your intended subjects• Highlights problems before starting – Effects of alternative wording – Overall impression on respondents and interviewers – Final polishing after several amendments
    47. 47. PRESENTATION AND LAYOUT• Clear consistent layout – Adequate space to answer – Large font size – Appropriate page breaks – Avoid • experimental layouts • fancy logos • printed on recycled paper/is an equal opportunity employer etc
    48. 48. PRESENTATION AND LAYOUT• Using colour or printing questionnaire on coloured paper may help• Use filter questions, if necessary• Give clear instructions about how to answer the questions
    49. 49. WAYS TO INCREASE PERCEIVED REWARD• Show positive regard• Say thank you• Ask them for “advice”• Give social validation• Give a tangible reward• Make the questionnaire interesting• State an upcoming deadline
    50. 50. WAYS TO DECREASE PERCEIVED COST• Avoid subordinating language• Do not embarrass the respondent• Do not inconvenience the respondent• Make questions appear short and easy• Avoid asking personal information (if it must be asked, use ‘soft’ wording and inform about confidentiality)• Keep subsequent requests similar
    51. 51. CREATE A NAVIGATIONAL PATH• Instructions should be placed right where they are needed• Matrices are confusing: it is best to order questions from top to bottom, and left to right• Use larger font to attract attention• Use color shading to attract attention or show groupings• Use spacing and similarities to show groupings
    52. 52. WAYS TO ESTABLISH TRUST• Provide a token of appreciation• Provide a sense of legitimate authority• Make completing the questionnaire seem important• Remind respondent of previous relationship with sponsor (if applicable)
    53. 53. SUMMARYA well designed questionnaire:• Will give appropriate data which allow to answer your research question• Will minimise potential sources of bias, thus increasing the validity of the questionnaire• Will much more likely be completed
    55. 55. Q & As