SlideShare a Scribd company logo
Survey Design Week 5 (3) Dr. Kelly Page Cardiff Business School E: pagekl@cardiff.ac.uk T: @drkellypage T: @caseinsights FB: kelly@caseinsights.com
Survey Research Use of a questionnaire to gather facts, opinions and attitudes Cross-sectional and/or longitudinal Individuals NOT groups (e.g., stakeholders) Objectives General  (e.g.,  describe situation ;  facts ;  find opinions ;  explore underlying reasons ) Identify  sample  characteristics Measure   many differing characteristics and/or constructs Advantages:  Quick ,  cheap  &  efficient but…   a poor survey is worse than no survey at all
What do Surveys Measure? Characteristics of People Behaviours: actions that are observable by others (e.g., product usage) Demographics: Characteristics that are directly observable and directly verifiable (e.g., gender) Sociographics: Social characteristics (e.g., income) Geographics: Geographic characteristics (e.g., place of birth, residence) Mindsets of People Beliefs, emotions, behavioural intent (i.e, attitudes)  Perceptions (e.g., ease of use) Preferences of People Wants and/or needs (i.e., motivations) Specific Constructs: Satisfaction, confidence, knowledge etc
Survey Methods  (1) Personal Door-to-door interviews Executive Interviews Intercept Surveys Mall-intercept Interviews Telephone Interviews Central location telephone interviews Computer-assisted telephone interviews (CATI) Completely automated telephone surveys (CATS) using IVR technology
Surveys Methods  (2) Self-administered Completed by participants with no assistance from an interviewer (e.g., in-class) Mail (postal) surveys Ad-hoc or one-shot mail surveys sent without prior contact from researcher Mail panels: pre-contacted and pre-screened participants who are periodically sent questionnaires  Internet Surveys Email questionnaires Web survey Bulletin Boards Downloadable
Internet Surveys ADVANTAGES Fast to deploy & report Inexpensive (reduced costs) Easier to manage A utomated error reduction I nterface error reduction I nterviewer influence  reduced Personalisation High response rates Hard-to-reach respondents DISADVANTAGES Lack of  probability sample :  no list of users exists!  (e.g., email addresses) C are  needed  in interpreting the results S elf-selection bias Respondent  authenticity Unrestricted D u plicate  responses Security
Determining Survey Method  (1) Sampling precision Required level of sampling precision is important E.g., low = convenience sample = self-admin in-class E.g., high = random sample = central located telephone Budget For example: Budget = £10,000; sample size required = 1000 Cost of mall-intercept = £27.50 per interview = £27,500 Cost of  internet survey = £0.50 per survey = £500 Requirements for participant reactions (e.g., taste test). Quality of data (e.g., validity & reliability)
Determining Survey Method  (2) Length of Questionnaire Affects response rates (non-response error) and response error Incidence rate % of people in general population that fit the characteristics to be sampled Need to consider search costs to locate the people required e.g., door-to-door interviewing very expensive for low-incidence Structure of Questionnaire Structured = closed questions, sequence = mail, self-administered, telephone Unstructured = open questions = face-to-face interviewing  Scheduled time available
Errors in Survey Research Random Error (i.e., random sampling error) Error that results from chance variation Chance variation: difference between sample value & true value of population mean Can be reduce by increasing the sample size Systematic Error (i.e., non-sampling error) Results from mistakes or problems in execution of the research design Sample design & measurement error
METHOD COMPARATOR Personal Intercept Telephone Postal Internet Highest  flexibility in collecting data Best Best Ok Worst Ok Maximum  diversity of questions Best Best Worst Worst Ok Best  use of physical stimuli Best Best Worst Worst Good Effective  sample control Best Best Good Worst Worst Controlling data collection environment Best Best Ok Worst Worst Restricting field interviewer effects Worst Worst Ok Best Best Maximising quantity of data Best Ok Worst Worst Ok Highest response rate Best Best Ok Worst Best Protecting respondent anonymity Worst Worst Ok Best Best Avoiding socially desirable answers Worst Worst Best Best Ok Keeping costs low Worst Ok Good Best Best Probing questions Best Best Worst Worst Ok Fast results Ok Ok Best Worst Best Building rapport with respondents Best Ok Ok Worst Worst
Discussion Questions Which survey method would you select for the following and why? Highly personal & controversial questions A survey that needs to completed quickly Boring questions It would be difficult to find the respondent at home A survey of a particular organisation Finances are very limited Questionnaire is difficult to follow Questionnaire is relatively long A high response rate is important
Questionnaire Design Week 5 (3) Dr. Kelly Page Cardiff Business School E: pagekl@cardiff.ac.uk T: @drkellypage T: @caseinsights FB: kelly@caseinsights.com
Questionnaires Questionnaire A set of questions/items designed to generate the data necessary to accomplish the objectives of the research project  (i.e., survey instrument) Formalised schedule for for collecting information from participants Standardises the wording and sequencing of questions Imposes uniformity on data-gathering process (e.g., reliability, reduces error) Facilitate data processing Improper design = Inaccurate data & information Higher costs Poor decision making GOOD QUESTIONNAIRE DESIGN IS IMPERATIVE FOR GOOD DATA
Questionnaire Design Process See ‘survey data collection methods’ in previous lecture notes
3) Question / Item Design Measurement  The process of assigning numbers or labels to person’s, objects, or events in accordance with specific rules for representing quantities and qualities of attributes  e.g., Biological Sex: 0 = Males, 1 = Female Levels of Measurement Nominal  (a) Ordinal  (b) Interval Ratio b)  How frequently do you use the Internet?    Once a month  1   Twice a month  2   Once a week  3   Twice a week  4 a)  Please indicate your gender?    Male  0   Female  1
Question Response Format  (1) Open-ended questions participant responds in own words open response option  (a) Close-ended questions participants required to choose from a pre-determined list of answers Dichotomous  (b) Multichotomous  c) Partially open-ended  (d) a)  Why is brand X better? b)  Have you used the Internet today?    Yes    No c)  Which best represents your age? a) Under 17  d) 36-50 b) 18-25  e) 51-65 c) 26-35  f) 66+ d)  What is your preferred brand of car?    BMW  Mercedes  Ford  Other  (please specify)  ________________
Question Response Format  (2) Scale-response questions Close-ended questions in which the response choices are designed to capture  intensity of participants feelings   Measure subjective and abstract concepts  e.g., brand loyalty, satisfaction Unidimensional = measure only one attribute of a concept e.g., 10-items = perceived ease of web use Multidimensional = measure several dimensions of a concept e.g., 10-items = perceived ease of web use for a) finding information; b) communicating; c) conducting transactions etc.
Types Measurement Scales  (1) Graphic Rating Scales  Graphic continuum anchored by extremes  Participants asked to mark on continuum  Continuous  interval  level of measurement Itemized Rating Scales  Selection from limited number of ordered categories  Ordinal  scaled Rank order scale Comparative scales as compare two or more items and rank each item e.g., please rank the brands listed where 1 = most preferred and 5 = least preferred (BMW, Mercedes, Ford etc) Ordinal  scaled
Types Measurement Scales  (2) Paired Comparisons Pick one of two objects from a set, based on some stated criteria Easier to select, than rank (as in rank-order scales) Order bias is overcome (e.g., order of brands/criteria) No. of criteria should remain small a)  Please tell me which characteristics in each pair is ‘more important’ to you when selecting a sun care product. a) Tans evenly b) Tans without burning a) Prevents burning b) Protects against burning & tanning a) Good value for money b) Goes on evenly a) Not Greasy b) Does not stain clothing
Types Measurement Scales  (3) Constant Sum Scales Ask participants to divide a given number of points (e.g., 100) among two or more attributes, based on importance to him/her No. of points = ranking assigned =  Ordinal  scaled Advantages: If two items perceived equal importance, can be assigned equal values a)  Please allocate 100 points among the characteristics of sports clothing below such that allocation = importance. The more points allocated = the more important. All points should add up to 100. Is comfortable to wear   _______ Is durable   _______ Is made by a well-known brand _______ Is made in UK    _______   100 pts
Types Measurement Scales  (4) Semantic Differential Scales Examines strengths & weaknesses of a product/company image by having participant rank it between dichotomous pairs of words/phrases (1-7) Means of responses are then plotted as a profile Interpretation of rating of 4 = neutral, or unable to relate to anchor Ordinal  scaled Modern 1  2 3  4 5  6 7  Old-fashioned  Aggressive 1  2 3  4 5  6 7  Defensive Friendly 1  2 3  4 5  6 7  Unfriendly  Reliable 1  2 3  4 5  6 7  Unreliable Helpful 1  2 3  4 5  6 7  Unhelpful  Successful 1  2 3  4 5  6 7  Unsuccessful
Types Measurement Scales  (5) Likert Scales Series of statements expressing either a favourable or unfavourable attitudes toward the concept under investigation Participants indicate level of agreement Scores are summated to equal respondents attitudes on item, dimension and/or scale Interval  scaled   SD   Neutral  SA The registration was simple    1  2 3  4 5  6 7  Registration did not take long to complete 1  2 3  4 5  6 7  The registration informed me about the site 1  2 3  4 5  6 7  Registration was non-threatening   1  2 3  4 5  6 7
4. Question Wording  (1) Objectionable questions  How old are you? ________________  (WRONG) Please indicate your age:  (RIGHT) Bias in more than one direction Are you against same sex marriage and in favour of legislation to ban it?  (WRONG) What is your view of same sex marriage?  (RIGHT) Emotionally charged words Was the government negligent by ignoring the views of the people whom were opposed to the war in Iraq?  (WRONG)   Given the views expressed against the ware in Iraq, what should have the government done?  (RIGHT)
4. Question Wording  (2) Threats to self-esteem How often have you driven home drunk  (WRONG) Have you ever driven a vehicles after you have had too much to drink  (RIGHT) Personalisation Dear Kelly Page … How would you rate …..  (WRONG) Dear valued customer …. How would you rate …..  (RIGHT) Make sure the wording is clear Consider respondents willingness & ability to answer
5. Questionnaire Flow & Layout Screening questions: Use to identify appropriate respondents Questions to gain interest (Warm-ups): Easy to answer questions General Questions:  e.g., behavioural question about purchase/usage Difficult & Complicated questions:  e.g, attitudes, rankings etc Position sensitive, threatening, and demographic questions at the end  e.g., age, income etc Distinguish instructions  e.g., capitals, italics Insert  prompters  at strategic points throughout
 
6-10. Design Process Evaluate questionnaire Are all questions necessary Is questionnaire too long Will the questions provide insight required Is it well-layout & easy to follow Are the instructions clear Consider data processing & coding Obtain Approvals Pre-test & Revise Prepare final copy Implement survey Field instructions & call/contact sheets for management
Other t h ings  to avoid … Question bias Complex questions Unspecific questions Jargon, shorthand Sophisticated/uncommon words Negative questions Hypothetical questions Potential ambiguity Over-tight banding Overlapping responses Not allowing for ‘other’  or ‘don’t know’  responses
The content of this work is of shared interest between the author, Kelly Page and other parties who have contributed and/or provided support for the generation of the content detailed within.  This work is licensed under a Creative Commons  Attribution-NonCommercial-Share Alike 2.0 UK: England & Wales.  http://creativecommons.org/ Kelly Page (cc)

More Related Content

What's hot

Marketing Research Ch4
Marketing Research Ch4 Marketing Research Ch4
Marketing Research Ch4
kkjjkevin03
 
Qualitative Vs Quantitative Research
Qualitative Vs Quantitative ResearchQualitative Vs Quantitative Research
Qualitative Vs Quantitative Research
Sam Ladner
 
Research design
Research designResearch design
Research design
Ekta Chauhan
 
PRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENT
PRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENTPRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENT
PRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENT
ABHISHEK YALAL
 
Questionaire design
Questionaire designQuestionaire design
Questionaire design
Manoj Subedi
 
RESEARCH DESIGN
RESEARCH DESIGNRESEARCH DESIGN
RESEARCH DESIGN
Vishnu Sanker
 
Survey analysis
Survey analysisSurvey analysis
Survey analysis
Rukman Manapurath
 
Sampling Methods in Qualitative and Quantitative Research
Sampling Methods in Qualitative and Quantitative ResearchSampling Methods in Qualitative and Quantitative Research
Sampling Methods in Qualitative and Quantitative Research
Sam Ladner
 
Questionnaires 6 steps for research method.
Questionnaires 6 steps for research method.Questionnaires 6 steps for research method.
Questionnaires 6 steps for research method.
Namo Kim
 
Quantitative, qualitative, and mixed method approaches
Quantitative, qualitative, and mixed method approachesQuantitative, qualitative, and mixed method approaches
Quantitative, qualitative, and mixed method approaches
muryantinarima
 
Chapter 8 Marketing Research Malhotra
Chapter 8 Marketing Research MalhotraChapter 8 Marketing Research Malhotra
Chapter 8 Marketing Research Malhotra
AADITYA TANTIA
 
Case Study Research Methods
Case Study Research MethodsCase Study Research Methods
Case Study Research Methods
University of Roehampton
 
Q sort
Q sortQ sort
Q sort
Bhuvana Rao
 
Research Proposal Presentation
Research Proposal PresentationResearch Proposal Presentation
Research Proposal Presentation
Val MacMillan
 
Research design
Research designResearch design
Research design
Komal Patel
 
Lesson 19 choosing an appropriate research design
Lesson 19  choosing an appropriate research designLesson 19  choosing an appropriate research design
Lesson 19 choosing an appropriate research design
mjlobetos
 
Chapter 1 Marketing Research Malhotra
Chapter 1 Marketing Research MalhotraChapter 1 Marketing Research Malhotra
Chapter 1 Marketing Research Malhotra
AADITYA TANTIA
 
Descriptive research design
Descriptive research designDescriptive research design
Descriptive research design
biswajitu
 
Qualitative Research Methods
Qualitative Research MethodsQualitative Research Methods
Qualitative Research Methods
Jukka Peltokoski
 
Sampling & surveying ppt
Sampling & surveying pptSampling & surveying ppt
Sampling & surveying ppt
ivisdude82
 

What's hot (20)

Marketing Research Ch4
Marketing Research Ch4 Marketing Research Ch4
Marketing Research Ch4
 
Qualitative Vs Quantitative Research
Qualitative Vs Quantitative ResearchQualitative Vs Quantitative Research
Qualitative Vs Quantitative Research
 
Research design
Research designResearch design
Research design
 
PRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENT
PRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENTPRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENT
PRESENTATION ON QUESTIONNAIRE DESIGN AND DEVELOPMENT
 
Questionaire design
Questionaire designQuestionaire design
Questionaire design
 
RESEARCH DESIGN
RESEARCH DESIGNRESEARCH DESIGN
RESEARCH DESIGN
 
Survey analysis
Survey analysisSurvey analysis
Survey analysis
 
Sampling Methods in Qualitative and Quantitative Research
Sampling Methods in Qualitative and Quantitative ResearchSampling Methods in Qualitative and Quantitative Research
Sampling Methods in Qualitative and Quantitative Research
 
Questionnaires 6 steps for research method.
Questionnaires 6 steps for research method.Questionnaires 6 steps for research method.
Questionnaires 6 steps for research method.
 
Quantitative, qualitative, and mixed method approaches
Quantitative, qualitative, and mixed method approachesQuantitative, qualitative, and mixed method approaches
Quantitative, qualitative, and mixed method approaches
 
Chapter 8 Marketing Research Malhotra
Chapter 8 Marketing Research MalhotraChapter 8 Marketing Research Malhotra
Chapter 8 Marketing Research Malhotra
 
Case Study Research Methods
Case Study Research MethodsCase Study Research Methods
Case Study Research Methods
 
Q sort
Q sortQ sort
Q sort
 
Research Proposal Presentation
Research Proposal PresentationResearch Proposal Presentation
Research Proposal Presentation
 
Research design
Research designResearch design
Research design
 
Lesson 19 choosing an appropriate research design
Lesson 19  choosing an appropriate research designLesson 19  choosing an appropriate research design
Lesson 19 choosing an appropriate research design
 
Chapter 1 Marketing Research Malhotra
Chapter 1 Marketing Research MalhotraChapter 1 Marketing Research Malhotra
Chapter 1 Marketing Research Malhotra
 
Descriptive research design
Descriptive research designDescriptive research design
Descriptive research design
 
Qualitative Research Methods
Qualitative Research MethodsQualitative Research Methods
Qualitative Research Methods
 
Sampling & surveying ppt
Sampling & surveying pptSampling & surveying ppt
Sampling & surveying ppt
 

Viewers also liked

Marketing Research Ch3
Marketing Research Ch3 Marketing Research Ch3
Marketing Research Ch3
kkjjkevin03
 
pratik meshram Unit 2 contemporary marketing research full notes pune univers...
pratik meshram Unit 2 contemporary marketing research full notes pune univers...pratik meshram Unit 2 contemporary marketing research full notes pune univers...
pratik meshram Unit 2 contemporary marketing research full notes pune univers...
Pratik Meshram
 
Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...
Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...
Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...
Aneesh Porwal
 
Report writing
Report writingReport writing
Report writing
Samuel Maniraj
 
“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...
“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...
“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...
Akash Dhainje
 
Marketing Research Methods
Marketing Research MethodsMarketing Research Methods
Marketing Research Methods
Hugo Guyader
 
1 copy of research design
1 copy of research design1 copy of research design
1 copy of research design
Vinay Jeengar
 
3 marketing research
3 marketing research3 marketing research
3 marketing research
rrhhoohhii
 
Data Collection Methods - Nursing Research
Data Collection Methods -  Nursing ResearchData Collection Methods -  Nursing Research
Data Collection Methods - Nursing Research
anand l
 
Methods of data collection
Methods of data collectionMethods of data collection
Methods of data collection
Binty Agarwal
 
Market research notes
Market research notesMarket research notes
Market research notes
Dr. Durgaprasad Navulla
 
Collecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And InterviewsCollecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And Interviews
Amanda Walker
 
Sampling in Market Research
Sampling in Market ResearchSampling in Market Research
Sampling in Market Research
Pawandeep Singh Maniktala
 
Seafood marketing research design
Seafood marketing research designSeafood marketing research design
Seafood marketing research design
Philippos Papageorgiou
 
Marketing research process
Marketing research processMarketing research process
Marketing research process
sunil kumar
 
Errors in research
Errors in researchErrors in research
Errors in research
Abinesh Raja M
 
Format of research report
Format of research reportFormat of research report
Format of research report
Ram Doss
 
Primary vs. secondary research ig
Primary vs. secondary research igPrimary vs. secondary research ig
Primary vs. secondary research ig
George Panther
 
Marketing research project on nike shoes
Marketing research project on nike shoesMarketing research project on nike shoes
Marketing research project on nike shoes
Rohit Kumar
 
Questionnaire
QuestionnaireQuestionnaire
Questionnaire
subairibrahim
 

Viewers also liked (20)

Marketing Research Ch3
Marketing Research Ch3 Marketing Research Ch3
Marketing Research Ch3
 
pratik meshram Unit 2 contemporary marketing research full notes pune univers...
pratik meshram Unit 2 contemporary marketing research full notes pune univers...pratik meshram Unit 2 contemporary marketing research full notes pune univers...
pratik meshram Unit 2 contemporary marketing research full notes pune univers...
 
Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...
Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...
Report in Word Format on MARKETING OF TRADE FAIR FOR CONSUMER DURABLES TO COR...
 
Report writing
Report writingReport writing
Report writing
 
“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...
“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...
“MARKET RESEARCH ON ADVERTISING AND BRAND IMAGE OF CONSUMER ELECTRONIC COMPAN...
 
Marketing Research Methods
Marketing Research MethodsMarketing Research Methods
Marketing Research Methods
 
1 copy of research design
1 copy of research design1 copy of research design
1 copy of research design
 
3 marketing research
3 marketing research3 marketing research
3 marketing research
 
Data Collection Methods - Nursing Research
Data Collection Methods -  Nursing ResearchData Collection Methods -  Nursing Research
Data Collection Methods - Nursing Research
 
Methods of data collection
Methods of data collectionMethods of data collection
Methods of data collection
 
Market research notes
Market research notesMarket research notes
Market research notes
 
Collecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And InterviewsCollecting Research Data With Questionnaires And Interviews
Collecting Research Data With Questionnaires And Interviews
 
Sampling in Market Research
Sampling in Market ResearchSampling in Market Research
Sampling in Market Research
 
Seafood marketing research design
Seafood marketing research designSeafood marketing research design
Seafood marketing research design
 
Marketing research process
Marketing research processMarketing research process
Marketing research process
 
Errors in research
Errors in researchErrors in research
Errors in research
 
Format of research report
Format of research reportFormat of research report
Format of research report
 
Primary vs. secondary research ig
Primary vs. secondary research igPrimary vs. secondary research ig
Primary vs. secondary research ig
 
Marketing research project on nike shoes
Marketing research project on nike shoesMarketing research project on nike shoes
Marketing research project on nike shoes
 
Questionnaire
QuestionnaireQuestionnaire
Questionnaire
 

Similar to Survey & Questionnaire Design in Applied Marketing Research

Needs Assessment and Program Planning
Needs Assessment and Program PlanningNeeds Assessment and Program Planning
Needs Assessment and Program Planning
Lynda Milne
 
Survey design workshop
Survey design workshopSurvey design workshop
Survey design workshop
James Neill
 
problem
problemproblem
problem
Mad Monk
 
Chapters 7 8
Chapters 7 8Chapters 7 8
Chapters 7 8
EDUCAUSE
 
Research Design
Research DesignResearch Design
Research Design
godara1986
 
Research and advocacy by Seetal Daas
Research and advocacy by Seetal DaasResearch and advocacy by Seetal Daas
Research and advocacy by Seetal Daas
Seetal Daas
 
Research methodology - Collection of Data
Research methodology - Collection of DataResearch methodology - Collection of Data
Research methodology - Collection of Data
The Stockker
 
Survey Design: Introduction & Overview
Survey Design: Introduction & OverviewSurvey Design: Introduction & Overview
Survey Design: Introduction & Overview
James Neill
 
SOC2002 Lecture 5
SOC2002 Lecture 5SOC2002 Lecture 5
SOC2002 Lecture 5
Bonnie Green
 
Data Analysis
Data AnalysisData Analysis
Data Analysis
Clive McGoun
 
Research CHap 4
Research CHap 4Research CHap 4
Research CHap 4
Shoaib Mansoor
 
Survey research
Survey researchSurvey research
Survey research
Punjab University Lahore
 
Design and Development of Questionnaire
Design and Development of Questionnaire Design and Development of Questionnaire
Design and Development of Questionnaire
Kaja Bantha Navas Raja Mohamed
 
Research methods - qual or quant
Research methods - qual or quantResearch methods - qual or quant
Research methods - qual or quant
Tracy Harwood
 
Questionnaires
QuestionnairesQuestionnaires
Questionnaires
Anamika Sonawane
 
Questionnaire Vinay
Questionnaire VinayQuestionnaire Vinay
Questionnaire Vinay
nibraspk
 
Questionnaire2002
Questionnaire2002Questionnaire2002
Questionnaire2002
wardah azhar
 
QuestionPro Audience Webinar - How to Improve Data Quality For Your Research
QuestionPro Audience Webinar - How to Improve Data Quality For Your ResearchQuestionPro Audience Webinar - How to Improve Data Quality For Your Research
QuestionPro Audience Webinar - How to Improve Data Quality For Your Research
QuestionPro
 
power
powerpower
Questionnaire PPT.pptx
Questionnaire PPT.pptxQuestionnaire PPT.pptx
Questionnaire PPT.pptx
Rakshanda Dhanda
 

Similar to Survey & Questionnaire Design in Applied Marketing Research (20)

Needs Assessment and Program Planning
Needs Assessment and Program PlanningNeeds Assessment and Program Planning
Needs Assessment and Program Planning
 
Survey design workshop
Survey design workshopSurvey design workshop
Survey design workshop
 
problem
problemproblem
problem
 
Chapters 7 8
Chapters 7 8Chapters 7 8
Chapters 7 8
 
Research Design
Research DesignResearch Design
Research Design
 
Research and advocacy by Seetal Daas
Research and advocacy by Seetal DaasResearch and advocacy by Seetal Daas
Research and advocacy by Seetal Daas
 
Research methodology - Collection of Data
Research methodology - Collection of DataResearch methodology - Collection of Data
Research methodology - Collection of Data
 
Survey Design: Introduction & Overview
Survey Design: Introduction & OverviewSurvey Design: Introduction & Overview
Survey Design: Introduction & Overview
 
SOC2002 Lecture 5
SOC2002 Lecture 5SOC2002 Lecture 5
SOC2002 Lecture 5
 
Data Analysis
Data AnalysisData Analysis
Data Analysis
 
Research CHap 4
Research CHap 4Research CHap 4
Research CHap 4
 
Survey research
Survey researchSurvey research
Survey research
 
Design and Development of Questionnaire
Design and Development of Questionnaire Design and Development of Questionnaire
Design and Development of Questionnaire
 
Research methods - qual or quant
Research methods - qual or quantResearch methods - qual or quant
Research methods - qual or quant
 
Questionnaires
QuestionnairesQuestionnaires
Questionnaires
 
Questionnaire Vinay
Questionnaire VinayQuestionnaire Vinay
Questionnaire Vinay
 
Questionnaire2002
Questionnaire2002Questionnaire2002
Questionnaire2002
 
QuestionPro Audience Webinar - How to Improve Data Quality For Your Research
QuestionPro Audience Webinar - How to Improve Data Quality For Your ResearchQuestionPro Audience Webinar - How to Improve Data Quality For Your Research
QuestionPro Audience Webinar - How to Improve Data Quality For Your Research
 
power
powerpower
power
 
Questionnaire PPT.pptx
Questionnaire PPT.pptxQuestionnaire PPT.pptx
Questionnaire PPT.pptx
 

More from Kelly Page

Designing for Evaluation
Designing for EvaluationDesigning for Evaluation
Designing for Evaluation
Kelly Page
 
Designing for Search
Designing for SearchDesigning for Search
Designing for Search
Kelly Page
 
Designing for Mobility
Designing for MobilityDesigning for Mobility
Designing for Mobility
Kelly Page
 
Socially Mediated Fundraising
Socially Mediated FundraisingSocially Mediated Fundraising
Socially Mediated Fundraising
Kelly Page
 
Creative Consumers
Creative ConsumersCreative Consumers
Creative Consumers
Kelly Page
 
Community, networks and audience design
Community, networks and audience designCommunity, networks and audience design
Community, networks and audience design
Kelly Page
 
2.3 Creative Consumers
2.3 Creative Consumers2.3 Creative Consumers
2.3 Creative Consumers
Kelly Page
 
2.2 Community Design
2.2 Community Design2.2 Community Design
2.2 Community Design
Kelly Page
 
1.6 Social Content Design
1.6 Social Content Design1.6 Social Content Design
1.6 Social Content Design
Kelly Page
 
1.4 Class Social Practices
1.4 Class Social Practices1.4 Class Social Practices
1.4 Class Social Practices
Kelly Page
 
1.2 Social Business Design
1.2 Social Business Design1.2 Social Business Design
1.2 Social Business Design
Kelly Page
 
1.1 Social Design Thinking
1.1 Social Design Thinking1.1 Social Design Thinking
1.1 Social Design Thinking
Kelly Page
 
The Art of Social Music
The Art of Social MusicThe Art of Social Music
The Art of Social Music
Kelly Page
 
Developing a Social Media Strategy
Developing a Social Media StrategyDeveloping a Social Media Strategy
Developing a Social Media Strategy
Kelly Page
 
Ticketing & Pricing in the Arts & Entertainment
Ticketing & Pricing in the Arts & EntertainmentTicketing & Pricing in the Arts & Entertainment
Ticketing & Pricing in the Arts & Entertainment
Kelly Page
 
Developing Audience Insight: Arts and Entertainment Experience (Un)marketing
Developing Audience Insight: Arts and Entertainment Experience (Un)marketingDeveloping Audience Insight: Arts and Entertainment Experience (Un)marketing
Developing Audience Insight: Arts and Entertainment Experience (Un)marketing
Kelly Page
 
Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...
Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...
Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...
Kelly Page
 
The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...
The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...
The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...
Kelly Page
 
The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...
The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...
The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...
Kelly Page
 
Our Experience Culture: Arts and Entertainment Experience (Un)marketing
Our Experience Culture: Arts and Entertainment Experience (Un)marketingOur Experience Culture: Arts and Entertainment Experience (Un)marketing
Our Experience Culture: Arts and Entertainment Experience (Un)marketing
Kelly Page
 

More from Kelly Page (20)

Designing for Evaluation
Designing for EvaluationDesigning for Evaluation
Designing for Evaluation
 
Designing for Search
Designing for SearchDesigning for Search
Designing for Search
 
Designing for Mobility
Designing for MobilityDesigning for Mobility
Designing for Mobility
 
Socially Mediated Fundraising
Socially Mediated FundraisingSocially Mediated Fundraising
Socially Mediated Fundraising
 
Creative Consumers
Creative ConsumersCreative Consumers
Creative Consumers
 
Community, networks and audience design
Community, networks and audience designCommunity, networks and audience design
Community, networks and audience design
 
2.3 Creative Consumers
2.3 Creative Consumers2.3 Creative Consumers
2.3 Creative Consumers
 
2.2 Community Design
2.2 Community Design2.2 Community Design
2.2 Community Design
 
1.6 Social Content Design
1.6 Social Content Design1.6 Social Content Design
1.6 Social Content Design
 
1.4 Class Social Practices
1.4 Class Social Practices1.4 Class Social Practices
1.4 Class Social Practices
 
1.2 Social Business Design
1.2 Social Business Design1.2 Social Business Design
1.2 Social Business Design
 
1.1 Social Design Thinking
1.1 Social Design Thinking1.1 Social Design Thinking
1.1 Social Design Thinking
 
The Art of Social Music
The Art of Social MusicThe Art of Social Music
The Art of Social Music
 
Developing a Social Media Strategy
Developing a Social Media StrategyDeveloping a Social Media Strategy
Developing a Social Media Strategy
 
Ticketing & Pricing in the Arts & Entertainment
Ticketing & Pricing in the Arts & EntertainmentTicketing & Pricing in the Arts & Entertainment
Ticketing & Pricing in the Arts & Entertainment
 
Developing Audience Insight: Arts and Entertainment Experience (Un)marketing
Developing Audience Insight: Arts and Entertainment Experience (Un)marketingDeveloping Audience Insight: Arts and Entertainment Experience (Un)marketing
Developing Audience Insight: Arts and Entertainment Experience (Un)marketing
 
Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...
Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...
Understanding Audiences & Communities: Arts and Entertainment Experience (Un)...
 
The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...
The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...
The Experience of Place and Space: Arts and Entertainment Experience (Un)mark...
 
The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...
The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...
The Artist/Art as a Branding Experience: Arts and Entertainment Experience (U...
 
Our Experience Culture: Arts and Entertainment Experience (Un)marketing
Our Experience Culture: Arts and Entertainment Experience (Un)marketingOur Experience Culture: Arts and Entertainment Experience (Un)marketing
Our Experience Culture: Arts and Entertainment Experience (Un)marketing
 

Recently uploaded

21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf
21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf
21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf
emmanuelpulido003
 
Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...
Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...
Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...
Aggregage
 
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
dimplekumaridk322
 
WAM Corporate Presentation July 2024.pdf
WAM Corporate Presentation July 2024.pdfWAM Corporate Presentation July 2024.pdf
WAM Corporate Presentation July 2024.pdf
Western Alaska Minerals Corp.
 
foodgasm restaurant and Bar pune road.docx
foodgasm restaurant and Bar pune road.docxfoodgasm restaurant and Bar pune road.docx
foodgasm restaurant and Bar pune road.docx
PraghyaBhandari
 
STEPIC Innovations 2026 futurism publications
STEPIC Innovations 2026 futurism publicationsSTEPIC Innovations 2026 futurism publications
STEPIC Innovations 2026 futurism publications
mcynthus
 
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
itnewsafrica
 
You Get Me! Leveraging Communication Styles in Virtual Trainingpptx
You Get Me! Leveraging Communication Styles in Virtual TrainingpptxYou Get Me! Leveraging Communication Styles in Virtual Trainingpptx
You Get Me! Leveraging Communication Styles in Virtual Trainingpptx
Cynthia Clay
 
AI at Work​ The demystification of AI and real-world stories on how to apply ...
AI at Work​ The demystification of AI and real-world stories on how to apply ...AI at Work​ The demystification of AI and real-world stories on how to apply ...
AI at Work​ The demystification of AI and real-world stories on how to apply ...
Auxis Consulting & Outsourcing
 
شركات إبراهيم العرجاني: لدعم الاقتصاد المصري
شركات إبراهيم العرجاني: لدعم الاقتصاد المصريشركات إبراهيم العرجاني: لدعم الاقتصاد المصري
شركات إبراهيم العرجاني: لدعم الاقتصاد المصري
إبراهيم العرجاني
 
Connected Small Boat Protection Solution | July 2024
Connected Small Boat Protection Solution | July  2024Connected Small Boat Protection Solution | July  2024
Connected Small Boat Protection Solution | July 2024
Hector Del Castillo, CPM, CPMM
 
Girls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in City
Girls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in CityGirls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in City
Girls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in City
maigasapphire
 
Top Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdfTop Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdf
Top IT Marketing
 
Cracking the Customer Experience Code.pptx
Cracking the Customer Experience Code.pptxCracking the Customer Experience Code.pptx
Cracking the Customer Experience Code.pptx
Workforce Group
 
Mandated reporting powerpoint to help with understanding your role
Mandated reporting powerpoint to help with understanding your roleMandated reporting powerpoint to help with understanding your role
Mandated reporting powerpoint to help with understanding your role
khidalgo2
 
Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...
Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...
Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...
Philip M Caputo
 
The-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptx
The-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptxThe-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptx
The-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptx
Jindal Global University, Sonipat Haryana 131001
 
A Complete Guide of Dubai Freelance Visa and Permit in 2024
A Complete Guide of Dubai Freelance Visa and Permit in 2024A Complete Guide of Dubai Freelance Visa and Permit in 2024
A Complete Guide of Dubai Freelance Visa and Permit in 2024
Dubiz
 
Corporate Governance for South African Mining Companies
Corporate Governance for South African Mining CompaniesCorporate Governance for South African Mining Companies
Corporate Governance for South African Mining Companies
James AH Campbell
 
Test Bank For Principles Of Cost Accounting, 17th Edition Edward J. Vander...
Test Bank For Principles Of Cost Accounting, 	  17th Edition Edward J. Vander...Test Bank For Principles Of Cost Accounting, 	  17th Edition Edward J. Vander...
Test Bank For Principles Of Cost Accounting, 17th Edition Edward J. Vander...
kevinkariuki227
 

Recently uploaded (20)

21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf
21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf
21stcenturyskillsframeworkfinalpresentation2-240509214747-71edb7ee.pdf
 
Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...
Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...
Don’t Get Left Behind: Leveraging Modern Product Management Across the Organi...
 
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
High Profile Girls Call Bhubaneswar 🎈🔥000XX00000 🔥💋🎈 Provide Best And Top Gir...
 
WAM Corporate Presentation July 2024.pdf
WAM Corporate Presentation July 2024.pdfWAM Corporate Presentation July 2024.pdf
WAM Corporate Presentation July 2024.pdf
 
foodgasm restaurant and Bar pune road.docx
foodgasm restaurant and Bar pune road.docxfoodgasm restaurant and Bar pune road.docx
foodgasm restaurant and Bar pune road.docx
 
STEPIC Innovations 2026 futurism publications
STEPIC Innovations 2026 futurism publicationsSTEPIC Innovations 2026 futurism publications
STEPIC Innovations 2026 futurism publications
 
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
Anton Grutzmache- Ominisient: The Data Revolution in Banking: From Scoring Cr...
 
You Get Me! Leveraging Communication Styles in Virtual Trainingpptx
You Get Me! Leveraging Communication Styles in Virtual TrainingpptxYou Get Me! Leveraging Communication Styles in Virtual Trainingpptx
You Get Me! Leveraging Communication Styles in Virtual Trainingpptx
 
AI at Work​ The demystification of AI and real-world stories on how to apply ...
AI at Work​ The demystification of AI and real-world stories on how to apply ...AI at Work​ The demystification of AI and real-world stories on how to apply ...
AI at Work​ The demystification of AI and real-world stories on how to apply ...
 
شركات إبراهيم العرجاني: لدعم الاقتصاد المصري
شركات إبراهيم العرجاني: لدعم الاقتصاد المصريشركات إبراهيم العرجاني: لدعم الاقتصاد المصري
شركات إبراهيم العرجاني: لدعم الاقتصاد المصري
 
Connected Small Boat Protection Solution | July 2024
Connected Small Boat Protection Solution | July  2024Connected Small Boat Protection Solution | July  2024
Connected Small Boat Protection Solution | July 2024
 
Girls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in City
Girls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in CityGirls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in City
Girls Call Kharghar 9910780858 Provide Best And Top Girl Service And No1 in City
 
Top Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdfTop Digital Marketing Strategy in 2024.pdf
Top Digital Marketing Strategy in 2024.pdf
 
Cracking the Customer Experience Code.pptx
Cracking the Customer Experience Code.pptxCracking the Customer Experience Code.pptx
Cracking the Customer Experience Code.pptx
 
Mandated reporting powerpoint to help with understanding your role
Mandated reporting powerpoint to help with understanding your roleMandated reporting powerpoint to help with understanding your role
Mandated reporting powerpoint to help with understanding your role
 
Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...
Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...
Innovation Hub_ Spotlight on Toms River's Role as a Beacon for Entrepreneuria...
 
The-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptx
The-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptxThe-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptx
The-Three-Pillars-of-Doctoral-Research-What-Why-and-How (1).pptx
 
A Complete Guide of Dubai Freelance Visa and Permit in 2024
A Complete Guide of Dubai Freelance Visa and Permit in 2024A Complete Guide of Dubai Freelance Visa and Permit in 2024
A Complete Guide of Dubai Freelance Visa and Permit in 2024
 
Corporate Governance for South African Mining Companies
Corporate Governance for South African Mining CompaniesCorporate Governance for South African Mining Companies
Corporate Governance for South African Mining Companies
 
Test Bank For Principles Of Cost Accounting, 17th Edition Edward J. Vander...
Test Bank For Principles Of Cost Accounting, 	  17th Edition Edward J. Vander...Test Bank For Principles Of Cost Accounting, 	  17th Edition Edward J. Vander...
Test Bank For Principles Of Cost Accounting, 17th Edition Edward J. Vander...
 

Survey & Questionnaire Design in Applied Marketing Research

  • 1. Survey Design Week 5 (3) Dr. Kelly Page Cardiff Business School E: pagekl@cardiff.ac.uk T: @drkellypage T: @caseinsights FB: kelly@caseinsights.com
  • 2. Survey Research Use of a questionnaire to gather facts, opinions and attitudes Cross-sectional and/or longitudinal Individuals NOT groups (e.g., stakeholders) Objectives General (e.g., describe situation ; facts ; find opinions ; explore underlying reasons ) Identify sample characteristics Measure many differing characteristics and/or constructs Advantages: Quick , cheap & efficient but… a poor survey is worse than no survey at all
  • 3. What do Surveys Measure? Characteristics of People Behaviours: actions that are observable by others (e.g., product usage) Demographics: Characteristics that are directly observable and directly verifiable (e.g., gender) Sociographics: Social characteristics (e.g., income) Geographics: Geographic characteristics (e.g., place of birth, residence) Mindsets of People Beliefs, emotions, behavioural intent (i.e, attitudes) Perceptions (e.g., ease of use) Preferences of People Wants and/or needs (i.e., motivations) Specific Constructs: Satisfaction, confidence, knowledge etc
  • 4. Survey Methods (1) Personal Door-to-door interviews Executive Interviews Intercept Surveys Mall-intercept Interviews Telephone Interviews Central location telephone interviews Computer-assisted telephone interviews (CATI) Completely automated telephone surveys (CATS) using IVR technology
  • 5. Surveys Methods (2) Self-administered Completed by participants with no assistance from an interviewer (e.g., in-class) Mail (postal) surveys Ad-hoc or one-shot mail surveys sent without prior contact from researcher Mail panels: pre-contacted and pre-screened participants who are periodically sent questionnaires Internet Surveys Email questionnaires Web survey Bulletin Boards Downloadable
  • 6. Internet Surveys ADVANTAGES Fast to deploy & report Inexpensive (reduced costs) Easier to manage A utomated error reduction I nterface error reduction I nterviewer influence reduced Personalisation High response rates Hard-to-reach respondents DISADVANTAGES Lack of probability sample : no list of users exists! (e.g., email addresses) C are needed in interpreting the results S elf-selection bias Respondent authenticity Unrestricted D u plicate responses Security
  • 7. Determining Survey Method (1) Sampling precision Required level of sampling precision is important E.g., low = convenience sample = self-admin in-class E.g., high = random sample = central located telephone Budget For example: Budget = £10,000; sample size required = 1000 Cost of mall-intercept = £27.50 per interview = £27,500 Cost of internet survey = £0.50 per survey = £500 Requirements for participant reactions (e.g., taste test). Quality of data (e.g., validity & reliability)
  • 8. Determining Survey Method (2) Length of Questionnaire Affects response rates (non-response error) and response error Incidence rate % of people in general population that fit the characteristics to be sampled Need to consider search costs to locate the people required e.g., door-to-door interviewing very expensive for low-incidence Structure of Questionnaire Structured = closed questions, sequence = mail, self-administered, telephone Unstructured = open questions = face-to-face interviewing Scheduled time available
  • 9. Errors in Survey Research Random Error (i.e., random sampling error) Error that results from chance variation Chance variation: difference between sample value & true value of population mean Can be reduce by increasing the sample size Systematic Error (i.e., non-sampling error) Results from mistakes or problems in execution of the research design Sample design & measurement error
  • 10. METHOD COMPARATOR Personal Intercept Telephone Postal Internet Highest flexibility in collecting data Best Best Ok Worst Ok Maximum diversity of questions Best Best Worst Worst Ok Best use of physical stimuli Best Best Worst Worst Good Effective sample control Best Best Good Worst Worst Controlling data collection environment Best Best Ok Worst Worst Restricting field interviewer effects Worst Worst Ok Best Best Maximising quantity of data Best Ok Worst Worst Ok Highest response rate Best Best Ok Worst Best Protecting respondent anonymity Worst Worst Ok Best Best Avoiding socially desirable answers Worst Worst Best Best Ok Keeping costs low Worst Ok Good Best Best Probing questions Best Best Worst Worst Ok Fast results Ok Ok Best Worst Best Building rapport with respondents Best Ok Ok Worst Worst
  • 11. Discussion Questions Which survey method would you select for the following and why? Highly personal & controversial questions A survey that needs to completed quickly Boring questions It would be difficult to find the respondent at home A survey of a particular organisation Finances are very limited Questionnaire is difficult to follow Questionnaire is relatively long A high response rate is important
  • 12. Questionnaire Design Week 5 (3) Dr. Kelly Page Cardiff Business School E: pagekl@cardiff.ac.uk T: @drkellypage T: @caseinsights FB: kelly@caseinsights.com
  • 13. Questionnaires Questionnaire A set of questions/items designed to generate the data necessary to accomplish the objectives of the research project (i.e., survey instrument) Formalised schedule for for collecting information from participants Standardises the wording and sequencing of questions Imposes uniformity on data-gathering process (e.g., reliability, reduces error) Facilitate data processing Improper design = Inaccurate data & information Higher costs Poor decision making GOOD QUESTIONNAIRE DESIGN IS IMPERATIVE FOR GOOD DATA
  • 14. Questionnaire Design Process See ‘survey data collection methods’ in previous lecture notes
  • 15. 3) Question / Item Design Measurement The process of assigning numbers or labels to person’s, objects, or events in accordance with specific rules for representing quantities and qualities of attributes e.g., Biological Sex: 0 = Males, 1 = Female Levels of Measurement Nominal (a) Ordinal (b) Interval Ratio b) How frequently do you use the Internet?  Once a month 1  Twice a month 2  Once a week 3  Twice a week 4 a) Please indicate your gender?  Male 0  Female 1
  • 16. Question Response Format (1) Open-ended questions participant responds in own words open response option (a) Close-ended questions participants required to choose from a pre-determined list of answers Dichotomous (b) Multichotomous c) Partially open-ended (d) a) Why is brand X better? b) Have you used the Internet today?  Yes  No c) Which best represents your age? a) Under 17 d) 36-50 b) 18-25 e) 51-65 c) 26-35 f) 66+ d) What is your preferred brand of car?  BMW  Mercedes  Ford  Other (please specify) ________________
  • 17. Question Response Format (2) Scale-response questions Close-ended questions in which the response choices are designed to capture intensity of participants feelings Measure subjective and abstract concepts e.g., brand loyalty, satisfaction Unidimensional = measure only one attribute of a concept e.g., 10-items = perceived ease of web use Multidimensional = measure several dimensions of a concept e.g., 10-items = perceived ease of web use for a) finding information; b) communicating; c) conducting transactions etc.
  • 18. Types Measurement Scales (1) Graphic Rating Scales Graphic continuum anchored by extremes Participants asked to mark on continuum Continuous interval level of measurement Itemized Rating Scales Selection from limited number of ordered categories Ordinal scaled Rank order scale Comparative scales as compare two or more items and rank each item e.g., please rank the brands listed where 1 = most preferred and 5 = least preferred (BMW, Mercedes, Ford etc) Ordinal scaled
  • 19. Types Measurement Scales (2) Paired Comparisons Pick one of two objects from a set, based on some stated criteria Easier to select, than rank (as in rank-order scales) Order bias is overcome (e.g., order of brands/criteria) No. of criteria should remain small a) Please tell me which characteristics in each pair is ‘more important’ to you when selecting a sun care product. a) Tans evenly b) Tans without burning a) Prevents burning b) Protects against burning & tanning a) Good value for money b) Goes on evenly a) Not Greasy b) Does not stain clothing
  • 20. Types Measurement Scales (3) Constant Sum Scales Ask participants to divide a given number of points (e.g., 100) among two or more attributes, based on importance to him/her No. of points = ranking assigned = Ordinal scaled Advantages: If two items perceived equal importance, can be assigned equal values a) Please allocate 100 points among the characteristics of sports clothing below such that allocation = importance. The more points allocated = the more important. All points should add up to 100. Is comfortable to wear _______ Is durable _______ Is made by a well-known brand _______ Is made in UK _______ 100 pts
  • 21. Types Measurement Scales (4) Semantic Differential Scales Examines strengths & weaknesses of a product/company image by having participant rank it between dichotomous pairs of words/phrases (1-7) Means of responses are then plotted as a profile Interpretation of rating of 4 = neutral, or unable to relate to anchor Ordinal scaled Modern 1 2 3 4 5 6 7 Old-fashioned Aggressive 1 2 3 4 5 6 7 Defensive Friendly 1 2 3 4 5 6 7 Unfriendly Reliable 1 2 3 4 5 6 7 Unreliable Helpful 1 2 3 4 5 6 7 Unhelpful Successful 1 2 3 4 5 6 7 Unsuccessful
  • 22. Types Measurement Scales (5) Likert Scales Series of statements expressing either a favourable or unfavourable attitudes toward the concept under investigation Participants indicate level of agreement Scores are summated to equal respondents attitudes on item, dimension and/or scale Interval scaled SD Neutral SA The registration was simple 1 2 3 4 5 6 7 Registration did not take long to complete 1 2 3 4 5 6 7 The registration informed me about the site 1 2 3 4 5 6 7 Registration was non-threatening 1 2 3 4 5 6 7
  • 23. 4. Question Wording (1) Objectionable questions How old are you? ________________ (WRONG) Please indicate your age: (RIGHT) Bias in more than one direction Are you against same sex marriage and in favour of legislation to ban it? (WRONG) What is your view of same sex marriage? (RIGHT) Emotionally charged words Was the government negligent by ignoring the views of the people whom were opposed to the war in Iraq? (WRONG) Given the views expressed against the ware in Iraq, what should have the government done? (RIGHT)
  • 24. 4. Question Wording (2) Threats to self-esteem How often have you driven home drunk (WRONG) Have you ever driven a vehicles after you have had too much to drink (RIGHT) Personalisation Dear Kelly Page … How would you rate ….. (WRONG) Dear valued customer …. How would you rate ….. (RIGHT) Make sure the wording is clear Consider respondents willingness & ability to answer
  • 25. 5. Questionnaire Flow & Layout Screening questions: Use to identify appropriate respondents Questions to gain interest (Warm-ups): Easy to answer questions General Questions: e.g., behavioural question about purchase/usage Difficult & Complicated questions: e.g, attitudes, rankings etc Position sensitive, threatening, and demographic questions at the end e.g., age, income etc Distinguish instructions e.g., capitals, italics Insert prompters at strategic points throughout
  • 26.  
  • 27. 6-10. Design Process Evaluate questionnaire Are all questions necessary Is questionnaire too long Will the questions provide insight required Is it well-layout & easy to follow Are the instructions clear Consider data processing & coding Obtain Approvals Pre-test & Revise Prepare final copy Implement survey Field instructions & call/contact sheets for management
  • 28. Other t h ings to avoid … Question bias Complex questions Unspecific questions Jargon, shorthand Sophisticated/uncommon words Negative questions Hypothetical questions Potential ambiguity Over-tight banding Overlapping responses Not allowing for ‘other’ or ‘don’t know’ responses
  • 29. The content of this work is of shared interest between the author, Kelly Page and other parties who have contributed and/or provided support for the generation of the content detailed within. This work is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 2.0 UK: England & Wales. http://creativecommons.org/ Kelly Page (cc)

Editor's Notes

  1. Personal Surveys In-home or place of work Advantages control/flexibility quality and level of response Disadvantages cost Used in b2b & other situations Appointments Structured/unstructured Intercept Surveys Public places Consumers/shoppers Low cost (high volume, minimal travel) Shopping centre approaches flexibility compromised by time pressures low co-operation rates sample bias Telephone Surveys Consumer and b2b research Sampling, random or Random Digit Dialling (RDD) Generally CATI (Computer Assisted Telephone Interviews) inflexible/invisible sample bias participation rates non-availability/ gatekeepers non participation legal issues
  2. Postal Surveys Cheap and quick advance warning - questionnaire - follow-up letter - telephone call short, closed questions only inflexible lack of control non-response bias literacy rates interest levels Email Surveys Advantages and uses are as for telephone interviews Will be self-completed Response rates may be low Target population must have access to e-mail Researchers must have access to e-mail addresses of target population