Conducting
ONLINE SURVEYS
          Valerie M. Sue, Ph.D.
1.   Introduction
Learning Objectives
 1   Identify the purposes of survey research

 2   Define the characteristics of a survey

 3   Outline the steps in the survey process

 4   Evaluate survey administration methods

 5   Determine when an online survey is useful
Research
Process
5


Research purpose


 Research goal


   Research objective
Research Purpose

1   Exploratory

2   Descriptive

3   Explanatory
Identify the research purpose

  A survey to gauge employee
  satisfaction.

  A public opinion poll of registered
  voters before an election campaign.

  A survey of online shoppers focused
  on shopping cart abandonment.
Research Goal
General statement outlining the
aim of the research.
    Establish an assessment plan for
    the department.
Research Objectives
Specific statements about what
will be measured.
    To determine the number of
    projects completed in the
    department.

    To uncover inefficiencies in
    departmental processes.
Research objectives should be


   Specific     Measurable



 Reviewed by     Informed by
   experts      the literature
What is a
Survey
A survey is a system for collecting information
used to describe, explain or predict
knowledge, attitudes or behaviors.
Survey
Research
Process
Define survey
objectives or
 hypotheses
Conduct       Consult with
literature   subject matter
  review        experts
Conduct preliminary research:
  focus groups, interviews
Choose survey
   method:
e-mail, website,
   mobile
Evaluate       Draft
sampling   questionnaire
 options    & invitation
Pretest
  Design &
                questionnaire
select sample
                 & invitation
Launch survey, monitor
responses, send reminders
Download, clean & analyze data
Prepare report &
present findings
Survey Modes                 Telephone
               Postal mail
                              interview

                Face-to-
                   face       E-mail
                interview


                Website       Mobile
Evaluate pros &
                  26




cons of each
method
Postal Mail
  Advantages              Disadvantages

  Low cost                Low response rate


  Wide geographic reach   Lengthy response period

                          Contingency questions
  No interviewer bias
                          ineffective

  Sensitive questions     Don’t know who is
  easier to ask           responding
Telephone Interviews
  Advantages              Disadvantages

  Limited coverage bias   Fewer land phone lines


  Fast response           Confusion w/sales calls

  Complex questions
                          Intrusive
  possible

  Wide geographic reach   Call screening
Face-to-Face Interviews
  Advantages            Disadvantages

                        Limited geographic
  Good response rates
                        reach

  Complex questions     Time-consuming &
  possible              expensive

  Longer interviews     Susceptible to
  possible              interviewer bias

  Observational data    Sensitive topics difficult
  collection            to explore
Online Surveys
  Advantages              Disadvantages

  Can be low cost         Coverage bias


  Fast & efficient        Too many digital
                          surveys, resulting in
                          overload
  Contingency
  questions effective

  Direct data entry


  Wide geographic reach
Survey
Research
Timeline
• Define survey      • Continue literature
  objectives           review
• Begin literature   • Review objectives
  review               with experts




     Week 1               Week 2
• Revise objectives
                        • Select sampling
• Conduct preliminary
                          strategy
  research
                        • Locate or create
• Choose survey
                          sampling frame
  method




    Week 3                  Week 4
• Pretest
                          questionnaire &
• Draft questionnaire     invitation
  & invitation          • Revise
                          questionnaire &
                          invitation




     Week 5                 Week 6
• Launch survey    • Send additional
• Send reminders     reminders




    Week 7             Week 8
• Continue data
• Download & clean
                       analysis
  data
                     • Write first draft of
• Analyze data
                       report




    Week 9               Week 10
• Finalize report
• Write second draft of
                          • Prepare
  report
                            presentation




    Week 11                   Week 12
• Present survey
  results




   Week 13
Summary
Use an Online Survey if
1   Sample is large &
    widely distributed
                          5   Sampling frame
                              is available




2   Timeline is short
                          6   Convenience
                              sample is adequate


                              Multi-media

3   Topic is sensitive
                          7   features would
                              enhance project

    Audience has              Staff has

4   access to necessary
    technology            8   technological
                              capability

ConductingOnlineSurveys_Sue_ch1

  • 1.
    Conducting ONLINE SURVEYS Valerie M. Sue, Ph.D.
  • 2.
    1. Introduction
  • 3.
    Learning Objectives 1 Identify the purposes of survey research 2 Define the characteristics of a survey 3 Outline the steps in the survey process 4 Evaluate survey administration methods 5 Determine when an online survey is useful
  • 4.
  • 5.
    5 Research purpose Researchgoal Research objective
  • 6.
    Research Purpose 1 Exploratory 2 Descriptive 3 Explanatory
  • 7.
    Identify the researchpurpose A survey to gauge employee satisfaction. A public opinion poll of registered voters before an election campaign. A survey of online shoppers focused on shopping cart abandonment.
  • 8.
    Research Goal General statementoutlining the aim of the research. Establish an assessment plan for the department.
  • 9.
    Research Objectives Specific statementsabout what will be measured. To determine the number of projects completed in the department. To uncover inefficiencies in departmental processes.
  • 10.
    Research objectives shouldbe Specific Measurable Reviewed by Informed by experts the literature
  • 11.
  • 12.
    A survey isa system for collecting information
  • 13.
    used to describe,explain or predict
  • 14.
  • 15.
  • 16.
  • 17.
    Conduct Consult with literature subject matter review experts
  • 18.
    Conduct preliminary research: focus groups, interviews
  • 19.
    Choose survey method: e-mail, website, mobile
  • 20.
    Evaluate Draft sampling questionnaire options & invitation
  • 21.
    Pretest Design& questionnaire select sample & invitation
  • 22.
  • 23.
    Download, clean &analyze data
  • 24.
  • 25.
    Survey Modes Telephone Postal mail interview Face-to- face E-mail interview Website Mobile
  • 26.
    Evaluate pros & 26 cons of each method
  • 27.
    Postal Mail Advantages Disadvantages Low cost Low response rate Wide geographic reach Lengthy response period Contingency questions No interviewer bias ineffective Sensitive questions Don’t know who is easier to ask responding
  • 28.
    Telephone Interviews Advantages Disadvantages Limited coverage bias Fewer land phone lines Fast response Confusion w/sales calls Complex questions Intrusive possible Wide geographic reach Call screening
  • 29.
    Face-to-Face Interviews Advantages Disadvantages Limited geographic Good response rates reach Complex questions Time-consuming & possible expensive Longer interviews Susceptible to possible interviewer bias Observational data Sensitive topics difficult collection to explore
  • 30.
    Online Surveys Advantages Disadvantages Can be low cost Coverage bias Fast & efficient Too many digital surveys, resulting in overload Contingency questions effective Direct data entry Wide geographic reach
  • 31.
  • 32.
    • Define survey • Continue literature objectives review • Begin literature • Review objectives review with experts Week 1 Week 2
  • 33.
    • Revise objectives • Select sampling • Conduct preliminary strategy research • Locate or create • Choose survey sampling frame method Week 3 Week 4
  • 34.
    • Pretest questionnaire & • Draft questionnaire invitation & invitation • Revise questionnaire & invitation Week 5 Week 6
  • 35.
    • Launch survey • Send additional • Send reminders reminders Week 7 Week 8
  • 36.
    • Continue data •Download & clean analysis data • Write first draft of • Analyze data report Week 9 Week 10
  • 37.
    • Finalize report •Write second draft of • Prepare report presentation Week 11 Week 12
  • 38.
    • Present survey results Week 13
  • 39.
  • 40.
    Use an OnlineSurvey if 1 Sample is large & widely distributed 5 Sampling frame is available 2 Timeline is short 6 Convenience sample is adequate Multi-media 3 Topic is sensitive 7 features would enhance project Audience has Staff has 4 access to necessary technology 8 technological capability