Your SlideShare is downloading. ×

Carma internet research module: Research design catalog

633

Published on

Used in CARMA summer workshop on Web survey methods.

Used in CARMA summer workshop on Web survey methods.

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
633
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. CARMA Internet Research Module
    Research Design Catalog
    Jeffrey Stanton
  • 2. May 17-19, 2007
    Internet Data Collection Methods (Day 1-2)
    Research Design Catalog
    Objective knowledge test
    1 shot self report, single data source
    1 shot survey, multi-data source
    Two (or more) wave survey AKA “Panel” Design
    (Field) Quasi-experiment
    (Field) Experiment
    Repeated measures (field) experiment
    Time series
    Interview or Focus Group
    Document analysis
    Archival text mining
    Including discussion groups, email archives, text message logs, etc.
    Naturalistic (unobtrusive) observation
    Case Study
    Participant observation
    Ethnographic methods
    Historical methods
  • 3. Mixed Methods Designs
    Sequential Explanatory
    Quantitative data obtained first, qualitative second
    Example: Cross-sectional web survey followed by Skype interviews
    Priority given to quantitative data
    Questioning in qualitative phase driven by specific results obtained earlier
    Sequential Exploratory
    Qualitative data obtained first, quantitative second
    Example: Discussion forum used to develop issues poll
    Priority given to qualitative data
    Numbers from quantitative phase used to underscore or affirm themes from qualitative
    Concurrent Mixed Methods Designs collect quantitative and qualitative data at the
    same time, for example using open ended comment boxes on a web survey. Neither
    type of data gets priority, results are synthesized or used for corroboration.
  • 4. May 17-19, 2007
    Internet Data Collection Methods (Day 1-4)
    Cross Sectional SurveyTiming Exercise: How Long?
    150-WordIntroduction
    Introductory material, implied consent
    Likert type questions
    Checklists
    Open-ended questions
    Demographics
    Plus instructions
    45 Likert Items
    20 itemchecklist
    2 open endedparagraphs
    8 demographicquestions
  • 5. May 17-19, 2007
    Internet Data Collection Methods (Day 1-5)
    Two Condition Quasi-Experiment
    Condition 1:
    Introductory material, implied consent
    Manipulation (condition 1)
    Dependent measure
    Demographics
    Manipulation check
    Thanks
    Condition 2:
    Introductory material, implied consent
    Manipulation (condition 2)
    Dependent measure
    Demographics
    Manipulation check
    Thanks
  • 6. Why Quasi?
    Why would a web-based, two version survey be considered a quasi-experiment rather than a true experiment?
    What are some alternative methods of conducting a multi-condition study with manipulations (i.e., other than a web survey)?
    What are some of the pitfalls of trying to conduct an experiment using Internet tools to interact with research participants?
  • 7. May 17-19, 2007
    Internet Data Collection Methods (Day 1-7)
    Time 1:
    Introductory material, implied consent
    Unique identifier
    Independent measure
    Baseline measure
    Demographics
    Thanks
    Time 2:
    Introductory material, implied consent
    (Matching) Unique identifier
    Change measure
    Experience check
    Thanks
    Intervention
    Maturation
    Training
    Design Example 3: Two Wave Panel Design
  • 8. May 17-19, 2007
    Internet Data Collection Methods (Day 1-8)
    Wall Separated Identifier
    Identifier
    Email
    Identifier
    Email
    Identifier
    Email
    Identifier
    Email
    Identifier
    Email
    Identifier
    Email
    Identifier
    Email
    Identifier
    Data
    Identifier
    Data
    Identifier
    Data
    Identifier
    Data
    Identifier
    Data
    Identifier
    Data
    Wall
    • The two researchers communicate only with unique identifiers
  • May 17-19, 2007
    Internet Data Collection Methods (Day 1-9)
    Design Example 4: Time Series
    EmailNotification
    EmailNotification
    EmailNotification
    EmailNotification
    RespondentCompletesWeb Survey
    RespondentCompletesWeb Survey
    RespondentCompletesWeb Survey
    RespondentCompletesWeb Survey
    Introduce StudyProvide Persistent ID
    Time 1 Time 2 Time 3 Time 4 . . . . Time T
  • 9. May 17-19, 2007
    Internet Data Collection Methods (Day 1-10)
    Design Example 5: Linked Dyads
    Participant 1:
    Introductory material, implied consent
    Unique identifier
    Scales
    Demographics
    Referral Procedure
    Thanks
    Recruiting Message
    Participant 2:
    Introductory material, implied consent
    Unique identifier
    Scales
    Demographics
    Referral Check
    Thanks

×