CARMA Internet Research Module<br />Research Design Catalog<br />Jeffrey Stanton<br />
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-2)<br />Research Design Catalog<br />Objective knowledge test...
Mixed Methods Designs<br />Sequential  Explanatory<br />Quantitative data obtained first, qualitative second<br />Example:...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-4)<br />Cross Sectional SurveyTiming Exercise: How Long?<br /...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-5)<br />Two Condition Quasi-Experiment<br />Condition 1:<br /...
Why Quasi?<br />Why would a web-based, two version survey be considered a quasi-experiment rather than a true experiment?<...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-7)<br />Time 1:<br />Introductory material, implied consent<b...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-8)<br />Wall Separated Identifier<br />Identifier<br />Email<...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-10)<br />Design Example 5: Linked Dyads<br />Participant 1:<b...
Carma internet research module: Research design catalog
Upcoming SlideShare
Loading in...5
×

Carma internet research module: Research design catalog

655

Published on

Used in CARMA summer workshop on Web survey methods.

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
655
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Carma internet research module: Research design catalog

  1. 1. CARMA Internet Research Module<br />Research Design Catalog<br />Jeffrey Stanton<br />
  2. 2. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-2)<br />Research Design Catalog<br />Objective knowledge test<br />1 shot self report, single data source<br />1 shot survey, multi-data source<br />Two (or more) wave survey AKA “Panel” Design<br />(Field) Quasi-experiment<br />(Field) Experiment<br />Repeated measures (field) experiment<br />Time series<br />Interview or Focus Group<br />Document analysis<br />Archival text mining<br />Including discussion groups, email archives, text message logs, etc.<br />Naturalistic (unobtrusive) observation<br />Case Study<br />Participant observation<br />Ethnographic methods<br />Historical methods<br />
  3. 3. Mixed Methods Designs<br />Sequential Explanatory<br />Quantitative data obtained first, qualitative second<br />Example: Cross-sectional web survey followed by Skype interviews<br />Priority given to quantitative data<br />Questioning in qualitative phase driven by specific results obtained earlier<br />Sequential Exploratory<br />Qualitative data obtained first, quantitative second<br />Example: Discussion forum used to develop issues poll<br />Priority given to qualitative data<br />Numbers from quantitative phase used to underscore or affirm themes from qualitative<br />Concurrent Mixed Methods Designs collect quantitative and qualitative data at the<br />same time, for example using open ended comment boxes on a web survey. Neither<br />type of data gets priority, results are synthesized or used for corroboration. <br />
  4. 4. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-4)<br />Cross Sectional SurveyTiming Exercise: How Long?<br />150-WordIntroduction<br />Introductory material, implied consent<br />Likert type questions<br />Checklists<br />Open-ended questions<br />Demographics<br />Plus instructions <br />45 Likert Items<br />20 itemchecklist<br />2 open endedparagraphs<br />8 demographicquestions<br />
  5. 5. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-5)<br />Two Condition Quasi-Experiment<br />Condition 1:<br />Introductory material, implied consent<br />Manipulation (condition 1)<br />Dependent measure<br />Demographics<br />Manipulation check<br />Thanks<br />Condition 2:<br />Introductory material, implied consent<br />Manipulation (condition 2)<br />Dependent measure<br />Demographics<br />Manipulation check<br />Thanks<br />
  6. 6. Why Quasi?<br />Why would a web-based, two version survey be considered a quasi-experiment rather than a true experiment?<br />What are some alternative methods of conducting a multi-condition study with manipulations (i.e., other than a web survey)?<br />What are some of the pitfalls of trying to conduct an experiment using Internet tools to interact with research participants?<br />
  7. 7. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-7)<br />Time 1:<br />Introductory material, implied consent<br />Unique identifier<br />Independent measure<br />Baseline measure<br />Demographics<br />Thanks<br />Time 2:<br />Introductory material, implied consent<br />(Matching) Unique identifier<br />Change measure<br />Experience check<br />Thanks<br />Intervention<br />Maturation<br />Training<br />Design Example 3: Two Wave Panel Design<br />
  8. 8. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-8)<br />Wall Separated Identifier<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Wall<br /><ul><li> The two researchers communicate only with unique identifiers</li></li></ul><li>May 17-19, 2007<br />Internet Data Collection Methods (Day 1-9)<br />Design Example 4: Time Series<br />EmailNotification<br />EmailNotification<br />EmailNotification<br />EmailNotification<br />RespondentCompletesWeb Survey<br />RespondentCompletesWeb Survey<br />RespondentCompletesWeb Survey<br />RespondentCompletesWeb Survey<br />Introduce StudyProvide Persistent ID<br /> Time 1 Time 2 Time 3 Time 4 . . . . Time T<br />
  9. 9. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-10)<br />Design Example 5: Linked Dyads<br />Participant 1:<br />Introductory material, implied consent<br />Unique identifier<br />Scales<br />Demographics<br />Referral Procedure<br />Thanks<br />Recruiting Message<br />Participant 2:<br />Introductory material, implied consent<br />Unique identifier<br />Scales<br />Demographics<br />Referral Check<br />Thanks<br />
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×