Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
CARMA Internet Research Module<br />Research Design Catalog<br />Jeffrey Stanton<br />
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-2)<br />Research Design Catalog<br />Objective knowledge test...
Mixed Methods Designs<br />Sequential  Explanatory<br />Quantitative data obtained first, qualitative second<br />Example:...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-4)<br />Cross Sectional SurveyTiming Exercise: How Long?<br /...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-5)<br />Two Condition Quasi-Experiment<br />Condition 1:<br /...
Why Quasi?<br />Why would a web-based, two version survey be considered a quasi-experiment rather than a true experiment?<...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-7)<br />Time 1:<br />Introductory material, implied consent<b...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-8)<br />Wall Separated Identifier<br />Identifier<br />Email<...
May 17-19, 2007<br />Internet Data Collection Methods (Day 1-10)<br />Design Example 5: Linked Dyads<br />Participant 1:<b...
Carma internet research module: Research design catalog
Upcoming SlideShare
Loading in …5
×

Carma internet research module: Research design catalog

961 views

Published on

Used in CARMA summer workshop on Web survey methods.

Published in: Education
  • Be the first to comment

  • Be the first to like this

Carma internet research module: Research design catalog

  1. 1. CARMA Internet Research Module<br />Research Design Catalog<br />Jeffrey Stanton<br />
  2. 2. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-2)<br />Research Design Catalog<br />Objective knowledge test<br />1 shot self report, single data source<br />1 shot survey, multi-data source<br />Two (or more) wave survey AKA “Panel” Design<br />(Field) Quasi-experiment<br />(Field) Experiment<br />Repeated measures (field) experiment<br />Time series<br />Interview or Focus Group<br />Document analysis<br />Archival text mining<br />Including discussion groups, email archives, text message logs, etc.<br />Naturalistic (unobtrusive) observation<br />Case Study<br />Participant observation<br />Ethnographic methods<br />Historical methods<br />
  3. 3. Mixed Methods Designs<br />Sequential Explanatory<br />Quantitative data obtained first, qualitative second<br />Example: Cross-sectional web survey followed by Skype interviews<br />Priority given to quantitative data<br />Questioning in qualitative phase driven by specific results obtained earlier<br />Sequential Exploratory<br />Qualitative data obtained first, quantitative second<br />Example: Discussion forum used to develop issues poll<br />Priority given to qualitative data<br />Numbers from quantitative phase used to underscore or affirm themes from qualitative<br />Concurrent Mixed Methods Designs collect quantitative and qualitative data at the<br />same time, for example using open ended comment boxes on a web survey. Neither<br />type of data gets priority, results are synthesized or used for corroboration. <br />
  4. 4. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-4)<br />Cross Sectional SurveyTiming Exercise: How Long?<br />150-WordIntroduction<br />Introductory material, implied consent<br />Likert type questions<br />Checklists<br />Open-ended questions<br />Demographics<br />Plus instructions <br />45 Likert Items<br />20 itemchecklist<br />2 open endedparagraphs<br />8 demographicquestions<br />
  5. 5. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-5)<br />Two Condition Quasi-Experiment<br />Condition 1:<br />Introductory material, implied consent<br />Manipulation (condition 1)<br />Dependent measure<br />Demographics<br />Manipulation check<br />Thanks<br />Condition 2:<br />Introductory material, implied consent<br />Manipulation (condition 2)<br />Dependent measure<br />Demographics<br />Manipulation check<br />Thanks<br />
  6. 6. Why Quasi?<br />Why would a web-based, two version survey be considered a quasi-experiment rather than a true experiment?<br />What are some alternative methods of conducting a multi-condition study with manipulations (i.e., other than a web survey)?<br />What are some of the pitfalls of trying to conduct an experiment using Internet tools to interact with research participants?<br />
  7. 7. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-7)<br />Time 1:<br />Introductory material, implied consent<br />Unique identifier<br />Independent measure<br />Baseline measure<br />Demographics<br />Thanks<br />Time 2:<br />Introductory material, implied consent<br />(Matching) Unique identifier<br />Change measure<br />Experience check<br />Thanks<br />Intervention<br />Maturation<br />Training<br />Design Example 3: Two Wave Panel Design<br />
  8. 8. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-8)<br />Wall Separated Identifier<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Email<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Identifier<br />Data<br />Wall<br /><ul><li> The two researchers communicate only with unique identifiers</li></li></ul><li>May 17-19, 2007<br />Internet Data Collection Methods (Day 1-9)<br />Design Example 4: Time Series<br />EmailNotification<br />EmailNotification<br />EmailNotification<br />EmailNotification<br />RespondentCompletesWeb Survey<br />RespondentCompletesWeb Survey<br />RespondentCompletesWeb Survey<br />RespondentCompletesWeb Survey<br />Introduce StudyProvide Persistent ID<br /> Time 1 Time 2 Time 3 Time 4 . . . . Time T<br />
  9. 9. May 17-19, 2007<br />Internet Data Collection Methods (Day 1-10)<br />Design Example 5: Linked Dyads<br />Participant 1:<br />Introductory material, implied consent<br />Unique identifier<br />Scales<br />Demographics<br />Referral Procedure<br />Thanks<br />Recruiting Message<br />Participant 2:<br />Introductory material, implied consent<br />Unique identifier<br />Scales<br />Demographics<br />Referral Check<br />Thanks<br />

×