• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Using m turk for data collection
 

Using m turk for data collection

on

  • 727 views

http://mgto.org/running-experiments-with-amazon-mechanical-turk/

http://mgto.org/running-experiments-with-amazon-mechanical-turk/

Statistics

Views

Total Views
727
Views on SlideShare
727
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Using m turk for data collection Using m turk for data collection Presentation Transcript

    • Using MTurk for Data Collection Gilad Feldman (HKUST) filian@ust.hk http://mgto.org/running-experiments-with-amazon-mechanical-turk / -1-
    • Amazon Mechanical Turk What it is: Online Labor Market Complete task, get money For researchers: Data collection online Why? Very cheap International sample Very quick results -2- -2-
    • Online? You can’t be serious. This gets published? Yes, it certainly does, in the best journals Psychology - Buhrmester ,  Kwang, & Gosling (2011, Perspectives on Psychological Science) Amazon’s M    Economics – Horton, Rand & Zeckhauser (2010, Experimental Economics) – The Online Lab   Management - Paolacci, Chandler & Ipeirotis (2010, Judgment and Decision Making) – Runnin   Really? Published where? •Examples of recent top-tier publications : Science / PNAS / JPSP / Psychological Science / etc. -3- -3-
    • Quick DemonstrationMturk + Qualtrics -4-
    • How I run things Setup I pay 0.01US$/minute + 10% Amazon commission. Most experiments are 3-5 minutes. Participants Indian participants : A dilemma, I sometimes exclude those. Target Turks : Completed atleast 50 HITs before with 95% acceptance -5- -5-
    • How I run things Making sure they do it right Quiz after every scenario or manipulation. (Can’t move on without getting it right) Reading checks (“set this bar on twenty seven”). Manipulation checks, more than 1! Funneling section. (Intention of study, connection between parts) English proficiency self report + test questions. Pre-Test your survey on 20 participants, tweak, then launch. -6- -6-
    • Advanced Use of Online Experiments More advanced things I ran with Mturk: Implicit Association Test (Response time). Crossword Puzzle (Javascript). More advanced use of Qualtrics (1 / 2 / 3). Essentially, you can run whatever you want online. -7- -7-
    • What to use this for? Pretest your stimuli. Pretest your manipulations. Even run the actual study (but probably best to also supplement with actual participants). -8- -8-
    • Any other questions?Email : filian@ust.hk -9-