Your SlideShare is downloading. ×
Open Source IAT - SPSP 2013
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Open Source IAT - SPSP 2013

7,916
views

Published on


2 Comments
1 Like
Statistics
Notes
  • This looks fantastic! I'm going to be telling everyone I know who does IAT stuff about this.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Hi Winter, unfortunately I was unable to attend your symposium but I wanted to let you know that I have adapted the 2.0 version by Ben Sigmon to work on touchscreens. If you'd like some more information, feel free to contact me at darrick.chow@mail.mcgill.ca.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total Views
7,916
On Slideshare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
36
Comments
2
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Copy to serverWalk through experimenter interfaceWalk through IATCreate new IAT (Flowers / Insects?)Set it to activeStart IAT
  • Copy to serverWalk through experimenter interfaceWalk through IATCreate new IAT (Flowers / Insects?)Set it to activeStart IAT
  • Transcript

    • 1. An Open Source IAT forOnline Data Collection Winter Mason Stevens Institute of Technology
    • 2. Implicit Association Test (IAT) The Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998) was devised as a way to measure implicit attitudes towards categories of objects or people. Since then it has been used extensively in the field (McConnell & Leibold, 2001; Conrey, et al., 2003; Nosek, 2005, 2007) Including online applications (c.f., Project Implicit: http://projectimplicit.com). However, until now, the means to run the IAT has required commercial software such as e-Prime for laboratory studies and has not been widely and freely available for online research.
    • 3. Open Source software Open-source software is software that has been developed by and/or shared with a community of developers  Firefox, Linux, R, etc., etc. Based on the idea that sharing resources reduces unnecessary duplication of effort and increases social efficiency This idea should be applied to all aspects of science  Sharing methods and materials reduces duplication of effort and facilitates replication  Sharing data allows transparency and reproducibility  Also see openscienceframework.org
    • 4. Requirements Experimenter:  Has been successfully tested  A web server that runs PHP with v4.0 or greater  Mac OS 10.5, 10.6,  Windows XP, Vista  Ubuntu 11. Participant:  A web browser that allows  It has also been successfully Javascript tested with  Mozilla’s Firefox  Google Chrome  Internet Explorer 8 & 9.
    • 5. Experimenter View
    • 6. A list of available IATtemplates to modify ormake active
    • 7. The currently active IAT;Participants will completethis version when they goto the main IAT page.
    • 8. Edit the name of thetemplate
    • 9. Choose whetherparticipants arepresented with theresults of their IAT atthe end of the test.
    • 10. Select the categoryyou want to edit
    • 11. Select the categoryyou want to edit
    • 12. Select the categoryyou want to edit
    • 13. This is the name of thecategory seen by theparticipants.
    • 14. This is the name of thecategory that is storedin the output datafile.
    • 15. Choose whether theitems in the categorywill be text or images.
    • 16. With images, you cansee a preview of theimage next to the filename.
    • 17. Change the file namehere…
    • 18. …and update thethumbnail image withthis button.
    • 19. With text items, thethumbnails and“update images”button are hidden.
    • 20. Delete an item withthe „x‟ button
    • 21. Once you have madeall of your changes,don‟t forget to save!
    • 22. If you select anothertemplate or create anew template,unsaved changed willbe lost!
    • 23. To change the IATparticipants see,select the templateand press this button.
    • 24. Create a new template withthis button.
    • 25. Make sure you‟veadded items for all 4categories, and don‟tforget to save!
    • 26. Participant View
    • 27. Enter a unique identifier for theparticipant (a random string is pre-filled). The output data file will beassociated with this ID. You canalso use this to match with aTurker‟s submitted HIT.
    • 28. The name of theactive template isshown here.
    • 29. The category labels forCategory A and B are shownin the first trial
    • 30. The templates are stored in a folder with the samename as the template, and image files are storedin the “img” folder inside the correspondingtemplate folder.
    • 31. The category labels forCategory 1 and 2 are shownin the second trial
    • 32. If the participant gets it wrong,the X appears until the correctkey is pressed.
    • 33. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … …The output is stored in the “output” folder in the template‟s folder asa comma-delimited file. The name of the file follows the pattern[Template Name]-[Subject ID]-YYYY-MM-DD-HH-mm. For example,Race-JohnDoe-2013-01-22-18-52.csv.
    • 34. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … There are 7 Trials in the standard IAT
    • 35. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … There are 20 or 40 round per trial, depending on whether it is a practice trial or not
    • 36. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … The character(s) used here to indicate the category are defined in the template.
    • 37. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … The item number refers to which particular item was presented. The order of item presentation is randomized. The number indicates its order in the template (starting from zero).
    • 38. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … This is the number of errors the participant made on that round.
    • 39. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … This is the participant‟s response time in milliseconds for that item on that round. The final IAT score is determined by these reaction times.
    • 40. Validation The standard deviation of system error was 29.4ms, with fewer than 4% larger than 50ms and the largest error recorded at 167ms. The typical standard deviation of a users reaction time is approximately 300ms, as reported in Greenwald, et. al (1998, 2003) and observed in the replications reported here. The error introduced by the system is an order of magnitude less than user error.
    • 41. Replicating prior work 63 participants recruited from Amazon‟s Mechanical Turk 46.7% female median age of 29 (mean age 31.8) median household annual income less than $30k median education of a Bachelor’s Degree 55.5% from India, 38% from the U.S., and the remainder were from Pakistan, Lithuania, Algeria, and Sweden.
    • 42. Flowers-Insects IAT Congruent first Incongruent first(Flowers-Good / Insects-Bad) (Flowers-Bad / Insects-Good)
    • 43. Results Congruent Incongruent IAT t-value p d (ms) (ms) Flowers-Insects 727.52 1003.12 26.342 ~0.00 0.65(Congruent first) Flowers-Insects 750.88 850.85 10.3841 ~0.00 0.26(Incongruent first) Race 771.1 903.88 12.8621 ~0.00 0.32
    • 44. Future extensions Allow easy duplication of templates in experimenter interface Data storage in a database instead of text files Automatic aggregation and display of results in experimenter interface Suggestions? Requests?
    • 45. Thank You!http://github.com/winteram/IAT