Open Source IAT - SPSP 2013

15,211 views

Published on

3 Comments
2 Likes
Statistics
Notes
  • Hi, where can I find this website please?
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • This looks fantastic! I'm going to be telling everyone I know who does IAT stuff about this.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Hi Winter, unfortunately I was unable to attend your symposium but I wanted to let you know that I have adapted the 2.0 version by Ben Sigmon to work on touchscreens. If you'd like some more information, feel free to contact me at darrick.chow@mail.mcgill.ca.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
15,211
On SlideShare
0
From Embeds
0
Number of Embeds
10,767
Actions
Shares
0
Downloads
53
Comments
3
Likes
2
Embeds 0
No embeds

No notes for slide
  • Copy to serverWalk through experimenter interfaceWalk through IATCreate new IAT (Flowers / Insects?)Set it to activeStart IAT
  • Copy to serverWalk through experimenter interfaceWalk through IATCreate new IAT (Flowers / Insects?)Set it to activeStart IAT
  • Open Source IAT - SPSP 2013

    1. 1. An Open Source IAT forOnline Data Collection Winter Mason Stevens Institute of Technology
    2. 2. Implicit Association Test (IAT) The Implicit Association Test (IAT; Greenwald, McGhee, & Schwartz, 1998) was devised as a way to measure implicit attitudes towards categories of objects or people. Since then it has been used extensively in the field (McConnell & Leibold, 2001; Conrey, et al., 2003; Nosek, 2005, 2007) Including online applications (c.f., Project Implicit: http://projectimplicit.com). However, until now, the means to run the IAT has required commercial software such as e-Prime for laboratory studies and has not been widely and freely available for online research.
    3. 3. Open Source software Open-source software is software that has been developed by and/or shared with a community of developers  Firefox, Linux, R, etc., etc. Based on the idea that sharing resources reduces unnecessary duplication of effort and increases social efficiency This idea should be applied to all aspects of science  Sharing methods and materials reduces duplication of effort and facilitates replication  Sharing data allows transparency and reproducibility  Also see openscienceframework.org
    4. 4. Requirements Experimenter:  Has been successfully tested  A web server that runs PHP with v4.0 or greater  Mac OS 10.5, 10.6,  Windows XP, Vista  Ubuntu 11. Participant:  A web browser that allows  It has also been successfully Javascript tested with  Mozilla’s Firefox  Google Chrome  Internet Explorer 8 & 9.
    5. 5. Experimenter View
    6. 6. A list of available IATtemplates to modify ormake active
    7. 7. The currently active IAT;Participants will completethis version when they goto the main IAT page.
    8. 8. Edit the name of thetemplate
    9. 9. Choose whetherparticipants arepresented with theresults of their IAT atthe end of the test.
    10. 10. Select the categoryyou want to edit
    11. 11. Select the categoryyou want to edit
    12. 12. Select the categoryyou want to edit
    13. 13. This is the name of thecategory seen by theparticipants.
    14. 14. This is the name of thecategory that is storedin the output datafile.
    15. 15. Choose whether theitems in the categorywill be text or images.
    16. 16. With images, you cansee a preview of theimage next to the filename.
    17. 17. Change the file namehere…
    18. 18. …and update thethumbnail image withthis button.
    19. 19. With text items, thethumbnails and“update images”button are hidden.
    20. 20. Delete an item withthe „x‟ button
    21. 21. Once you have madeall of your changes,don‟t forget to save!
    22. 22. If you select anothertemplate or create anew template,unsaved changed willbe lost!
    23. 23. To change the IATparticipants see,select the templateand press this button.
    24. 24. Create a new template withthis button.
    25. 25. Make sure you‟veadded items for all 4categories, and don‟tforget to save!
    26. 26. Participant View
    27. 27. Enter a unique identifier for theparticipant (a random string is pre-filled). The output data file will beassociated with this ID. You canalso use this to match with aTurker‟s submitted HIT.
    28. 28. The name of theactive template isshown here.
    29. 29. The category labels forCategory A and B are shownin the first trial
    30. 30. The templates are stored in a folder with the samename as the template, and image files are storedin the “img” folder inside the correspondingtemplate folder.
    31. 31. The category labels forCategory 1 and 2 are shownin the second trial
    32. 32. If the participant gets it wrong,the X appears until the correctkey is pressed.
    33. 33. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … …The output is stored in the “output” folder in the template‟s folder asa comma-delimited file. The name of the file follows the pattern[Template Name]-[Subject ID]-YYYY-MM-DD-HH-mm. For example,Race-JohnDoe-2013-01-22-18-52.csv.
    34. 34. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … There are 7 Trials in the standard IAT
    35. 35. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … There are 20 or 40 round per trial, depending on whether it is a practice trial or not
    36. 36. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … The character(s) used here to indicate the category are defined in the template.
    37. 37. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … The item number refers to which particular item was presented. The order of item presentation is randomized. The number indicates its order in the template (starting from zero).
    38. 38. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … This is the number of errors the participant made on that round.
    39. 39. OutputTrial Round Category Item Errors RT0 1 F 4 0 5600 2 M 3 0 4320 3 F 0 1 913… … … … … … This is the participant‟s response time in milliseconds for that item on that round. The final IAT score is determined by these reaction times.
    40. 40. Validation The standard deviation of system error was 29.4ms, with fewer than 4% larger than 50ms and the largest error recorded at 167ms. The typical standard deviation of a users reaction time is approximately 300ms, as reported in Greenwald, et. al (1998, 2003) and observed in the replications reported here. The error introduced by the system is an order of magnitude less than user error.
    41. 41. Replicating prior work 63 participants recruited from Amazon‟s Mechanical Turk 46.7% female median age of 29 (mean age 31.8) median household annual income less than $30k median education of a Bachelor’s Degree 55.5% from India, 38% from the U.S., and the remainder were from Pakistan, Lithuania, Algeria, and Sweden.
    42. 42. Flowers-Insects IAT Congruent first Incongruent first(Flowers-Good / Insects-Bad) (Flowers-Bad / Insects-Good)
    43. 43. Results Congruent Incongruent IAT t-value p d (ms) (ms) Flowers-Insects 727.52 1003.12 26.342 ~0.00 0.65(Congruent first) Flowers-Insects 750.88 850.85 10.3841 ~0.00 0.26(Incongruent first) Race 771.1 903.88 12.8621 ~0.00 0.32
    44. 44. Future extensions Allow easy duplication of templates in experimenter interface Data storage in a database instead of text files Automatic aggregation and display of results in experimenter interface Suggestions? Requests?
    45. 45. Thank You!http://github.com/winteram/IAT

    ×