Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Badges to Acknowledge Open Practices

Presented at IASSIST 2014 meeting, Toronto, Canada.

  • Be the first to comment

Badges to Acknowledge Open Practices

  1. 1. Badges to Acknowledge Open Practices Andrew Sallans Center for Open Science http://cos.io IASSIST June 2014
  2. 2. Openness is a core value of scientific practice
  3. 3. Challenges: Perceived norms Norms Communality Open Sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Organized skepticism Consider all new evidence, even against one’s prior work Quality Counternorms Secrecy Closed Particularlism Evaluate research by reputation Self-interestedness Treat science as a competition Organized dogmatism Invest career promoting one’s own theories, findings Quantity
  4. 4. Anderson, Martinson & DeVries, 2007
  5. 5. Challenges ● Perceived norms (Anderson, Martinson & DeVries, 2007) ● Motivated reasoning (Kunda, 1990) ● Minimal accountability (Lerner & Tetlock, 1999) ● I am busy (Everyone)
  6. 6. How might this change?
  7. 7. Top-down ● Committees ● Journal Editors ● Federal Agencies ● University administrators Bottom-up ● Exposing users to good practices ● Training sessions ● Workshops ● Spreading the message through active publishing ● Going to where the user is now ● Consultants serving as “Shock troops” Focus on simple interventions that researchers can actually adopt.
  8. 8. How to get a badge... 1. Disclosure --- author provides public statement that they’ve met badge criteria 1. Peer Reviewed --- independent review of author’s public statement and meeting of criteria
  9. 9. What are the criteria? ● Persistent path to the data, materials, pre registration, etc. ● Sufficient information for an independent person to reproduce the results ● Other more specialized items...
  10. 10. Who endorses these badges?
  11. 11. Which journals are adopting?
  12. 12. Going further…baking badges
  13. 13. What comes next? ● Improve the badge issuing workflow ● Refine integration into peer review process ● Gain adoption of more journals/organizations ● Measure effect
  14. 14. Lastly, this is a community effort... Ben B. Blohowiak | Johanna Cohoon | Lee de-Wit | Eric Eich | Frank J. Farach | Roger Giner-Sorolla | Fred Hasselman | Alex O. Holcombe | Macartan Humphreys | Melissa Lewis | Brian A. Nosek | Jonathan Peirce | Andrew Sallans | Jeffrey R. Spies | Chris Seto | Sara Bowman Note: bold are non-COS
  15. 15. Thanks! Find out more and get involved here: https://osf.io/tvyxz/ Email me: andrew@cos.io Twitter: @asallans

×