Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Improving Integrity, Transparency, and Reproducibility Through Connection of the Scholarly Workflow

The Center for Open Science (COS) was founded as a non-profit technology start-up in 2013 with the goal of improving transparency and reproducibility by connecting the scholarly workflow. COS achieves this goal through the development of a free, open source web application called the Open Science Framework (OSF), providing features like file sharing and citing, persistent urls, provenance tracking, and automated versioning. Initial workflow API connections focused on storage services and included Figshare, GitHub, Amazon S3, Dropbox, and Dataverse. The team is now working to connect other parts of the workflow with services like DMPTool, Databib/re3data, and Databrary. This session will introduce the core architecture and the problems that it solves, and illustrate how connecting services can benefit everyone involved in supporting the research ecosystem. COS is funded through the generosity of grants from the Laura and John Arnold Foundation, the John Templeton Foundation, the Alfred P. Sloan Foundation, the Association of Research Libraries, and others.

Presented at CNI Fall 2014, Washington, DC.

  • Be the first to comment

  • Be the first to like this

Improving Integrity, Transparency, and Reproducibility Through Connection of the Scholarly Workflow

  1. 1. Improving Integrity, Transparency, and Reproducibility Through Connec:on of the Scholarly Workflow Andrew Sallans Partnerships Lead Center for Open Science
  2. 2. A talk on the Open Science Framework 1. Free, open source plaHorm 2. Designed to add efficiency to workflow 3. Connector to other tools and services
  3. 3. So, why is this important?
  4. 4. Challenges: Perceived norms Norms Communality Open Sharing Universalism Evaluate research on own merit Disinterestedness Motivated by knowledge and discovery Organized skepticism Consider all new evidence, even against one’s prior work Quality Counternorms Secrecy Closed Particularlism Evaluate research by reputation Self-interestedness Treat science as a competition Organized dogmatism Invest career promoting one’s own theories, findings Quantity
  5. 5. Anderson, Martinson & DeVries, 2007
  6. 6. A liNle something about COS • Est. 2013 • Non-­‐profit tech startup • 4 leading founda:on funders, > $14M • Located in CharloNesville, VA • Team: ~ 25 FT & 20 interns • Mostly so]ware developers and researchers Mission: Improve openness, integrity, and reproducibility of research
  7. 7. Create an account easy and free!
  8. 8. Modify Account Settings Update information
  9. 9. Dashboard Project Organizer
  10. 10. Project Overview Page Overview
  11. 11. Using the Wiki In the menu bar Wiki history Add new or edit
  12. 12. Adding Components Add a new component
  13. 13. Adding Contributors Select from the results Choose permissions
  14. 14. Privacy
  15. 15. Uploading Files Click upload button or just drag and drop
  16. 16. Versioning See version history and download
  17. 17. Registering Your Work Choose the registration template Create a frozen registered version
  18. 18. Sharing Your Work Create a view-only link Describe the link use Option to make anonymous Select what parts of the project to share
  19. 19. Unique and permanent IDs Scientific content must be easy to cite and annotate Approach: GUIDs for all content -> RPCB -> Tim Errington -> Coding_Study_1.xslx
  20. 20. Current Add Ons: • Dropbox • Github • Dataverse • Figshare • AmazonS3
  21. 21. Connecting the workflow
  22. 22. Examples of other connec:ons Taking a data management plan and conver:ng it into a living document. Providing a data repository lookup service and checklist to assist with prepara:on for deposit. Connec:ng to a sensi:ve video storage service.
  23. 23. Tools used: OPEN SCIENCE FRAMEWORK | @OSFramework | #OSFinAction OSF in the lab Erica Baranski Qualtrics, Dropbox, Survey Monkey, R Q What tools do you use in your research? A OSF features used: version control, collabora:on, wiki for lab notebook and mee:ngs Q How do you use the OSF?
  24. 24. Tools used: next-­‐gen sequencers, pipeline so]ware, custom so]ware OSF features used: version control, file sharing, GitHub and Dropbox integra:on, public sharing.
  25. 25. Problem to solve: teaching undergrads how to make research reproducible and verifiable. OSF features used: organiza:on of documents and data, command files, metadata, and file sharing.
  26. 26. What’s underneath the hood? • Python • Javascript • Git • MongoDB / TokuMx • Ansible • Elas:csearch • OSF API • Rackspace • Linode
  27. 27. Want to join the effort? • Contribute content to SHARE or partner on cura:on of content • Serve as an Ambassador • Coordinate a reproducible sta:s:cs and prac:ces workshop • Join the team – hNp://
  28. 28. Open Science Framework Email: Twitter: @OSFramework