Repeat after me:
Is our research reproducible (enough)?
Lex Nederbragt
whoami

@lexnederbragt

flxlexblog.wordpress.com
whatdoido
What is ‘Reproducible research’?
“Reproducibility is the ability of an entire
experiment or study to be reproduced

either...
Reproducibility: why?
The worst case

https://www.sciencemag.org/content/334/6056/579.full.pdf
A reproducibility crisis?

Retraction rates are on the rise Murat Cokol, Fatih Ozbay & Raul Rodriguez-Esteban
EMBO reports...
Does this affect us?
An example from our own work

2011
An example from our own work

Are all these figures/tables reproducible?

Supplementary information, page 19-63 of 72
An exercise in reproducibility
Master student project at informatics Sabba Ifzal
Solutions

Flick: http://farm4.staticflickr.com/3319/3265787219_bfbc654b5e_o.jpg

Wikimedia commons
Levels of reproducibility

Loose descriptions
that are very
incomplete, no
data/materials

All
data, protocols, code
etc
Levels of reproducibility
Minimum effort needed to
reproduce meaningfully
Loose descriptions
that are very
incomplete, no
...
Reproducibility and reusability

http://upload.wikimedia.org/wikipedia/commons/4/48/Recycle.jpg
How to make your research reproducible
Document your work
How to make your research reproducible

http://howdoitradestocks.com/wp-content/uploads/2011/12/share-ideas1.jpg
How to make your research reproducible

https://twitter.com/vsbuffalo/statuses/377651287133003776
How to make your research reproducible

https://github.com/lexnederbragt
How to make your research reproducible
Version control

https://www.atlassian.com/git/workflows
How to make your research reproducible
How to make your research reproducible

http://software-carpentry.org
https://twitter.com/ctitusbrown/status/383730337811296256
Upcoming SlideShare
Loading in …5
×

Repeat after me: Is our research reproducible (enough)?

1,484 views

Published on

A short talk I gave to colleagues at the Centre for Ecological and Evolutionary Synthesis (CEES) Dept. of Biosciences, University of Oslo

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,484
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
10
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Repeat after me: Is our research reproducible (enough)?

  1. 1. Repeat after me: Is our research reproducible (enough)? Lex Nederbragt
  2. 2. whoami @lexnederbragt flxlexblog.wordpress.com
  3. 3. whatdoido
  4. 4. What is ‘Reproducible research’? “Reproducibility is the ability of an entire experiment or study to be reproduced either by the researcher or by someone else working independently. It is one of the main principles of the scientific method.” Wikipedia
  5. 5. Reproducibility: why?
  6. 6. The worst case https://www.sciencemag.org/content/334/6056/579.full.pdf
  7. 7. A reproducibility crisis? Retraction rates are on the rise Murat Cokol, Fatih Ozbay & Raul Rodriguez-Esteban EMBO reports (2008) 9, 2 doi:10.1038/sj.embor.7401143
  8. 8. Does this affect us?
  9. 9. An example from our own work 2011
  10. 10. An example from our own work Are all these figures/tables reproducible? Supplementary information, page 19-63 of 72
  11. 11. An exercise in reproducibility Master student project at informatics Sabba Ifzal
  12. 12. Solutions Flick: http://farm4.staticflickr.com/3319/3265787219_bfbc654b5e_o.jpg Wikimedia commons
  13. 13. Levels of reproducibility Loose descriptions that are very incomplete, no data/materials All data, protocols, code etc
  14. 14. Levels of reproducibility Minimum effort needed to reproduce meaningfully Loose descriptions that are very incomplete, no data/materials All data, protocols, code etc
  15. 15. Reproducibility and reusability http://upload.wikimedia.org/wikipedia/commons/4/48/Recycle.jpg
  16. 16. How to make your research reproducible Document your work
  17. 17. How to make your research reproducible http://howdoitradestocks.com/wp-content/uploads/2011/12/share-ideas1.jpg
  18. 18. How to make your research reproducible https://twitter.com/vsbuffalo/statuses/377651287133003776
  19. 19. How to make your research reproducible https://github.com/lexnederbragt
  20. 20. How to make your research reproducible Version control https://www.atlassian.com/git/workflows
  21. 21. How to make your research reproducible
  22. 22. How to make your research reproducible http://software-carpentry.org
  23. 23. https://twitter.com/ctitusbrown/status/383730337811296256

×