research scandals representmerely the extreme of acontinuum in the culture ofacademic research
the status quo tolerates poor communication of ﬁndings can reproduce partially can reproduce from 6% processed data w/ discrepancies 21% 54% cannot can reproduce 8% reproduce w/discrepancies 11% can reproduce in principleIoannidis A. et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149-155 (2009) | doi:10.1038/ng.295
often what is in principle reproducible, is not practically reproducible 208,294,724 datapoints 124 pages supplemental material ?? lines unobtainable source code ?? version or architecture of statistical analysis program (R) enumerable R packages and package dependencies key R package “ClaNC” no longer available 442 citationsunidentiﬁed publication ‣ from journal with 5 year impact factor of 28 ‣ article freely available for download ‣ data freely available for download
how are we to move science forwardif we cannot understand what was done previously ?
Nature 483, 509 (29 March 2012) | doi:10.1038/483509a
scientiﬁc method 1. deﬁne a question 2. gather information and resources (background research) 3. form a hypothesis 4. test hypothesis experimentally 5. analyze experimental data 6. draw conclusions based on data 7. publish results 8. retest (frequently done by other scientists)
printed on paper store on local serverexperimentally generatedata @ the bench or static htmlfrom a clinical cohort representation accepted & digitally typeset static pdf representation analyze on local machine sent to write a document reviewers as pdf rn al t to jou s ubmi
scientiﬁc claimsare being artiﬁcially uncoupled from science itself
AcknowledgementsSage Bionetworks External PartnersDavid Burdick - Rockstar Engineer Myles Axton - Nature GeneticsStephen Friend - President and CEO Phil Bourne - PLoS Computational BiologyErich S. Huang - Director of Cancer Research Josh Greenberg - Alfred P. Sloan FoundationMike Kellen - Director of Technology Kelly LaMarco - Science Translational Medicine Ian Mulvaney - eLife Sciences Eric Schadt - Open Network Biology
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.