Public Sharing of Research Datasets: A Pilot Study of Associations

Public sharing of research datasets: a pilot study of associations Heather Piwowar and Wendy Chapman Department of Biomedical Informatics University of Pittsburgh

http://www.flickr.com/photos/vroomvroommm/3457772539 data data

http://www.flickr.com/photos/75166820@N00/5318468/ stale

http://www.flickr.com/photos/ryanr/142455033/ sounds great

http://www.flickr.com/photos/faerie-dust/2315927946/ but not easy

http://www.flickr.com/photos/sunrise/35819369/ http://www.flickr.com/photos/fboyd/2156630044/ persuade

http://www.flickr.com/photos/mesh/14102209/ does it work?

Prior work has focused on surveys and studies of intention. Our aim: measure associations between observed data sharing behaviour and environmental variables aim

Funder Journal Investigator Institution Study Is research data shared after publication? aim

http://en.wikipedia.org/wiki/DNA_microarray http://en.wikipedia.org/wiki/Image:Heatmap.png http://commons.wikimedia.org/wiki/ File:DNA_double_helix_vertikal.PNG microarray data

microarray data

Ochsner et al. (2008). Much room for improvement in deposition rates of expression microarray datasets. Nature Methods, 5(12), 991. Manually reviewed 20 journals for 2007: 400 studies 200 shared their microarray data data sample

Journal Funder Journal Investigator impact mandates mandates “experience” factor Is research data shared after publication? variables

Funder mandates variables

Funder mandates NIH 2003 Data Sharing Requirement Requires a data sharing plan for studies funded after October 2003 that receive more than $500 000 in direct funding per year variables

Funder mandates Assumed data sharing requirement was applicable if: the NIH grant numbers associated with PubMed entry had $750 000 in total funding any year since 2004 plus a NIH grant number with a leading “1” or “2” since 2004 variables

Journal mandates variables

Journal mandates Piwowar and Chapman. A review of journal policies for sharing research data. International Conference on Electronic Publishing (ELPUB) 2008 Journal Policy Strength: Strong, Weak, or None variables

Author experience variables

Author experience Publication history and impact variables

Author experience “experience and impact” proxy: • years since ﬁrst publication • h-index estimate • a-index estimate Scriptable, to allow scaling up to thousands of authors? variables

Author experience Author publication history variables

Author experience Citation counts variables

Author experience Author name disambiguation Author-ity web service: Torvik & Smalheiser. (2009). Author Name Disambiguation in MEDLINE. ACM Transactions on Knowledge Discovery from Data, 3(3):11. variables

Author experience PubMed + PubMed Central + Author-ity to compute pubmedi citation estimates ➡ not comprehensive account of publication accomplishments ➡ for aggregate analysis: free, open, scriptable, ﬂexible, reproducible. variables

Author experience For each first and last author, we used the first principal component of: • years since first publication • pubmedi h-index estimate • pubmedi a-index estimate variables

Journal Funder Journal Investigator impact mandates mandates “experience” factor Is research data shared after publication? variables

Univariate odds ratios Multivariate logistic regression stats

http://www.flickr.com/photos/paperpariah/3002687604/ results

Not statistically significant Statistically significant Journal Funder Journal Investigator impact mandates mandates “experience” factor Is research data shared after publication? results

Funder mandates 33% results

Journal Journal impact mandates factor Strength of journal data sharing policy is very correlated with impact factor results

Investigator “experience” results

http://www.flickr.com/photos/vlastula/300102949/ • Association does not imply causation • Only one datatype • Small sample, limited variables • Dataset contains disproportionate number of high-impact studies limitations

• NIH data sharing plan applies to a minority of NIH microarray studies • NIH data sharing plan does not seem to increase frequency of data sharing • More experienced investigators are more likely to share data prelim conclusions

http://www.flickr.com/photos/krcla/2069243613/ PhD dissertation! • More samples • More variables next steps

http://www.flickr.com/photos/cogdog/123072/ Spin-off projects: • Quantify usefulness of pubmedi h-index • Study the patterns and prevalence of data reuse future

Dept of Biomedical Informatics at U of Pittsburgh NLM for training grant funding Open science online community and those who release their articles, datasets and photos openly Dr Wendy Chapman for her support and feedback thanks

Journal mandates variables

Journal Policy strength mandates categorization: None: No applicable mention of data sharing Weak: Request or unenforceable requirement Strong: Require data deposit accession number as a condition of publication variables

http://www.flickr.com/photos/myklroventine/892446624/ I post my data, code, and statistical scripts at http://www.dbmi.pitt.edu/piwowar Share yours too! open science

Public Sharing of Research Datasets: A Pilot Study of Associations

by Heather Piwowar on Oct 16, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 1

Statistics

Public Sharing of Research Datasets: A Pilot Study of Associations — Presentation Transcript