Presentation given by Heather Piwowar at the JISC Managing Research Data workshop on March 29 2011 in Birmingham UK.

1. 7 data citation challenges
illustrated with data
(includes elephants)
Heather
Piwowar
DataONE
postdoc
with
NESCent
and
Dryad
@researchremix
JISC
Managing
Research
Data
March
2011
#jiscmrd

2. http://www.flickr.com/photos/nilsrinaldi/5157809483/

3. http://www.flickr.com/photos/paulhami/1020538523//

4. Why do we care?
CVs
Impact of repositories, research programs, institutions,
funding programs
Tracking patterns to inform policy

5. A1%'-3,'&%"1%'()'6778'9:;',-5-'-B&2$"5%,'$C'-//%112(3'
&%)%&%3/%D'%=5&->(0-5%,'5('-00'()'*"$+%,'
%#!!"
!"#$%&'()'*"$+%,'-&./0%1'&%)%&&234'5('-'6778'9:;',-5-1%5''
%!!!"
)*"+,-.*/0"12"3*44*2"
<%=5&->(0-5%,')&(#'*"$+%,'?%35&-0@'
51-."6+-+07-"678*01-"
$#!!"
9,-.*/0"12"3*44*2"51-."
6+-+07-"678*01-"
$!!!"
#!!"
!"
%!!&" %!!'" %!!(" %!$!"
http://researchremix.wordpress.com/2011/02/18/early_results

6. #1
Few policies request
or require data
citation

7. We reviewed policies of various stakeholders within the
environmental sciences, looking for evidence of data citation
policies and attribution suggestions.
Policies in our sample that mention data citation:
Journal policies rarely included useful best practices.
Nicholas Weber, Data citation in the wild IDCC 2010 poster.
Policy links can be found at: http://openwetware.org/wiki/User:Valerie_Enriquez/Notebook/DataONE_Web_resources

8. #2
No consistent practice

10. We reviewed 500 articles in six major evolution and ecology
journals for evidence of data citation:
Sarah Judson, Data citation in the wild IDCC 2010 poster.

11. We reviewed 500 articles in six major evolution and ecology
journals for evidence of data citation:
Sarah Judson, Data citation in the wild IDCC 2010 poster.

12. #3
Huge manual effort
required to track

14. http://www.flickr.com/photos/archeon/2941655917/

16. In 2009, there were 116 articles citing ORNL DAAC data.
Finding these articles took 70-80 hours of work
across
at
least
12
search
engines,
abstract
servers,
cita3on
databases,
and
full-­‐text
archives,
all
chosen
from
a
deep
understanding
of
this
specific
research
domain
then
the
full
text
of
the
hits
were
manually
reviewed.
Valerie Enriquez interview with James Kidder
http://openwetware.org/wiki/DataONE:Notebook/Reuse_of_repository_data

17. Data citation in the wild IDCC 2010 poster.

20. #4
Lack of tool support!

27. Research Remix blog: http://bit.ly/aOwLoJ
“Tracking Dataset Citations Using Common Citation Tracking Tools Doesn’t Work”

28. Research Remix blog: http://bit.ly/aOwLoJ
“Tracking Dataset Citations Using Common Citation Tracking Tools Doesn’t Work”

29. #5
Our best practices don’t
scale to mega-reuse

31. !"#$%&'()'*+,+-%,-'&%)%&%./%*'$0'+&1/2%-'
,3+,'&%"-%*'456'*+,+7'/"#"2+18%'
$!!"#
,!"#
+!"#
*!"#
)!"#
(!"#
'!"#
&!"#
%!"#
$!"#
!"#
!# (# $!# $(# %!# %(# &!#

32. !"#$%&'()'*+,+-%,-'&%)%&%./%*'$0'+&1/2%-'
,3+,'&%"-%*'456'*+,+7'/"#"2+18%'
$!!"#
,!"#
+!"#
*!"#
)!"#
(!"#
'!"#
&!"#
%!"#
$!"#
!"#
!# (# $!# $(# %!# %(# &!#

33. !"#$%&'()'*+,+-%,-'&%)%&%./%*'$0'+&1/2%-'
,3+,'&%"-%*'456'*+,+7'/"#"2+18%'
$!!"#
,!"#
+!"#
*!"#
)!"#
(!"#
'!"#
&!"#
%!"#
$!"#
!"#
!# (# $!# $(# %!# %(# &!#

34. http://www.nature.com/nature/authors/gta/

36. #6
Adoption of best practices
erode incentives in the
short term

37. ~70%
in multivariate
analysis

38. #7
Data citations only matter
if they are valued

39. Please donʼt tweet or publicize this next bit...
Early results from an ongoing survey.
n=538

40. [graphs removed from public slides because
survey data collection is ongoing]
Do not publicize outside MRC workshop

41. [graphs removed from public slides because
survey data collection is ongoing]
Do not publicize outside MRC workshop

42. • Few policies request or require data citation
• No consistent practice
• Huge manual effort required to track
• Lack of tool support!
• Our best practices donʼt scale to mega-reuse
• Adoption of best practices erode incentives
in the short term
• Data citations only matter if they are valued

43. http://www.flickr.com/photos/sunrise/35819369/

44. http://www.flickr.com/photos/ryanr/142455033/

45. http://www.flickr.com/photos/ginable/325235488/

46. thank you
Dryad and DataONE colleagues, in particular:
Todd Vision
Nicholas Weber, Sarah Judson, Valerie Enriquez
Simon Hodson and JISC.
The open science online community
and those who release their articles, datasets and
photos openly.