7 data citation challenges, illustrated with data (includes elephants)

2,377 views
2,295 views

Published on

Presentation given by Heather Piwowar at the JISC Managing Research Data workshop on March 29 2011 in Birmingham UK.

Published in: Education

7 data citation challenges, illustrated with data (includes elephants)

  1. 1. 7 data citation challenges illustrated with data (includes elephants) Heather  Piwowar DataONE  postdoc  with  NESCent  and  Dryad @researchremix   JISC  Managing  Research  Data    March  2011  #jiscmrd
  2. 2. http://www.flickr.com/photos/nilsrinaldi/5157809483/
  3. 3. http://www.flickr.com/photos/paulhami/1020538523//
  4. 4. Why do we care?CVsImpact of repositories, research programs, institutions, funding programsTracking patterns to inform policy
  5. 5. A1%-3,&%"1%()67789:;,-5--B&2$"5%,$C-//%112(3 &%)%&%3/%D%=5&->(0-5%,5(-00()*"$+%, %#!!"!"#$%&()*"$+%,-&./0%1&%)%&&2345(-67789:;,-5-1%5 %!!!" )*"+,-.*/0"12"3*44*2" <%=5&->(0-5%,)&(#*"$+%,?%35&-0@ 51-."6+-+07-"678*01-" $#!!" 9,-.*/0"12"3*44*2"51-." 6+-+07-"678*01-" $!!!" #!!" !" %!!&" %!!" %!!(" %!$!" http://researchremix.wordpress.com/2011/02/18/early_results
  6. 6. #1Few policies request or require data citation
  7. 7. We reviewed policies of various stakeholders within the environmental sciences, looking for evidence of data citation policies and attribution suggestions. Policies in our sample that mention data citation:Journal policies rarely included useful best practices. Nicholas Weber, Data citation in the wild IDCC 2010 poster. Policy links can be found at: http://openwetware.org/wiki/User:Valerie_Enriquez/Notebook/DataONE_Web_resources
  8. 8. #2No consistent practice
  9. 9. We reviewed 500 articles in six major evolution and ecologyjournals for evidence of data citation: Sarah Judson, Data citation in the wild IDCC 2010 poster.
  10. 10. We reviewed 500 articles in six major evolution and ecologyjournals for evidence of data citation: Sarah Judson, Data citation in the wild IDCC 2010 poster.
  11. 11. #3Huge manual effort required to track
  12. 12. http://www.flickr.com/photos/archeon/2941655917/
  13. 13. In 2009, there were 116 articles citing ORNL DAAC data.Finding these articles took 70-80 hours of workacross  at  least  12  search  engines,  abstract  servers,  cita3on  databases,  and  full-­‐text  archives,  all  chosen  from  a  deep  understanding  of  this  specific  research  domainthen  the  full  text  of  the  hits  were  manually  reviewed. Valerie Enriquez interview with James Kidder http://openwetware.org/wiki/DataONE:Notebook/Reuse_of_repository_data
  14. 14. Data citation in the wild IDCC 2010 poster.
  15. 15. #4Lack of tool support!
  16. 16. Research Remix blog: http://bit.ly/aOwLoJ“Tracking Dataset Citations Using Common Citation Tracking Tools Doesn’t Work”
  17. 17. Research Remix blog: http://bit.ly/aOwLoJ“Tracking Dataset Citations Using Common Citation Tracking Tools Doesn’t Work”
  18. 18. #5Our best practices don’t scale to mega-reuse
  19. 19. !"#$%&()*+,+-%,-&%)%&%./%*$0+&1/2%- ,3+,&%"-%*456*+,+7/"#"2+18%$!!"# ,!"# +!"# *!"# )!"# (!"# !"# &!"# %!"# $!"# !"# !# (# $!# $(# %!# %(# &!#
  20. 20. !"#$%&()*+,+-%,-&%)%&%./%*$0+&1/2%- ,3+,&%"-%*456*+,+7/"#"2+18%$!!"# ,!"# +!"# *!"# )!"# (!"# !"# &!"# %!"# $!"# !"# !# (# $!# $(# %!# %(# &!#
  21. 21. !"#$%&()*+,+-%,-&%)%&%./%*$0+&1/2%- ,3+,&%"-%*456*+,+7/"#"2+18%$!!"# ,!"# +!"# *!"# )!"# (!"# !"# &!"# %!"# $!"# !"# !# (# $!# $(# %!# %(# &!#
  22. 22. http://www.nature.com/nature/authors/gta/
  23. 23. #6Adoption of best practices erode incentives in the short term
  24. 24. ~70%in multivariateanalysis
  25. 25. #7Data citations only matter if they are valued
  26. 26. Please donʼt tweet or publicize this next bit...Early results from an ongoing survey.n=538
  27. 27. [graphs removed from public slides because survey data collection is ongoing] Do not publicize outside MRC workshop
  28. 28. [graphs removed from public slides because survey data collection is ongoing] Do not publicize outside MRC workshop
  29. 29. • Few policies request or require data citation• No consistent practice• Huge manual effort required to track• Lack of tool support!• Our best practices donʼt scale to mega-reuse• Adoption of best practices erode incentives in the short term• Data citations only matter if they are valued
  30. 30. http://www.flickr.com/photos/sunrise/35819369/
  31. 31. http://www.flickr.com/photos/ryanr/142455033/
  32. 32. http://www.flickr.com/photos/ginable/325235488/
  33. 33. thank youDryad and DataONE colleagues, in particular: Todd Vision Nicholas Weber, Sarah Judson, Valerie EnriquezSimon Hodson and JISC.The open science online community and those who release their articles, datasets and photos openly.

×