Uncovering the                        Impact Story                     of Open Research                         Heather	  ...
Research evaluation     matters
who gets hired               who gets grants           which journals succeed      which journal innovations succeed     w...
right now, impact factor
problems!        run-away hitsdecision of 4 anonymous people    only one type of impact    favours the established
let me tell you something that isgoing to start changing the game
A few weeks ago, on Oct 4,NSF announced it is going to change its Biosketch Template to call for             “Products”   ...
Big deal. So it is a new title.
Whole lot more than that.
1.A major science funder believes status quo isnt the onlyway to disseminate research, and traditional peer-reviewedarticl...
2.It signals this to all the researchers who apply to the NSF.This is a big deal, because it moves the discussionaway from...
3.It necessitates a move away from journal impact factors.The quality and impact of data and software cant beevaluated wit...
4.Once we are in the grant review door with item-level metrics,watch out!Alternative metrics are empowering for innovation...
5.It demonstrates a willingness on the part of funders torefine what they consider evaluation-worthy criteria.Transformati...
what can the world     look like
Beyond theImpact Factor
Beyond the  Article
QualityImpact
A Single NumberMultiple Dimensions
Multiple Flavours         CC-BY-NC by maniacyak on flickr         http://www.flickr.com/photos/maniacyak/3432589472
Open
Context
Agileexperimentation
Tell the full story of research impact.
altmetrics.org/tools Altmetric.com ImpactStory PLOS article-level metrics Plum Analytics Reader Meter Science Card
http://www.flickr.com/photos/pixscapes/4331070047
born as total-impactHackathon!incorporating as nonprofitBoard: Cameron Neylon, John Wilbanks
http://orcid.org
what can the world     look like
Beyond theImpact Factor
Beyond the  Article
datasets!software! slides!preprints!  blogs!
context
type of engagement  type of audience
comparisons, reference sets
not just one number
not just one flavour
open!
rOpenSci     PlumUbiquity Press    PeerEv dissertationsIR experiments      ...
barrier-based $$$
http://www.flickr.com/photos/quinnanya/2055471833
http://flickr.com/photos/nieve44/2152712789/
Changes are happening inscholarly communication.      http://www.flickr.com/photos/myklroventine/892446624/
http://www.flickr.com/photos/jo-h/2688026447/
Build great things.Reward impactful work. Tell the full story of our research impact.
thank you!Jason Priem: cofounder of ImpactStoryAlso: Todd Vision, Mike Whitlock, the open science community, and   those w...
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Uncovering the Impact Story of Open Research
Upcoming SlideShare
Loading in...5
×

Uncovering the Impact Story of Open Research

672

Published on

UBC OAweek 2012 presentation by Heather Piwowar. Covers research impact tracking, altmetrics, data sharing, ImpactStory, and more.

Published in: Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
672
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
7
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Uncovering the Impact Story of Open Research

  1. 1. Uncovering the Impact Story of Open Research Heather  Piwowar  @researchremix   Postdoc  with  NESCent  and  Dryad,  at  Duke  and  UBCsome photos NC, SA UBC  2012  
  2. 2. Research evaluation matters
  3. 3. who gets hired who gets grants which journals succeed which journal innovations succeed whether we publish in journals at all whether we actually write articlesthe whole structure of scientific communication
  4. 4. right now, impact factor
  5. 5. problems! run-away hitsdecision of 4 anonymous people only one type of impact favours the established
  6. 6. let me tell you something that isgoing to start changing the game
  7. 7. A few weeks ago, on Oct 4,NSF announced it is going to change its Biosketch Template to call for “Products” instead of “Publications”
  8. 8. Big deal. So it is a new title.
  9. 9. Whole lot more than that.
  10. 10. 1.A major science funder believes status quo isnt the onlyway to disseminate research, and traditional peer-reviewedarticles in high impact journals are not all that matters.Other research products can be consideredfirst-class research products.
  11. 11. 2.It signals this to all the researchers who apply to the NSF.This is a big deal, because it moves the discussionaway from just OA advocates and open data tweepsto all scientists. All scientists now get to think,"hrmm, did I release a dataset that is as good as my papers?"
  12. 12. 3.It necessitates a move away from journal impact factors.The quality and impact of data and software cant beevaluated with the journal impact factor.Item level metrics and altmetrics are going to be totallynecessary for grant reviewers to know whether thesealternative products have made a difference.
  13. 13. 4.Once we are in the grant review door with item-level metrics,watch out!Alternative metrics are empowering for innovations inpublishing. All the new journal experiments that arespringing up... eLife, Peerj, F1000 Research, PLoSCurrents.... are invited to compete, invited to help authorsmake the case that the articles published in those containerswere impactful.Very empowering for innovative journals, most of which areOA. And empowering for dismantling the "article" yet furtherinto its component parts.
  14. 14. 5.It demonstrates a willingness on the part of funders torefine what they consider evaluation-worthy criteria.Transformation is going to happen as major fundersencourage their applicants to brag about their openness,and the impact that their openness has enabled.
  15. 15. what can the world look like
  16. 16. Beyond theImpact Factor
  17. 17. Beyond the Article
  18. 18. QualityImpact
  19. 19. A Single NumberMultiple Dimensions
  20. 20. Multiple Flavours CC-BY-NC by maniacyak on flickr http://www.flickr.com/photos/maniacyak/3432589472
  21. 21. Open
  22. 22. Context
  23. 23. Agileexperimentation
  24. 24. Tell the full story of research impact.
  25. 25. altmetrics.org/tools Altmetric.com ImpactStory PLOS article-level metrics Plum Analytics Reader Meter Science Card
  26. 26. http://www.flickr.com/photos/pixscapes/4331070047
  27. 27. born as total-impactHackathon!incorporating as nonprofitBoard: Cameron Neylon, John Wilbanks
  28. 28. http://orcid.org
  29. 29. what can the world look like
  30. 30. Beyond theImpact Factor
  31. 31. Beyond the Article
  32. 32. datasets!software! slides!preprints! blogs!
  33. 33. context
  34. 34. type of engagement type of audience
  35. 35. comparisons, reference sets
  36. 36. not just one number
  37. 37. not just one flavour
  38. 38. open!
  39. 39. rOpenSci PlumUbiquity Press PeerEv dissertationsIR experiments ...
  40. 40. barrier-based $$$
  41. 41. http://www.flickr.com/photos/quinnanya/2055471833
  42. 42. http://flickr.com/photos/nieve44/2152712789/
  43. 43. Changes are happening inscholarly communication. http://www.flickr.com/photos/myklroventine/892446624/
  44. 44. http://www.flickr.com/photos/jo-h/2688026447/
  45. 45. Build great things.Reward impactful work. Tell the full story of our research impact.
  46. 46. thank you!Jason Priem: cofounder of ImpactStoryAlso: Todd Vision, Mike Whitlock, the open science community, and those who release their articles, datasets and photos openly. blog.ImpactStory.org team@ImpactStory.org @ImpactStory ImpactStory.org
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×