Impact                      beyond the                     Impact Factor                        Heather	  Piwowar	  @resea...
Research evaluation     matters
who gets hired               who gets grants           which journals succeed      which journal innovations succeed     w...
right now, impact factor
evaluated based on the container   that publishes the research
impact factor is  the average number of citationsreceived by an article in that journal  within first 2 years of publication
rewards impactbased on a journal pecking order
right now, evaluation looks like this
problems!          prefiltered        run-away hitsdecision of 4 anonymous people    only one type of impact  favours esta...
Impact beyond theImpact Factorpause for Qs   (h:mute)
what can the world     look like
beyond theImpact Factor
http://www.flickr.com/photos/pixscapes/4331070047
right now, evaluation looks like this
it can look like this
even better, it can look like this
not just for articles
not just two years from now                   http://arxiv.org/html/1203.4745
not just on a website
not just winners and losers      impact flavors!              CC-BY-NC by maniacyak on flickr              http://www.flic...
#altmetricsfastflavourfulopenwith contextbeyond the article
altmetrics.org/tools Altmetric.com ImpactStory PLOS article-level metrics Plum Analytics Reader Meter Science Card
Impact beyond theImpact Factorpause for Qs   (h:mute)
Tell the full story of research impact.  ImpactStory.org
born as total-impactNonprofitBoard: Cameron Neylon, John Wilbanks
http://www.flickr.com/photos/quinnanya/2055471833
embedding in journals      rOpenSci     Plum demo   Ubiquity Press       PeerEv    dissertations   IR experiments         ...
barrier-based $$
barrier-based pond
http://flickr.com/photos/nieve44/2152712789/
ImpactStory.orgaltmetrics.org/tools
Changes are happening inscholarly communication.      http://www.flickr.com/photos/myklroventine/892446624/
http://www.flickr.com/photos/jo-h/2688026447/
Tell the full story ofour research impact.
thank you!Jason Priem: cofounder of ImpactStoryAlso: Todd Vision, Mike Whitlock, the open science community, and   those w...
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Impact beyond the Impact Factor
Upcoming SlideShare
Loading in …5
×

Impact beyond the Impact Factor

4,318 views

Published on

Presentation by Heather Piwowar on Nov 15, 2012 in a webinar hosted by EdFuture 2012 #CFHE12

Impact beyond the Impact Factor

  1. 1. Impact beyond the Impact Factor Heather  Piwowar  @researchremix   cofounder  of  @ImpactStory EdFuture  2012    some photos NC, SA #CFHE12
  2. 2. Research evaluation matters
  3. 3. who gets hired who gets grants which journals succeed which journal innovations succeed whether we publish in journals at all whether we actually write articlesthe whole structure of scientific communication
  4. 4. right now, impact factor
  5. 5. evaluated based on the container that publishes the research
  6. 6. impact factor is the average number of citationsreceived by an article in that journal within first 2 years of publication
  7. 7. rewards impactbased on a journal pecking order
  8. 8. right now, evaluation looks like this
  9. 9. problems! prefiltered run-away hitsdecision of 4 anonymous people only one type of impact favours established venues expensive closed
  10. 10. Impact beyond theImpact Factorpause for Qs (h:mute)
  11. 11. what can the world look like
  12. 12. beyond theImpact Factor
  13. 13. http://www.flickr.com/photos/pixscapes/4331070047
  14. 14. right now, evaluation looks like this
  15. 15. it can look like this
  16. 16. even better, it can look like this
  17. 17. not just for articles
  18. 18. not just two years from now http://arxiv.org/html/1203.4745
  19. 19. not just on a website
  20. 20. not just winners and losers impact flavors! CC-BY-NC by maniacyak on flickr http://www.flickr.com/photos/maniacyak/3432589472
  21. 21. #altmetricsfastflavourfulopenwith contextbeyond the article
  22. 22. altmetrics.org/tools Altmetric.com ImpactStory PLOS article-level metrics Plum Analytics Reader Meter Science Card
  23. 23. Impact beyond theImpact Factorpause for Qs (h:mute)
  24. 24. Tell the full story of research impact. ImpactStory.org
  25. 25. born as total-impactNonprofitBoard: Cameron Neylon, John Wilbanks
  26. 26. http://www.flickr.com/photos/quinnanya/2055471833
  27. 27. embedding in journals rOpenSci Plum demo Ubiquity Press PeerEv dissertations IR experiments ...
  28. 28. barrier-based $$
  29. 29. barrier-based pond
  30. 30. http://flickr.com/photos/nieve44/2152712789/
  31. 31. ImpactStory.orgaltmetrics.org/tools
  32. 32. Changes are happening inscholarly communication. http://www.flickr.com/photos/myklroventine/892446624/
  33. 33. http://www.flickr.com/photos/jo-h/2688026447/
  34. 34. Tell the full story ofour research impact.
  35. 35. thank you!Jason Priem: cofounder of ImpactStoryAlso: Todd Vision, Mike Whitlock, the open science community, and those who release their articles, datasets and photos openly. blog.ImpactStory.org team@ImpactStory.org @ImpactStory ImpactStory.org

×