Brace for Impact: New Means for Measuring Research Metrics

1,222 views

Published on

As open access journals and repositories gain a foothold in scholarly communication, researchers are finding that the traditional impact factor and citation count metrics only reflect a portion of the dissemination of scholarly works.
New technology, research, and citation tools aid our ability to measure the influence of research. A matrix of tools and initiatives, like PLoS Article-Level Metrics, BePress’ Author Dashboard, Mendeley, Altmetrics, and ImpactStory are providing a more robust picture of scholarly communication today.
This presentation provides an overview of the impact factor system and new tools for gathering metrics and their relevance for librarians and researchers.
Presentation given at the Library Information Technology Association (LITA) Forum in Louisville, KY, in November 2013.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,222
On SlideShare
0
From Embeds
0
Number of Embeds
159
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Brace for Impact: New Means for Measuring Research Metrics

  1. 1. BRACE FOR IMPACT: NEW MEANS OF MEASURING RESEARCH METRICS MARY ELLEN SLOANE, SCHOLARLY COMMUNICATIONS LIBRARIAN FOR BASIC AND APPLIED SCIENCES, MIDDLE TENNESSEE STATE UNIVERSITY
  2. 2. OUTLINE • Impact Factor system • Evolution of Scholarly Communication • Altmetrics sources • Open access platforms • Sharing platforms • Saving platforms • Hacking altmetrics • Impact of altmetrics
  3. 3. SUMMARY • As open access journals and repositories gain a foothold in scholarly communication, researchers are finding that the traditional impact factor and citation count metrics only reflect a portion of the dissemination of scholarly works. • New technology, research, and citation tools aid our ability to measure the influence of research. A matrix of tools and initiatives, like PLoS Article-Level Metrics, BePress’ Author Dashboard, Mendeley, Altmetrics, and ImpactStory are providing a more robust picture of scholarly communication today. • This presentation will provide an overview of the impact factor system and new tools for gathering metrics and their relevance for librarians and researchers.
  4. 4. IMPACT FACTOR SYSTEM • The impact factor system measures the number of citations for a given journal over a period of time.
  5. 5. IMPACT FACTOR SYSTEM
  6. 6. IMPACT FACTOR SYSTEM • • • • • • • • • Not always a good indicator of quality research Journal ‘impact’ is relative to an article’s value Not necessarily meaningful to authors or researchers Self-citations can skew results Focuses on overall impact, as opposed to articlelevel measures Review journals have more citations San Francisco Declaration on Research Assessment – concerns with impact system Open access sources may not be represented Tenure and promotion criteria tied to publishing
  7. 7. EIGENFACTOR
  8. 8. EVOLUTION OF SCHOLARLY COMMUNICATION New means of publishing Institutional repositories Sharing data sets Sharing code Sharing presentations Sharing video Article-level metrics can help encourage publishing in open-access journals and repositories • Open access publishing and sharing is increasing • Social networks can evolve organically and include open access and other sources of sharing • • • • • • •
  9. 9. EVOLUTION OF SCHOLARLY COMMUNICATION • Ability to measure use by readers, researchers • Earlier indicators of research impact • Web of Science: • Mendeley:
  10. 10. EVOLUTION OF SCHOLARLY COMMUNICATION
  11. 11. METRICS SOURCES • • • • • • • • • Social media Blog posts, Wikipedia Sharing links to publisher full text Open access views, downloads, citations, followers Bookmarks, favorites Citation saving and groups Worldcat holdings Standard citation counts PlumX - http://www.plumanalytics.com/metrics.html
  12. 12. METRICS SOURCES • Open access sources: • • • • • • Dryad Figshare GitHub BePress dSpace PLOS • Saves • Mendeley, • citeulike • Delicious • Uses • Youtube, Vimeo • Slideshare • Shares • Twitter • Facebook • Bit.ly • Citations • • • • Web of Science Scopus Google Scholar PubMed • Aggregate metrics • Altmetrics, and • ImpactStory • Plum X
  13. 13. WEB OF SCIENCE ARTICLE METRICS • C&RL Impact Factor: • Citation map:
  14. 14. OPEN ACCESS - PLOS
  15. 15. OPEN ACCESS - FIGSHARE
  16. 16. OPEN ACCESS - DRYAD
  17. 17. INSTITUTIONAL REPOSITORIES
  18. 18. IF YOU CAN’T BEAT THEM, JOIN THEM • Articles Metrics from publishers
  19. 19. ACCURACY PROBLEMS
  20. 20. IMPACT STORY
  21. 21. ALTMETRIC
  22. 22. PLUMX • PlumX Tracks Groups • • • • • • • • • • • University Institute Museum Department Lab Company Publisher Journal Volume Issue Collection
  23. 23. SO WHAT ? • How many are using social media and reference managers in meaningful ways? • How meaningful are the metrics? • Links between related items, article and data set • Can easily be gamed • Debate over early downloads as indicator of later citation • Limited to DOI in some cases • Disciplines may use different platforms and tools
  24. 24. HACKING METRICS • Does this milk smell bad?
  25. 25. IMPACT OF ALTMETRICS • • • • • • • • New ways to perform bibliometrics New ways to do research New ways to share and connect Recent articles will have more altmetrics Discipline-specific measures of impact Tenure and promotion considerations Researcher’s dissemination will evolve At some point will become customary
  26. 26. COMING SOON • NISO Alternative Assessment Metrics (Altmetrics) Project • Here Comes the Sunburst: Measuring and Visualizing Scholarly Impact – Sunday 11/10 – 9:00 am

×