Mike Buschman
mike@plumanalytics.com
@mikebuschman
@plumanalytics

Altmetrics in Practice
World Social Science Forum
?
Mon...
Current State of Scholarly Measure

Plum Analytics Confidential

2
Well-known Problems with Citation
Analysis
•
•
•
•
•
•

Self-citations
Citations added because of pressure by editors
Nega...
Legacy Metrics
• Journal Impact Factor
– Journal-based
measures only

• Citation Counts
– Designed in the
1960’s
– Lagging...
5
Scholarly Data Exhaust

6
PlumX provides access to the full impact spectrum

7
Our Approach to Altmetrics
• Captures
• Mentions
• Social Media
• Citations
• Usage

Altmetrics

8
Different Categories of Impact
• Usage
• Downloads, views, book holdings, ILL, document
delivery
• Captures
• Favorites, b...
Citations are lagging indicators
•
•
•
•

Scopus = 2
Web of Science = 0
Google Scholar = 8
PubMed = 1

10
Photo credit: A....
Metrics for Every Copy

•
•
•
•

59 Bitly clicks through PLOS
21 Bitly clicks through DOI link
92 Delicious bookmarks to P...
How can I use these metrics?
• New data to compete for grant dollars
• Showcase full breadth of impact
• New benchmarks

F...
Tracks 20+ Types of Artifacts
•
•
•
•
•
•
•
•
•
•
•

Articles
Blog posts
Book chapters
Books
Cases
Clinical Trials
Confere...
Largest List of Metrics Sources
•
•
•
•
•
•
•
•
•
•

Amazon
Bit.ly
CrossRef
Delicious
Dryad
dSpace
ePrints
Facebook
Figsha...
PlumX / Smithsonian

15
Artifact / Article Level Metrics

16
Book metrics

17
Research Output Summarized
Clear, visual summaries of each researcher’s or group’s output

18
PlumX Author Dashboard

19
Tabular View
Sortable, table-view of full output.
Exportable to spreadsheets or integrated into other applications.

20
Author / Group Visualization

21
Search: Measuring Present
Impact Changes the Game

22
Embed Metrics Everywhere

23
24
25
Some active Projects
• University of Pittsburgh
– Rolling out to full university
– Metrics for 35 journals

• Cambridge Ce...
Groupings & Author Widgets too

27
Learn more:
http://www.plumanalytics.com
https://plu.mx

@plumanalytics
@mikebuschman
Mike Buschman
mike@plumanalytics.com...
Upcoming SlideShare
Loading in …5
×

Altmetrics in Practice - wssf -- Montreal - Oct 14, 2013

1,663 views

Published on

World Social Science Forum presentation by Mike Buschman

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,663
On SlideShare
0
From Embeds
0
Number of Embeds
242
Actions
Shares
0
Downloads
10
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • Published articles in prominent journals cite other articles in prominent journals = prestige and tenure.This mechanism of using citations in published journals to determine impact of research was built in the 1960’s.
  • http://blog.qmee.com/qmee-online-in-60-seconds/
  • At the time this snapshot of metrics was taken, his work was newly published. It hadn’t been picked up in Web of Science yet at all.However, the metrics surrounding his work give us a leading indicator that it may be impactful research.
  • http://demo.plu.mx/a/eKXLDK8_gEB-iSPG_HLlHVGtDVYDreSTzdY7VST1rmY/Plum’s Identity resolution system, can match different artifacts together by known identifiers (like DOI), aliases of URLs, and proprietary clustering analysis algorithms.This system scales across millions of artifacts, and gives a complete view to the metrics.
  • This visualization of a researcher’s output, when weighted by impact, shows which artifacts have been getting the most engagement across their entire life’s work.This is very useful when trying to get an overall sense of what a particular researcher (or lab, or group) is most known for.
  • Compare the metrics showcasing the capturing of immediate impact versus a search on Google Scholar for something like “brain cancer.”
  • Altmetrics in Practice - wssf -- Montreal - Oct 14, 2013

    1. 1. Mike Buschman mike@plumanalytics.com @mikebuschman @plumanalytics Altmetrics in Practice World Social Science Forum ? Montréal – Oct 14, 2013 1
    2. 2. Current State of Scholarly Measure Plum Analytics Confidential 2
    3. 3. Well-known Problems with Citation Analysis • • • • • • Self-citations Citations added because of pressure by editors Negative citations Only about 30% of influences are cited* “Informal” influence isn’t measured through citations Secondary sources – Review articles “take” citations away from reviewed articles • Matthew effect – the rich get richer * MacRoberts and MacRoberts, 2010 3
    4. 4. Legacy Metrics • Journal Impact Factor – Journal-based measures only • Citation Counts – Designed in the 1960’s – Lagging indicator Plum Analytics Confidential 4
    5. 5. 5
    6. 6. Scholarly Data Exhaust 6
    7. 7. PlumX provides access to the full impact spectrum 7
    8. 8. Our Approach to Altmetrics • Captures • Mentions • Social Media • Citations • Usage Altmetrics 8
    9. 9. Different Categories of Impact • Usage • Downloads, views, book holdings, ILL, document delivery • Captures • Favorites, bookmarks, saves, readers, groups, watchers • Mentions • Blog posts, news stories, Wikipedia articles, comments, reviews • Social Media • Tweets, Google +1s, likes, shares, ratings • Citations • Scopus, PubMed Citations, Microsoft Academic Search, patents 9
    10. 10. Citations are lagging indicators • • • • Scopus = 2 Web of Science = 0 Google Scholar = 8 PubMed = 1 10 Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.
    11. 11. Metrics for Every Copy • • • • 59 Bitly clicks through PLOS 21 Bitly clicks through DOI link 92 Delicious bookmarks to PLOS 2 Delicious bookmarks to PubMed 11
    12. 12. How can I use these metrics? • New data to compete for grant dollars • Showcase full breadth of impact • New benchmarks Funding Research • ROI of research • New data to make funding decisions Publishing Research • Uncover hidden data • Add value to IRs and online journals • Recruit / retain “best” authors Plum Analytics Confidential Performing Research 12
    13. 13. Tracks 20+ Types of Artifacts • • • • • • • • • • • Articles Blog posts Book chapters Books Cases Clinical Trials Conference Papers Data Sets Figures Grants Interviews • Letters • • • • • • • Media Patents Posters Presentations Reports Source Code Theses / Dissertations • Videos • Web Pages 13
    14. 14. Largest List of Metrics Sources • • • • • • • • • • Amazon Bit.ly CrossRef Delicious Dryad dSpace ePrints Facebook Figshare Github • • • • • • • • • Google+ Medwave Mendeley Microsoft Academic Search PLOS PubMed Reddit Research Blogging Scopus • • • • • • • • • SlideShare SourceForge Stack Overflow Twitter USPTO Vimeo Wikipedia Worldcat YouTube 14
    15. 15. PlumX / Smithsonian 15
    16. 16. Artifact / Article Level Metrics 16
    17. 17. Book metrics 17
    18. 18. Research Output Summarized Clear, visual summaries of each researcher’s or group’s output 18
    19. 19. PlumX Author Dashboard 19
    20. 20. Tabular View Sortable, table-view of full output. Exportable to spreadsheets or integrated into other applications. 20
    21. 21. Author / Group Visualization 21
    22. 22. Search: Measuring Present Impact Changes the Game 22
    23. 23. Embed Metrics Everywhere 23
    24. 24. 24
    25. 25. 25
    26. 26. Some active Projects • University of Pittsburgh – Rolling out to full university – Metrics for 35 journals • Cambridge Centre for Health Services • OHSU – Medical taxonomy + metrics • VIVO – Apps and tools working group – Weekly monitor of impact of promoting their research • Royal Society of Chemistry – Pilot to incorporate researcher-level widget into RSC author profile site • University of Alberta – Comparing top business school researchers • Anonymous institution – Testing impact of open access vs. published versions in their repository Plum Analytics Confidential 26
    27. 27. Groupings & Author Widgets too 27
    28. 28. Learn more: http://www.plumanalytics.com https://plu.mx @plumanalytics @mikebuschman Mike Buschman mike@plumanalytics.com 206.331.7297 28 28

    ×