This document discusses how ALLmetrics (not altmetrics) can help summarize the broader impact of research through metrics collected on various research outputs and online mentions. It provides examples of how different organizations like the University of Pittsburgh, Pacifica Graduate Institute, Oregon Health & Science University, and Autism Speaks have used ALLmetrics dashboards from PlumX to analyze and showcase the impact of their research. The dashboards allow viewing metrics on different types of research, filtering by categories like subject areas, grants, or institutions. They help identify highly engaged works and fill gaps when traditional citations are not yet available.

1. 1
ALLmetrics.
Not Altmetrics.
Stephan Buettgen
Director Analytic Product Sales
Informatie aan Zee 2015
@StephanBuettgen or sbuettgen@ebsco.com

2. Answer the questions
And tell the stories
About your research

3. 3
PlumX can help answer these questions
you couldn’t answer before
What impact has our research had in the past
12 months?
How do we arm our researchers to better
compete for funding?
Can we measure non-STM,
non-article research?

4. 4
Researchers have
Moved Online

5. 5
5

6. 6
Scholarly Data Exhaust

7. 7
“Same” Article,
Different Places

8. 8
Beyond the Journal Article
• Articles
• Blog posts
• Book chapters
• Books
• Cases
• Clinical Trials
• Conference Papers
• Data Sets
• Figures
• Grants
• Interviews
• Letters
• Media
• Patents
• Posters
• Presentations
• Reports
• Source Code
• Theses /
Dissertations
• Videos
• Web Pages

9. 9
Sources of Data Exhaust
(Sample sources)
• Amazon
• Bit.ly
• CrossRef
• Delicious
• Dryad
• dSpace
• EBSCO
• ePrints
• Facebook
• figshare
• Github
• Goodreads
• Google+
• Medwave
• Mendeley
• PLOS
• PubMed Central
• Reddit
• Research
Blogging
• Scopus
• SlideShare
• SourceForge
• Stack Overflow
• Twitter
• USPTO
• Vimeo
• Wikipedia
• Worldcat
• YouTube

10. 10
ALLmetrics
Categories
USAGE
(clicks, downloads, views,
library holdings, video plays)
CAPTURES
(bookmarks, code forks, favorites,
readers, watchers)
MENTIONS
(blog posts, comments, reviews,
Wikipedia links)
SOCIAL MEDIA
(+1s, likes, shares, tweets)
CITATIONS
(PubMed Central, Scopus,
patents)

11. There’s a new way
to tell the story

12. 1
University of
Pittsburgh
CASE STUDY

13. 13
Metrics Dashboards
Researchers box:
University of
Pittsburgh uses
PlumX to support
their researchers.
Narrow By:
They also build
dashboards for their digital
collections, the 26 journals
they publish, and for every
school, department, and
research institute
Tabs of Different
Artifacts:
PlumX gathers
metrics from over 20
types of research
output.

14. 14
PlumX Customer Data:
Citations Lag Research output
from 2013 and
2014 will have
few citations.

15. 15
Other Metrics Categories Fill
the Gap Showcase
impact in the
past 12 to 24
months.

16. 2
Pacifica Graduate
Institute
CASE STUDY

17. 17
• Graduate degrees in psychology
• Half the faculty is actively involved in research
• Books are the main output of faculty members
• Want to showcase faculty work

18. Books
are their most
common research
artifact type

19. 19
Books/Book Chapters Matter
• Citation counts do not do books justice
– Never have & never will
– We need new book metrics
• Important to Social Sciences and
Humanities
• Books are often the seminal work from
these faculty members

20. 20
PlumX Book Specific Metrics
How many libraries hold this book?
How many Wikipedia articles reference this book?
What are the reviews on Amazon about this book?
What is the book’s average rating?
How many people added this book to their
bookshelf? What reviews have they written? How
did they rate the book?
How many abstract views, downloads, and clicks did
this eBook get?

21. 21
Susan Rowland, Ph.D.
Chair of Engaged Humanities & the Creative Life
Pacifica Graduate Institute

22. 22
PlumX links directly to
Amazon reviews and ratings

23. 23
PlumX links directly
to Goodreads
• See reviews and
ratings
• See individuals who
have read or want to
read the book

24. 24
Uncover the conversations
the author was not even
aware of.

25. 25
Discover how many libraries
hold a copy of the book
Back to Case Studies »

26. 3
Oregon Health &
Science University
CASE STUDY

27. 27
OHSU –
Tagging Medical Subjects
• Working collaboratively, the library and office of
research have defined subjects to use in
analyzing their research output
• They categorize their articles in PlumX by
these subjects
• PlumX dashboards allow comparisons within
and across these categories

28. OHSU –
Metabolic Bone Disease Category
The sunburst
visualization easily
identifies the top
artifacts in this
subject area

29. 29
OHSU –
Bringing Altmetrics into Grant Proposals
• NIH Biosketch
– Where researchers highlight accomplishments
when submitting grants to the NIH
• OHSU is helping their researchers add
impact metrics to their NIH Biosketch
• Move beyond just a list of publications
– They can make their researchers’ applications
stand out
Back to Case Studies »

30. 4
Autism Speaks
CASE STUDY

31. 31
Funders are using PlumXResearcher from:
Autism Speaks analyzes their
grants by the following
categories:
• By geography
• By institution
• By their major areas of
funding
• By they type of grant
Data Table:
Looking at one
grantee’s output,
even for his research
published in 2013 and
2014, PlumX metrics
are available.

32. PlumX dashboards
are created for every
institution where
Autism Speaks
funds research.

33. 33
Autism Speaks - Captures in
2014
Capture metrics are
an indicator of what
research happening
now will likely be
highly cited in the
future
Back to Case Studies »

34. 34
Visualizing Impact: Widgets
Plum Print Group Widget Author Widget

35. Thank you