This presentation was provided by Kristi Holmes of Northwestern University for a NISO Virtual Conference, held on April 20, 2016

1. A Library-Based Metrics
& Impact Core
Kristi Holmes, PhD
@kristiholmes
NISO Virtual Conference: Justifying the Library
Using Assessment to Justify Library Investments
April 20, 2016

2. Galter Library’s Metrics and Impact Core
• The Metrics and Impact Core (MIC), housed
in Galter Library, has expertise in
bibliometrics, data visualization, continuous
improvement, information systems and
alternative metrics. The core provides
extensive advisory services for researchers,
groups or departments on topics such as:
• developing successful publishing strategies
• managing or tracking publications
• maintaining an impactful online identity
• measuring or assessing research impact by discipline
• communicating research impact to audiences
Metrics and Impact Core website
http://galter.northwestern.edu/Request-Services-and-Materials/metrics-and-impact-core-mic

3. Northwestern University Clinical and Translational
Sciences (NUCATS) Institute
Mission: Speeding transformative
research discoveries to patients
and the community
http://nucats.northwestern.edu/

4. Evaluation Services for the campus
Studios – lead to training grants,
foundation awards, cores, etc.

5. Northwestern University Clinical and
Translational Sciences (NUCATS)
Institute Evaluation and Continuous
Improvement Program
Mission: Speeding transformative research discoveries
to patients and the community
http://nucats.northwestern.edu/
Some sample metrics…
OUTPUT Metrics
Time to Publication or other output
Number of technology transfer
products
ROI of pilot awards
ROI of TL1, T32, KL2 scholars
Time from publication to research
synthesis
IMPACT Metrics
Influence of a research output
Researcher and institutional
collaborations
Career development and
path/trajectory
PROCESS Metrics
Time from IRB submission to
approval
Time from grant award to start of
study
Volume of investigators who use
services, take training, and other
activities

6. Writing About Your Impact on the
New NIH Biosketch
http://galter.northwestern.edu/news/writing-about-
your-impact-in-the-new-nih-biosketch
Matchmaker, Make Me a Match:
Choosing a Journal
http://galter.northwestern.edu/news/matchmaker-
make-me-a-match-choosing-a-journal
Sharing, Publishing, and Archiving
Your Work
http://galter.northwestern.edu/news/sharing-
publishing-and-archiving-your-work
Visualizing Science at Feinberg
School of Medicine
http://galter.northwestern.edu/news/visualizing-
science-at-feinberg-school-of-medicine
Recent News Items
Communication

7. Frameworks and Resources
Becker Model for Assessing Research Impact (C Sarli)
-https://becker.wustl.edu/impact-assessment/how-to-use
Academic Careers Understood through Measurement and Norms (ACUMEN)
-http://research-acumen.eu/portfolio
Research Excellence Framework (REF) Impact Case Studies
-http://impact.ref.ac.uk/CaseStudies/
Canadian Academy of Health Sciences (CAHS) Framework
-http://www.cahs-acss.ca/wp-content/uploads/2011/09/ROI_FullReport.pdf
And more…

8. Tools and data sources
Bibliographic databases:
Scopus (Elsevier)
NU Scholars (Elsevier)
PubMed (NLM)
Web of Science (Thomson Reuters)
Google Scholar
Other databases:
Scholarly Database
NIH RePORTER
Essential Science Indicators
(Thomson Reuters)
Tools:
Sci2
Tableau
Tagxedo
Excel
Illustrator

9. Service Examples

10. Recognition of Faculty and Alumni
Visualizations for recognition
Department of Preventive Medicine, NU FSM
Development and Alumni Relations, NU FSM

11. Global Influence of JeremiahStamler,MD
Network of top 50 co-author relationships with JeremiahStamler,MD
Data from Elsevier’s Scopus.
Data span from 1949-2014.
Visualization created using Sci2 tool (cns.iu.edu).
Top 20 Journal Titles for JeremiahStamler,MD
Titles of publications for JeremiahStamler,MD
Data from Elsevier’s Scopus.
Data span from 1949-2014.
Visualization created using Tagxedo.

13. Publication Summaries
• Productivity: how much research was produced and who produced it
- # of researchers in group
- # of articles published by members
- Average articles per year
- # of unique source (journal) titles
• Collaboration: who worked together to make the research happen
- # of country affiliations of co-authors
- # of top institutional affiliations of co-authors
- Listing of funding organizations from 2014 to present
• Research Topics: what the research was about
- Document types for published articles
- Top key words used in articles
- Top subject areas of source (journal) titles

14. Departmental Publication Summaries
continued…
Citation Impact for the Group: the impact it had on
subsequent scientific research
- Total citations
- Average citations per year
- Average citations per publication
- Citations by year of publication
- Citations cumulative
- Citations by year of publication per publication
- Most highly cited publication
- # of country affiliations of citing authors
- # of languages of citing articles
- # of unique source (journal titles) from citing articles
- # of unique country affiliations of citing authors
- # of unique institutional affiliations of citing authors
- h- index of departmental documents
- # of documents with no citations
- Hot or Highly Cited publications
Citation Impact for Individuals: the impact he/she
had on subsequent scientific research
­ Total published articles (career span and report timespan)
­ Total citations (career span and report timespan)
­ h-index
­ m-index
­ # of co-authors

15. High Impact Research
http://www.feinberg.northwestern.edu/research/about/high-impact/index.html
Office of the Dean, NU FSM

16. Other services…
https://galter.northwestern.edu/news/writing-about-your-impact-in-the-new-nih-biosketch
We offer:
u Galter class
u Individual consultations
u Online guide
It’s a team effort!
u Pamela Shaw
u Karen Gutzman
NIH biosketch review

17. Other services…
Assistance with grant proposal and submission
u Award nominations
u Visa applications
u Progress reports
Custom reports

18. The library offers expertise in bibliometrics, data visualization, continuous improvement, information systems and alternative
metrics through the Metrics and Impact Core. 18
Research Impact and Metrics Services and
Support
VisualizationsPublication Summaries
Indicator and Measurement Overview
Productivity: how much research was produced and who
produced it
# of researchers in department
# of articles published by faculty
Average articles per year
# of unique source (journal) titles
Collaboration: who worked together to make the research
happen
# of country affiliations of co-authors
# of top institutional affiliations of co-authors
Listing of funding organizations from 2014 to present
Research Topics: what the research was about
Document types for published articles
Top key words used in articles
Top subjectareas of source (journal) titles
Citation Impact for Department: the impact it had on
subsequentscientific research
Total citations
Average citations per year
Average citations per publication
Citations by year of publication
Citations cumulative
Citations by year of publication per publication
Most highly cited publication
# of country affiliations of citing authors
# of languages of citing articles
# of unique source (journal titles) from citing articles
# of unique country affiliations of citing authors
# of unique institutional affiliations of citing authors
h- index of departmental documents
# of documents with no citations
Hot or Highly Cited publications
Citation Impact for Individuals: the impact he/she had on
subsequentscientific research
Total published articles (career span and report timespan)
Total citations (career span and reporttimespan)
h-index
m-index
# of co-authors
Custom Reports
Karen Gutzman is our
Impact and Evaluation Librarian.
Contact her directly or through
your liaison librarian. Visit the
Metrics and Impact Core online.

19. A few future directions
Galter Classes:
-Enhancing the Impact of Your Research
-Bibliometrics for Researchers
Galter Guides
-Enhancing the Impact of Your Research
-Methods and Processes for Individual/Group Publication
Summaries
-Evaluation Resources at Northwestern
Building out the Service Core

20. Acknowledgements
Teams:
• Karen Gutzman & Pamela Shaw
• The amazing team at Galter Library
• NUCATS
Questions/Follow-up:
• kristi.holmes@northwestern.edu
• Twitter: @kristiholmes

21. Thank you!
Kristi Holmes
@kristiholmes
kristi.holmes@northwestern.edu
orcid.org/0000-0001-8420-5254

22. Image credits
• http://k12education.gatesfoundation.org/wp-
content/uploads/2015/10/tools_cropped.jpg
• http://www.clipartpanda.com/categories/stack-of-paper-png