Measuring the impact of your research publications
Your Research Impact:
how to measure the impact of your publications
Am I famous yet?
Tracy Speeding at www.flickr.com/shutterbugsheep
Moira Bent & Jenny Campbell
Making and measuring impact workshops
Things to consider pre-publication
• Create an (academic) online profile
• Where should/could I publish?
• Understand & use the Journal Citation Report (JCR) and other journal ranking tools
• Understand Open Access publishing models and how OA can increase the visibility
of your research
• Understand how to apply for OA publishing funds at Newcastle University
Things to consider post publication
• Who has been reading it?
• How often?
• Where from?
• Have I made a difference?
Why do we want to know?
Was anyone interested in my research?
Who, why, what did they do?
Making contacts and connections for future
Feel good factor – exciting, challenging
Making a difference – social responsibility
Building your reputation, recognition
To report back to funder
Of a Journal
How much impact does a specific journal have on the
How many times are articles from that journal cited by
Use Impact Factors
Of an article
How often was a specific article cited/read by others?
Of an individual author
What impact is an individual person having on the
How important is an individual?
Use h-index and other metrics
Count web/blog page hits
Article impact: Counting citations
Use citation counts to see how often an ARTICLE has
Web of Knowledge – Cited Reference Searching
Good coverage, within limits
Citation mapping tool
More open access titles
Citation counts and tracking
Not specific in terms of coverage
Picks up non traditional publications eg eprints
Citation counts and tracking
CiteseerX and others
Article impact: Counting downloads
Article impact: Who is reading it?
Cited Reference searching
Publish or Perish
Image used: http://www.flickr.com/photos/asimulator/3258082746/
Article impact: Cited reference searching
Find out how many times a particular piece of
work has been cited.
Discover who is citing a specific piece of
Discover how older research is influencing newer
Track the work of a specific researcher.
Citation mapping: who and where
Alert you to when a new article is indexed in
which your work is cited.
WoK, Scopus, Zetoc, Google Scholar and other
The h-index measures the impact of an
I wonder who
I’ll squash if I
Calculating the h index
A scholar with an index of h has published h papers, each of
which has been cited by others at least h times
Use WoK or Scopus
WoK h=61 Scopus h=48
WoK h=42 Scopus h=33
WoK h=44 Scopus h=42
May vary depending on forms of author name, affiliation
As with any metric, use with caution!
How does the H-index work?
How does the H-index work?
cited 162 times
H index issues
Comparing apples and pears
Varies depending on database
Varies depending on discipline
One seminal paper does not imply high h-index
Doesn’t recognise new researchers
Doesn’t allow weighting in multi-authored papers
Can be slightly skewed by self citation
May miss out key articles
May not account for books, book chapters, reports and
other types of resource
Google Scholar Citations www.scholar.google.co.uk
Can work out your personal citation data
Widget for other people’s data – accuracy is debatable
Has h-index for journals as well as individuals
Publish or Perish: (http://www.harzing.com/pop.htm) (free)
Uses Google Scholar citations, and runs as standalone software that links
to the web.
Has to be downloaded
Difficult to identify publications
Less accurate than Scopus or WoS,
Google Scholar Citation tool
Maximising your altmetrics impact
For example, create a profile on
Or write a blog/ tweet/ join other social research networks
Altmetrics – alternative metrics
Traditional filters (citation counts, h-index, JIF…)
Slow, take a long time to accumulate
Don’t always measure impact at article level
Restricted – behind paywalls
Neglect impact outside of academia
Don’t take account of scholarly attention received via new
Altmetrics considers the creation and study of new
metrics based on the social web for analysing and
A supplemental measure of the quality of scholarship
Altmetrics data is being collected from many
Views – HTML views and PDF downloads
Mentions – blog posts, Wikipedia articles, online
news items, comments on blog posts, etc
Social Media –
Twitter, Facebook, LinkedIn, Google+, etc
Captures/Shares – Mendeley, CiteULike, social
Cites – citations in the scholarly literature, tracked
by Web of Science, PubMed, Scopus, etc
Combination of scholarly attention and
Organisations and publishers are already
collecting and displaying altmetrics data
A free open-source tool to help
researchers understand the
impact of their outputs… from
traditional journal articles to
blog posts and datasets…
Includes a free ‘bookmarklet’ to allow researchers
to see metrics relating to individual articles
Example paper on Altmetric.com
Do altmetrics reflect actual impact or just ‘buzz’?
Can altmetrics distinguish ‘scholarly interest’ from
Isn’t ‘gaming’ easy?
Tools to enable institutional comparisons much less
developed than tools for individual researcher
Can be difficult to interpret – require
scrutiny, contextualisation and interpretation
17 reasons why you should blog about your research
It helps you become more clear about your ideas.
It gives you practice at presenting your ideas for a non-specialist audience.
It increases your visibility within academia.
It increases your visibility outside academia and makes it much easier for journalists, campaigners and practitioners to find you.
It increases your visibility more than a static site and allows people who find you to get an overall sense of your academic interests.
It’s a great way of making connections & finding potential collaborators.
It can provide an archive of your thoughts, ideas and reactions which can later be incorporated into more formal work.
It makes it easier for people to find your published work and increases the likelihood they will and cite it.
Its informality and immediate accessibility can help make writing part of your everyday life rather than being a source of stress and
Its a great way to promote events and call for papers. Particularly if you blog regularly and your blog is connected to Twitter.
It helps ensure you can continue to develop strands of thought which, for now, don’t have any practical implications but might at
some point in the future.
It encourages you to reflexively interrogate and organise your work, drawing out emergent themes and placing isolated snippets of
commentary into shared categories.
It allows you to procrastinate for a further 10 to 20 minutes before going back to NVivo in a useful(ish) way.
It helps you build a community around your ideas and interests
It allows you to start a conversation that other researchers can join using comments
It’s a tremendous way to access additional relevant information/sources through the connections you make
It can also be a great way to increase your sample size by crowd sourcing contributions and through public scrutiny help prepare
you for the peer review process when the time comes to publish your work
Library Guide on Research Impact:
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.