Published on

Presentation given as part of the REF, Citations and Research Outputs trainng course (

Published in: Education, Technology, Spiritual
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide


  1. 1. Dan Holden
  2. 2.  Limitations Assessment of research impact ◦ Calculating h-index using Web of Science and Publish or Perish Assessment of journal quality ◦ Calculating Impact Factor using Journal Citation Reports ◦ Calculating h-index using Publish or Perish ◦ Other metrics and tools
  3. 3.  Metrics and tools not well established for arts, humanities and social sciences Citation patterns vary from subject to subject Coverage of tools is not comprehensive Self-citations can distort metrics Review articles are more highly cited than standard articles Citations to a paper may not reflect its quality Metrics tend not to account for age of researcher
  4. 4.  Publication count ◦ Number of publications produced by individual, school or university Citation count ◦ Number of times publication is cited by other publications
  5. 5.  h-index ◦ Defined as largest number h, where a researcher has at least h publications cited at least h times ◦ Eg an h-index of 25 tells us that an author has written 25 papers which have each been cited at least 25 times
  6. 6.  Web of Science ◦ Covers over 11,500 journal titles and 120,000 conference proceedings ◦ Consists of:  Science Citation Index - 1970 to present  Social Sciences Citation Index - 1970 to present  Arts & Humanities Citation Index - 1975 to present ◦ Limited coverage of non-English language titles ◦ Does not include books, book chapters or theses
  7. 7.  SCOPUS ◦ Covers over 18,000 journal titles and 4.4 million conference papers ◦ Better coverage of social science titles than Web of Science ◦ Better coverage of non-English language publications from Europe than Web of Science ◦ Citation data only available for papers published from 1996 onwards ◦ Does not include books, book chapters or theses
  8. 8.  Publish or Perish ◦ Free analysis tool used in conjunction with Google Scholar ◦ Google Scholar covers much wider range of material than Web of Science or Scopus ◦ Better coverage of non-English language publications from Africa, Asia and Central and South America than Web of Science or Scopus ◦ No source list or indication of timescale covered
  9. 9.  Journal Impact Factor (JIF) ◦ Average number of times articles published in journal in past 2 years have been cited in current year ◦ Eg title with JIF of 1 in 2010 means that articles published in 2008 or 2009 have been cited on average once in 2010
  10. 10.  h-index ◦ Increasingly applied to journals ◦ Largest number h, where a journal has at least h of its articles cited at least h times ◦ Eg journal has an h-index of 10 if 10 of its papers have each been cited at least 10 times
  11. 11.  Journal Citation Reports ◦ Produced using data from Science Citation Index and Social Sciences Citation Index ◦ Covers over 10,500 journals ◦ Reports from 2000 to 2010 are available Publish or Perish
  12. 12.  SCImago Journal & Country Rank ◦ Free service ◦ Based on SCOPUS data ◦ Key metric is SCImago Journal Rank (SJR) indicator – underlying number of citations received by number of articles published calculation but citations are weighted depending on ‘prestige’ and subject area
  13. 13.  Source-Normalized Impact per Paper (SNIP) ◦ Free service ◦ Based on SCOPUS data ◦ Underlying citations received by number of articles published calculation but divided by Citation Potential of subject area ◦ Citation Potential is likelihood of being cited in particular subject area ◦ SJR and SNIP are components of Journals Analyzer tool in SCOPUS
  14. 14.  Eigenfactor ◦ Free service ◦ Eigenfactor Score (EFS) is like SJR but uses Web of Science data, self-citations are not included and citations are counted over 5 years rather than 3 years ◦ Article Influence Score (AIS) is average influence of journals articles. Calculated by dividing EFS by number of articles in journal (mathematically adjusted so it is comparable with other journals)
  15. 15.  Eigenfactor Library’s A to Z list of databases (via QSearch) Library’s Bibliometrics pages: Measuring Your Research Impact SCImago Journal & Country Rank SCOPUS Source-Normalized Impact per Paper (SNIP)