This document provides an overview of various bibliometric products and metrics that can be used to measure research impact, including journal impact factor, h-index, citation counts, and journal/article ranking tools from Journal Citation Reports, Scopus, and Google Scholar. It discusses the purpose and calculations of metrics like impact factor, eigenfactor, and source normalized impact per paper (SNIP). It also covers limitations of bibliometrics and recommends using multiple metrics and tools to evaluate research. Exercises are provided to help understand how to analyze journals, articles, and individual researchers using different bibliometric resources.

1. Research Metrics Nazi TorabiResearch & Instructional Librarian Allyn & Betty Taylor LibraryApril 27, 2011http://www.slideshare.net/ntorabi/1

2. Objectives To provide an overview of various bibliometrics productsHave a good understanding of limitation of each product How to calculate your own h-index2

3. 3

4. Why Research Metrics?Get published in a good journalApplication for tenure, promotion, or grant fundingMeasure the impact of an individual’s research4

5. The MetricsPublication count measures quantity but not quality (impact) Citation counts Total number of citation count

6. Total number of citation count in particular time span

7. Total number of citation per paper

8. Number of papers cited more than n times

9. Number of citations to the n most cited papersNormalized citation counts 5

10. Journal Citation ReportKey metric: Journal Impact Factor (IF)

11. Journal ranking by discipline

12. Citing pattern analysis in discipline 6

13. Impact FactorNumber of times articles published in 2008 and 2009 were cited by indexed journals during 2010 Total number of "citable items" published by that journal in 2008 and 20092010 Journal IF = i.e. An Impact Factor of 1.0 in 2010 means that, on average, the articles published in 2008 and 2009 have been cited one time. Self-citation is included.7

14. Journal Immediacy IndexNumber of times articles published in 2010 were cited by indexed journals during 2010Total number of "citable items" published by that journal in 20102010 Journal Immediacy =Index i.e. The journal Immediacy Index indicates how quickly articles in a journal are cited.JCR 8

15. For 2009, the journal CHEMBIOCHEM has an Impact Factor of 3.824.9

16. Journal RankingThe Journal Ranking table shows the ranking of the current journal in its subject categories based on the journal IF. Data for Total Journals in Category and Quartile in Category are not available for JCR years before 2003. 10

17. IF & its shortcomings Citation pattern is discipline specific Time spanCitation frequencydifferences in citation normsSleeping beautiesSelf-Citation and other!!!Negative citations Title and journal format changesA questionable validity11

18. Impact FactorNumber of times articles published in 2008 and 2009 were cited by indexed journals during 2010 Total number of "citable items" published by that journal in 2008 and 20092010 Journal IF = i.e. An Impact Factor of 1.0 in 2010 means that, on average, the articles published in 2008 and 2009 have been cited one time. Self-citation is included.12

19. Probability density function for journals in subject categories of ENERGY & FUELS – data from JCR-5 -4 -3 -2 -1 0 1 2 3 4 5Normal distributionPareto distribution13

20. Eigenfactor.org14

21. Citation Networks & Network Effects 15

22. Scholarship is the flow of idea. 16

23. High School Dating NetworkBearman, Peter S., James Moody, and Katherine Stovel. "Chains of Affection: The Structure of Adolescent Romantic and Sexual Networks." American Journal of Sociology 110, no. 1 (July 2004): 44-91. 17

24. Which network you would rather be part of?West, J (2010). The EigenfactorTM Metrics: a network approach to assessing scholarly journals. http://mediazone.brighttalk.com/comm/ReedElsevier/ad0fb0ef1d-21688-4348-2306618AB

25. The Rich gets Richer Journals are ranked according to the citation network.

26. Journals are influential when they are cited by other influential journals.

27. “The Eigenfactor™ score of a journal is an estimate of the percentage of time that library users spend with that journal.”19

28. http://well-formed.eigenfactor.org/radial.html20

29. Article Influence™ ScoreJournal’s Eigenfactor Score (5yrs)Number of articles in the journalArticle Influence™ = Scorehttp://www.eigenfactor.org/21

30. How can we better evaluate the scholarly literature ?How can we better navigate the scholarly literature?22

31. CWTS Journal IndicatorsKey metric: Source Normalized Impact per Paper (SNIP)

32. Journal ranking by discipline

33. Author analysis

34. Article analysis23

35. Raw Impact per Paper (RIP)Number of times articles published in 2007, 2008 and 2009 were cited by indexed journals during 2010 Total number of "citable items" published by that journal in 2007, 2008 and 20092010 Journal RIP= 24

36. Source normalized impact per paper (SNIP) A journal’s Source Normalized Impact per Paper (SNIP) =Raw Impact per Paper published in the journal (RIP) ÷Relative Database Citation Potential (RDCP) in the journal’s subfieldi.e. It corrects for differences in the frequency of citation across research fields.http://www.journalindicators.com/Indicators.pdf25CWTS

37. SCImagoKey metric: ScImago Journal Ranking (SJR)

38. Journal and Country ranking by discipline26Scopus

39. Journal Ranking Summary Adapted and modified from: González-Pereir , B. et al. “The SJR indicator: A new indicator of journals' scientific prestige”. http://arxiv.org/ftp/arxiv/papers/0912/0912.4141.pdf27

40. Exercise : Journal RankingWhat is the Impact Factor Trend in the last 5 yearsfor the Am J Bioeth? Tip: you need to find the journal’s full title first.You are thinking of submitting a manuscript to the journal of MOLECULAR MEDICINE. How do you rank this journal in its appropriate subject category? Is it better to present this journal using IF or EigenFactor? Using Scopus, compare the journal of MOLECULAR MEDICINE with the journal of CURRENT MOLECULAR MEDICINE. Which journal might be a better candidate for your article?28

41. h-indexh measures the cumulative impact of a researcher's output by looking at the amount of citation his/her work has received.

42. i.e. If a researcher has an h-index of 25 if 25 of their papers have been cited at least 25 times (See the graph in the handout).29

43. h-index shortcomings Early career researchers Sleeping beautiesThe balance between number of publications vs. number of citations each receivesDatabases are not error freeInconsistency between different metric tools (See the handout). 305 articles published – each cited 5 times – h-index = 52 articles published – each cited 20 times – h-index = 2

44. h-index Variantsg-index: more weight is given to the highest cited papers The individual h-index: accounts for co-authorship in calculating impact by giving less weight to such papersThe contemporary h-index: less weight to older cited papers The age-weighted citation rate: accounts for the age of papers Tarma Software Research (2010). Publish or Perish User’s Manual http://www.harzing.com/pophelp/metrics.htm#gindex31

45. ArticlesRanking F1000ScopusPOPWOS32

46. Web OF Science33

47. Citation Report from WOS The Citation Report provides aggregate citation statistics for a set of search results. These statistics include:The total number of times all items have been cited

48. The average number of times an item has been cited

49. The number of times an item has been cited each year