This document discusses journal metrics and how they can help researchers. It addresses common questions about finding important journals in a field and high impact papers. Journal metrics can help with publishing decisions, funding applications, and tracking research impact. The main databases that provide journal metrics are Web of Science and Scopus. They include impact factors, rankings, citations per paper, and more. An example of one metric, the Journal Impact Factor, is explained as well as some limitations of metrics and best practices for using them.
2. As Librarians you may have been asked to consider some of
these questions relating to journal information…….
• Which journal titles are available to publish in in my field of research?
• How do I find a metric to determine which journal is important in my field of
research?
• Which journal titles are publishing the ‘hottest’ papers within a discipline?
• Where and how do I find a journal impact factor and journal rankings?
3. Why do we need journal analytics?
• Where to publish for maximum visibility
• Analyze and compare journal information to others
in the same field
• Track how research is received by others
• Funding applications may require journal metrics
• The relative importance of a journal may help
you decide in which journal to publish your research
4. •Web of Science (Thomson Reuters)
•Includes Journal Citation Reports for journal metrics
•Scopus (Elsevier)
•Includes SCImago journal analytics / rankings
The main databases with multi-disciplinary coverage that can be
used to track bibliometric data:
5. UCT Libraries subscribes to databases that can help you
determine:
Journal Impact factor – a metric that reflects the impact of a journal over a
number of years - use the database ‘Journal Citation Reports’ (Web of
Science)
Journal Ranking metrics – metrics that reflects the prestige value of a
journal relative to discipline - use ‘SCImago’ (Scopus SNIP & SJR.) or
‘Journal Citation Reports’
Comparison of Journals – use ‘Journal Citation Reports’ or ‘SCImago’
Citations per paper – use Web of Science, Scopus, Google Scholar
6. Example of a journal metric: “Journal Impact Factor (JIF)”
• “The journal impact factor is a measure of the
frequency with which the "average article" in a
journal has been cited in a particular year.”
7. How the Journal Impact Factor is calculated
Calculation:
The journal impact factor (JIF) calculation is based over three years.
For example the 2014 JIF of the journal “Nature” in this example is 41.456
8. Limitations:
JCR – JIF
SCOPUS - IPP – Impact per publication.
Takes into account the same peer-reviewed scholarly papers
only, in both the numerator and denominator of the equation
provides a fair impact measurement of the journal and
diminishes the chance of manipulation.
9. Using metrics
No single metric is better than another metric.
Depends on what questions you want to answer.
Use more than one metric to tell a story.
Ten principles to guide research evaluation:
Hicks, D. 2015. The Leiden Manifesto for research metrics. Nature. 520:429-431. Available:
http://www.nature.com/news/bibliometrics-the-leiden-manifesto-for-research-metrics-1.17351
[2016, July 05].
Webinars:
Library Connect Webinars: https://libraryconnect.elsevier.com/library-connect-webinars
Libguide: http://libguides.lib.uct.ac.za/tracking_your_academic_footprint/journal-metrics
Editor's Notes
Bibliometric indicators can be used in a variety of contexts – either as indicators of scholarly research or for making policy decisions.
Individual researchers can use Bibliometrics to determine the research impact of published work. There are a variety of metrics, like the ones used in citation analysis for example, where individuals can track, measure and evaluate their own or other’s scholarly activities.
Bibliometric information can be useful for finding collaborating partners in different areas of research. Collaboration is important because it provides opportunities and the potential for sourcing information about national and international research as well as the opportunity for finding cross-disciplinary research partners.
Journal statistics provide information about journals that could can give insight into where it is best to publish for maximum visibility, find subject specific or niche journal titles, analyse and compare journal information and track how research is received by others.
Sometimes bibliometric information is required when applying for grants, for NRF rating applications, for research performance reviews or for inclusion in one’s curriculum vitae.
Bibliometric indicators can be used in a variety of contexts – either as indicators of scholarly research or for making policy decisions.
Individual researchers can use Bibliometrics to determine the research impact of published work. There are a variety of metrics, like the ones used in citation analysis for example, where individuals can track, measure and evaluate their own or other’s scholarly activities.
Bibliometric information can be useful for finding collaborating partners in different areas of research. Collaboration is important because it provides opportunities and the potential for sourcing information about national and international research as well as the opportunity for finding cross-disciplinary research partners.
Journal statistics provide information about journals that could can give insight into where it is best to publish for maximum visibility, find subject specific or niche journal titles, analyse and compare journal information and track how research is received by others.
Sometimes bibliometric information is required when applying for grants, for NRF rating applications, for research performance reviews or for inclusion in one’s curriculum vitae.
Many of you may already be aware of the databases that UCT Libraries provides, but may not be familiar with the other functions that are available from these tools. The main databases with multi-disciplinary coverage that can track bibliometric data are:
Web of Science which is a Thomson Reuters product and includes the database called Journal Citation Reports for journal metrics. WoS is the traditional source of citation data developed by Eugene Garfield in the 1960’s.
The database Scopus is an Elsevier product and includes a product called SCImago for journal ranking analytics.
SciVal is also an Elsevier product and is a powerful tool that includes 3 different modules. The overview module provides high level overviews of research performance of one’s own institution and others based on output, impact and collaboration indicators for benchmarking and collaboration. The Benchmarking module determines one’s strengths and weaknesses. It compares one’s research institution and teams to others based on performance metrics and allows you to model different test scenarios. In the Collaboration module one can identify and analyze existing and potential collaboration opportunities, identify suitable collaboration partners and see who others are collaborating with.
In his article comparing various databases Falagas 2008 states that: “For citation analysis, Scopus offers about 20% more coverage than Web of Science, whereas Google Scholar offers results of inconsistent accuracy. PubMed remains an optimal tool in biomedical electronic research. Scopus covers a wider journal range, of help both in keyword searching and citation analysis, but it is currently limited to recent articles (published after 1995) compared with Web of Science. Google Scholar, as for the Web in general, can help in the retrieval of even the most obscure information but its use is marred by inadequate, less often updated, citation information.”
Information about journals and specifically about journal impact factors have been used in the areas of research policy decisions, research management, library collection management and monitoring of titles. These analytics are also used to evaluate scholars and develop publication strategies. To find JIFactors which is a metric that reflects the impact of a journal over a number of years, use the database ‘Journal Citation Reports’
A Journal rank metric is one that reflects the prestige value of a journal. For these metrics use ‘SCImago’ in (Scopus)
Source Normalized Impact per Paper (SNIP) and SCImago Journal Rank (SJR) are journal metrics found in Scopus.
SJR (SCImago Journal Rank) SJR is weighted by the prestige of a journal. SCImago Journal Rank is a prestige metric based on the idea that not all citations are the same. Subject field, quality, and reputation of the journal have a direct effect on the value of a citation.
SJR also normalizes for differences in citation behavior between subject fields.
SNIP is normalized for the journal’s subject field, weighting citations based on the number of expected citations in that field.
See www.journalmetrics.com for more details on SNIP and SJR.
Comparison of journals use ‘Journal Citation Reports’ or ‘SCImago’
Citation counts can provide insight into the study of individual scholars, research groups, Departments, Institutions, Scholarly Disciplines and a give an overview of Scholarly Research globally. In his book “Citation analysis and research evaluation” Moed (2011) states that “Citation analysis involves the construction and application of a series of indicators of the ‘impact’, ‘influence’ or ‘quality’ of scholarly work, derived from citation data”
For Citations per paper use Web of Science, Scopus or Google Scholar. In her book “Publish or Perish : your guide to effective and responsible citation analysis” 2011, Harzing describes the tool that she developed using data that was gathered from Google Scholar and compares this tool with other bibliometric tools.
Information about journals and specifically about journal impact factors have been used in the areas of research policy decisions, research management, library collection management and monitoring of titles. These analytics are also used to evaluate scholars and develop publication strategies. To find JIFactors which is a metric that reflects the impact of a journal over a number of years, use the database ‘Journal Citation Reports’
A Journal rank metric is one that reflects the prestige value of a journal. For these metrics use ‘SCImago’ in (Scopus)
Source Normalized Impact per Paper (SNIP) and SCImago Journal Rank (SJR) are journal metrics found in Scopus.
SJR (SCImago Journal Rank) SJR is weighted by the prestige of a journal. SCImago Journal Rank is a prestige metric based on the idea that not all citations are the same. Subject field, quality, and reputation of the journal have a direct effect on the value of a citation.
SJR also normalizes for differences in citation behavior between subject fields.
SNIP is normalized for the journal’s subject field, weighting citations based on the number of expected citations in that field.
See www.journalmetrics.com for more details on SNIP and SJR.
Comparison of journals use ‘Journal Citation Reports’ or ‘SCImago’
Citation counts can provide insight into the study of individual scholars, research groups, Departments, Institutions, Scholarly Disciplines and a give an overview of Scholarly Research globally. In his book “Citation analysis and research evaluation” Moed (2011) states that “Citation analysis involves the construction and application of a series of indicators of the ‘impact’, ‘influence’ or ‘quality’ of scholarly work, derived from citation data”
For Citations per paper use Web of Science, Scopus or Google Scholar. In her book “Publish or Perish : your guide to effective and responsible citation analysis” 2011, Harzing describes the tool that she developed using data that was gathered from Google Scholar and compares this tool with other bibliometric tools.
Information about journals and specifically about journal impact factors have been used in the areas of research policy decisions, research management, library collection management and monitoring of titles. These analytics are also used to evaluate scholars and develop publication strategies. To find JIFactors which is a metric that reflects the impact of a journal over a number of years, use the database ‘Journal Citation Reports’
A Journal rank metric is one that reflects the prestige value of a journal. For these metrics use ‘SCImago’ in (Scopus)
Source Normalized Impact per Paper (SNIP) and SCImago Journal Rank (SJR) are journal metrics found in Scopus.
SJR (SCImago Journal Rank) SJR is weighted by the prestige of a journal. SCImago Journal Rank is a prestige metric based on the idea that not all citations are the same. Subject field, quality, and reputation of the journal have a direct effect on the value of a citation.
SJR also normalizes for differences in citation behavior between subject fields.
SNIP is normalized for the journal’s subject field, weighting citations based on the number of expected citations in that field.
See www.journalmetrics.com for more details on SNIP and SJR.
Comparison of journals use ‘Journal Citation Reports’ or ‘SCImago’
Citation counts can provide insight into the study of individual scholars, research groups, Departments, Institutions, Scholarly Disciplines and a give an overview of Scholarly Research globally. In his book “Citation analysis and research evaluation” Moed (2011) states that “Citation analysis involves the construction and application of a series of indicators of the ‘impact’, ‘influence’ or ‘quality’ of scholarly work, derived from citation data”
For Citations per paper use Web of Science, Scopus or Google Scholar. In her book “Publish or Perish : your guide to effective and responsible citation analysis” 2011, Harzing describes the tool that she developed using data that was gathered from Google Scholar and compares this tool with other bibliometric tools.
Information about journals and specifically about journal impact factors have been used in the areas of research policy decisions, research management, library collection management and monitoring of titles. These analytics are also used to evaluate scholars and develop publication strategies. To find JIFactors which is a metric that reflects the impact of a journal over a number of years, use the database ‘Journal Citation Reports’
A Journal rank metric is one that reflects the prestige value of a journal. For these metrics use ‘SCImago’ in (Scopus)
Source Normalized Impact per Paper (SNIP) and SCImago Journal Rank (SJR) are journal metrics found in Scopus.
SJR (SCImago Journal Rank) SJR is weighted by the prestige of a journal. SCImago Journal Rank is a prestige metric based on the idea that not all citations are the same. Subject field, quality, and reputation of the journal have a direct effect on the value of a citation.
SJR also normalizes for differences in citation behavior between subject fields.
SNIP is normalized for the journal’s subject field, weighting citations based on the number of expected citations in that field.
See www.journalmetrics.com for more details on SNIP and SJR.
Comparison of journals use ‘Journal Citation Reports’ or ‘SCImago’
Citation counts can provide insight into the study of individual scholars, research groups, Departments, Institutions, Scholarly Disciplines and a give an overview of Scholarly Research globally. In his book “Citation analysis and research evaluation” Moed (2011) states that “Citation analysis involves the construction and application of a series of indicators of the ‘impact’, ‘influence’ or ‘quality’ of scholarly work, derived from citation data”
For Citations per paper use Web of Science, Scopus or Google Scholar. In her book “Publish or Perish : your guide to effective and responsible citation analysis” 2011, Harzing describes the tool that she developed using data that was gathered from Google Scholar and compares this tool with other bibliometric tools.
Information about journals and specifically about journal impact factors have been used in the areas of research policy decisions, research management, library collection management and monitoring of titles. These analytics are also used to evaluate scholars and develop publication strategies. To find JIFactors which is a metric that reflects the impact of a journal over a number of years, use the database ‘Journal Citation Reports’
A Journal rank metric is one that reflects the prestige value of a journal. For these metrics use ‘SCImago’ in (Scopus)
Source Normalized Impact per Paper (SNIP) and SCImago Journal Rank (SJR) are journal metrics found in Scopus.
SJR (SCImago Journal Rank) SJR is weighted by the prestige of a journal. SCImago Journal Rank is a prestige metric based on the idea that not all citations are the same. Subject field, quality, and reputation of the journal have a direct effect on the value of a citation.
SJR also normalizes for differences in citation behavior between subject fields.
SNIP is normalized for the journal’s subject field, weighting citations based on the number of expected citations in that field.
See www.journalmetrics.com for more details on SNIP and SJR.
Comparison of journals use ‘Journal Citation Reports’ or ‘SCImago’
Citation counts can provide insight into the study of individual scholars, research groups, Departments, Institutions, Scholarly Disciplines and a give an overview of Scholarly Research globally. In his book “Citation analysis and research evaluation” Moed (2011) states that “Citation analysis involves the construction and application of a series of indicators of the ‘impact’, ‘influence’ or ‘quality’ of scholarly work, derived from citation data”
For Citations per paper use Web of Science, Scopus or Google Scholar. In her book “Publish or Perish : your guide to effective and responsible citation analysis” 2011, Harzing describes the tool that she developed using data that was gathered from Google Scholar and compares this tool with other bibliometric tools.