Publish or perish" is an aphorism describing the pressure to publish academic work in order to succeed in an academic career. ... The pressure to publish has been cited as a cause of poor work being submitted to academic journals.

2. Paradoxical
betweenness in
Academic
endeavors and
research metrics
Dr. S.Ghosh
Associate Professor
Department of Library &
Information Science,
University of North
Bengal, West Bengal
734013

3. Core
Issues
“Publish or Perish” & Stakeholders
Existing Bunch of Metrics for measuring scientific productivity.
Alternative Metrics
Paradox of Intuitiveness and measurement
Key Deliverables
Focusing Identity
5/22/2020@sghoshnbu 3

4. Publish or
Perish?
Publish or perish" is an aphorism
describing the pressure to publish academic
work in order to succeed in an academic
career. ... The pressure to publish has been
cited as a cause of poor work being
submitted to academic journals.
5/22/2020@sghoshnbu 4

5. The Harsh
Consequences of
“Publish or Perish”
 Salami Slicing
 Multiplication of authorship
 Publication Bias
 Citation Obsession
 Research Integrity is compromised
 The culture of “publish or perish” is clearly pervasive and
appears to be here to stay. Calls for instant distribution and
transparency of both authorship and peer review may help
to address problems with research quality, but as long as
researchers are threatened by the publication venue of their
research, the system will remain fundamentally broken.
5/22/2020@sghoshnbu 5

6. Stakeholders
Academic Stakeholders—Individual
Academic Stakeholders—
Institutional/Organizational
Societal Stakeholders
Commercial Stakeholders
5/22/2020@sghoshnbu 6

7. Communication
in Research
Within academia
Presentations and
seminars
Funding and ethics
applications
Academic books
Journal articles and
posters
Term papers and
essays
Meetings and
conferences
Correspondence
With Society
Speaking at public
events
Books for general
audiences
Press
Social media
Blogs

8. Download counts
Page views
Mentions in news reports
Mentions in social media
Mentions in blogs
Reference manager readers
… etc.
Journal Impact Factor
Citation counts
Perspectives of impact
ACADEMIC IMPACT SOCIETAL IMPACT
Alternative metrics
“altmetrics”
+
Traditional metricsTraditional metrics
More article-centric, as opposed to
journal-centric.

9. What are
metrics
Traditional
Bibliometrics
Based on
citation counts
Emerging
Altmetrics
Based on
online tools

10. Why is
metrics?
Quantification of research
impact
Multidimentional Array of
Stakeholders
Calculations of fuzzy concepts
and associative activities

11. What are the
different
metrics?
Scholars have combined standard research
metrics, like scholarly output and citation
counts, into formulas to measure and assess
author and journal impact in new ways. Some
of these metrics include:
 Journal Impact Factor
 h-index
 g-index
 Eigenfactor score
 Altmetric
@sghoshnbu 5/22/2020 11

12. Models for
Assessing
Impact
Academic Outputs Model
Person-Centered Model
Four Quadrants Model
Pragmatic Model—The “Funder Test”
5/22/2020@sghoshnbu 12

13. Ways of
Measuring
Impact
Article Impact - citation count and analysis using Web of
Science and Google Scholar
Journal Impact - journal data and standard measures for
journals
Author Impact - common measures of author impact (h-
index) and other metrics scholars might encounter
Altmetrics - what are altmetrics? Altmetric badges and
altmetrics tools
Book and Book Chapter Impact - book citation counts,
holdings, book reviews and other qualitative indicators
Maximize Impact - unique researcher identifiers and profiles,
academic communities, and other strategies to maximize
impact
5/22/2020@sghoshnbu 13

14. Some
Impact
Factor
limitations
Retrospective measurement
Narrow measurement
Confined by what is indexed as a citation
Can’t be compared between disciplines
Other known issues: language, co-authorship,
disproportionate article citation impact

15. Traditional metrics for journals
 Impact Factor and Citation Counts, created to measure
Journals and journal articles
Scholarly (journal) impact
 Initially created for librarians, then largely adopted by STEM
Image from Journal Citation Reports (library database)
Software

16. Metrics in a nutshell(Impact Factor)
@sghoshnbu 5/22/2020 16
Impact Factor
Journal Citation
Reports
Use a two-year period to divide the
number of times articles were cited by
the number of articles that were
published
Example:
200 = the number of times articles
published in 2008 and 2009 were cited
by indexed journals during 2010.
73 = the total number of "citable
items" published in 2008 and 2009.
200/73 = 2.73
2010 impact factor
Impact factor reflects only on
how many citations on a
specific journal there are (on
average). A journal with a
high impact factor has articles
that are cited often.

17. Immediacy Index
The Immediacy Index measures how frequently the average article from a
journal is cited within the same year as publication. This number is useful
for evaluating journals that publish cutting-edge research.
Immediacy Index Numerator - Cites to recent items:
The numerator looks at citations in a particular JCR year to a journal's
content from the same year. For example, the 2015 Immediacy Index for a
journal would take into account 2015 citations to the journal's 2015 papers.
The numerator includes citations to anything published by the journal in that
year.
Immediacy Index Denominator - Number of recent items:
The denominator takes into account the number of citable items published
in the journal in 2015. Citable items include articles and reviews.
@sghoshnbu 5/22/2020 17

18. Histcite(By Eugene Garfield)
5/22/2020@sghoshnbu 18
See in Action

19. H-index variant H5-Index
@sghoshnbu 5/22/2020 19
h-index
Web of
Science, Google
Scholar, Scopus
1) Create a list of all your publications. Put the list in descending order based
on the number of times it was cited (you can get this information from any
of the sources to the left). The first article should have the most citations. Go
through and number these.
2) Look down through the list to figure out at what point the number of
times a publication has been cited is equal to or larger than the line (or
paper) number of the publication.
Example:
Paper Number # of citations
1 13
2 7
3 4
h-index= 3
*please remember that many databases will give you this number; this is
only if you'd like to calculate it manually. You can also often find calculators
online.
The h-index focuses more
specifically on the impact
of only one scholar instead
of an entire journal. The
higher the h-index, the
more scholarly output a
researcher has.
SoftwareJorge E. Hirsch
Argentine American professor of physics at the University of California,
San Diego.[1] He is known for inventing the h-index in 2005

20. G-index
@sghoshnbu 5/22/2020 20
g-index Harzing's Publish or Perish
Given a list of articles ranked
in decreasing order of the
number citations that they
received, the g-index is the
largest unique number to the
extent that the top g articles
received together is at least
g
2
citations.
The g-index can be thought of
as a continuation of the h-index.
The difference is that this index
puts more weight on highly-
cited citations. The g-index was
created because scholars
noticed that h-index ignores the
number of citations to each
individual article beyond what is
needed to achieve a certain h-
index. This number often
complements the h-index and
isn't necessarily a replacement.
Egghe, Leo
Hasselt University, Nederlands in 2006 suggested
g-index

21. Publish or Perish by Anne-Wil Harzing'
5/22/2020@sghoshnbu 21

22. Eigenfactor score
@sghoshnbu 5/22/2020 22
Eigenfactor score Eigenfactor.org
• The Eigenfactor score is calculated by
eigenfactor.org.
• However, their process is very similar to
calculating impact factor and they pull
their data from the JCR as well.
• The major difference is that the
Eigenfactor score deletes references
from one article in a journal to another
in the same journal.
• This eliminates the problem of self-
citing.
• The Eigenfactor score is also a five-year
calculation.
• More information can be found
through Journal Citation Reports.
A high Eigenfactor score signals
that the journal does not self-
cite and controls the network of
that discipline. It's useful to look
at scholar's h-index as well as
the Eigenfactor score of the
journals they publish in in order
to get a broad sense of their
impact as a researcher.
Jevin West Carl T. Bergstrom Ted C. Bergstrom
Ben Althouse

23. i10-index
The i10-index is used by Google
Scholar and indicates the
number of publications that have
been cited at least 10 times.
5/22/2020@sghoshnbu 23

24. Journal Evaluation
Resources
@sghoshnbu 5/22/2020 24
Journal Citation Report(JCR)
Database for journal evaluation
Google Scholar Metrics
SJR (Scimago Journal & Country
Rank)
SciRev

25. Citation
Analysis
Citation analysis is the study of the impact and (assumed) quality of an article
on the number of times a publication has been cited by others in scholarly works.
>Citation analysis is used to :
>discover how many times a scholarly work has been cited
>learn who is citing a specific scholarly work
>track a specific scholar/author
>identify seminal works that are frequently cited
>determine trends in research
5/22/2020@sghoshnbu 25

26. Measuring
Impact for
Books
5/22/2020 @sghoshnbu 26
In some disciplines, the book rather than the journal
is the primary mode of sharing research. Book Citation
Counts
Library Holdings
Book Reviews
Other Qualitative Indicators

27. Altmetrics
Jason Priem
The tweet by Jason Priem,
which coined the
term altmetrics.
The term "altmetrics" (alternative metrics) is used to describe
approaches to measure the impact of scholarship by using new
social media tools such as bookmarks, links, blog postings,
inclusion in citation management tools, mentions and tweets to
measure the importance of scholarly output.
Proponents of altmetrics believe that using altmetrics will help
measure the impact of an article in a more comprehensive and
objective way than was done with more traditional scholarly
impact measures such as journal impact factor. However, there
are limits to this approach and caution should be used to not rely
on any one particular measure in evaluating the importance of
scholarship.
5/22/2020@sghoshnbu 27

28. “The Umbrella
Classification of
Non-Citation
based Metrics”
“alternative metrics”
• new ways of measuring different, non-traditional
forms of impact.
• “alternative to only using citations”, not
“alternative to citations”.
• complementary to traditional citation-based
analysis.
Article-level metrics have come to refer to
any metrics (e.g., including altmetrics) that
surround a scholarly article.

29. An article-centric approach
 Measure online attention surrounding journal articles (and datasets).
 Collect and deliver article-level metrics to journal publishers.

30. Categories
of altmetrics
Article-level [individual
Journal-level
Author-level
Institutional-level

31. Where do altmetrics come from?

32. How do we collect
data for altmetrics?
 Directly from the individual tools
 From publishers (views, download data)
 From (some) library databases
 From scholarly networks
 Through aggregating tools
SlideShare views
PLOS article metrics
Web of Science usage
ResearchGate metrics
Altmetric metrics

33. “Impact”
and metrics
Inherently fuzzy and
subjective
Attention
Engagement
Some correlate to
bibliometrics; some don’t

34. Altmetrics
Measures
5/22/2020 @sghoshnbu 34
Usage : clicks, downloads, views; Social Media - likes, shares, or tweets;
Captures - bookmarks, favorites, followers; Mentions - blog posts,
reviews, comments, or ratings
Altmetrics are often used to measure the impact of gray literature or
materials that are not formally published, such as posters and working
papers. They can also be used to provide more information about the
reach of published articles and books.
It is unlikely that altmetrics will supplant traditional metrics as the
measure of research impact. However, altmetrics can demonstrate the
reach and interest in a topic from the public, practitioners, and policy
makers
Authors should refrain from judging the impact of a work based on the
altmetrics numbers. Digging into who is saying what about the work
may provide more reliable information about the quality and influence
of a work.

35. Altmetric Tools
 Altmetrics.org
 Impactstory
 ReaderMeter
 ScienceCard
 PLoS Impact Explorer
 PaperCritic
 Crowdometer
5/22/2020@sghoshnbu 35

36. Impact Story
@sghoshnbu 5/22/2020 36

37. ReaderMeter
@sghoshnbu 5/22/2020 37

38. ScienceCard
@sghoshnbu 5/22/2020 38

39. PLoS Impact
Explorer
@sghoshnbu 5/22/2020 39

40. PaperCritic
@sghoshnbu 5/22/2020 40

41. Strategies to
Maximize
Your Impact
5/22/2020 @sghoshnbu 41
Create Unique
Researcher Identifiers
Create Researcher
Profiles
Share Your Research
Online
Take Steps to Broaden
Your Impact

42. Take Steps
to Broaden
Your Impact
Contribute
Contribute to Wikipedia, either in a new entry or in the text and
references of an existing entry.
Discuss Discuss your research findings on a blog or through Twitter.
Link Link your most recent research to your email signature.
Publish in
Publish in open access journals or pay to have the work available
open access in a subscription journal.
Craft
Craft a work's title and abstract carefully. Repeat keywords so the
work is highly relevant in search engines.
Add
Add postprints/white papers/drafts of work to your institutional
repository, DigitalCommons@EMU, or to a disciplinary repository.
5/22/2020@sghoshnbu 42

43. Identity
Exploration
Google Scholar Profile
A Google Scholar Profile tracks your publications listed in Google Scholar,
provides the number of citations and links to the items citing your work, and
calculates your h-index. (Note: You need to have a Gmail account to track
your profile. Once you are logged in to your Gmail account, click on "My
citations" to view and edit your profile.)
Impactstory
This web-based service collects metrics and displays them with a link that
can be added to CVs. Join free with an ORCID account.
Share Your Research Online
The process of writing for publication often creates several outputs in
addition to the final journal article, book, or book chapter. Consider posting
slides from presentations, brief videos of presentations, data sets, or other
materials online with a link to the official publication.
Postprints/White Papers/Drafts of work - DigitalCommons@EMU or
subject/disciplinary repositories.
Presentation Slides - SlideShare or Speaker Deck
Videos - Vimeo or YouTube
Data Sets - Dryad or figshare (figshare can handle other outputs as well)
Code & Software - GitHub
@sghoshnbu 5/22/2020 43

44. What do you
think?
30th Apr, 2013 Jan Hrušák The Czech Academy of Sciences
I firmly believe that already the question shows that something goes fundamentally wrong in
the scientific world. The old motto “Nobody is reading, as everybody is kept busy by writing”
seems to have evolved, over the 30 years I saw it for the first time, to an overwhelming and
distorted reality sketch. It seems, as nobody would believe in his/her own assessment, if this
is not underpinned by a quantitative measure (often off any kind and of any quality). The
attempt to linearize research performance is based on a very simple parallel. It resembles the
situation, where a new branch of fast universal managers, equipped with general knowledge on
economic rules and on managerial processes, can take decisions and steer almost any
company just by optimizing cost and benefits. It is effective, fast and often successful. Why
not to bring this effectiveness to research as well. It such straightforward. However, the
approach, to squeeze all quality measures to one single number (irrespective if it is the impact
factor, citation or H- index) and to use this figure for sophisticated decisions is fundamentally
wrong. Nothing against scientometry that has evolved to its own scientific discipline. I just
pledge for against oversimplification. None impact factor, neither citation nor H-index has the
uniformity of money (as an expression of value) and it cannot replace careful reading,
understanding and evaluating of a research result or of a researcher. Certainly these numbers
can serve as indicators or hints for further quality assessments. They can be valuable
especially at the low-end. They identify easily cases where low performing research(er) that
has not created any result or impact can be expected. On the other hand, these figures are
often (miss)used as the only (or main) evaluation criteria. The resulting rankings then, form
the basis for managerial, political and/or financial decisions. In that a way supporting
measures become the main guiding or steering principle. Notwithstanding, it fails and leads to
opportunistic behavior of research(ers). One gets what one is paying for.
Publications are optimized according to the minimal needed content of information in order to
maximize the number of papers. Citation indexes are artificially increased by different citation
mafias. Journals adopt their policies not to serve best to science, but to artificially increase
their value (citation indexes). The integrity of all players is seriously in danger.
It is forgotten that the quality of science and of the performed research is the thing that shall
count most. It is forgotten that the scientific publication is not the primary result of scientific
undertaking. It is the new knowledge that moves science (and society) forward. We publish
just in order to contribute efficiently to the common knowledge pot. It is absolutely irrelevant
how many articles or pages you wrote if you have pushed things forward.
Do we (researchers) really need such a simplistic view? Is it really important to rank a chemist
against a philosopher based on a numerical index (and finance them by a mechanistic
approach)? Do we want to support the ignorance of certain decision makers? Many other
questions seem to arise.
(My citation index is about 26 citations per paper and recently I saw that my H-index
approached 31. Is it good enough to support this my opinion? I do not know. But I do not care
either.)
@sghoshnbu 5/22/2020 44

45. References
 Ayris, P., López de San Román, A., Maes, K., & Labastida, I. (2018). Open Science and its role in universities : A roadmap for cultural
change. League of European Research Universities.
 Bose, R. (2004). Knowledge management metrics. Industrial Management and Data Systems. https://doi.org/10.1108/02635570410543771
 Commission, E. (2017). Next generation metrics: Responsible metrics and evaluation for open science: European commission Report.
Brussels.
 Hicks, D., Wouters, P., Waltman, L., De Rijcke, S., & Rafols, I. (2015). Bibliometrics: The Leiden Manifesto for research metrics. Nature.
https://doi.org/10.1038/520429a
 Lăzăroiu, G. (2017). What do altmetrics measure? Maybe the broader impact of research on society. Educational Philosophy and Theory.
https://doi.org/10.1080/00131857.2016.1237735
 LibGuides: Introduction to Impact Factor and Other Research Metrics: Home. (n.d.). Retrieved from
https://guides.library.illinois.edu/impact
 SAGE Publishing. (2019). The latest thinking about metrics for research
 impact in the social sciences (White paper). Thousand Oaks, CA: Author. doi: 10.4135/wp190522.
 Understanding research metrics. (n.d.). Retrieved May 17, 2020, from https://editorresources.taylorandfrancis.com/understanding-
research-metrics/
5/22/2020@sghoshnbu 45

46. Questions
&
Answers
&
More
5/22/2020 @sghoshnbu 46
Just shoot…We are here to
listen
“Thank You” Slide is not
Made
It’s For All...Not Digital…
From Heart

47. 5/22/2020@sghoshnbu 47

48. 5/22/2020@sghoshnbu 48