Analysis of Bibliometrics information for selecting the best field of study

Analysis of Bibliometrics
information for selecting
the best field of study
aleebrahim@um.edu.my
@aleebrahim
www.researcherid.com/rid/C-2414-2009
http://scholar.google.com/citations
Nader Ale Ebrahim, PhD
Visiting Research Fellow
Research Support Unit
Centre for Research Services
Research Management & Innovation Complex
University of Malaya, Kuala Lumpur, Malaysia
15th June 2016

3rd SERIES OF INTRODUCTORY WORKSHOP ON:
Strategies to Enhance Research
Visibility, Impact & Citations
=====================================
All of my presentations are available online at:
https://figshare.com/authors/Nader_Ale_Ebrahim/100797
Link to this presentation: https://dx.doi.org/10.6084/m9.figshare.1621261.v3 (New version)
Read more:
1. Ale Ebrahim, N., Salehi, H., Embi, M. A., Habibi Tanha, F., Gholizadeh, H., Motahar, S. M., & Ordi, A. (2013). Effective
Strategies for Increasing Citation Frequency. International Education Studies, 6(11), 93-99. doi: 10.5539/ies.v6n11p93
2. Ale Ebrahim, Nader. "Optimize Your Article for Search Engine." University of Malaya Research Bulletin 2.1 (2014): 38-39.

Abstract
Abstract:
Bibliometrics can be defined as the statistical analysis of publications.
Bibliometrics has focused on the quantitative analysis of citations and
citation counts which is complex. It is so complex and specialized that
personal knowledge and experience are insufficient tools for understanding
trends for making decisions. We need tools for analysis of Bibliometrics
information for select the best field of study with promising enough
attention.
This presentation will provide tools to discover the new trends in our field of
study in order to select an area for research and publication which
promising the highest research impact.
Keywords: H-index, Improve citations, Research tools, Bibliometrics,
Research Visibility, Research Impact
©2016-2017 Nader Ale Ebrahim

Research Tools Mind Map

Effective Strategies for Increasing Citation Frequency
Journal Reputation and Impact: publishing a paper in a journal based on disciplinary reputatation or with a high
impact factor is the most well known way of getting your paper cited. But there are many other things a scholar can do
to promote his or her work and make it easy for others to find.
Utilize Open Access Tools: Open Access journals tend to be cited more than non open access. Deposit your paper in
a repository such as Scholars Archive here on campus or a disciplinary repository. Share your detailed research data in
a repository.
Standarize Identifying Info: try to use the same name throughout your career as well as the name of your affiliated
insitution. Using common "official" names will allow for consistency and easy retrieval of your work by author or
affiliation.
Bring Colleagues on Board: team-authored articles are cited more frequently, as does publishing with international
authors. Working cross-or inter-disciplinarily helps as well.
Beef Up That Paper: use more references, publish a longer paper. Also papers which are published elsewhere after
having been rejected are cited more frequently.
Beyond Peer-Reviewed Original Research: Write a review paper. Present a working paper. Write and disseminate
web-based tutorials on your topic.
Search Optimization: use keywords in the abstract and assign them to the manuscript. Use descriptive titles that
utilize the obvious terms searchers would use to look for your topic, avoiding questions in the title. Select a journal that
is indexed in the key library databases for your field.
Market Yourself: create a key phrase that describes your research career and use it. Update your professional web
page and publication lists frequently. Link to your latest and greatest article in your professional email signature file.
Utliize Social Media: Use author profiles such as ResearcherID and ORCID. Contribute to Wikipedia, start a blog
and/or podcast, join academic social media sites.
From: Ebrahim, N.A., et al. (2013). Effective strategies for increasing citation frequency. International Education
Studies, 6(11), 93-99. doi:10.5539/ies.v6n11p93

Top 10 authors with the highest
profile view counts on ResearchGate
Source: Martín-Martín, A., Orduna-Malea, E., Ayllón, J. M., & López-Cózar, E. D. (2016). The counting house, measuring those who count: Presence of
Bibliometrics, Scientometrics, Informetrics, Webometrics and Altmetrics in Google Scholar Citations, ResearcherID, ResearchGate, Mendeley, & Twitter.
EC3 Reseach Group: Evaluación de la Ciencia y de la Comunicación Científica Universidad de Granada and Universidad Politécnica de Valencia (Spain), In
Progress,. doi:10.13140/RG.2.1.4814.4402

World Report

From submission to sharing: the life
cycle of an article
• Phase 1: Conception and birth
• Phase 2: Submission
• Phase 3: Reviewers
• Phase 4: Production and publication
• Phase 5: Dissemination and archiving
– The article is published, but its life cycle isn’t
yet complete. In this phase, dissemination can
start; sharing the Share Links article helps
increase readership and make it more visible.
Source: https://www.elsevier.com/reviewers-update/home/featured-article/from-submission-to-sharing-the-life-cycle-of-an-article

Introduction of bibliometrics
• Bibliometrics can be defined as the quantitative analysis
of science and technology performance and the
cognitive and organizational structure of science and
technology.
• Basic for these analyses is the scientific communication
between scientists through (mainly) journal publications.
• Key concepts in bibliometrics are output and impact, as
measured through publications and citations.
• Important starting point in bibliometrics: scientists
express, through citations in their scientific publications,
a certain degree of influence of others on their own work.
• By large scale quantification, citations indicate influence
or (inter)national visibility of scientific activity, but
should not be interpreted as synonym for ‘quality’.
Source: Thed van Leeuwen, (2010) Application of bibliometric analysis: Advantages & pitfalls, Workshop on Research Evaluation in Statistical
Sciences , Bologna, 25th March 2010

Altmetrics
Webometrics
Cybermetrics
Bibliometrics
Scientometrics
Informetrics
Science of
Science
Bibliographies –
largely
references
Alternative
metrics – views,
downloads, web
citations, etc
Web presence,
visibility and
impact – links,
pages,
documents
Whole Internet,
cyberspace
Informetrics, scientometrics, bibliometrics,
webometrics, cybermetrics and altmetrics
Source: Onyancha, Omwoyo Bosire. "Can informetrics shape biomedical research? A case study of the HIV/AIDS research in sub-Saharan Africa ."
Inkanyiso: Journal of Humanities and Social Sciences 6.1 (2014): 49-65.

Frequently Used Terms for Research
Evaluation Metrics
Source: Das, A.-K. (2015). Research Evaluation Metrics. 7, place de Fontenoy, 75352 Paris 07 SP, France: United Nations Educational, Scientific and
Cultural Organization.

Reasons for bibliometric studies
• Understanding of patterns
– discovery of regularities, behavior
– “order out of documentary chaos” [Bradford, 1948]
• Analysis of structures & dynamics
– discovery of connections, relations, networks
– search for regularities - possible predictions
• Discovery of impacts, effects
• relation between entities & amounts of their various uses
– providing support for making of decisions, policies
Source: https://comminfo.rutgers.edu/~tefko/Courses/e530/Lectures/Lecture09%20Bibliometric%20searching.ppt

Use of evaluative bibliometrics
• Academic, research & government institutions for:
– promotion and tenure, hiring, salary raising
– decisions for support of departments, disciplines
– grants decision; research policy making
– visualization of scholarly networks, identifying key contributions
& contributors
– monitoring scholarly developments
– determining journal citation impact
• Resource allocation:
– identifying authors most worthy of support;
– research areas most worthy of funding
– journals most worthy of support or purchase; etc.
Source: https://comminfo.rutgers.edu/~tefko/Courses/e530/Lectures/Lecture09%20Bibliometric%20searching.ppt

Applications of Scientometrics and
Bibliometrics in Research Evaluation
• For Institution/ Collaborative Research
Group
• For a scientist:
– Mapping of collaborations, collaborating institutions, collaborating countries,
co-authors, highly cited papers, top publishing journals, percentage of cited vs.
uncited papers, percentage of self-citations, author-level indicators such as h-
index, i10-index, etc.
• For a country
• For a journal

Major Citation Databases

The Institute for Scientific Information (ISI)
• The Institute for Scientific Information (ISI) was founded by Eugene
Garfield in 1960. It was acquired by Thomson Scientific & Healthcare in
1992, became known as Thomson ISI and now is part of the Healthcare &
Science business of the multi-billion dollar Thomson Reuters Corporation.
• ISI offered bibliographic database services. Its speciality: citation indexing
and analysis, a field pioneered by Garfield. It maintains citation databases
covering thousands of academic journals, including a continuation of its long
time print-based indexing service the Science Citation Index (SCI), as well
as the Social Sciences Citation Index (SSCI), and the Arts and Humanities
Citation Index (AHCI). All of these are available via ISI's Web of Knowledge
database service.

Science Citation
Index
Arts &
Humanities
Citation Index
WOK 4.0
Social
Sciences
Citation
Index
ISI Web of
Knowledge
1960 1965 1970 1975 1980 1985 1990 1995 2000 2005 2007 2008
SciSearch
Century of
Science TS Innovation
Essential
Science
Indicators
PC-based Indicators
for journals, nations,
institutions
PC-based citation sets
Custom citation projects
and national indicators -
mainframe
Thomson Reuters (formerly ISI) has been the
authority on citation data for over 50 years.

Eugene Garfield, Ph.D.
Founder & Chairman Emeritus
Institute for Scientific Information (ISI)
For more Info

The Institute for Scientific Information (ISI)
• The ISI also publishes annual Journal Citation Reports which list an impact
factor for each of the journals that it tracks. Within the scientific community,
journal impact factors play a large but controversial role in determining the
kudos attached to a scientist's published research record.

Scopus (Launched 2004)
• Scopus is the largest abstract and citation database of
peer-reviewed literature: scientific journals, books and
conference proceedings. Delivering a comprehensive
overview of the world's research output in the fields of
science, technology, medicine, social sciences, and arts
and humanities, Scopus features smart tools to track,
analyze and visualize research.
• As research becomes increasingly global,
interdisciplinary and collaborative, you can make sure
that critical research from around the world is not missed
when you choose Scopus.
Source: http://www.elsevier.com/online-tools/scopus

A Comparison between Two Main Academic Literature
Collections: Web of Science and Scopus Databases
Source: Aghaei Chadegani, Arezoo and Salehi, Hadi and Yunus, Melor Md and Farhadi, Hadi and Fooladi, Masood and Farhadi, Maryam and Ale Ebrahim,
Nader, A Comparison between Two Main Academic Literature Collections: Web of Science and Scopus Databases (April 7, 2013). Asian Social Science, Vol.
9, No. 5, pp. 18-26, April 27, 2013. Available at SSRN: http://ssrn.com/abstract=2257540

Author Level Indicators

CHECK YOUR SCORE
• H-Index?
• i10-Index?
• g-Index?
• Citations Count?
• Articles with citation?
• Average citations per article?
• Impact Points?
• RG Score?

Citations as a proxy of scientific
impact
QualityQuality
Scientific
impact
Scientific
impact
RelevanceRelevance
VisibilityVisibility
Random
factors
Random
factors
ReputationReputation
CitationsCitations
Source: Martijn S. Visser, (2012) Measuring UNL Research: The use and interpretation of bibliometric indicators, Lisbon, 29 June 2012

H-index Example
Scholar A Scholar B
10 27
10 12
9 5
8 4
7 4
6 2
6 2
56 citations 56 citations
6 h-index 4 h-index
0
5
10
15
20
25
30
1 2 3 4 5 6 7
NumberofCitations
Article Number
H-index
Scholar A
Scholar B
Source: http://www.slideshare.net/librarian68/overview-of-citation-metrics
Jorge E. Hirsch

A new phenomenon
Numbers of published papers on the h-index
6
19
31
63
115
145
173
224
2005 2006 2007 2008 2009 2010 2011 2012
Papers
Source: Scopus July 2013
Source: Rowlands, I. (2013). The h-index. Friend or Foe?
2nd Bibliometrics in Libraries Meeting: The Open
University.

Source: http://guides.is.uwa.edu.au/content.php?pid=372347&sid=3050052
A scientist has index h if h of his/her Np papers have at least
h citations each, and the other (Np-h) papers have no more than
h citations each.

h-index importance
“Hirsch, who has a h-index of 49, says that a
"successful scientist" will have an index of 20
after 20 years; an "outstanding scientist" will
have an index of 40 after 20 years; and a "truly
unique individual" will have an index of 60 after
20 years.”
Source: Ball, P. (2005). Index aims for fair ranking of scientists. Nature 436(7053), 900-
900.

Source: Rousseau, Ronald. "New developments related to the Hirsch index." (2006).

How “good” is this? What is the
context?
Additional metrics are needed to
understand research performance.
23.3 cites/paper
H-index: 13
Citation rates vary among fields. What is good or average in
mathematics is very different from what is good or average in
biochemistry.
14.5 cites/paper
H-index: 7 9.8 cites/paper
H-index: 7 4.2 cites/paper
H-index: 3
Normalized citation metrics put citation
information in context
Source: Ann Kushmerick (May 3, 2013), Bibliometric Analysis Tools for
Research Portfolio Analysis and Management, Manager, Research Evaluation
and Bibliometric Data

All three publication lists have a Hirsch Index of 5
30 P1
10 P2
8 P3
6 P4
5 P5
1 P6
0 P7
30 P1
10 P2
8 P3
6 P4
5 P5
4 P6
4 P7
4 P8
4 P9
100 P1
70 P2
8 P3
6 P4
5 P5
1 P6
0 P7
H=? H=? H=?5 5 5
1
2
3
4
5
6
7
8
9
Author 2Author 1 Author 3
Source: Henk F. Moed, (2011) “New developments in electronic publishing and bibliometrics”, CWTS, Leiden University, Netherlands & Elsevier, Amsterdam, Netherlands

Different bibliometric
distributions
have the same H-Index
Source: Henk F. Moed, (2011) “New developments in electronic publishing and bibliometrics”, CWTS, Leiden University, Netherlands &
Elsevier, Amsterdam, Netherlands

Targeted advertising
1
2
3
4
5
6
7
8
9
10
11

Predicting scientific success

Subject Bubble Chart - US

Technology Management
and Virtual Teams

Bibliometrics

SCOPUS - Analyze author output

SciVal - Elsevier Research Intelligence

DATA DRILL DOWN: CITATION TRENDS
Users can view citation trends for any entity in the rankings list. For example, if
the user clicks on the name CHINESE ACAD SCI:
Source: MASSIMILIANO CARLONI (2014) THE NEW JCR, Journal Citation Reports on INCITES, Strategic Business Manager, Thomson Reuters

They will be taken to the Citation Trends Page for the Chinese Academy of Sciences, which
shows a trend graph, normalized citation data, and raw citation data:
DATA DRILL DOWN: CITATION TRENDS
Source: MASSIMILIANO CARLONI (2014) THE NEW JCR, Journal Citation Reports on INCITES, Strategic Business Manager, Thomson Reuters

Practical Advice
• Find out what’s Hot
– http://info.scopus.com/topcited/
– http://top25.sciencedirect.com/
• Find the trends of the subject area
– Search tips (including alerts)
– Journals, authors, publications per year (Scopus)
• Evaluate which journal is right for your article
– Impact Factor
– Subject Specific Impact Factor (http://tinyurl.com/scopusimpact)
– SCImago Journal & Country Ranking (http://scimagojr.com/)
– Journal Analyzer
– h-Index
• Find out more about the journals
– Who are the editors?
– Guide for authors
– Article of the future
http://beta.cell.com/erickson/
IF
Source: How To Get Your Article Published: From title to references, From submission to revision Presented by: Anthony Newman, Elsevier, Amsterdam, Birmingham, Nov. 2010

Your paper is worthless if no one reads, uses, or cites it
A research study is meaningful only if…
• it is clearly described, so
• someone else can use it in his/her studies
• it arouses other scientists’ interest and
• allows others to reproduce the results.
By submitting a manuscript you are basically trying to
sell your work to your community…
Source: How To Get Your Article Published: From title to references, From submission to revision Presented by: Anthony Newman, Elsevier, Amsterdam, Birmingham, Nov. 2010

Positive correlation between
downloads and citations
partly due to the effect of
citations upon downloads

Age distribution of citations to Arxiv
and non-ArXiv papers
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.10
0 6 12 18 24 30 36 42 48 54 60 66 72 78 84
Months after Publication Date
CitesperPaper
in ArXiv-CM
Not in ArXiv-CM
3 per. Mov. Avg. (in
ArXiv-CM)
3 per. Mov. Avg. (Not
in ArXiv-CM)
Move curve
by 6 months
to the right

Citations lead to downloads
[Moed, J. Am Soc Inf Sci Techn, 2005]
1
10
100
1000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
AGE PAPER A (MONTHS)
DOWNLOADS
A
B (B cites A)
C (C cites A and B)
Paper
A
published
Paper B
published;
it cites A
Download of A
increases
Paper C
published;
it cites A and B

RELATIVE IMPACT
AGAINST JOURNAL AVERAGE
Search
publications by:
- Journal
- Document type
- Year
Source: Rachel Mangan, (2010), WEB OF KNOWLEDGE UPDATE TRAINING, MIMAS

RELATIVE IMPACT
Citation report shows an
average of 7.81 citations
per paper for that journal,
year and document type

RELATIVE IMPACT
So our paper was
cited 22/7.81 = 2.82
times the average
We call this journal
actual versus
expected cites

Questions?
E-mail: aleebrahim@um.edu.my
Twitter: @aleebrahim
=====================================
RESEARCH SUPPORT UNIT (RSU)
CENTRE FOR RESEARCH SERVICES
RESEARCH MANAGEMENT & INNOVATION COMPLEX (IPPP)
UNIVERSITY OF MALAYA

References
1. Thed van Leeuwen, (2010) Application of bibliometric analysis: Advantages & pitfalls, Workshop on Research Evaluation in Statistical Sciences ,
Bologna, 25th March 2010
2. Onyancha, Omwoyo Bosire. "Can informetrics shape biomedical research? A case study of the HIV/AIDS research in sub-Saharan Africa ." Inkanyiso:
Journal of Humanities and Social Sciences 6.1 (2014): 49-65.
3. Das, A.-K. (2015). Research Evaluation Metrics. 7, place de Fontenoy, 75352 Paris 07 SP, France: United Nations Educational, Scientific and Cultural
Organization.
4. Aghaei Chadegani, Arezoo and Salehi, Hadi and Yunus, Melor Md and Farhadi, Hadi and Fooladi, Masood and Farhadi, Maryam and Ale Ebrahim,
Nader, A Comparison between Two Main Academic Literature Collections: Web of Science and Scopus Databases (April 7, 2013). Asian Social
Science, Vol. 9, No. 5, pp. 18-26, April 27, 2013. Available at SSRN: http://ssrn.com/abstract=2257540
5. Ann Kushmerick (May 3, 2013), Bibliometric Analysis Tools for Research Portfolio Analysis and Management, Manager, Research Evaluation and
Bibliometric Data
6. Henk F. Moed, (2011) “New developments in electronic publishing and bibliometrics”, CWTS, Leiden University, Netherlands & Elsevier, Amsterdam,
Netherlands
7. MASSIMILIANO CARLONI (2014) THE NEW JCR, Journal Citation Reports on INCITES, Strategic Business Manager, Thomson Reuters
8. Rachel Mangan, (2010), WEB OF KNOWLEDGE UPDATE TRAINING, MIMAS
9. Ale Ebrahim, Nader, Introduction to the Research Tools Mind Map (June 14, 2013). Research World, Vol. 10, No. 4, pp. 1-3,. Available at SSRN:
http://ssrn.com/abstract=2280007
10. Akhavan, P., Ale Ebrahim, N., Fetrati, M. A., & Pezeshkan, A. (2016). Major trends in knowledge management research: a bibliometric study.
Scientometrics 1-16. doi:10.1007/s11192-016-1938-x
11. Shakiba, M., Ale Ebrahim, N., Danaee, M., Bakhtiyari, K., & Sundararajan, E. (2016). A Comprehensive Comparison of Educational Growth within Four
Different Developing Countries between 1990 and 2012. Revista de Gestão e Secretariado, 6(3), 152-174. doi:10.7769/gesec.v6i3.486
12. Martín-Martín, A., Orduna-Malea, E., Ayllón, J. M., & López-Cózar, E. D. (2016). The counting house, measuring those who count: Presence of
Bibliometrics, Scientometrics, Informetrics, Webometrics and Altmetrics in Google Scholar Citations, ResearcherID, ResearchGate, Mendeley, &
Twitter. EC3 Reseach Group: Evaluación de la Ciencia y de la Comunicación Científica Universidad de Granada and Universidad Politécnica de
Valencia (Spain), In Progress,. doi:10.13140/RG.2.1.4814.4402
13. Müller, A. M., Ansari, P., Ale Ebrahim, N., & Khoo, S. (2015). Physical Activity and Aging Research: A Bibliometric Analysis. Journal Of Aging And
Physical Activity In Press. doi:10.1123/japa.2015-0188
14. Maghami, M., Navabi Asl, S., Rezadad, M. i., Ale Ebrahim, N., & Gomes, C. (2015). Qualitative and Quantitative Analysis of Solar hydrogen Generation
Literature From 2001 to 2014. Scientometrics 105(2), 759-771. : http://dx.doi.org/10.1007/s11192-015-1730-3

Analysis of Bibliometrics information for selecting the best field of study

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Analysis of Bibliometrics information for selecting the best field of study

Similar to Analysis of Bibliometrics information for selecting the best field of study (20)

Recently uploaded

Recently uploaded (20)

Analysis of Bibliometrics information for selecting the best field of study