presentation for IGAD Barcelona 2017

1. Agricultural Science: three bibliometric systems compared
Sub title
201703, Ellen Fest & Hugo Besemer

2. General
• The expected citedness of an article depends
very much on subject
• In bibliometric studies subject = journal
category
• Most categorization systems depend on
choices who made them
• There are subject specific (economy,
chemistry) categorizations but most are
generic

3. What we did
• Compare three systems, based on
Web of Science - Essential Science Indicators
Web of Science - WOS categories
Scopus - ASJC (All Science Journal
Classification)
We looked at 14 University Departments
9 Institutes (or their business
units)
Groups that were: very specific (compared to ESI); low coverage in WOS;
Performing particularly well or particularly not so well….

4. The systems compared
Web of Science Scopus
Number of articles 9124596 10770432
Number of Journals 12393 24015
Number of
Categories
22 (ESI)
251 (Incites)
331
Avg categories per
Jounal
1 (ESI)
1.6 (Incites)
2.1

5. What we expected
• Scopus would cover better than Web of
Science
• Specific groups would perform better with
more specific categories
• Web of Science categories are more precise
Based on Wang, Qi, and Ludo Waltman.
"Large-scale analysis of the accuracy of the journal classification systems of
Web of Science and Scopus." Journal of Informetrics 10.2 (2016): 347-364.
http://dx.doi.org/10.1016/j.joi.2016.02.003

6. Coverage (University)
0%
20%
40%
60%
80%
100%
dekkingvanref.artindedatabases
SciVal (Art+Rev) Staff Pubs/InCites

7. Coverage (Institutes)
0%
20%
40%
60%
80%
100%
dekkingvanref.artindedatabases
SciVal (Art+Rev) Staff Pubs/InCites

8. Performance: the overall picture
0
1
2
3
4
5
RI/CNCI/FWCI
Staff Pubs InCites SciVal

9. How do groups with low WOS
coverage perform?
Management studies
0
0.5
1
1.5
2
2.5
2009 2010 2011 2012 2013 2014
CNCS/RI/FWCI
SciVal
InCites
Staff Pubs

10. MST Altmetrics
Patient hospital choice for hip replacement:
empirical evidence from the Netherlands
https://www.altmetric.com/details/1858555
Supply Chain-Wide Consequences of
Transaction Risks and Their Contractual
Solutions: Towards an Extended
Transaction Cost Economics Framework
https://www.altmetric.com/details/188
0868
University-industry collaboration in
turkish SMEs
https://www.altmetric.com/details/1
421267

11. How do very specific groups perform?
Fisheries
0
0.5
1
1.5
2
2.5
3
2009 2010 2011 2012 2013 2014
CNCS/RI/FWCI
SciVal
InCites
Staff Pubs

12. Categories for fisheries
Staff Publications InCites SciVal
Research Field (ESI) Share RI* Web of Science Categories Share CNCI* Subject Area Subcategory Share FWCI*
Agricultural Sciences 50% 0.97
AGRICULTURAL ECONOMICS &
POLICY
17% 1.47
Agricultural and Biological
Sciences
Food Science 13% 2.30
Economics & Business 18% 1.42 FOOD SCIENCE & TECHNOLOGY 14% 1.05
Business, Management and
Accounting
Business and
International
Management
8% 1.03
Engineering 13% 1.70 ECONOMICS 8% 1.06
Economics, Econometrics
and Finance
Economics and
Econometrics
7% 1.50
Social Sciences, General 13% 1.62
AGRICULTURE,
MULTIDISCIPLINARY
8% 1.07 Computer Science
Computer Science
Applications
6% 0.39
Computer Science 4% 1.18 MANAGEMENT 7% 1.20
Business, Management and
Accounting
Management
Information Systems
6% 0.46
Environment/Ecology 1% 1.48 BUSINESS 5% 1.80 Computer Science
Computer Networks
and Communications
5% 0.27
Immunology 1% 1.49 ENGINEERING, INDUSTRIAL 4% 1.37
Agricultural and Biological
Sciences
Agronomy and Crop
Science
5% 1.12
Plant & Animal Science 1% 0.95
OPERATIONS RESEARCH &
MANAGEMENT SCIENCE
4% 1.40
Business, Management and
Accounting
General Business,
Management and
Accounting
3% 1.11
COMPUTER SCIENCE,
INTERDISCIPLINARY
APPLICATIONS
3% 0.87
Business, Management and
Accounting
Strategy and
Management
3% 2.24
PLANNING & DEVELOPMENT 3% 2.55 Decision Sciences
Management Science
and Operations
Research
3% 2.46
Other 27% Other 41%

13. Fisheries Altmetrics
Red light represses the photophysiology of
the scleractinian coral Stylophora pistillata
https://www.altmetric.com/details/2204276
Cell turnover and detritus production in
marine sponges from tropical and temperate
benthic ecosystems
https://www.altmetric.com/details/4897480
Oxygen and Heterotrophy Affect Calcification
of the Scleractinian Coral Galaxea fascicularis
https://www.altmetric.com/details/1179630

14. Forestry, a group that perform well in
the present system (WOS / ESI)
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
5
2009 2010 2011 2012 2013 2014
CNCS/RI/FWCI
SciVal
InCites
Staff Pubs

15. Staff Publications InCites SciVal
Research Field (ESI) Share RI* Web of Science Categories Share CNCI* Subject Area Subcategory Share FWCI*
Environment/Ecology 50% 2.71 ECOLOGY 36% 2.11
Agricultural and Biological
Sciences
Ecology, Evolution,
Behavior and
Systematics
17% 2.80
Plant & Animal Science 42% 3.00 FORESTRY 24% 1.67
Agricultural and Biological
Sciences
Plant Science 14% 2.37
Agricultural Sciences 4% 1.85 PLANT SCIENCES 18% 2.79 Environmental Science Ecology 13% 2.81
Geosciences 2% 1.20 ENVIRONMENTAL SCIENCES 8% 3.17
Agricultural and Biological
Sciences
Forestry 11% 1.81
Social Sciences, General 2% 0.42 BIODIVERSITY CONSERVATION 4% 5.58 Environmental Science
Nature and Landscape
Conservation
6% 2.69
Engineering 0.4% 0.52 GEOGRAPHY, PHYSICAL 4% 2.55
Biochemistry, Genetics and
Molecular Biology
Physiology 5% 2.13
AGRONOMY 3% 2.06 Environmental Science
Management,
Monitoring, Policy and
Law
5% 2.48
GEOSCIENCES,
MULTIDISCIPLINARY
2% 1.72 Medicine General Medicine 3% 1.54
METEOROLOGY &
ATMOSPHERIC SCIENCES
1% 4.81 Environmental Science
Global and Planetary
Change
3% 7.10
ZOOLOGY 1% 1.13 Environmental Science
General Environmental
Science
2% 7.67
Other 10% Other 22%
* RI = Relative Impact * CNCI = Category Normalized Citation Impact * FWCI = Field Weighted Citation Impact, 2011-2014, all output types
And what categories do they end up?

16. Forest ecology Altmetrics
Key role of symbiotic dinitrogen
fixation in tropical forest
secondary succession.
https://www.altmetric.com/det
ails/1751737
Sustaining conservation values in
selectively logged tropical
forests: The attained and the
attainable
https://www.altmetric.com/deta
ils/685506
Limitations to sustainable
frankincense production: blocked
regeneration, high adult mortality
and declining populations
https://www.altmetric.com/details/
502114

17. Mine:
• Do we want agricultural
journal categories?
• Do we want open
citation data?
And yours?