Bibliometric analysis for the peer review 2009 Wouter Gerritsma & Marianne Renkema Information specialists, Wageningen UR Library

Contents Peer review 2009 Role of the library Bibliometric indicators Planning

Peer review 2009

Role of the library

Bibliometric indicators

Planning

Peer review of graduate schools in 2009 PE&RC, WIAS, EPS, VLAG, Ceres, Mansholt will be externally peer reviewed in 2009 3000 researchers published 9000 peer reviewed articles in the period 2002-2007 Criteria by QANU http:// www.qanu.nl / comasy / uploadedfiles /sep2003-2009.pdf Quality Productivity Relevance Vitality

PE&RC, WIAS, EPS, VLAG, Ceres, Mansholt will be externally peer reviewed in 2009

3000 researchers published 9000 peer reviewed articles in the period 2002-2007

Criteria by QANU http:// www.qanu.nl / comasy / uploadedfiles /sep2003-2009.pdf

Quality

Productivity

Relevance

Vitality

What role does the library play? Productivity of a group is extracted from METIS/WaY Quality of a group based can be based on bibliometric indicators Bibliometric analysis is not stipulated in the SEP !

Productivity of a group is extracted from METIS/WaY

Quality of a group based can be based on bibliometric indicators

Bibliometric analysis is not stipulated in the SEP !

Bibliometric indicators

I have been cited 33 times! But what does it mean? Citation data from Web of Science Research Fields from Essential Science Indicators Baseline data from Essential Science Indicators

Citation data from Web of Science

Research Fields from Essential Science Indicators

Baseline data from Essential Science Indicators

How do we compare numbers? Scientist Z. Math has a publication from 1996 with 17 citations Scientist M. Biology has a publication from 2003 with 24 citations

Scientist Z. Math has a publication from 1996 with 17 citations

Scientist M. Biology has a publication from 2003 with 24 citations

Baseline mathematics

Baseline Molecular Biology

Example Claassen PAM, van Lier JB, Contreras AML, van Niel EWJ, Sijtsma L, Stams AJM, de Vries SS, Weusthuis RA(1999) Utilisation of biomass for the supply of energy carriers . APPLIED MICROBIOLOGY AND BIOTECHNOLOGY , 52 (6): 741-755. Time cited: 56 times APPLIED MICROBIOLOGY AND BIOTECHNOLOGY (look up in journals menu ESI) microbiology , ranked 13 th, 8.9 citations per article over past 10 years Baseline data (from ESI) Article from 1999 in microbiology: Average: 24.38 citations, 10%: 56 citations, 1%: 162 citations RI= 56 / 24.38 = 2.3

Claassen PAM, van Lier JB, Contreras AML, van Niel EWJ, Sijtsma L, Stams AJM, de Vries SS, Weusthuis RA(1999) Utilisation of biomass for the supply of energy carriers . APPLIED MICROBIOLOGY AND BIOTECHNOLOGY , 52 (6): 741-755.

Time cited: 56 times

APPLIED MICROBIOLOGY AND BIOTECHNOLOGY (look up in journals menu ESI)

microbiology , ranked 13 th, 8.9 citations per article over past 10 years

Baseline data (from ESI)

Article from 1999 in microbiology: Average: 24.38 citations, 10%: 56 citations, 1%: 162 citations

RI= 56 / 24.38 = 2.3

Other bibliometric indicators Number or percentage of highly cited articles Number or percentage of uncited articles H-index (g-index etc …) Balancing productivity and citedness

Number or percentage of highly cited articles

Number or percentage of uncited articles

H-index (g-index etc …)

Balancing productivity and citedness

h-index

Some results from candidates for professorship 9 4 1.34 11.23 348 31 Candidate F 8 11 4.92 8.70 235 27 Candidate E 8 1 0.83 7.21 137 19 Candidate D 4 0 0.65 7.69 123 16 Candidate C 9 8 2.61 10.61 191 18 Candidate B 8 3 1.23 8.19 172 21 Candidate A h-index Pubs top 10% RI Cits/Pub S cits Pubs Researcher

Some results for SENSE 68 9 215 60 19 474 1.69 1.56 22405.23 35002 2457 SENSE 60 8 105 35 18 254 1.67 1.59 14418.67 22872 1400 WIMEK 31 14 39 10 25 72 1.95 2.01 1763.53 3537 284 IVM 22 14 41 6 20 57 1.55 1.30 1906.09 2470 292 Copernicus 29 5 14 8 19 55 1.81 1.57 2525.22 3965 292 IES h-index As % of total pubs Uncited Pubs Pubs top 1% As % of total Pubs Pubs top 10% RI S Cits/ S Wavg S Wavg S cits Pubs Institute

Strengths Weaknesses 1.51(384) 0.98(338) Total 0.75(11) 1.66(1) Plant & Animal Science 0.88(12) Molecular Biology & Genetics 1.54(203) 1.05(29) Microbiology 2.30(45) 1.13(181) Environment/Ecology 3.35(1) 5.70(2) Engineering 0.36(8) 0.98(17) Chemistry 1.05(92) 0.59(100) Biology & Biochemistry 3.54(12) 0.94(6) Agricultural Sciences Group 2 Group 1

Planning

Planning Sep. ’08 Searching WoS on basis of address fields, matching with Metis Oct. ’08 Checking unmatched articles from Metis in WoS Nov. ’08 Publication of personal reference lists with citation data in Way Nov.-Dec. ’08 Checking publication lists by authors, feedback to contacts at chair groups Feb. ’09 Update of citation data Mar. ’09 Drafting reports in preparation for peer review

Sep. ’08 Searching WoS on basis of address fields, matching with Metis

Oct. ’08 Checking unmatched articles from Metis in WoS

Nov. ’08 Publication of personal reference lists with citation data in Way

Nov.-Dec. ’08 Checking publication lists by authors, feedback to contacts at chair groups

Feb. ’09 Update of citation data

Mar. ’09 Drafting reports in preparation for peer review

Thank you ! More info: http://wowter.net This presentation http:// www.slideshare.net/Wowter/citation+analysis vlag /