Your SlideShare is downloading. ×
0
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Research evaluation in the Netherlands : a library perspective
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Research evaluation in the Netherlands : a library perspective

2,094

Published on

My presentation during the 2006 Keris symposium

My presentation during the 2006 Keris symposium

Published in: Economy & Finance, Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,094
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
32
Comments
0
Likes
3
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Research evaluation in the Netherlands : a library perspective Wouter Gerritsma, Library Wageningen UR
  • 2. Introduction
    • Research evaluation in the Netherlands
    • Bibliometric evaluation
    • Impact factors
    • Citation analysis
  • 3. Research evaluation in the Netherlands
    • Based on a 6 year cycle
      • Supervised by Quality Assurance Netherlands Universities (QANU).
      • Standard Evaluation Protocol (SEP) ( http://www.vsnu.nl/web/show/id=53923/langid=43/ ; in English)
      • Self assessments and external reviews
  • 4. SEP criteria
    • Quality
    • Productivity
    • Relevance
    • Vitality
  • 5. Procedures
    • External reviews are internally prepared
      • Productivity is extracted from publication databases (repositories play an important role)
      • Relevance, bibliometric analyses do play a role
      • Vitality, SWOT analyses are popular.
  • 6. Bibliometrics analyses
    • Bibliometric analysis is not stipulated by the SEP
    • It is valued by the preparing committee
      • Used internally to judge researchers and research groups
      • Not always used by the peer review committee
  • 7. Bibliometric analysis
  • 8. A word of warning : Impact factors
    • Measure for the quality of journals
      • “… it is also used for assessment of the quality of individual papers, scientists and departments. For the latter a scientific basis is lacking, as we will demonstrate in this contribution” (Opthof, 1997)
      • Opthof, T. (1997). Sense and nonsense about the impact factor. Cardiovascular Research 33 (1): 1-7. http:// dx.doi.org /10.1016/S0008-6363(96)00215-5
  • 9. 50 % of articles generate 90% of citations Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. BMJ 314 (7079): 497-502. http://bmj.bmjjournals.com/cgi/content/full/314/7079/497
  • 10. Bibliometric analysis
    • Citation data can be derived from many resources
    • The main question is:
    • How do we compare numbers?
    • Scientist Z. Math has a publication from 1996 with 17 citations
    • Scientist M. Biology has a publication from 2003 with 24 citations
  • 11. Baseline mathematics
  • 12. Baseline Molecular Biology
  • 13. Essential Science Indicators (ESI)
    • Database that presents analyses of the most recent (10 years + year building) data from SCI
    • Comparisons between countries, institutes, researchers en journals
    • Hot papers
    • Research fronts
    • Baselines
  • 14. Steps in citation analysis
    • On the basis of authors names, all publications are checked for citations in WoS, downloaded to EndNote, subsequently to Access
    • Baselines are retrieved from ESI
    • Journals categories are checked in ESI
    • The three tables are linked by ISSN and category names
    • Analyses are made for authors, research groups and Institutes
  • 15. Relations in Access
  • 16. Graduate School in Environment/Ecology
  • 17. Evaluation of a research institute 1,84 2,26 2,08 2,06 Overall impact 1,73 0.57 1,70 Microbiology 1,11 1,81 1,73 Clinical medicine 1,76 1,76 Chemistry 1,09 0,44 1,55 0,91 Biology & biochemistry 3,60 3,87 3,86 3,82 Agricultural Sciences Group 3 Group 2 Group 1 All groups
  • 18. Evaluation of candidates 0 3 0,83 0,58 0,75 346 57 e 3 16 1,94 1,69 1,86 1886 88 d 0 8 0,9 1,39 1,15 972 93 c 1 17 1,95 1,84 1,93 498 65 b 2 4 1,52 1,76 1,64 1565 80 a #papers top 1% #papers top 10% RI 1999-2003 RI 1994-1998 Relative Impact #Citations # Papers 1994-2003 Author
  • 19. Tools at hand
    • Subscription citation products
      • Web of Science (WOS) (= Science Citation Index)
      • Essential Science Indicators (ESI)
      • Scopus (new, Elsevier product)
    • Free available Web services
      • Google Scholar http://scholar.google.com/
      • Citeseer http://citeseer.ist.psu.edu/
      • Smealsearch http://smealsearch2.psu.edu/
  • 20. Scopus
    • Scopus has some important advantages
      • Comprehensive citation reports
      • Substantially larger journal base
      • Author disambiguation
      • Cooperation with third parties
      • Institute disambiguation
  • 21. Thank you for your attention © Wageningen UR

×