<ul><li>wolfgang glänzel </li></ul><ul><ul><li>the 'perspective shift' in bibliometrics and its consequences </li></ul></u...
BACKGROUND In their discussion paper entitled  “Little scientometrics, big scientometrics … and beyond? ”  Glänzel & Schop...
<ul><li>Changes in methodology and objectives of the field </li></ul><ul><ul><li>Worst Case Scenario: bibliometrics might ...
glänzel: the ‘perspective shift’ <ul><li>ON BIBLIOMETRICS AND SCIENTOMETRICS </li></ul><ul><li>The two terms were introduc...
<ul><li>Bibliometrics for bibliometricians </li></ul><ul><ul><li>The domain of bibliometric “basic research”. </li></ul></...
glänzel: the ‘perspective shift’ Webometrics Informetrics Mathematics/Physics Library and Information Science Sociology of...
glänzel: the ‘perspective shift’ THE “PERSPECTIVE SHIFT” IN USE OF BIBLIOMETRICS
glänzel: the ‘perspective shift’ Bibliometrics represented a statistical approach to master the flood of scientific inform...
<ul><li>The growth of knowledge and scientific literature, international collaboration and competition, increasing special...
glänzel: the ‘perspective shift’
<ul><li>The need for supplementing the evaluation of research with quantitative methods and of linking funding to performa...
glänzel: the ‘perspective shift’ <ul><li>Sociology of science has laid the theoretical groundwork for this paradigmatic pe...
glänzel: the ‘perspective shift’ 1. Changes in methodology and objectives  of the field In the paper “Through citations to...
Research Services What happens if services dominate research? glänzel: the ‘perspective shift’
2. Distorted behaviour based on policy use and  misuse of bibliometric data The roots of changing behaviour of scientists ...
Studies on the problem choice behaviour of academic scientists have revealed that both cognitive and social influences det...
glänzel: the ‘perspective shift’ Schematic visualisation of the feedback of policy use of bibliometrics on the scientific ...
<ul><li>Publication activity: </li></ul><ul><ul><li>Butler  (2004)   has shown on the example of Australia what might  hap...
<ul><li>Scientific collaboration: </li></ul><ul><ul><li>According to  deSolla Price  (1963), massive funding is one of the...
<ul><li>Citations : </li></ul><ul><li>Some important notions of citation </li></ul><ul><ul><li>Citations give a formalised...
<ul><ul><li>Gross  and  Gross  (1927) published their citation-based study in order to aid the decision which chemistry pe...
glänzel: the ‘perspective shift’ The co-citation based “Atlas of Science” developed and issued by the Institute for Scient...
<ul><li>Author self-citations: </li></ul><ul><ul><li>Re-interpreting underlying contexts such as the notion of  citation  ...
glänzel: the ‘perspective shift’ The process of re-interpreting the notion of citation and its consequences Information us...
glänzel: the ‘perspective shift’ Glänzel, Thijs, Schlemmer (2004) scientific commucation (18 cites) Schubert, Glänzel, Thi...
Journal  Impact Factor : The journal “Impact Factor” ( Garfield  &  Sher , 1963) was first used as measure for comparing j...
“ American Journal of Transplantation is the leading journal in its field   New impact factor for 2005 - 6.002 - Still the...
Today, IF has become the “ common currency of scientific quality ” ( Sevinc , 2004)  Consequence: Several journals have be...
glänzel: the ‘perspective shift’ <ul><li>Typical questions addressed by scientists  </li></ul><ul><li>“ What is the best o...
glänzel: the ‘perspective shift’ <ul><li>Effects of policy use on the scientific community </li></ul><ul><li>Possible posi...
glänzel: the ‘perspective shift’ <ul><ul><li>Replacing  targeting  by  visibility  in individual and institutional publica...
<ul><li>CONCLUSIONS </li></ul><ul><li>Bibliometrics evolved from a sub-discipline of LIS, from an ‘extension’ of science i...
Upcoming SlideShare
Loading in …5
×

The 'Perspective Shift' in bibliometrics and its consequences

2,154 views

Published on

Wolfang Glanzel's presentation at InSciT2006.

Published in: Technology, Education
0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,154
On SlideShare
0
From Embeds
0
Number of Embeds
55
Actions
Shares
0
Downloads
0
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide

The 'Perspective Shift' in bibliometrics and its consequences

  1. 1. <ul><li>wolfgang glänzel </li></ul><ul><ul><li>the 'perspective shift' in bibliometrics and its consequences </li></ul></ul>k.u.leuven, steunpunt o&o statistieken, leuven (belgium) hungarian academy of sciences, ispr, budapest (hungary)
  2. 2. BACKGROUND In their discussion paper entitled “Little scientometrics, big scientometrics … and beyond? ” Glänzel & Schopeflin (1994) reported on symptoms of a crisis ( “teething troubles or agony?”). Among others, they mentioned lacking communication, drifting apart of sub-disciplines are and increasing commercialisation of the field. Although the field of bibliometrics/scientometrics became established, a certain ‘perspective shift’ has taken place. Pointing to some of its consequences will be the objective of this talk. glänzel: the ‘perspective shift’
  3. 3. <ul><li>Changes in methodology and objectives of the field </li></ul><ul><ul><li>Worst Case Scenario: bibliometrics might cease to exist as a reaserch field (cf. Glänzel & Schoepflin , 1994) </li></ul></ul><ul><li>Distorted behaviour of scientists based on policy use and misuse of bibliometric data </li></ul>glänzel: the ‘perspective shift’ Possible consequences of the perspective shift in terms of:
  4. 4. glänzel: the ‘perspective shift’ <ul><li>ON BIBLIOMETRICS AND SCIENTOMETRICS </li></ul><ul><li>The two terms were introduced in 1969, and are nowadays used almost synonymously. </li></ul><ul><li>Pritchard </li></ul><ul><ul><li>“ bibliometrics is the application of mathematical and statistical methods to books and other media of communication ”. </li></ul></ul><ul><li>Nalimov & Mulchenko </li></ul><ul><ul><li>Scientometrics is “the application of those quantitative methods which are dealing with the analysis of science viewed as an information process”. </li></ul></ul>
  5. 5. <ul><li>Bibliometrics for bibliometricians </li></ul><ul><ul><li>The domain of bibliometric “basic research”. </li></ul></ul><ul><li>Bibliometrics for scientific disciplines </li></ul><ul><ul><li>A large but also the most diverse interest-group. Due to the scientists’ primary scientific orientation, their interests are strongly related to their speciality. </li></ul></ul><ul><li>Bibliometrics for science policy and research management </li></ul><ul><ul><li>The most important field of application. Here the assessment and comparative analysis of research performance are in the foreground. </li></ul></ul>glänzel: the ‘perspective shift’ Three “components” of bibliometrics according to its main target-groups
  6. 6. glänzel: the ‘perspective shift’ Webometrics Informetrics Mathematics/Physics Library and Information Science Sociology of science History of science Economics Science information Services for Research in Librarianship Science policy Research management Life sciences LINKS WITH SCIENCE FIELDS AND APPLICATION SERVICES Computer science Scientometrics applied basic
  7. 7. glänzel: the ‘perspective shift’ THE “PERSPECTIVE SHIFT” IN USE OF BIBLIOMETRICS
  8. 8. glänzel: the ‘perspective shift’ Bibliometrics represented a statistical approach to master the flood of scientific information and to analyse and to understand the cognitive characteristics of “big science” by measuring quantitative aspects of communication in science and by providing the results to scientists and users outside the scientific community ( Price , 1963) . Monitoring, description and modelling of the production, dissemination and use of knowledge was originally in the foreground.
  9. 9. <ul><li>The growth of knowledge and scientific literature, international collaboration and competition, increasing specialisation as well as growing importance of cross- and interdisciplinarity in scientific research has reached a stage where funding systems based on personal knowledge and evaluations by peers became more and more difficult. </li></ul><ul><li>The ‘science indicators’ movement in the US in the 1970s resulted in a discussion about the possible use of bibliometrics for science policy around 1980. </li></ul><ul><li>In the following two decades, bibliometrics was characterised by a perceptible shift towards science-policy and research-management application. </li></ul>glänzel: the ‘perspective shift’
  10. 10. glänzel: the ‘perspective shift’
  11. 11. <ul><li>The need for supplementing the evaluation of research with quantitative methods and of linking funding to performance indicators was one consequence of this process. </li></ul><ul><li>Recently, Bibliometrics evolved from a discipline analysing all quantitative aspects and creating models of scientific communication to a tool for the benchmarking of knowledge (Glänzel & Schoepflin , 1994, van Raan , 1997, Weingart , 2003, Ohly, 2003). </li></ul>glänzel: the ‘perspective shift’
  12. 12. glänzel: the ‘perspective shift’ <ul><li>Sociology of science has laid the theoretical groundwork for this paradigmatic perspective shift. </li></ul><ul><li>In particular, sociologists recognised that communication in science is also characterised by the position scientists have reached and hold in the science system. </li></ul><ul><ul><li>This is reflected by their publication behaviour, their status as co-authors (e.g. Kretschmer , 1985), their published results and the reception by their colleagues. </li></ul></ul><ul><ul><li>The Mertonian notion describes citation as a reward system, actually as the currency of science. </li></ul></ul>
  13. 13. glänzel: the ‘perspective shift’ 1. Changes in methodology and objectives of the field In the paper “Through citations to marks and money” ( Frick , 2004) science policy and research management appears as the only acceptable application of bibliometrics. In the process of evaluation, benchmarking and funding, the role of bibliometrics is reduced to being an auxiliary tool. Narrowing down the discipline to one predominant service task and lacking methodological research might uncouple results from the original context and thus support uninformed use.
  14. 14. Research Services What happens if services dominate research? glänzel: the ‘perspective shift’
  15. 15. 2. Distorted behaviour based on policy use and misuse of bibliometric data The roots of changing behaviour of scientists can be detected in a time when bibliometrics not yet existed, but bibliometrics might act as catalysator. In particular, an additional issue concerns the changes in the publication, citation and collaboration behaviour of scientists (both positive and negative) that the consistent policy use of bibliometric indicators might potentially induce. glänzel: the ‘perspective shift’
  16. 16. Studies on the problem choice behaviour of academic scientists have revealed that both cognitive and social influences determine the manner in which scientists go about choosing the problems they work on ( Debackere & Rappa, 1994). Hence the issue should be raised to what extent the policy use of bibliometrics might or could affect this behaviour. Repercussions might be observed when bibliometric tools are used in decision-making in science policy and research management and the scientific community recognises the feedback in terms of their funding . glänzel: the ‘perspective shift’
  17. 17. glänzel: the ‘perspective shift’ Schematic visualisation of the feedback of policy use of bibliometrics on the scientific community Weingart, 2005
  18. 18. <ul><li>Publication activity: </li></ul><ul><ul><li>Butler (2004) has shown on the example of Australia what might happen when funding is linked to publication counts. She found that the publications component of the Composite Index has stimulated an increased publication activity in the lower impact journals . </li></ul></ul>glänzel: the ‘perspective shift’ EXAMPLES
  19. 19. <ul><li>Scientific collaboration: </li></ul><ul><ul><li>According to deSolla Price (1963), massive funding is one of the characteristics of ‘big science’; team work is anther one. </li></ul></ul><ul><ul><li>A large share of co-authorship, above all of international co-authorship is almost considered a guarantee for success and impact. </li></ul></ul><ul><ul><li>The other side of the coin is a trend towards exaggerate co-authorship, even hyper-authorship ( Cronin , 2001) with inflationary features ( Persson et al, 2004). Collaboration is also used as means of compensation in the framework of national publication strategies ( Braun & Glänzel , 1996). </li></ul></ul>glänzel: the ‘perspective shift’ EXAMPLES
  20. 20. <ul><li>Citations : </li></ul><ul><li>Some important notions of citation </li></ul><ul><ul><li>Citations give a formalised account of the information use (Smith, 1981), and can be taken as a strong indicator of reception (Glänzel & Schoepflin, 1995) . </li></ul></ul><ul><ul><li>According to Merton, citations are intimately connected with the reward system of science and can be considered the currency of science. </li></ul></ul><ul><ul><li>According to Cozzens’ rhetoric-first model (1989), citation is only secondarily a reward system. </li></ul></ul>glänzel: the ‘perspective shift’ EXAMPLES
  21. 21. <ul><ul><li>Gross and Gross (1927) published their citation-based study in order to aid the decision which chemistry periodicals should best purchased by small college libraries. </li></ul></ul><ul><ul><li>Citations were considered documented use of information, and have consequently applied first in the context of librarianship, science information and information retrieval. </li></ul></ul><ul><ul><li>Bibliometrics analyses citation networks to depict the structure of science and its dynamics as well as the frequency of citations as a measure of the reception of research results. </li></ul></ul>glänzel: the ‘perspective shift’ EXAMPLES
  22. 22. glänzel: the ‘perspective shift’ The co-citation based “Atlas of Science” developed and issued by the Institute for Scientific Information (ISI) was considered a new kind of “review literature” which is also suited to help students in choice of career in science ( Garfield, 1975 ). More recently Noyons observed that many issues brought up in domain mapping studies relate to policy-relevant questions, and consequently described the necessity of the evolution of bibliometric mapping towards a science policy tool. EXAMPLES
  23. 23. <ul><li>Author self-citations: </li></ul><ul><ul><li>Re-interpreting underlying contexts such as the notion of citation shows author self-citations in an unfavourable light. Authors might thus be urged avoiding self-citations – a clear intervention into the mechanism of scientific communication. </li></ul></ul>glänzel: the ‘perspective shift’ EXAMPLES
  24. 24. glänzel: the ‘perspective shift’ The process of re-interpreting the notion of citation and its consequences Information use Reward system (quality measure) Research evaluation/ Science policy Bibliometrics/ Information science citation uncitedness : unused information frequent cite : good reception self-cite : part of scient. communication interpretation re-interpretation repercussion (possible distortion of citation behaviour) uncitedness : low quality frequent cite : high quality self-cite : distortion of impact
  25. 25. glänzel: the ‘perspective shift’ Glänzel, Thijs, Schlemmer (2004) scientific commucation (18 cites) Schubert, Glänzel, Thijs (2006) fractional counting (0 cites) Glänzel et al. (2006) concise review (1 cites) Thijs & Glänzel (2005) meso indicators (0 cites) Glänzel & Thijs (2004b) co-authorship (4 cites) Glänzel & Thijs (2004a) macro indictors (5 cites) Example for a citation/self-citation network (Papers over author self-citations) Source: Web of Science, updated 14 October 2006)
  26. 26. Journal Impact Factor : The journal “Impact Factor” ( Garfield & Sher , 1963) was first used as measure for comparing journals independently of “size” and to help select journals for the Science Citation Index (SCI). Garfield recognised the power of the IF for journal evaluation and considered it also a journal performance indicator. glänzel: the ‘perspective shift’ EXAMPLES
  27. 27. “ American Journal of Transplantation is the leading journal in its field New impact factor for 2005 - 6.002 - Still the #1 transplantation journal (Ranked second in the surgery category)” Source: http://www.blackwellpublishing.com/journal.asp?ref=1600-6135&site=1 Accessed on 15 September 2006 glänzel: the ‘perspective shift’ Example for the role of the Impact Factor
  28. 28. Today, IF has become the “ common currency of scientific quality ” ( Sevinc , 2004) Consequence: Several journals have been accused of manipulating impact factor ( Smith , 1997, Weingart , 2005) Moreover, IF increasingly plays an important part in the evaluation of research groups and individuals (‘2 nd order perspective shift’ through uncoupling this measure from its original context). IF seems to be the only convertible currency in research evaluation, and has already influence on scientists’ funding and carrier. glänzel: the ‘perspective shift’ EXAMPLES
  29. 29. glänzel: the ‘perspective shift’ <ul><li>Typical questions addressed by scientists </li></ul><ul><li>“ What is the best output strategy for an individual researcher, cf. trade off between number of publications in top journals and number of publications in moderately ranked journals; trade off between investing time and energy in PhD-students (resulting in high number of co-authorships) or working alone (resulting in lower number of first authorships)?” ( Anon , 2005) </li></ul><ul><li>“ What is the weight of a co-authorship in a CV? What is the importance of author number and rank on the evaluation of a publication for a researcher?” ( Anon , 2005) </li></ul>EXAMPLES
  30. 30. glänzel: the ‘perspective shift’ <ul><li>Effects of policy use on the scientific community </li></ul><ul><li>Possible positive effects </li></ul><ul><ul><li>Scientists might recognise that scientific collaboration and publishing in high-impact or even top journals pays off. Also their publication activity might be stimulated. </li></ul></ul><ul><li>Possible negative effects </li></ul><ul><ul><li>Exaggerated collaboration, even trends towards hyper-authorship, inflating publication output by splitting up publications to sequences, inflating citation impact by self-citations and forming citation cliques, etc. </li></ul></ul>
  31. 31. glänzel: the ‘perspective shift’ <ul><ul><li>Replacing targeting by visibility in individual and institutional publication strategies. </li></ul></ul><ul><ul><li>Trend towards replacing quality and recognition by visibility at any price or towards preferring journals as publication channels in social sciences and humanities might be among these effects. </li></ul></ul><ul><ul><li>A certain “champions league” mentality is spreading among scientists (“Shanghai ranking”, H-index, “IF Filter”). </li></ul></ul>
  32. 32. <ul><li>CONCLUSIONS </li></ul><ul><li>Bibliometrics evolved from a sub-discipline of LIS, from an ‘extension’ of science information to an evaluation and benchmarking tool. </li></ul><ul><li>New fields of applications resulted in use of bibliographic databases, research methods and bibliometric measures for which these were originally not designed. </li></ul><ul><li>Beyond any doubt, growing policy application turned ‘little bibliometrics’ into ‘big bibliometrics’. </li></ul><ul><li>However, this evolution also resulted in a clear ‘perspective shift’. </li></ul><ul><li>This shift, in turn, has severe consequences for the field itself and the whole scientific community as well. </li></ul>glänzel: the ‘perspective shift’

×