SlideShare a Scribd company logo
Use and Misuse of BibliometricMeasures for Assessment of Academic Performance, Tenure and Publication Support 
Yaşar Tonta 
Hacettepe University 
Department of Information Management 
06800 Beytepe, Ankara, Turkey 
yunus.hacettepe.edu.tr/~tonta/tonta.html 
yasartonta@gmail.com 
@yasartonta 
ASIST2014 SIG-MET Workshop on Informetric and Scientometric Research, Nov. 5, 2014, Seattle, WA
"Not everything that counts can be counted, and not everything that can be counted counts." 
--Albert Einstein
Outline 
•Citation indexes and research assessment 
•Journal impact factors and publication support 
•H index and research assessment 
•Conclusions
Turkey 
•Higher Education Council (HEC) 
•184 universities 
•121,995 faculty (55,232 professors) 
•5,5M HE students 
•HEC’s minimum tenure requirements 
http://www.yok.gov.tr/web/guest/ogretim-elemanlari-dagilimi
http://www.tubitak.gov.tr/sites/default/files/tr_sti70.pdf
Citation indexes 
•Journal impact factor (JIF) 
•Skewed distributions 
•JIFs vary by domain and can be manipulated 
•Transparent data 
•Changing policies of publishers
Number of journals in JCR (2000-2012) 
http://yunus.hacettepe.edu.tr/~umutal/publications/war.pdf
JIFs and publication support 
•Turkish Scientific and Technological Research Council (TUBITAK) 
•TUBITAK’s use of JIFs 
–Till 2013: Journals categorized by their JIFs as A, B, C, D 
–2013: TUBITAK’s own JIF: 5-year IF * cited half-life, max/min support for ±2 SDsof average, support for the ones in between transformed using a linear formula 
–2014: Article influence score
TUBITAK’s support to Archaeology journals (2012-2014)
TUBITAK’s support to Archaeology journals (2012-2014) 
0 
500 
1000 
1500 
2000 
2500 
3000 
3500 
4000 
4500 
5000 
AmericanAntiquity 
CambridgeArchaeol. J. 
J. ofArchaeol. Science 
J. of FieldArchaeology 
Antiquity 
Adalya 
Oxford J. ofArchaeology 
American J. ofArchaeology 
WorldArchaeology 
J. of NearEasternStudies 
IranicaAntique 
Olba 
Belleten 
2012 support (in TL) 
2013 support (in TL) 
2014 support (in TL)
Issues with indicators 
•Use of cited half-life. . . 
–Skewed 
–Has nothing much to do with the paper quality 
–Obsolescence 
•Correlation between 2013 and 2014 lists r= .58 
•56% of 286 Geology journals ranked lower 
•49% misranked 
•Correlation between JIFs and AISs r=.90 
–(N=5,900 journals, JCR 2007 edition) 
•Higher JIFs => Higher AISs 
•TUBITAK support program should be reviewed
H index and research assessment
Issues with h index 
•Co-authors are not taken into account (Hirsch, 2007) 
•Citations below/above one’s h index do not count 
•Vary by disciplines 
•Not suitable for short-term research assessment 
•Vary by publishers’ policies
h = 10 
http://www.theguardian.com/science/2013/dec/06/peter-higgs-boson-academic-system
Conclusions 
•JIFs: "poor man’s citation analysis" (Marx & Bornmann, 2013) 
•"fatal attraction" (Van Raan, 2005) 
•IEEE: "...bibliometricperformance indicators should be applied only as a collective group (and not individually), and in conjunction with peer review following a clearly stated code of conduct"(original emphasis) (IEEE, 2013)
Goodhart’s Law (1975) 
"When a measure becomes a target, it ceases to be a good measure." 
http://en.wikipedia.org/wiki/Goodhart%27s_law
http://issi2015.org/en/
Use and Misuse of BibliometricMeasures for Assessment of Academic Performance, Tenure and Publication Support 
Yaşar Tonta 
Hacettepe University 
Department of Information Management 
06800 Beytepe, Ankara, Turkey 
yunus.hacettepe.edu.tr/~tonta/tonta.html 
yasartonta@gmail.com 
@yasartonta 
ASIST2014 SIG-MET Workshop on Informetric and Scientometric Research, Nov. 5, 2014, Seattle, WA 
Full text of the paper: http://bit.ly/1ur3cGN
Use and Misuse of Bibliometric Measures for Assessment of Academic Performance, Tenure and Publication Support

More Related Content

What's hot

Increase visibility of your research
Increase visibility of your researchIncrease visibility of your research
Increase visibility of your research
Berenika Webster
 
Alternative metrics approach to Croatian OA journals
Alternative metrics approach to Croatian OA journalsAlternative metrics approach to Croatian OA journals
Alternative metrics approach to Croatian OA journals
Rudjer Boskovic Institute
 
Publishing and impact 20140617
Publishing and impact 20140617Publishing and impact 20140617
Publishing and impact 20140617
Hugo Besemer
 
Introduction to Research
Introduction to Research Introduction to Research
Introduction to Research
Sanzid Kawsar
 
Publishing research articles made easy
Publishing research articles  made easyPublishing research articles  made easy
Publishing research articles made easy
chelliah paramasivan
 
Role of information professionals in promoting research culture
Role of information professionals in promoting research cultureRole of information professionals in promoting research culture
Role of information professionals in promoting research culture
Khalid Mahmood
 
The Metric Wave
The Metric WaveThe Metric Wave
The Metric Wave
SPARC Europe
 
Using google scholar in research evaluation of social science research
Using google scholar in research evaluation of social science researchUsing google scholar in research evaluation of social science research
Using google scholar in research evaluation of social science research
Ad Prins
 
Dissertation India
Dissertation IndiaDissertation India
Dissertation India
Justth12
 
Introduction to Bibliometrics
Introduction to BibliometricsIntroduction to Bibliometrics
Introduction to Bibliometrics
Awot Kiflu Gebregziabher
 
Bibliometric Tools
Bibliometric ToolsBibliometric Tools
Bibliometric Tools
UCT
 
Feedback Bibliometrics
Feedback BibliometricsFeedback Bibliometrics
Feedback Bibliometrics
Ina Smith
 
Law Research Visibility Workshop 3
Law Research Visibility Workshop 3Law Research Visibility Workshop 3
Law Research Visibility Workshop 3
Elizabeth Moll-Willard
 
Data analysis course
Data analysis courseData analysis course
Data analysis course
Research Coach
 
Research impact beyond metrics
Research impact beyond metricsResearch impact beyond metrics
Research impact beyond metrics
Pat Loria
 
aiSelections: Computational Techniques for Matching Faculty Research Profiles...
aiSelections: Computational Techniques for Matching Faculty Research Profiles...aiSelections: Computational Techniques for Matching Faculty Research Profiles...
aiSelections: Computational Techniques for Matching Faculty Research Profiles...
Peter Broadwell
 
A new role for libraries in research assessments
A new role for libraries in research assessmentsA new role for libraries in research assessments
A new role for libraries in research assessments
Wouter Gerritsma
 
Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)
Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)
Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)
Murat KOÇAK
 
Uses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impactUses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impact
Berenika Webster
 

What's hot (19)

Increase visibility of your research
Increase visibility of your researchIncrease visibility of your research
Increase visibility of your research
 
Alternative metrics approach to Croatian OA journals
Alternative metrics approach to Croatian OA journalsAlternative metrics approach to Croatian OA journals
Alternative metrics approach to Croatian OA journals
 
Publishing and impact 20140617
Publishing and impact 20140617Publishing and impact 20140617
Publishing and impact 20140617
 
Introduction to Research
Introduction to Research Introduction to Research
Introduction to Research
 
Publishing research articles made easy
Publishing research articles  made easyPublishing research articles  made easy
Publishing research articles made easy
 
Role of information professionals in promoting research culture
Role of information professionals in promoting research cultureRole of information professionals in promoting research culture
Role of information professionals in promoting research culture
 
The Metric Wave
The Metric WaveThe Metric Wave
The Metric Wave
 
Using google scholar in research evaluation of social science research
Using google scholar in research evaluation of social science researchUsing google scholar in research evaluation of social science research
Using google scholar in research evaluation of social science research
 
Dissertation India
Dissertation IndiaDissertation India
Dissertation India
 
Introduction to Bibliometrics
Introduction to BibliometricsIntroduction to Bibliometrics
Introduction to Bibliometrics
 
Bibliometric Tools
Bibliometric ToolsBibliometric Tools
Bibliometric Tools
 
Feedback Bibliometrics
Feedback BibliometricsFeedback Bibliometrics
Feedback Bibliometrics
 
Law Research Visibility Workshop 3
Law Research Visibility Workshop 3Law Research Visibility Workshop 3
Law Research Visibility Workshop 3
 
Data analysis course
Data analysis courseData analysis course
Data analysis course
 
Research impact beyond metrics
Research impact beyond metricsResearch impact beyond metrics
Research impact beyond metrics
 
aiSelections: Computational Techniques for Matching Faculty Research Profiles...
aiSelections: Computational Techniques for Matching Faculty Research Profiles...aiSelections: Computational Techniques for Matching Faculty Research Profiles...
aiSelections: Computational Techniques for Matching Faculty Research Profiles...
 
A new role for libraries in research assessments
A new role for libraries in research assessmentsA new role for libraries in research assessments
A new role for libraries in research assessments
 
Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)
Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)
Urap 2014 2015 world ranking and urap tr presentation nov 12 2014 sa (1)
 
Uses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impactUses and misuses of quantitative indicators of impact
Uses and misuses of quantitative indicators of impact
 

Similar to Use and Misuse of Bibliometric Measures for Assessment of Academic Performance, Tenure and Publication Support

“Support Programs to Increase the Number of Scientific Publications Using Bib...
“Support Programs to Increase the Number of Scientific Publications Using Bib...“Support Programs to Increase the Number of Scientific Publications Using Bib...
“Support Programs to Increase the Number of Scientific Publications Using Bib...
Yasar Tonta
 
Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...
Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...
Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...
Yasar Tonta
 
Faux
FauxFaux
Faux
Mike Kim
 
Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...
Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...
Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...
Susan Ariew, Vera Lux, & Matt Torrence
 
Feedback on the draft summary report
Feedback on the draft summary reportFeedback on the draft summary report
Feedback on the draft summary report
MEYS, MŠMT in Czech
 
Report writing
Report writingReport writing
Report writing
Dr Lipilekha Patnaik
 
Clement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivityClement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivity
National Information Standards Organization (NISO)
 
RDAP14 Poster: Evaluation of research data services: What things should we ev...
RDAP14 Poster: Evaluation of research data services: What things should we ev...RDAP14 Poster: Evaluation of research data services: What things should we ev...
RDAP14 Poster: Evaluation of research data services: What things should we ev...
ASIS&T
 
Atmiya university. shree m n virani college of science 14 oct 2021. researc...
Atmiya university. shree m n virani college of science 14 oct 2021.   researc...Atmiya university. shree m n virani college of science 14 oct 2021.   researc...
Atmiya university. shree m n virani college of science 14 oct 2021. researc...
Saurashtra University
 
Critiquing and evaluating health literature and manuscripts
Critiquing and evaluating health literature and manuscriptsCritiquing and evaluating health literature and manuscripts
Critiquing and evaluating health literature and manuscripts
Kern Rocke
 
Altmetrics for kla final
Altmetrics for kla finalAltmetrics for kla final
Altmetrics for kla final
Sarah Sutton
 
QS and THE subject rankings compared.pptx
QS and THE subject rankings compared.pptxQS and THE subject rankings compared.pptx
QS and THE subject rankings compared.pptx
rjholmes99
 
Bibliometrics: journals, articles, authors (v2)
Bibliometrics: journals, articles, authors (v2)Bibliometrics: journals, articles, authors (v2)
Bibliometrics: journals, articles, authors (v2)
Lancaster University Library
 
Altmetrics 101 - Altmetrics in Libraries
Altmetrics 101 - Altmetrics in LibrariesAltmetrics 101 - Altmetrics in Libraries
Altmetrics 101 - Altmetrics in Libraries
IUPUI
 
DORA and the reinvention of research assessment
DORA and the reinvention of research assessmentDORA and the reinvention of research assessment
DORA and the reinvention of research assessment
Mark Patterson
 
Gaps and assumptions in our research assessment approach: KAUST experience
Gaps and assumptions in our research assessment approach: KAUST experienceGaps and assumptions in our research assessment approach: KAUST experience
Gaps and assumptions in our research assessment approach: KAUST experience
ORCID, Inc
 
Assessing research impact mic 1 Sep 2015
Assessing research impact mic 1 Sep 2015Assessing research impact mic 1 Sep 2015
Assessing research impact mic 1 Sep 2015
Glucksman Library, University of Limerick
 
Assessing Research Impact: Bibliometrics, Citations and the H-Index
Assessing Research Impact: Bibliometrics, Citations and the H-IndexAssessing Research Impact: Bibliometrics, Citations and the H-Index
Assessing Research Impact: Bibliometrics, Citations and the H-Index
Fintan Bracken
 
A report about crippled research culture in pakistan
A report about crippled research culture in pakistanA report about crippled research culture in pakistan
A report about crippled research culture in pakistan
Danyal Ahmad
 
Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...
Kristi Holmes
 

Similar to Use and Misuse of Bibliometric Measures for Assessment of Academic Performance, Tenure and Publication Support (20)

“Support Programs to Increase the Number of Scientific Publications Using Bib...
“Support Programs to Increase the Number of Scientific Publications Using Bib...“Support Programs to Increase the Number of Scientific Publications Using Bib...
“Support Programs to Increase the Number of Scientific Publications Using Bib...
 
Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...
Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...
Can Bibliometric and Scientometric Measures be Used to Assess Research Quali...
 
Faux
FauxFaux
Faux
 
Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...
Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...
Proving Your Value: The Librarians’ Contribution to the Promotion and Tenure ...
 
Feedback on the draft summary report
Feedback on the draft summary reportFeedback on the draft summary report
Feedback on the draft summary report
 
Report writing
Report writingReport writing
Report writing
 
Clement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivityClement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivity
 
RDAP14 Poster: Evaluation of research data services: What things should we ev...
RDAP14 Poster: Evaluation of research data services: What things should we ev...RDAP14 Poster: Evaluation of research data services: What things should we ev...
RDAP14 Poster: Evaluation of research data services: What things should we ev...
 
Atmiya university. shree m n virani college of science 14 oct 2021. researc...
Atmiya university. shree m n virani college of science 14 oct 2021.   researc...Atmiya university. shree m n virani college of science 14 oct 2021.   researc...
Atmiya university. shree m n virani college of science 14 oct 2021. researc...
 
Critiquing and evaluating health literature and manuscripts
Critiquing and evaluating health literature and manuscriptsCritiquing and evaluating health literature and manuscripts
Critiquing and evaluating health literature and manuscripts
 
Altmetrics for kla final
Altmetrics for kla finalAltmetrics for kla final
Altmetrics for kla final
 
QS and THE subject rankings compared.pptx
QS and THE subject rankings compared.pptxQS and THE subject rankings compared.pptx
QS and THE subject rankings compared.pptx
 
Bibliometrics: journals, articles, authors (v2)
Bibliometrics: journals, articles, authors (v2)Bibliometrics: journals, articles, authors (v2)
Bibliometrics: journals, articles, authors (v2)
 
Altmetrics 101 - Altmetrics in Libraries
Altmetrics 101 - Altmetrics in LibrariesAltmetrics 101 - Altmetrics in Libraries
Altmetrics 101 - Altmetrics in Libraries
 
DORA and the reinvention of research assessment
DORA and the reinvention of research assessmentDORA and the reinvention of research assessment
DORA and the reinvention of research assessment
 
Gaps and assumptions in our research assessment approach: KAUST experience
Gaps and assumptions in our research assessment approach: KAUST experienceGaps and assumptions in our research assessment approach: KAUST experience
Gaps and assumptions in our research assessment approach: KAUST experience
 
Assessing research impact mic 1 Sep 2015
Assessing research impact mic 1 Sep 2015Assessing research impact mic 1 Sep 2015
Assessing research impact mic 1 Sep 2015
 
Assessing Research Impact: Bibliometrics, Citations and the H-Index
Assessing Research Impact: Bibliometrics, Citations and the H-IndexAssessing Research Impact: Bibliometrics, Citations and the H-Index
Assessing Research Impact: Bibliometrics, Citations and the H-Index
 
A report about crippled research culture in pakistan
A report about crippled research culture in pakistanA report about crippled research culture in pakistan
A report about crippled research culture in pakistan
 
Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...Understanding impact through alternative metrics: developing library-based as...
Understanding impact through alternative metrics: developing library-based as...
 

Recently uploaded

11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf
PirithiRaju
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
Sérgio Sacani
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
by6843629
 
(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...
(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...
(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...
Scintica Instrumentation
 
Discovery of An Apparent Red, High-Velocity Type Ia Supernova at 𝐳 = 2.9 wi...
Discovery of An Apparent Red, High-Velocity Type Ia Supernova at  𝐳 = 2.9  wi...Discovery of An Apparent Red, High-Velocity Type Ia Supernova at  𝐳 = 2.9  wi...
Discovery of An Apparent Red, High-Velocity Type Ia Supernova at 𝐳 = 2.9 wi...
Sérgio Sacani
 
ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...
ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...
ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...
Advanced-Concepts-Team
 
Pests of Storage_Identification_Dr.UPR.pdf
Pests of Storage_Identification_Dr.UPR.pdfPests of Storage_Identification_Dr.UPR.pdf
Pests of Storage_Identification_Dr.UPR.pdf
PirithiRaju
 
Mending Clothing to Support Sustainable Fashion_CIMaR 2024.pdf
Mending Clothing to Support Sustainable Fashion_CIMaR 2024.pdfMending Clothing to Support Sustainable Fashion_CIMaR 2024.pdf
Mending Clothing to Support Sustainable Fashion_CIMaR 2024.pdf
Selcen Ozturkcan
 
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDSJAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
Sérgio Sacani
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
University of Hertfordshire
 
HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1
Shashank Shekhar Pandey
 
Immersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths ForwardImmersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths Forward
Leonel Morgado
 
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdfHUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
Ritik83251
 
Tissue fluids_etiology_volume regulation_pressure.pptx
Tissue fluids_etiology_volume regulation_pressure.pptxTissue fluids_etiology_volume regulation_pressure.pptx
Tissue fluids_etiology_volume regulation_pressure.pptx
muralinath2
 
fermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptxfermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptx
ananya23nair
 
The cost of acquiring information by natural selection
The cost of acquiring information by natural selectionThe cost of acquiring information by natural selection
The cost of acquiring information by natural selection
Carl Bergstrom
 
Direct Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart AgricultureDirect Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart Agriculture
International Food Policy Research Institute- South Asia Office
 
CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)
CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)
CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)
eitps1506
 
Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...
Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...
Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...
PsychoTech Services
 
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
ABHISHEK SONI NIMT INSTITUTE OF MEDICAL AND PARAMEDCIAL SCIENCES , GOVT PG COLLEGE NOIDA
 

Recently uploaded (20)

11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf11.1 Role of physical biological in deterioration of grains.pdf
11.1 Role of physical biological in deterioration of grains.pdf
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
 
(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...
(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...
(June 12, 2024) Webinar: Development of PET theranostics targeting the molecu...
 
Discovery of An Apparent Red, High-Velocity Type Ia Supernova at 𝐳 = 2.9 wi...
Discovery of An Apparent Red, High-Velocity Type Ia Supernova at  𝐳 = 2.9  wi...Discovery of An Apparent Red, High-Velocity Type Ia Supernova at  𝐳 = 2.9  wi...
Discovery of An Apparent Red, High-Velocity Type Ia Supernova at 𝐳 = 2.9 wi...
 
ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...
ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...
ESA/ACT Science Coffee: Diego Blas - Gravitational wave detection with orbita...
 
Pests of Storage_Identification_Dr.UPR.pdf
Pests of Storage_Identification_Dr.UPR.pdfPests of Storage_Identification_Dr.UPR.pdf
Pests of Storage_Identification_Dr.UPR.pdf
 
Mending Clothing to Support Sustainable Fashion_CIMaR 2024.pdf
Mending Clothing to Support Sustainable Fashion_CIMaR 2024.pdfMending Clothing to Support Sustainable Fashion_CIMaR 2024.pdf
Mending Clothing to Support Sustainable Fashion_CIMaR 2024.pdf
 
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDSJAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
JAMES WEBB STUDY THE MASSIVE BLACK HOLE SEEDS
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
 
HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1HOW DO ORGANISMS REPRODUCE?reproduction part 1
HOW DO ORGANISMS REPRODUCE?reproduction part 1
 
Immersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths ForwardImmersive Learning That Works: Research Grounding and Paths Forward
Immersive Learning That Works: Research Grounding and Paths Forward
 
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdfHUMAN EYE By-R.M Class 10 phy best digital notes.pdf
HUMAN EYE By-R.M Class 10 phy best digital notes.pdf
 
Tissue fluids_etiology_volume regulation_pressure.pptx
Tissue fluids_etiology_volume regulation_pressure.pptxTissue fluids_etiology_volume regulation_pressure.pptx
Tissue fluids_etiology_volume regulation_pressure.pptx
 
fermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptxfermented food science of sauerkraut.pptx
fermented food science of sauerkraut.pptx
 
The cost of acquiring information by natural selection
The cost of acquiring information by natural selectionThe cost of acquiring information by natural selection
The cost of acquiring information by natural selection
 
Direct Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart AgricultureDirect Seeded Rice - Climate Smart Agriculture
Direct Seeded Rice - Climate Smart Agriculture
 
CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)
CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)
CLASS 12th CHEMISTRY SOLID STATE ppt (Animated)
 
Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...
Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...
Sexuality - Issues, Attitude and Behaviour - Applied Social Psychology - Psyc...
 
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
MICROBIAL INTERACTION PPT/ MICROBIAL INTERACTION AND THEIR TYPES // PLANT MIC...
 

Use and Misuse of Bibliometric Measures for Assessment of Academic Performance, Tenure and Publication Support

  • 1. Use and Misuse of BibliometricMeasures for Assessment of Academic Performance, Tenure and Publication Support Yaşar Tonta Hacettepe University Department of Information Management 06800 Beytepe, Ankara, Turkey yunus.hacettepe.edu.tr/~tonta/tonta.html yasartonta@gmail.com @yasartonta ASIST2014 SIG-MET Workshop on Informetric and Scientometric Research, Nov. 5, 2014, Seattle, WA
  • 2. "Not everything that counts can be counted, and not everything that can be counted counts." --Albert Einstein
  • 3. Outline •Citation indexes and research assessment •Journal impact factors and publication support •H index and research assessment •Conclusions
  • 4. Turkey •Higher Education Council (HEC) •184 universities •121,995 faculty (55,232 professors) •5,5M HE students •HEC’s minimum tenure requirements http://www.yok.gov.tr/web/guest/ogretim-elemanlari-dagilimi
  • 6. Citation indexes •Journal impact factor (JIF) •Skewed distributions •JIFs vary by domain and can be manipulated •Transparent data •Changing policies of publishers
  • 7. Number of journals in JCR (2000-2012) http://yunus.hacettepe.edu.tr/~umutal/publications/war.pdf
  • 8. JIFs and publication support •Turkish Scientific and Technological Research Council (TUBITAK) •TUBITAK’s use of JIFs –Till 2013: Journals categorized by their JIFs as A, B, C, D –2013: TUBITAK’s own JIF: 5-year IF * cited half-life, max/min support for ±2 SDsof average, support for the ones in between transformed using a linear formula –2014: Article influence score
  • 9. TUBITAK’s support to Archaeology journals (2012-2014)
  • 10. TUBITAK’s support to Archaeology journals (2012-2014) 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000 AmericanAntiquity CambridgeArchaeol. J. J. ofArchaeol. Science J. of FieldArchaeology Antiquity Adalya Oxford J. ofArchaeology American J. ofArchaeology WorldArchaeology J. of NearEasternStudies IranicaAntique Olba Belleten 2012 support (in TL) 2013 support (in TL) 2014 support (in TL)
  • 11. Issues with indicators •Use of cited half-life. . . –Skewed –Has nothing much to do with the paper quality –Obsolescence •Correlation between 2013 and 2014 lists r= .58 •56% of 286 Geology journals ranked lower •49% misranked •Correlation between JIFs and AISs r=.90 –(N=5,900 journals, JCR 2007 edition) •Higher JIFs => Higher AISs •TUBITAK support program should be reviewed
  • 12. H index and research assessment
  • 13. Issues with h index •Co-authors are not taken into account (Hirsch, 2007) •Citations below/above one’s h index do not count •Vary by disciplines •Not suitable for short-term research assessment •Vary by publishers’ policies
  • 14. h = 10 http://www.theguardian.com/science/2013/dec/06/peter-higgs-boson-academic-system
  • 15. Conclusions •JIFs: "poor man’s citation analysis" (Marx & Bornmann, 2013) •"fatal attraction" (Van Raan, 2005) •IEEE: "...bibliometricperformance indicators should be applied only as a collective group (and not individually), and in conjunction with peer review following a clearly stated code of conduct"(original emphasis) (IEEE, 2013)
  • 16. Goodhart’s Law (1975) "When a measure becomes a target, it ceases to be a good measure." http://en.wikipedia.org/wiki/Goodhart%27s_law
  • 18. Use and Misuse of BibliometricMeasures for Assessment of Academic Performance, Tenure and Publication Support Yaşar Tonta Hacettepe University Department of Information Management 06800 Beytepe, Ankara, Turkey yunus.hacettepe.edu.tr/~tonta/tonta.html yasartonta@gmail.com @yasartonta ASIST2014 SIG-MET Workshop on Informetric and Scientometric Research, Nov. 5, 2014, Seattle, WA Full text of the paper: http://bit.ly/1ur3cGN