1. URAP
University Ranking by Academic
Performance 2012-2013
Prof. Dr. Ural AKBULUT
METU – 15 October 2012
1
2. URAP Research Laboratory
• URAP Lab: established at Informatics Institute of Middle East
Technical University in 2009.
• Objective: to develop a ranking system for the world
universities based on academic performances.
• The multidisciplinary team.
• Inter university Advisory Board.
2
3. ADVISORY BOARD
Prof. Dr. Attila Aşkar Prof. Dr. Tunçalp ÖZGEN
Former President of Koç University Former President of Hacettepe University
Prof. Dr. Engin Ataç Prof. Dr. Ülkü BAYINDIR
Former President of Anadolu University Former President of Ege University
Prof. Dr. Nusret ARAS Prof. Dr. Yaşar SÜTBEYAZ
Former President of Ankara University Former President of Atatürk University
3
4. URAP TEAM
Prof. Dr. Ural AKBULUT Prof. Dr. Nazife BAYKAL
URAP Coordinator URAP Associate Coordinator
Former President of METU
Informatics Institute, METU
Prof. Dr. Canan ÇİLİNGİR
Dept. of Industrial Engineering
Assist. Prof. Dr. Sevgi ÖZKAN
METU Informatics Institute
METU
Prof. Dr. Ayşen AKKAYA
Dept. of Statistics Dr. Murat Perit ÇAKIR
METU
Informatics Institute
METU
Dr. Cengiz ACARTÜRK
Informatics Institute
METU Nergis GÜREL
Informatics Institute, METU
Oğuzhan ALAŞEHİR
Informatics Institute, METU Buket ARAN
Informatics Institute, METU
Fatih ÖMRÜUZUN
Informatics Institute, METU Murat KOÇAK
Informatics Institute, METU
4
7. URAP RANKINGS
• URAP WORLD RANKING
– TOP 2000 for Overall Ranking
– TOP 1000 for Field Rankings (AGE, MED, SCI, SOC, ENG, LIFE)
• URAP TURKISH UNIVERSITIES RANKING
– TOP 125 for Overall Ranking
– TOP 125 for Field Rankings (AGE, MED, SCI, SOC, ENG, LIFE)
7
8. URAP WORLD RANKING
Aim and Scope
• URAP processed about 2500 HEIs data (in 2012) and top 2000 of
them are scored.
• The study includes HEIs except for governmental academic
research institutions.
• Objective data obtained from reliable open sources.
• Universities ranked according to multiple criteria.
• Working on a new methodology which will minimize the impact of
size and subject dependency.
8
9. URAP WORLD RANKING
Indicators
Indicator Objective Years Source
Number of Articles Current Scientific Productivity 2011 ISI
Total Documents Long - Term Overall Productivity 2007 - 2011 ISI
Citation Research Impact 2011 ISI
Cumulative Journal Impact
Scientific Impact 2007 - 2011 ISI
(JIT)
Cumulative Journal Citation
Scientific Impact 2007 - 2011 ISI
Impact (JCIT)
International Collaboration International Acceptance 2007 - 2011 ISI
9
10. URAP WORLD RANKING
Number of Articles
• Total number of articles indexed by Web of Science and
published in 2011.
• Objective: quantity of current scientific output.
• Also used in Field Ranking Methodology
10
11. URAP WORLD RANKING
Total Documents
• All type of documents results from year 2007 to 2011 from ISI.
• Objective: measures quantity of continuing scientific output.
• Also used in Field Ranking Methodology
11
12. URAP WORLD RANKING
Citation
• The total number of citations received in 2011 for the articles
published in 2007-2011.
(Self citations of authors are excluded.)
• Objective: measures sustainability of the quality of scientific
output.
• Also used in Field Ranking Methodology
12
13. URAP WORLD RANKING
Cumulative Journal Impact (JIT)
• Aggregated impact factors of journals in which a university
published articles between 2007 and 2011.
• Objective: indicates countinuity of publication quality.
• Also used in Field Ranking Methodology.
13
14. URAP WORLD RANKING
Cumulative Journal Citation Impact (JCIT)
• Aggregated impact factors of journals where citing articles are
published. The year range is between 2007 and 2011.
• Objective: indicates countinuity of citation quality.
• Also used in Field Ranking Methodology
14
15. URAP WORLD RANKING
International Collaboration
• Total number of documents of a university published in
collaboration with the universities of other countries for the
years 2007-2011.
• Objective: measures global acceptance of a university.
• Not used in Field Ranking Methodology.
15
17. URAP WORLD RANKING
DATA COLLECTION
• Data is gathered from: Web of Science and other sources which
provides list of HEIs.
• 2500 HEIs with highest number of publications analyzed.
• 2000 HEIs are ranked.
17
18. URAP WORLD RANKING
SCORING
• Data for indicators are not normally distributed.
0,88
0,8
0,72
0,64
0,56
0,48
f(x)
0,4
0,32
0,24
0,16
0,08
0
0 2000 4000 6000 8000 10000
article
Histogram Lognormal (3P)
18
19. URAP WORLD RANKING
SCORING
• The indicator values above and below the median are linearly
scored in two groups.
19
20. URAP WORLD RANKING
WEIGHTING and AGGREGATION
• Delphi system is used to assign weighting scores for the
indicators.
• Total score of 600 is assigned to each indicator as follows:
Indicator Weight (%)
Number of Articles 21
Total Documents 10
Citation 21
Cumulative Journal Impact 18
Cumulative Journal Citation Impact 15
International Collaboration 15
20
21. URAP WORLD RANKING
DATA CLEANING
• Noisy data due to:
– Unexpected data source failures
– Data transfer failures
• Suspicious data detection algorithms developed
• Data reliability is secured by data cleaning techniques
21
22. URAP WORLD RANKING
RESULTS
• Number of Countries : 109 Country
# of Universities in
Top 2000
• Countries with highest USA 400
number of universities in People's Republic of
186
URAP 2012 ranking: China
Japan 159
United Kingdom 93
Turkey 77
France 74
Germany 72
Taiwan 64
Italy 58
India 57
22
23. URAP WORLD RANKING
Universities with Highest Number of Articles
University Article Score
Harvard University 126,00
University of Toronto 100,48
University of Tokyo 98,27
University of Michigan Ann Arbor 97,20
Johns Hopkins University 96,07
Universidade de Sao Paulo 94,97
University of Washington Seattle 94,33
Stanford University 93,28
University of California Berkeley 93,23
University of California Los Angeles 93,03
23
24. URAP WORLD RANKING
Universities with Highest Total Documents
University Total Document Scores
Harvard University 60,00
University of Toronto 48,57
University of Michigan Ann Arbor 47,33
Johns Hopkins University 47,05
University of Tokyo 46,90
University of California Los Angeles 46,23
University of Washington Seattle 45,62
Stanford University 45,30
Universidade de São Paulo 44,22
University of California Berkeley 43,99
24
25. URAP WORLD RANKING
Universities with Highest Number of Citations
University Citation Scores
Harvard University 126,00
Stanford University 100,30
Johns Hopkins University 99,40
University of Washington Seattle 98,39
University of California Los Angeles 97,81
University of California Berkeley 97,17
University of Michigan Ann Arbor 96,74
University of Toronto 96,27
University of Oxford 92,72
University of Pennsylvania 92,29
25
26. URAP WORLD RANKING
Universities with Highest JIT
University JIT Score
Harvard University 108,00
Johns Hopkins University 77,62
Stanford University 76,47
University of Washington Seattle 75,57
University of Tokyo 75,07
University of Toronto 75,04
University of Michigan Ann Arbor 74,95
University of California Los Angeles 74,77
University of California Berkeley 74,51
University of Oxford 73,26
26
27. URAP WORLD RANKING
Universities with Highest JCIT
University JCIT Score
Harvard University 90,00
Stanford University 70,33
Johns Hopkins University 69,09
University of California Berkeley 68,87
Massachusetts Institute of Technology 68,33
University of California San Francisco 67,53
University of Washington Seattle 67,12
University of Oxford 65,72
University of Cambridge 65,68
University of California Los Angeles 65,58
27
28. URAP WORLD RANKING
Universities with Highest Number of Int. Collaboration
University Collaboration Score
Harvard University 90,00
University of Toronto 79,29
University of Oxford 78,75
University of Cambridge 75,32
Imperial College 73,23
University College London 70,59
University of California Berkeley 69,87
University of British Columbia 68,78
Johns Hopkins University 68,12
University of Tokyo 67,56
28
29. URAP WORLD RANKING
University Total Score
Top 15 Universities Harvard University 600,00
University of Toronto 463,69
Johns Hopkins University 457,35
Stanford University 451,39
University of California Berkeley 447,64
University of Michigan Ann Arbor 445,61
University of Oxford 445,43
University of Washington Seattle 445,38
University of California Los Angeles 443,75
University of Tokyo 441,19
University of Cambridge 436,20
University of Pennsylvania 422,96
University of California San Diego 422,31
Imperial College 419,58
Massachusetts Institute of Technology 419,07 29
30. URAP WORLD RANKING
University Total Score
Top 10 Universities University of California Davis
Wageningen University & Research
499,60
for the field of Centre
University of Florida
445,92
445,23
AGRICULTURE Cornell University 422,78
University of Wisconsin Madison 396,62
Universidade de São Paulo 393,31
University of California Berkeley 392,19
University of Copenhagen 387,21
Ghent University 383,22
Harvard University 383,00
30
31. URAP WORLD RANKING
University Total Score
Top 10 Universities Harvard University 500,00
385,90
for the field of
Johns Hopkins University
University of California San Francisco 369,61
MEDICINE University of Toronto
University of Pittsburgh
366,48
352,25
University of Pennsylvania 350,50
University of Washington Seattle 349,40
University of California Los Angeles 346,48
University of Michigan Ann Arbor 344,77
Duke University 344,57
31
32. URAP WORLD RANKING
University Total Score
Top 10 Universities Tsinghua University China 472,48
445,76
for the field of
University of California Berkeley
Massachusetts Institute of Technology 439,69
ENGINEERING National University of Singapore
Nanyang Technological University
429,39
419,70
Zhejiang University 408,28
Georgia Institute of Technology 405,84
Stanford University 394,14
Shanghai Jiao Tong University 391,78
Harbin Institute of Technology 386,09
32
33. URAP WORLD RANKING
University Total Score
Top 10 Universities Harvard University 500,00
366,32
for the field of
Johns Hopkins University
University of California San Francisco 358,81
LIFE SCIENCES University of Washington Seattle
University of California San Diego
349,16
347,26
University of Oxford 345,27
University of Pennsylvania 344,44
Stanford University 343,40
University of Toronto 340,13
University of Tokyo 337,56
33
34. URAP WORLD RANKING
Top 10 Universities University Total Score
477,92
University of California Berkeley
for the field of Harvard University 468,83
NATURAL University of Tokyo 445,85
Massachusetts Institute of Technology 439,95
SCIENCES Stanford University 410,29
409,45
California Institute of Technology Caltech
University of Cambridge 399,88
University of Oxford 386,25
Kyoto University 385,46
University of California Los Angeles 380,44
34
35. URAP WORLD RANKING
University Total Score
Top 10 Universities Harvard University 485,67
379,00
for the field of
University of Michigan Ann Arbor
University of North Carolina Chapel Hill 365,09
SOCIAL SCIENCES Columbia University New York
University of Washington Seattle
363,84
359,12
Johns Hopkins University 356,49
University of Toronto 356,48
University of Pennsylvania 353,18
University of California Los Angeles 352,47
University of California Berkeley 347,95
35
36. URAP TURKISH UNIVERSITIES RANKING
URAP TURKISH UNIVERSITIES SPECIAL RANKING
• 125 Universities including military schools and technology
institutes
• Overall Ranking & Fields Ranking
• 9 indicators to evaluate their academic performance, education
and research emphasis
36
37. URAP TURKISH UNIVERSITIES RANKING
Indicators for Overall Ranking
Indicator Objective Years Source
Number of articles Research 2011 ISI
Number of articles per faculty Research 2011 ISI and CHE
Number of citations Research 2007 - 2011 ISI
Number of citations per
Research 2007 - 2011 ISI and CHE
faculty
Total Number of Scientific
Research 2007 - 2011 ISI
Publications
Total Number of Scientific Research
2007 - 2011 ISI and CHE
Publications per faculty
Number of Ph.D. Students Education and Research 2011 SSPC
Percentage of Ph.D. Students Education and Research 2011 SSPC
Number of students per 2011
Education CHE and SSPC 37
faculty
38. URAP TURKISH UNIVERSITIES RANKING
University Total Score
Top 15 Universities HACETTEPE ÜNİVERSİTESİ 824,61
ORTA DOĞU TEKNİK ÜNİVERSİTESİ 816,66
ANKARA ÜNİVERSİTESİ 744,75
EGE ÜNİVERSİTESİ 741,42
İSTANBUL TEKNİK ÜNİVERSİTESİ 739,78
BOĞAZİÇİ ÜNİVERSİTESİ 732,09
İSTANBUL ÜNİVERSİTESİ 723,89
GEBZE YÜKSEK TEKNOLOJİ ENSTİTÜSÜ 709,37
İZMİR YÜKSEK TEKNOLOJİ ENSTİTÜSÜ 696,32
BİLKENT ÜNİVERSİTESİ 695,44
GAZİ ÜNİVERSİTESİ 689,26
SABANCI ÜNİVERSİTESİ 681,13
KOÇ ÜNİVERSİTESİ 653,25
ERCİYES ÜNİVERSİTESİ 643,50
ATATÜRK ÜNİVERSİTESİ 639,47 38
39. URAP TURKISH UNIVERSITIES RANKING
University Total Score
Top 10 Universities EGE ÜNİVERSİTESİ 323,33
315,97
for the field of
ANKARA ÜNİVERSİTESİ
ERCİYES ÜNİVERSİTESİ 288,69
AGRICULTURE ATATÜRK ÜNİVERSİTESİ
İSTANBUL ÜNİVERSİTESİ
286,18
272,61
SELÇUK ÜNİVERSİTESİ 270,19
ÇUKUROVA ÜNİVERSİTESİ 260,25
HACETTEPE ÜNİVERSİTESİ 250,17
ORTA DOĞU TEKNİK ÜNİVERSİTESİ 249,67
ULUDAĞ ÜNİVERSİTESİ 249,24
39
40. URAP TURKISH UNIVERSITIES RANKING
University Total Score
Top 10 Universities İSTANBUL ÜNİVERSİTESİ 340,00
310,81
for the field of
HACETTEPE ÜNİVERSİTESİ
ANKARA ÜNİVERSİTESİ 259,65
MEDICINE EGE ÜNİVERSİTESİ
GAZİ ÜNİVERSİTESİ
255,68
247,75
BAŞKENT ÜNİVERSİTESİ 242,84
MARMARA ÜNİVERSİTESİ 230,71
GÜLHANE ASKERİ TIP AKADEMİSİ 230,27
DOKUZ EYLÜL ÜNİVERSİTESİ 219,11
ERCİYES ÜNİVERSİTESİ 210,75
40
41. URAP TURKISH UNIVERSITIES RANKING
University Total Score
Top 10 Universities ORTA DOĞU TEKNİK ÜNİVERSİTESİ 337,77
322,19
for the field of
İSTANBUL TEKNİK ÜNİVERSİTESİ
GAZİ ÜNİVERSİTESİ 267,69
ENGINEERING EGE ÜNİVERSİTESİ
YILDIZ TEKNİK ÜNİVERSİTESİ
250,17
243,19
FIRAT ÜNİVERSİTESİ 238,02
ERCİYES ÜNİVERSİTESİ 235,35
DOKUZ EYLÜL ÜNİVERSİTESİ 230,32
HACETTEPE ÜNİVERSİTESİ 229,18
BİLKENT ÜNİVERSİTESİ 224,03
41
42. URAP TURKISH UNIVERSITIES RANKING
University Total Score
Top 10 Universities HACETTEPE ÜNİVERSİTESİ 338,28
332,90
for the field of
İSTANBUL ÜNİVERSİTESİ
ANKARA ÜNİVERSİTESİ 291,37
LIFE SCIENCES EGE ÜNİVERSİTESİ
GAZİ ÜNİVERSİTESİ
274,53
262,89
MARMARA ÜNİVERSİTESİ 234,78
ATATÜRK ÜNİVERSİTESİ 229,46
SELÇUK ÜNİVERSİTESİ 218,08
ONDOKUZ MAYIS ÜNİVERSİTESİ 217,25
ULUDAĞ ÜNİVERSİTESİ 214,73
42
43. URAP TURKISH UNIVERSITIES RANKING
Top 10 Universities University Total Score
340,00
ORTA DOĞU TEKNİK ÜNİVERSİTESİ
for the field of İSTANBUL TEKNİK ÜNİVERSİTESİ 296,45
NATURAL EGE ÜNİVERSİTESİ 263,03
GAZİ ÜNİVERSİTESİ 254,19
SCIENCES ANKARA ÜNİVERSİTESİ 252,63
250,09
HACETTEPE ÜNİVERSİTESİ
BİLKENT ÜNİVERSİTESİ 240,82
İSTANBUL ÜNİVERSİTESİ 235,20
BOĞAZİÇİ ÜNİVERSİTESİ 234,75
ATATÜRK ÜNİVERSİTESİ 214,94
43
44. URAP TURKISH UNIVERSITIES RANKING
University Total Score
Top 10 Universities ORTA DOĞU TEKNİK ÜNİVERSİTESİ 329,54
313,42
for the field of
HACETTEPE ÜNİVERSİTESİ
BİLKENT ÜNİVERSİTESİ 304,47
SOCIAL SCIENCES GAZİ ÜNİVERSİTESİ
ANKARA ÜNİVERSİTESİ
292,88
247,56
SELÇUK ÜNİVERSİTESİ 239,75
KOÇ ÜNİVERSİTESİ 236,17
BOĞAZİÇİ ÜNİVERSİTESİ 235,43
DOKUZ EYLÜL ÜNİVERSİTESİ 230,91
İSTANBUL TEKNİK ÜNİVERSİTESİ 228,92
44
45. Contact Information
www.urapcenter.org
info@urapcenter.org
URAP Laboratory
Informatics Institute
Middle East Technical University
Tel: +90 (312) 210 37 42 – Fax: +90 (312) 210 37 45
45
