This document summarizes a presentation about citation analysis services provided by the University of Manchester Library. It discusses how the library analyzes citations to evaluate research performance and impact at the institutional and department levels. Key points include that citation data can provide metrics for benchmarking research quality against peer institutions, and that the library produces customized reports for different faculties and schools analyzing their citation metrics and most cited articles. Automated scripts and predefined clusters are used to streamline reporting on citation percentiles and highly cited research.

1. The development of bibliometric and
citation analysis services at The
University of Manchester Library
The Northern Collaboration 2014 Conference
Stephen Pearson (Research Information Analyst)
& Scott Taylor (Research Services Librarian)

2. Outline of the session
Introduction
Citation
Services to
University
centrally
Reports for
Faculties and
Schools
Altmetrics

3. Introduction
Citation
Services to
University
centrally
Reports for
Faculties and
Schools
Altmetrics

4. ‘The Manchester Model’
Service Teams
(2012 onwards)
• Academic Engagement
• Research Services
• Teaching and Learning
Services
Subject Teams
(up to 2012)
• Arts
• Business and
Management
• Engineering and Physical
Sciences
• Life Sciences
• Medical and Human
Sciences
• Social Sciences

5. Where we are
Research
Services
Citation
Services
Business Data
Service
Institutional
Repository
Research Data
Management
Research
Resource
Management
and
Development
Scholarly
Communication
and Open
Access

6. Who we are
Citation
Services
Team
Research
Information
Analyst
Research
Services
Librarian

7. What is a citation?

8. What does a citation database look like?

9. Can we be sure that ...
• ... reference to earlier work implies value of
earlier work?
• ... the more citations a piece of work receives,
the greater its value is?

10. Which article has received the most
citations?
A. F. Brown, 'Occurrence of
vitamin-E in cod and other fish-liver
oils'. Nature 171 (4357)
1953, pp.790-791.
B. W.R. Davis, R.J. Slawson, G.R.
Rigby, 'An unusual form of
carbon'. Nature 171 (4356) 1953,
p.756
C. J.D. Watson, F.H.C. Crick,
'Molecular structure of nucleic
acids'. Nature 171 (4356) 1953,
pp.737-738
D. A. Wilska, 'A new method of
light microscopy'. Nature 171
(4347) 1953, p.353
0% 0% 0% 0%
F. Brown, 'Occurrence of...
J.D. Watson, F.H.C. Crick,...
W.R. Davis, R.J. Slawson, ...
A. Wilska, 'A new method...

11. • F. Brown, 'Occurrence of vitamin-E in cod and other fish-liver oils'. Nature
171 (4357) 1953, pp.790-791.
13 citations
• W.R. Davis, R.J. Slawson, G.R. Rigby, 'An unusual form of carbon'. Nature
171 (4356) 1953, p.756
169 citations
• J.D. Watson, F.H.C. Crick, 'Molecular structure of nucleic acids'. Nature 171
(4356) 1953, pp.737-738
5,170 citations
• A. Wilska, 'A new method of light microscopy'. Nature 171 (4347) 1953,
p.353
24 citations

12. • http://www.youtube.com/watch?v=f6a3B499
nwY&t=19m15s
• http://www.youtube.com/watch?v=M7INnQG
oBkE&t=2m52s

13. NBA 2013-2014
Player Field Goals
Kevin Durant 849
LeBron James 767
Carmelo Anthony 743
Blake Griffin 718
Al Jefferson 700
Stephen Curry 652
LaMarcus Aldridge 652
Kevin Love 650
Dirk Nowitzki 633
DeMar DeRozan 604
Premier League 2013-2014
Player Goals
Luis Suarez 31
Daniel Sturridge 22
Yaya Toure 20
Wayne Rooney 17
Wilfried Bony 17
Sergio Aguero 17
Edin Dzeko 16
Olivier Giroud 16
Jay Rodriguez 15
Romelo Lukaku 15

14. In which field would you expect
citation levels to be highest?
A. Classics
B. Economics and
Econometrics
C. Education
D. Philosophy
0% 0% 0% 0%
Classics
Economics and Economet...
Education
Philosophy

16. Articles
published:
9
Citations
received:
13
Citations
received
per article:
1.44
Articles
published:
379
Citations
received:
13,251
Citations
received
per article:
34.96

17. • Of 29,702 articles in the field of
Atomic and Molecular Physics
published worldwide in 2007 ...
• The most-cited 1% (297 articles)
have received at least 108
citations
• The most-cited 5% (1,485 articles)
have received at least 45 citations
• The most-cited 10% (2,970
articles) have received at least 30
citations
• The most-cited 25% (7,425
articles) have received at least 15
citations
• Of 10,624 articles in the field of
History published worldwide in
2007 …
• The most-cited 1% (106 articles)
have received at least 26
citations
• The most-cited 5% (531 articles)
have received at least 10 citations
• The most-cited 10% (1,062
articles) have received at least 6
citations
• The most-cited 25% (2,656
articles) have received at least 2
citations

18. Introduction
Citation
Services to
University
centrally
Reports for
Faculties and
Schools
Altmetrics

19. Reviewing institutional performance

20. Number of items
published 2008-
2012
Number of items in
top 10%
Percentage of items
in top 10%
Institute of Brain,
Behaviour and Mental
Health
731 232 31.74
Institute of Cancer
Sciences
978 305 31.19
Institute of
Cardiovascular
Sciences
371 83 22.37
Institute of Human
Development
1044 237 22.7
Institute of
Inflammation and
Repair
1826 562 30.78
Institute of Population
Health
1307 331 25.33
MHS Total (also
including Schools)
9917 2495 25.16

23. Excel

24. Authors Title Year Journal
title
Cited by Subject Article in
1%?
Article in
5%?
Article in
10%?
Nock M.K. Self-Injury 2010 Annual
Review of
Clinical
Psychology
75
Wolfer A.,
Ramaswamy
S.
MYC and
metastasis
2011 Cancer
Research
27
Valiant L.G. Evolvability 2009 Journal of the
ACM
12
Shleifer A.,
Vishny R.W.
Unstable
banking
2010 Journal of
Financial
Economics
43
Carey S. Beyond fast
mapping
2010 Language
Learning and
Development
12
Bates R.H. State failure 2008 Annual
Review of
Political
Science
14
Narayana S.,
Sato Y.
DC magnetic
cloak
2012 Advanced
Materials
13
De Leon N.P.,
Lukin M.D.,
Park H.
Quantum
plasmonic
circuits
2012 IEEE Journal
on Selected
Topics in
Quantum
Electronics
5

25. Authors Title Year Journal
title
Cited by Subject Article in
1%?
Article in
5%?
Article in
10%?
Nock M.K. Self-Injury 2010 Annual
Review of
Clinical
Psychology
75 Psychiatry
and Mental
Health
Yes
Wolfer A.,
Ramaswamy
S.
MYC and
metastasis
2011 Cancer
Research
27 Cancer
Research
Yes
Valiant L.G. Evolvability 2009 Journal of the
ACM
12 Artificial
Intelligence
Yes
Shleifer A.,
Vishny R.W.
Unstable
banking
2010 Journal of
Financial
Economics
43 Accounting Yes
Carey S. Beyond fast
mapping
2010 Language
Learning and
Development
12 Education Yes
Bates R.H. State failure 2008 Annual
Review of
Political
Science
14 Sociology and
Political
Science
Yes
Narayana S.,
Sato Y.
DC magnetic
cloak
2012 Advanced
Materials
13 Materials
Science
Yes
De Leon N.P.,
Lukin M.D.,
Park H.
Quantum
plasmonic
circuits
2012 IEEE Journal
on Selected
Topics in
Quantum
Electronics
5 Atomic and
Molecular
Physics, and
Optics
Yes

26. Setting a target
Manchester
highly cited
papers: ?%
Manchester
target for
highly cited
papers: ?%
UK top
university
highly cited
papers: ?%
World top
university
highly cited
papers: ?%

27. What are the top universities in the
UK and the world for citations?
A. Cambridge and
Stanford
B. Edinburgh and
Pennsylvania
C. Manchester and
Penn State
D. Oxford and Harvard
0% 0% 0% 0%
Cambridge and Stanford
Manchester and Penn State
Edinburgh and Pennsylv...
Oxford and Harvard

28. University Total number of
publications 2008-2012
Proportion in top 10% most
cited
Harvard 87,784 35.7
Stanford 41,816 31.1
Oxford 36,679 29.3
University of Pennsylvania 35,130 28.4
Cambridge 35,272 27.8
University College London 39,939 27.1
Imperial College London 28,392 26.2
Edinburgh 20,285 26
LSE 3,792 25.6
Toronto 52,852 24.2
Melbourne 27,531 23.5
Liverpool 12,776 22.8
Manchester 27,183 22.3
Sheffield 15,479 21.8
Penn State 29,496 21.1

29. Outline of the session
Introduction
Citation
Services to
University
centrally
Reports for
Faculties and
Schools
Altmetrics

30. Standard reporting
Demo

42. Standard reporting
Script
automation
(Python)
Ready-made
clusters
Citation
centile
thresholds

43. Outline of the session
Introduction
Citation
Services to
University
centrally
Reports for
Faculties and
Schools
Altmetrics

44. Thank you!
Questions?