Maximising the power of ORCID with metrics.

1. +
Philip Purnell
Director – Research Services
ORCID meeting – Abu Dhabi
18th October, 2015

2. +
Presenter – Philip Purnell
 Educated: Institute of Psychiatry, London
 Research: Max-Planck Institute of Psychiatry, Munich
 Pharmaceutical industry – AstraZeneca & UCB
 STM publishing
 Prous Science, Thomson Reuters
 Scientometrics consulting: Europe, Middle East, Africa, Asia
 Languages: English, German, Spanish
 Knowledge E: Information based research products & services

3. +
On the origins of citation databases
Eugene Garfield’s
landmark paper
published in Science,
1955

4. +
What is a citation?

5. +
Citations and the Internet
5
2003 2007
2011
2008
1965 1998
2001
1930
Times
Cited
Related
Records
1986
2008
1984
1972
Cited
References
“ … association of ideas …”
Citation
database
2002

6. +
Uses and limitations of bibliometric
indicators
 Productivity
 Output type, doc type, inclusion in databases, name and affiliation
accuracy, relative contribution
 Citations
 Self-citations, citation ‘cartels’, relative contribution, ‘quality’ of citing
source
 Impact
 Average citation counts generally ‘means’, h-index

7. +
Journal impact
Poor predictor of article impact
There are many uncited papers
published in even the highest
impact factor journals …

8. +
Journal impact
Poor predictor of article impact
… and conversely many highly
cited papers in low impact factor
journals

9. +
Impact
how accurate is your h-index?
9
Jorge E. Hirsch

10. +
Impact
how accurate is your h-index?

11. +
Thomson Reuters – Web of Science
ORCID integration

12. +
Elsevier Scopus
ORCID integration

13. +
Normalised article-level indicators
13
What is the impact of
this paper?

14. +
Normalised article-level indicators
14
Finding a suitable benchmark …
… normalised for subject category
(field), publication year, document type

15. +
Normalised article-level indicators
15

16. +
Normalised article-level indicators
16
Journal expected citations = 10.48
Journal Normalised Citation Impact =
20 / 10.48 = 1.91

17. +
Normalised article-level indicators
This paper has received
45/16.74 = 2.69 times the
expected citations for this
subject category
This paper has received
45/21.48 = 2.09 times the
expected citations for this
journal
Integrative &
Complementary Medicine
articles from 2005 have
been cited 16.74 times
Articles published
in this journal from
2005 have been
cited 21.48 times

18. +
Normalised article-level indicators
Researcher indicators
Computer
Science
Medicine

19. +
ORCID
Build up unified research groups
Researcher A
KIC
Immunology dept
ORCID: 0123-1234-2345-
3456
Researcher B
UAE Univ
Immunology dept
ORCID: 0011-2233-
4455-6677
Researcher D
Qatar Univ
Immunology dept
ORCID: 1122-3344-
5566-7788
Researcher F
KIC
Immunology dept
ORCID: 2233-4455-
6677-8899
Researcher E
UAE Univ
Immunology dept
ORCID: 2345-3456-
4567-5678
Researcher C
KIC
Biochemistry dept
ORCID: 1234-2345-
3456-4567

20. +
Bibliometric Indicators
Desired attribute Indicator InCites SciVal CWTS
Productivity
Number of outputs in a defined time
period
Web of Science Documents Scholarly Output P
Influence
Citations accrued to a body of papers in a
defined time period
Times Cited Citation Count TCS
Influence
Proportion of papers that have been cited
at least once
% Document Cited
Impact Average citations per paper Citation Impact Citations Per Publication MCS
Influence and impact Healthy proportion of cited papers h-index h-index
Impact normalised by field
Mean citation average divided by field
mean
Category Normalized
Citation Impact
Field-Weighted Citation
Impact
MNCS
Impact normalised by journal
Mean citation average divided by journal
mean
Journal Normalized Citation
Impact
MNJS
Journal impact Ratio of citations to size of journal Journal Impact Factor SNIP
High impact papers
Papers cited in top 10% for their field and
time period
% Documents in Top 10% Outputs in Top Percentiles PP(Top10%)
Notable papers
Papers cited in top 1% for their field and
time period
% Documents in Top 1% Outputs in Top Percentiles PP(Top1%)
Notable papers
Papers cited in top 1% for their field and
time period
% Highly Cited Papers Outputs in Top Percentiles
Outstanding papers
Papers cited in top 0.1% for their field and
time period
% Hot Papers Outputs in Top Percentiles
International collaboration
Proportion of papers that feature a co-
author from another country
% International
Collaborations
Collaboration Impact
Industry collaboration
Proportion of academic papers that
feature an industry co-author
% Industry Collaborations
Academic-Corporate
Collaboration Impact

21. + Quantitative indicators lead us in the right direction but
do not replace peer evaluation
21