An overview of the Thomson Reuters InCites BenchMarking & Analytics package with a range of indicators in addition to the journal impact fact and its use by publishers to analyse journal and list performance.
A Secure and Reliable Document Management System is Essential.docx
Go Beyond Impact with InCites Publisher Analytics
1. INCITES FOR PUBLISHERS
‘GOING BEYOND THE IMPACT FACTOR’
IAN POTTER
PUBLISHING & ASSOCIATIONS
IP & SCIENCE
14 OCTOBER 2015
2. 2
IT’S ALL ABOUT THE DATA
SCIENCE CITATION INDEX EXTENDED
SOCIAL SCIENCES CITATION INDEX
ARTS & HUMANITIES CITATION INDEX
CONFERENCE PROCS CITATION INDEX
BOOKS CITATION INDEX
49,424,595 RECORDS
10,372,963 SS & A&H
8,313,199 CONFERENCE PROCEEDINGS
1980—2015
12,718 INDEXED TITLES (227 NEW)
82 COUNTRIES
5625 UNIFIED ORGANIZATIONS
RESEARCH ANALYTICS INTEGRATED METRICS SYSTEM
ESSENTIAL SCIENCE INDICATORS
JOURNAL CITATION REPORTS
WEB OF SCIENCE
ORGANIZATIONS
REGIONS
RESEARCH AREAS
JOURNALS, BOOKS,
CONFERENCE
PROCEEDINGS
PEOPLE
EXPLORE BY
3. 3
WHAT IS INCITES
INCITES CAN HELP UNDERSTAND
THE IMPACT OF AUTHORS AND THEIR
PAPERS
HOW ARE AUTHORS
CONTRIBUTING TO YOUR
PUBLICATIONS? WHERE ARE
THEY FROM?
DEMONSTRATE
THE EFFECTIVENESS OF A PUBLISHING
STRATEGY
USE METRICS TO SHOW THE
IMPACT OF YOUR DECISIONS
COMPARE
PUBLICATIONS, AUTHORS, ARTICLES ON A
WIDE-RANGE OF INDICATORS AND CRITERIA
USE A WIDE RANGE OF
INDICATORS TO HELP
UNDERSTANDING
ANALYSE
COMPETITORS AND PEERS, FIND
STRENGTHS AND WEAKNESSES
OBJECTIVE METHODS, WORK
WITH DATA
BENCHMARK
PUT PERFORMANCE INTO CONTEXT WITH
NORMALIZATION AND BENCHMARKING
PUT PERFORMANCE IN CONTEXT
4. 4
A MEASURE OF PERFORMANCE
CITATIONS USAGE
MENTIONS
PERFORMANCE
5. 5
CITATIONS, CITATIONS, CITATIONS
NETWORK CITATIONS
YEAR
CITATIONS
ACCUMULATE
AT DIFFERENT
RATES
AND
VARY BY
SUBJECT
Review
Article
Editorial
AND BY
DOCUMENT
TYPE
REVIEWS CITED
MORE HEAVILY
6. 6
NORMALIZATION AND BENCHMARKING
20
0
25
20
0
1000
20
CONTEXT IS EVERYTHING
INDICTORS MUST BE PUT INTO CONTEXT TO BE USEFUL:
CATEGORY, JOURNAL, PEERS, GLOBAL
‣ NORMALIZED INDICATORS — for relative performance comparisons
‣ PERCENTILES — where does it fall in the range of values?
‣ BENCHMARKS — how does it compare with a group or globally?
IS THIS GOOD OR BAD?
GOOD
BAD
7. 7
NORMALIZED CITATION IMPACT
ARTICLE ARTICLE ARTICLE
ARTICLE ARTICLE ARTICLE
ARTICLE ARTICLE ARTICLE
ARTICLE ARTICLE ARTICLE
ARTICLE ARTICLE ARTICLE
NORMALIZED
RATIO OF ACTUAL / EXPECTED CITATIONS
EXPECTED NUMBER
OF CITATIONS FOR
ARTICLE SET*
AVERAGE CALCULATED
FROM SUM OF ALL
DOCUMENTS IN THE
SELECTED GROUP
20
2 32
5
0
189 2
1218 1
1
87 23
158 TOTAL CITES IN GROUP
15 DOCUMENTS IN GROUP
10.5 EXPECTED CITES
ARTICLE12
ARTICLE
12 TOTAL
10.5 EXPECTED
1.14 NORMALIZED
8 PEOPLE
8 TOTAL
10.5 EXPECTED
0.76 NORMALIZED
*FOR JOURNAL/CATEGORY, PUBLICATION YEAR, AND DOCUMENT TYPE
ALSO ORGANIZATIONS, COUNTRIES, RESEARCH AREAS
8. 8
USING NORMALIZED CITATION IMPACTS — ARTICLES
8
EXPECTED NUMBER OF CITATIONS
FOR AN ARTICLE PUBLISHED IN THE
JOURNAL IN 1998
EXPECTED NUMBER OF CITATIONS
FOR AN ARTICLE PUBLISHED IN THE
CATEGORY IN 1998
CATEGORY NORMALIZED CITATION IMPACT
>1 IS BETTER THAN EXPECTED
JOURNAL NORMALIZED CITATION IMPACT
>1 IS BETTER THAN EXPECTED
EXAMPLE ARTICLE PERFORMING BELOW EXPECTED FOR JOURNAL
AND CATEGORY IN 1998
PERCENTILE IN SUBJECT AREA
SMALLER IS BETTER — IN THIS EXAMPLE 53% OF THE PAPERS IN THE CATEGORY (PLANT SCIENCES) IN 1998 PERFORMED BETTER
9. 9
USING NORMALIZED CITATION IMPACTS — PEOPLE
NORMALIZATION CAN BE APPLIED ACROSS ORGANIZATIONS, COUNTRIES, RESEARCH AREAS,
JOURNALS AND OTHER PUBLICATIONS
CATEGORY NORMALIZED CITATION IMPACT
HOW WELL THIS INDIVIDUAL HAS PERFORMED
RELATIVE TO EXPECTED FOR THE CATEGORY
JOURNAL NORMALIZED CITATION IMPACT
HOW WELL THIS INDIVIDUAL HAS PERFORMED
RELATIVE TO EXPECTED FOR THE JOURNAL(S)
10. 10
USING INDICATORS WISELY
NO SINGLE INDICATOR TELLS THE ENTIRE STORY
NUMBEROFCITATIONS
TIME
SUBJECT 2
SUBJECT 1
SUBJECT 3
ABSOLUTE INDICATORS
number of documents or citations, and derivatives (e.g. citation impact) will vary depending on
subject category, time, and document type
These can tell you about factors such as productivity but do not allow for meaningful
comparisons across domains
19802015
NUMBEROFCITATIONS
NUMBER OF PAPERS
AVERAGE
MEDIAN
NORMALIZED INDICATORS
performance against the set of documents normalized for subject/journal, publication year, and
document type
These can be used for performance comparisons
Normalized indicators are based on averages and can be skewed by a single or small numbers of
highly cited documents: use larger document sets and appropriate thresholds and filters. Caution
should be applied to analyses of recent years as they may have low document and citation baselines
CITATION
DISTRIBUTIONS
are often skewed by a
small number of highly
cited articles with a
long tail of articles with
relatively few citations
11. 11
INCITES
DASHBOARD — TOP LEVEL
SAVED REPORT
EXPLORER — THE
STARTING POINT FOR AN
ANALYSIS
SYSTEM REPORTS —
READY-TO-RUN ANALYSES
12. 12
THE EXPLORER — PERFORMING AN ANALYSIS
1. CHOOSE AN
ANALYSIS THAT
FRAMES YOUR
QUESTION
2. SPECIFY FILTERS TO
TAILOR YOUR ANALYSIS
3. SET THRESHOLDS TO FILTER
OUT OUTLIERS AND FOCUS
5. BENCHMARK —
COMPARE WITH GLOBAL
AND SELECTED GROUPS
6. PIN & EXCLUDE TO
CUSTOMISE YOUR RESULTS
4. CHOOSE THE
RANGE OF
INDICATORS TO
VIEW
13. 13
MEASURING PERFORMANCE
11,149 INDEXED JOURNALS
82 COUNTRIES
1,721,170 ARTICLES
79,218 REVIEWS
493,588 OTHER ITEMS
CONTENT CURATED
YEAR-ROUND BY OUR
FULL-TIME EDITORIAL TEAM
EVALUATE the world’s leading
journals to measure influence
and impact at the journal and
category level.
CLARIFY a journal’s true place in the
world of scholarly literature with
Transparent indicators trusted by the
world’s leading research organizations.
DRILL DOWN to the article-level source
information with clickable metrics that
reveal underlying calculation, and
easy-to-download data and graphs.
INVESTIGATE journal
profiles, complete with
Open Access details.
272 NEW JOURNALS ADDED
FOR A 9% INCREASE IN CONTENT
DATA UPLOADING
CITED AND CITING DATA UNIFICATION
2015 JOURNAL
CITATION REPORTS
2015 JOURNAL
CITATION REPORTS
OUR LIST OF COVERED TITLES
IS CONTINUOUSLY CURATED
DATA IS REFRESHED TO CAPTURE
THE MOST COMPLETE PICTURE OF
JOURNAL ANALYTICS
JOURNAL EVALUATION
METRICS CALCULATION
THE JCR PROCESS CURATED CONTENT PROCESS
ADDITION OF THREE NEW INDICATORS:
• Journal Impact Factor Percentile
• Normalized Eigenfactor
• Percent Articles in Citable Items
A JOURNAL
IMPACT FACTOR
MEASURES
JUST ONE THING
NUMBER OF CITATIONS IN JCR YEAR
NUMBER OF ARTICLES PUBLISHED IN THE TWO PREVIOUS YEARS
IMPACT FACTORS CAN ONLY BE USED TO
COMPARE JOURNALS IN THE SAME FIELD
14. 14
USE A WIDE RANGE OF INDICATORS
number of
WoS
documents
times cited
citation
impact
% of
documents
cited
impact
factors
H-Index,
Eigenfactor,
etc.
PRODUCTIVITY & IMPACT
percentile/
average
percentile
category
normalized
citation
impact
category
expected
citation
impact
highly cited
papers
hot papers
journal
normalized
citation
impact
journal
expected
citation
impact
impact
relative to
the world
impact
factor
percentile
NORMALIZATION
% of
documents in
top 1%
% of
documents in
top 10%
category
expected
citation
impact
highly cited
papers
PERFORMANCE & INFLUENCE
% industry
collaboration
% internatl
collaboration
internatl
collaboration
COLLABORATION
15. 15
USE CASES — WHICH INSTITUTIONS ARE CONTRIBUTING TO OUR PUBLICATIONS?
USE THE ORGANIZATIONS EXPLORER
SELECT FILTER
OPTIONS
SET
THRESHOLDS
— EXCLUDE
OUTLIERS AND
FOCUS ON
DESIRED TIME
PERIOD
HERE THE FOCUS IS
CONTENT PUBLISHED
IN BUSINESS &
MANAGEMENT
FURTHER FILTERS
CAN BE ADDED, FOR
INSTANCE
DOCUMENT TYPE TO
FOCUS ON BOOK
CHAPTERS OR
REVIEWS
ANALYSIS
RESULTS
SORT DATA
ON ANY
INDICATOR
(IN THIS
EXAMPLE
CNCI)
16. 16
DIG DEEPER
SEE FULL DOCUMENT LIST
LINK TO WEB OF
SCIENCE™ RECORD
SORTABLE ARTICLE LEVEL INDICATORS DOWNLOAD DATA
REFOCUS TO DIG EVEN
DEEPER TO SEE JOURNAL
DETAILS AND MUCH MORE
REMOVE FILTERS TO GET SEE THE
FULL PICTURE & CREATE
COMPARATIVE DATASETS — E.G.
WHAT’S OUR MARKET SHARE IN
THIS FIELD?
17. 17
GO BEYOND…
83%
17%
‘MARKET SHARE’
— KNOW WHERE
YOU STAND
EXPLORE THE
IMPACT OF OPEN
ACCESS — FIND
GAPS IN THE
MARKET
USA
England
China
Germany
MOST IMPACTFUL AUTHORS,
INSTITUTIONS, COUNTRIES
GEOGRAPHICAL AND REGIONAL
ANALYSIS — BREAKDOWN
CONTRIBUTIONS & IMPACT
GLOBALLY
0
50
100
150
2005
2007
2009
2011
2013
TREND ANALYSIS — VIEW
INDICATORS AND COMPARE
PERFORMANCE OVER TIME
SUBJECT FOOTPRINT — DEMONSTRATE
STRENGTHS & IDENTIFY OPPORTUNITIES
18. 18
CREATE YOUR OWN DATASETS
1. CREATE A SEARCH IN
THE WEB OF SCIENCE™
CORE COLLECTION
2. AND CHOOSE THE SAVE
TO INCITES OPTION FROM
YOUR SEARCH RESULTS
3. UP TO 5 DATASETS EACH WITH A
MAXIMUM OF 50,000 RECORDS CAN BE
CREATED AND SAVED
4. AN EMAIL WILL
CONFIRM THE EXPORT AND
INDICATE ANY RECORDS
THAT DID NOT TRANSFER
5. SAVED DATASETS CAN THE BE SELECTED IN INCITES AND THE FULL RANGE
OF ANALYSES AND INDICATORS ARE AVAILABLE
19. 19
SHARE REPORTS & DOWNLOAD DATA
DOWNLOAD DATA,
INCLUDING BASELINES
AND TREND
SAVE ANALYSES
TO FOLDERS AND
DASHBOARDS
DATA REFRESHES
AUTOMATICALLY
ANALYSIS DATA
CAN BE VIEWED
AND EDITED
DASHBOARDS
CAN BE SAVED
AS REPORTS
AND SHARED BY
EMAIL
20. 20
AN EVOLVING PRODUCT
Future
v2.1
Journal & Highly
Cited Data
InCites Next
Generation
SEPT 2014
OCT 2014
NOV 2014
MAR 2015
JUN 2015
AUG 2015
JAN 2015
SEPT 2015
JUN 2014
APR 2015
v2.2 Custom ReportsMy Folders System
Export Document
Level Indications
Export Data Tablesv2.4
Publisher FilterJournal ExplorerInstitution Profilesv2.5
35 Years of Datav2.7
Share Live Reports
JCR Metrics in
InCites Explorerv2.9
Funder Filter
Save WoS Results
to InCites
Export Trend DataExport Baselinesv2.11
Open Access Filter
Journal Impact
Factor Percentile
Normalized
Eigenfactorv2.14
Baselines
Document Export
PubMedID ExportDOI Exportv2.17
Export
Timestamps
Average Impact
Factor Percentilev2.18
*DOES NOT INCLUDE MINOR OR MAINTENANCE
RELEASES, OR ALL FEATURES ADDED
ESCI
Funder
Explorer
InCites API
Publisher
Explorer
FUTURE ROADMAP IS NOT COMPLETE OR FINALIZED. PROPOSED FEATURES MAY CHANGE
Visualisation
Tools
Hyperlinked
Document Metrics
Edit Saved Tiles