1. Assessing the value of open
access agreements
Researcher to Reader
Wednesday 22 February 2023
Laura Wong, Jisc
Essential metrics, metadata, and infrastructure to support consortial
evaluation of open access agreements
2. Open Access agreements at Jisc
Assessing the value of open access agreements - Researcher to Research
2023
2
3. How do we assess value?
•What do we mean by value?
•When do we want to assess value?
•Where do usage statistics fit in?
Assessing the value of open access agreements - Researcher to Research
2023
3
5. Negotiation
•Which titles in the publisher’s portfolio are most
important in the UK context? Which are “high value”?
•To what extent are UK needs being met by OA content?
•How are patterns of use changing over time? Are we
seeing more usage of open compared to closed content?
Assessing the value of open access agreements - Researcher to Research
2023
5
6. Flipped journals
•What’s the global impact of flipped journals?
•What are the usage trends over the last couple of years
at journal and portfolio level? UK vs. global? Open vs.
closed content?
•Where does the UK sit in the international landscape?
What is its contribution to flipping titles to open access?
Assessing the value of open access agreements - Researcher to Research
2023
6
7. Institutional budgets and justifying spend
•What happens when we can no longer use the
subscriptions budget to fund these deals and initiatives?
•How do we secure budget and justify spend? How do we
continue demonstrating value for money and return on
investment?
•What benefits are we seeing from OA initiatives?
•What is the reach of our publication output?
Assessing the value of open access agreements - Researcher to Research
2023
7
8. Impact of policies
•How does the usage of funded research outputs
compare to non-funded outputs?
Assessing the value of open access agreements - Researcher to Research
2023
8
9. What does this mean for how we work with usage data?
Assessing the value of open access agreements - Researcher to Research
2023
9
•There’s still interest in…
•Paywalled usage
•Usage aggregated by title or journal
•Usage aggregated by publisher
•Usage attributed to institutions
•Annual trends
•But also interest in…
•Global usage of both open and paywalled
content
•Total usage of open content in the UK (not
just attributed to the institution)
•Global reach and country of use
Based on those key questions
10. A different approach
Holistic view
Indirect
value
Beyond the
publisher
platform
Slicing item
and global
data
Assessing the value of open access agreements - Researcher to Research
2023
10
11. Why item level reporting is important
Assessing the value of open access agreements - Researcher to Research
2023
11
Huge
Item
Report
COUNTER filters
• Articles published under
agreement
• Articles published by
associated authors
• Funded articles
• License type
• Articles on a platform
• Year of publication
Total usage
by…
• Single item
12. Supporting data
Assessing the value of open access agreements - Researcher to Research
2023
12
We need details
about:
• What has been
published
• Where was it
published
• Author affiliation
• Who funded it
• Under what licence
• Publication type
From places such as:
• Publisher systems
• Crossref
• Open Alex
• Open Access
Switchboard
• Databases such as
Scopus, WoS and
Dimensions
Matching on identifiers
such as:
• ISSN/ISBN
• DOI
• OCRID
• Funder ID
• Organisational IDs
13. 13
OA
agreements
analytics
and
evaluation
Data management
Automate processes to collect, collate,
clean and verify the required data
Shared understanding
Share approaches monitoring and
evaluation and build an evidence
base to support conversations
Data analysis
Data expertise of the team to work with
the dataset to find insights
Additional datasets
Supplement and enhance data with
Crossref, Unpaywall and Dimensions
Presentation
Provide robust and comparable
metrics with contextual information
in a digestible format
Accessible and re-usable
datasets
Provide datasets in an easy and
interoperable format
Assessing the value of open access agreements - Researcher to Research
2023
14. What are Jisc doing with global and item usage stats?
COUNTER item
reports through
JUSP, our
collection service
Prototype data
visualisations
using publisher
supplied global
usage reports
Global usage of
items in
repositories
through IRUS
Case study
using IRUS stats
in analysis of an
agreement with
self-archiving
element
Assessing the value of open access agreements - Researcher to Research
2023
14
How it works:
Total usage / global usage is built up of non-attributed and attributed usage of content on publisher platforms – that is, the usage we CAN link to institutions, and that which we CAN’T link to institutions, wherever they are in the world. Within that split, whether content is paywalled or free to read or OA is a secondary question.
For subscription content report providers break this down to show only attributed usage, for a single institution or consortium
For OA content, report providers don’t have to do that breakdown – that is, they can (AND SHOULD) report global usage
Great, but not necessarily granular…