The role of usage data in informing decision making processes, engaging stakeholders and assessing value

JUSPSTATS
The role of usage data in informing decision making
processes, engaging stakeholders and assessing value
LauraWong, library analytics services analyst, Jisc
21/11/18
Why use e-resource usage data?
E-resource usage data provides…
»evidence to back up decisions and support cases
»metrics used in reporting and monitoring
»additional source of information
which then enables and supports…
»informed collection development decisions
»informed discussions
»new insights and a different perceptive
21/11/18 UKSG E-Resources for Further Education 2
Analysis and interpretation
»Stats need to be interpreted to provide useful information
»What is being counted?What is the unit of use?
› click, download, search, view etc.
»What does that count mean?
› Add context
› Make comparisons
»Not used in isolation – usage data needs to be used
alongside other data, information and knowledge
21/11/18 UKSG E-Resources for Further Education 3
Informing decisions
Purchasing
and
renewal
decisions
Cost-per-use
or cost-per-
download
Trends
Access
denials
What to buy, what to keep and what to cancel
21/11/18 UKSG E-Resources for Further Education 4
Engaging stakeholders
Building
relationships
with
stakeholders
Open
dialogue with
lecturers
Inform
discussions
with suppliers
Regular
reporting to
management
21/11/18 UKSG E-Resources for Further Education 5
Feedback and evaluation
Delivering
the best
service
Under
used titles
Access
issues
High use
titles
21/11/18 UKSG E-Resources for Further Education 6
Impact and value
Demonstrating
impact and
value
Reporting
Value of
your
service
Making a
case
Evidence
21/11/18 UKSG E-Resources for Further Education 7
JUSP case study
»Regularly collected and monitored usage but asked could we make
better use?
»Systematic journals review
› Identified low use titles for review
› Calculated cost per use
› Considered factors such as impact, subject, cost and format
› Consulted with academics
»Saved money and re-allocate budget to more relevant resources
»https://jusp.jisc.ac.uk/docs/case5.pdf
Using JUSP to improve collection management and strategy
21/11/18 UKSG E-Resources for Further Education 8
JUSP
21/11/18 UKSG E-Resources for Further Education 9
Practical challenges of working with usage data
21/11/18 UKSG E-Resources for Further Education 10
Challenges JUSP
Collection – time and effort required to collect data Collects on behalf of libraries
Single point of access
Collation – time and effort required to process data for analysis Aggregates and summarises
Supports Jisc Collections
Consistency – reliability of data Standards based (COUNTER)
Central point of contact, expertise and support
Context – combining and matching with other information Export data
Core journal titles and KB+
Usage profiling/benchmarking
Communication – engaging others Community, support and training
Data visualisations
Further information about JUSP
»Joining information - http://jusp.jisc.ac.uk/join/uk-academic-libraries/
»Can JUSP help? - http://jusp.jisc.ac.uk/docs/Can_JUSP_help.pdf
»Use cases - http://jusp.jisc.ac.uk/use-cases/
»Case studies - http://jusp.jisc.ac.uk/case-studies/
»Video guides - http://jusp.jisc.ac.uk/screencasts/
»Webinars and slides - https://jusp.jisc.ac.uk/events-training/
› JUSP for further education - 16 Jul 2018
21/11/18 UKSG E-Resources for Further Education 11
Contacts
»help@jisc.ac.uk
»Mention JUSP
Any questions about JUSP
»Contact your Jisc account
manager
»https://www.jisc.ac.uk/contact
/your-account-manager
Any other questions about Jisc
and Jisc services
21/11/18 UKSG E-Resources for Further Education 12
1 of 12

Recommended

A new role for COUNTER usage data in open access agreements by
A new role for COUNTER usage data in open access agreementsA new role for COUNTER usage data in open access agreements
A new role for COUNTER usage data in open access agreementsJUSPSTATS
11 views22 slides
Assessing the value of OA agreements by
Assessing the value of OA agreementsAssessing the value of OA agreements
Assessing the value of OA agreementsJUSPSTATS
9 views21 slides
Role of JUSP in gathering usage statistics and informing decision making by
Role of JUSP in gathering usage statistics and informing decision makingRole of JUSP in gathering usage statistics and informing decision making
Role of JUSP in gathering usage statistics and informing decision makingJUSPSTATS
6 views21 slides
JUSP fundamentals for further education by
JUSP fundamentals for further educationJUSP fundamentals for further education
JUSP fundamentals for further educationJUSPSTATS
296 views33 slides
JUSP webinar: Reporting with COUNTER R4 and R5 data by
JUSP webinar: Reporting with COUNTER R4 and R5 dataJUSP webinar: Reporting with COUNTER R4 and R5 data
JUSP webinar: Reporting with COUNTER R4 and R5 dataJUSPSTATS
343 views23 slides
COUNTER R4 to R5 - transition and comparison with JUSP - updated by
COUNTER R4 to R5 - transition and comparison with JUSP - updatedCOUNTER R4 to R5 - transition and comparison with JUSP - updated
COUNTER R4 to R5 - transition and comparison with JUSP - updatedJUSPSTATS
248 views23 slides

More Related Content

More from JUSPSTATS

JUSP and COUNTER Release 5 - update by
JUSP and COUNTER Release 5 - updateJUSP and COUNTER Release 5 - update
JUSP and COUNTER Release 5 - updateJUSPSTATS
277 views19 slides
Getting started with JUSP by
Getting started with JUSPGetting started with JUSP
Getting started with JUSPJUSPSTATS
273 views28 slides
JUSP for further education by
JUSP for further educationJUSP for further education
JUSP for further educationJUSPSTATS
187 views30 slides
Update and Q&A by
Update and Q&AUpdate and Q&A
Update and Q&AJUSPSTATS
205 views21 slides
Data visualisations in JUSP by
Data visualisations in JUSPData visualisations in JUSP
Data visualisations in JUSPJUSPSTATS
290 views11 slides
Database and platform reports in JUSP by
Database and platform reports in JUSPDatabase and platform reports in JUSP
Database and platform reports in JUSPJUSPSTATS
293 views15 slides

More from JUSPSTATS(19)

JUSP and COUNTER Release 5 - update by JUSPSTATS
JUSP and COUNTER Release 5 - updateJUSP and COUNTER Release 5 - update
JUSP and COUNTER Release 5 - update
JUSPSTATS277 views
Getting started with JUSP by JUSPSTATS
Getting started with JUSPGetting started with JUSP
Getting started with JUSP
JUSPSTATS273 views
JUSP for further education by JUSPSTATS
JUSP for further educationJUSP for further education
JUSP for further education
JUSPSTATS187 views
Update and Q&A by JUSPSTATS
Update and Q&AUpdate and Q&A
Update and Q&A
JUSPSTATS205 views
Data visualisations in JUSP by JUSPSTATS
Data visualisations in JUSPData visualisations in JUSP
Data visualisations in JUSP
JUSPSTATS290 views
Database and platform reports in JUSP by JUSPSTATS
Database and platform reports in JUSPDatabase and platform reports in JUSP
Database and platform reports in JUSP
JUSPSTATS293 views
JUSP workshop - update and experience exchange by JUSPSTATS
JUSP workshop - update and experience exchangeJUSP workshop - update and experience exchange
JUSP workshop - update and experience exchange
JUSPSTATS315 views
JR2 and JR5 reports in JUSP by JUSPSTATS
JR2 and JR5 reports in JUSPJR2 and JR5 reports in JUSP
JR2 and JR5 reports in JUSP
JUSPSTATS460 views
Workshop manchester-june2016 by JUSPSTATS
Workshop manchester-june2016Workshop manchester-june2016
Workshop manchester-june2016
JUSPSTATS620 views
Workshop manchester-may2016-morning by JUSPSTATS
Workshop manchester-may2016-morningWorkshop manchester-may2016-morning
Workshop manchester-may2016-morning
JUSPSTATS319 views
Journal and ebook usage statistics with JUSP by JUSPSTATS
Journal and ebook usage statistics with JUSPJournal and ebook usage statistics with JUSP
Journal and ebook usage statistics with JUSP
JUSPSTATS330 views
JUSP for CPD25 eCollections Management workshop by JUSPSTATS
JUSP for CPD25 eCollections Management workshopJUSP for CPD25 eCollections Management workshop
JUSP for CPD25 eCollections Management workshop
JUSPSTATS774 views
5 ways to demonstrate value using usage statistics by JUSPSTATS
5 ways to demonstrate value using usage statistics5 ways to demonstrate value using usage statistics
5 ways to demonstrate value using usage statistics
JUSPSTATS1.5K views
JUSP at Brunel University by JUSPSTATS
JUSP at Brunel UniversityJUSP at Brunel University
JUSP at Brunel University
JUSPSTATS665 views
Knowledge Base+ and JUSP by JUSPSTATS
Knowledge Base+ and JUSPKnowledge Base+ and JUSP
Knowledge Base+ and JUSP
JUSPSTATS333 views
Value in numbers: A Shared Approach to Measuring Usage and Impact by JUSPSTATS
Value in numbers: A Shared Approach to Measuring Usage and Impact Value in numbers: A Shared Approach to Measuring Usage and Impact
Value in numbers: A Shared Approach to Measuring Usage and Impact
JUSPSTATS1.1K views
Making the most of JUSP 4th March - Afternoon by JUSPSTATS
Making the most of JUSP 4th March - AfternoonMaking the most of JUSP 4th March - Afternoon
Making the most of JUSP 4th March - Afternoon
JUSPSTATS174 views
University of Derby's use of JUSP by JUSPSTATS
University of Derby's use of JUSPUniversity of Derby's use of JUSP
University of Derby's use of JUSP
JUSPSTATS437 views
Newman University's use of JUSP by JUSPSTATS
Newman University's use of JUSPNewman University's use of JUSP
Newman University's use of JUSP
JUSPSTATS383 views

Recently uploaded

[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation by
[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation
[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented GenerationDataScienceConferenc1
13 views29 slides
Short Story Assignment by Kelly Nguyen by
Short Story Assignment by Kelly NguyenShort Story Assignment by Kelly Nguyen
Short Story Assignment by Kelly Nguyenkellynguyen01
19 views17 slides
[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptx by
[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptx[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptx
[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptxDataScienceConferenc1
5 views16 slides
UNEP FI CRS Climate Risk Results.pptx by
UNEP FI CRS Climate Risk Results.pptxUNEP FI CRS Climate Risk Results.pptx
UNEP FI CRS Climate Risk Results.pptxpekka28
11 views51 slides
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx by
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptxDataScienceConferenc1
5 views12 slides
TGP 2.docx by
TGP 2.docxTGP 2.docx
TGP 2.docxsandi636490
10 views8 slides

Recently uploaded(20)

[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation by DataScienceConferenc1
[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation
[DSC Europe 23] Spela Poklukar & Tea Brasanac - Retrieval Augmented Generation
Short Story Assignment by Kelly Nguyen by kellynguyen01
Short Story Assignment by Kelly NguyenShort Story Assignment by Kelly Nguyen
Short Story Assignment by Kelly Nguyen
kellynguyen0119 views
[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptx by DataScienceConferenc1
[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptx[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptx
[DSC Europe 23] Stefan Mrsic_Goran Savic - Evolving Technology Excellence.pptx
UNEP FI CRS Climate Risk Results.pptx by pekka28
UNEP FI CRS Climate Risk Results.pptxUNEP FI CRS Climate Risk Results.pptx
UNEP FI CRS Climate Risk Results.pptx
pekka2811 views
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx by DataScienceConferenc1
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
[DSC Europe 23] Zsolt Feleki - Machine Translation should we trust it.pptx
CRIJ4385_Death Penalty_F23.pptx by yvettemm100
CRIJ4385_Death Penalty_F23.pptxCRIJ4385_Death Penalty_F23.pptx
CRIJ4385_Death Penalty_F23.pptx
yvettemm1006 views
CRM stick or twist.pptx by info828217
CRM stick or twist.pptxCRM stick or twist.pptx
CRM stick or twist.pptx
info82821710 views
Ukraine Infographic_22NOV2023_v2.pdf by AnastosiyaGurin
Ukraine Infographic_22NOV2023_v2.pdfUkraine Infographic_22NOV2023_v2.pdf
Ukraine Infographic_22NOV2023_v2.pdf
AnastosiyaGurin1.4K views
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M... by DataScienceConferenc1
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
[DSC Europe 23] Milos Grubjesic Empowering Business with Pepsico s Advanced M...
CRM stick or twist workshop by info828217
CRM stick or twist workshopCRM stick or twist workshop
CRM stick or twist workshop
info8282179 views
Data Journeys Hard Talk workshop final.pptx by info828217
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptx
info82821710 views
Data about the sector workshop by info828217
Data about the sector workshopData about the sector workshop
Data about the sector workshop
info82821712 views
SUPER STORE SQL PROJECT.pptx by khan888620
SUPER STORE SQL PROJECT.pptxSUPER STORE SQL PROJECT.pptx
SUPER STORE SQL PROJECT.pptx
khan88862012 views
Cross-network in Google Analytics 4.pdf by GA4 Tutorials
Cross-network in Google Analytics 4.pdfCross-network in Google Analytics 4.pdf
Cross-network in Google Analytics 4.pdf
GA4 Tutorials6 views
Advanced_Recommendation_Systems_Presentation.pptx by neeharikasingh29
Advanced_Recommendation_Systems_Presentation.pptxAdvanced_Recommendation_Systems_Presentation.pptx
Advanced_Recommendation_Systems_Presentation.pptx

The role of usage data in informing decision making processes, engaging stakeholders and assessing value

  • 1. The role of usage data in informing decision making processes, engaging stakeholders and assessing value LauraWong, library analytics services analyst, Jisc 21/11/18
  • 2. Why use e-resource usage data? E-resource usage data provides… »evidence to back up decisions and support cases »metrics used in reporting and monitoring »additional source of information which then enables and supports… »informed collection development decisions »informed discussions »new insights and a different perceptive 21/11/18 UKSG E-Resources for Further Education 2
  • 3. Analysis and interpretation »Stats need to be interpreted to provide useful information »What is being counted?What is the unit of use? › click, download, search, view etc. »What does that count mean? › Add context › Make comparisons »Not used in isolation – usage data needs to be used alongside other data, information and knowledge 21/11/18 UKSG E-Resources for Further Education 3
  • 4. Informing decisions Purchasing and renewal decisions Cost-per-use or cost-per- download Trends Access denials What to buy, what to keep and what to cancel 21/11/18 UKSG E-Resources for Further Education 4
  • 5. Engaging stakeholders Building relationships with stakeholders Open dialogue with lecturers Inform discussions with suppliers Regular reporting to management 21/11/18 UKSG E-Resources for Further Education 5
  • 6. Feedback and evaluation Delivering the best service Under used titles Access issues High use titles 21/11/18 UKSG E-Resources for Further Education 6
  • 7. Impact and value Demonstrating impact and value Reporting Value of your service Making a case Evidence 21/11/18 UKSG E-Resources for Further Education 7
  • 8. JUSP case study »Regularly collected and monitored usage but asked could we make better use? »Systematic journals review › Identified low use titles for review › Calculated cost per use › Considered factors such as impact, subject, cost and format › Consulted with academics »Saved money and re-allocate budget to more relevant resources »https://jusp.jisc.ac.uk/docs/case5.pdf Using JUSP to improve collection management and strategy 21/11/18 UKSG E-Resources for Further Education 8
  • 9. JUSP 21/11/18 UKSG E-Resources for Further Education 9
  • 10. Practical challenges of working with usage data 21/11/18 UKSG E-Resources for Further Education 10 Challenges JUSP Collection – time and effort required to collect data Collects on behalf of libraries Single point of access Collation – time and effort required to process data for analysis Aggregates and summarises Supports Jisc Collections Consistency – reliability of data Standards based (COUNTER) Central point of contact, expertise and support Context – combining and matching with other information Export data Core journal titles and KB+ Usage profiling/benchmarking Communication – engaging others Community, support and training Data visualisations
  • 11. Further information about JUSP »Joining information - http://jusp.jisc.ac.uk/join/uk-academic-libraries/ »Can JUSP help? - http://jusp.jisc.ac.uk/docs/Can_JUSP_help.pdf »Use cases - http://jusp.jisc.ac.uk/use-cases/ »Case studies - http://jusp.jisc.ac.uk/case-studies/ »Video guides - http://jusp.jisc.ac.uk/screencasts/ »Webinars and slides - https://jusp.jisc.ac.uk/events-training/ › JUSP for further education - 16 Jul 2018 21/11/18 UKSG E-Resources for Further Education 11
  • 12. Contacts »help@jisc.ac.uk »Mention JUSP Any questions about JUSP »Contact your Jisc account manager »https://www.jisc.ac.uk/contact /your-account-manager Any other questions about Jisc and Jisc services 21/11/18 UKSG E-Resources for Further Education 12

Editor's Notes

  1. I work at Jisc on two services focused on usage data. JUSP which is a service that collects usage data on behalf of libraries, and IRUS which gathers repository usage. Today I will be drawing on my experience of working on JUSP and collages to get them set up in JUSP and speak to you about the role of e-resource usage data in libraries. In this presentation I will provide an overview of the range of ways libraries and LCRs are using usage data to ultimately improve their service.
  2. When we ask a library or Learning Resource Centre why they have started using JUSP or usage data more generally, the main drive is often around the need to provide evidence or be more data driven E-resource usage data provides evidence to back up decisions or support cases. Usage data can also be turned into metrics – things that you can report or using to monitor progress. Another reason for collecting usage data. And generally provides an additional source of information. But these are just numbers and figures. It what you do with the evidence, metrics and information that makes it really useful. The usage data then enables and support activities such… Informing your collection development decisions Informs your discussions with a range of stakeholders (from learners through to publishers). Having sight of user data will change the conversation you have with publishers or learners. They can offer new insights and a different perceptive – sometimes the usage shows you something unexpected and encourage you to ask questions.
  3. Simply collecting and viewing the usage statistics alone isn’t going to tell you what you need to know. One of the main considerations when viewing usage data is around interpretation. stats need to be interpreted to provide useful information – they need have meaning. First you need to understand what is being are counted. What is a unit of use? Usage statistics are essentially counts of events and activity. This could be a click, download, search or view or something else. There isn’t a single definition or metric for use. This means that usage is not always comparable. You need to make a decision about which metric to use. Then you need to analyse and interpret the data. What does this count mean? You can do this by adding context and making compassions Doesn’t need to be complicated, can be very simple. for example noting that you have had a subscription to a journal from a particular date. The comparison may be looking at the total for previous year. The key message is that usage data cannot be used in isolation.
  4. Informing purchasing and renewal decisions is the most common reason for collecting and analysing usage data for all sizes of library. Particularly if you are having to make tough budget decisions and you have to justifying spending. Cost per use common way of accessing value, particularly for journals but also other subscriptions based products. But this is just one metric for evaluation. Also interested in trends – over year or year on year. Is usage going up or down? Where there any unusual spikes or dips? Access denials – not really usage data but often supplied alongside. Counts number of times users attempt to access contact but are turned away. Indication of demand – provides evidence for new purchases. You can also use usages of products you already have to inform future purchases by looking at which types of products are well used.
  5. Some people can get defensive when usage stats are raised, but if presented in the right way and used in constructive conversation is can building relationships Stats can be a way of opening dialogue with new groups of people. A product it working for a course? Are learners doing their reading? And often you will need to consult with others before making any final discussions Having data to back you up will change the discussions with publishers and suppliers Regular reporting to management opens another communication channel and other conversations may follow
  6. Following on from that usage statistics can also be another form of feedback on how your service is working What isn’t being used? Why not? What needs to change? Are there any access issues? What’s used well? What’s working well? You may need to promote under used titles or you may need to look into
  7. While usage stats don’t directly indicate value or impact, alongside other information as part of a narrative it does provide supporting evidence For example in making a case to keep a product This can be for specific products, but also for your service as a whole
  8. Highlight a JUSP case study that looked at how a small higher education institution started making more use of their data. With a drive toward data driven decision making many libraries are taking a fresh look at what they are doing with the data they collect Stranmillis were regularly collecting and reviewing usage data but realised they weren’t making the best use of the information So they carried out a systematic review of their journal collection First they identified low use titles and then calculated the cost per use. They then considered other factors such as impact, subject and discipline, overall cost and the format. And then before making any decisions they consulted with academics As a result that they saved money and where able to use this to acquire more relevant set of databases that fitted with the curriculum and courses
  9. So far I have been speaking about role of usage data generally I would also like to briefly talk about the JUSP and where it fits into these wider processes JUSP is a service that collects standardised journal, book, database and platform usage reports on behalf of Jisc members JUSP collects and aggregates to help you report and analyse JUSP stands for Journal Usage Statistics Portal Books added 2016, databases/platforms added 2017
  10. JUSP aims to help manage some of the practical challenges of working with usage data JUSP helps with the burden of data collection so that you can focus more time and effort on analysis - Collection Collation – can also be time consuming to pull together into overviews so JUSP provides summary reports Consistency – JUSP is standards based and only gathers COUNTER compliant reports Context – institutions are best placed to understand their usage data, but JUSP can help with some of the processes of pulling info together e.g. all exportable, collaboration with KB+, some anonymised benchmarking Communication – can be a challenge and an opportunity – JUSP provides training and support to help with understanding JUSP provides reports and visualisations that help you quickly and easily access, report and analyse usage data
  11. Thank you for listening If you have any queries about JUSP come and speak to me or contact the team via the helpdesk If you have any questions about Jisc or Jisc services you can contact you account manager