The document provides information about the COUNTER initiative for consistently reporting online usage statistics. It discusses how libraries use COUNTER reports to diagnose access problems, inform decisions, and create metrics. Specific COUNTER reports like JR1 and DB1 are explained which provide statistics on full-text article requests and database searches. The document also reviews how to analyze COUNTER data by considering parameters, looking for patterns and outliers, and contextualizing numbers. Beyond COUNTER statistics, it notes other metrics vendors provide for items like books, music, videos, and images.
2. Counting Online Usage of NeTworked Electronic Resources
Standard for consistent reporting of usage data across
platforms and format types
An international initiative, launched March 2002
Regularly updated
Now on Release 4 of the COUNTER Code of Practice for e-
Resources
Introduction to COUNTER
3. Diagnose access problems
Inform decisions
Create metrics (e.g. cost
per use)
ARL reports
How do libraries use COUNTER?
4. JR1 = Number of successful full-text article requests by month
and journal
JR5 = Number of successful full-text article requests by year of
publication and journal
DB1 = Total searches, result clicks and record views by month
and database
BR1 = Number of successful title requests by month and title
BR2 = Number of successful section requests by month and
title
COUNTER: Access Reports
5. JR2 = Access denied to full-text articles by month, journal,
and category
DB2 = Access denied by month, database and category
BR3 = Access denied to content items by month, title and
category
BR4 = Access denied to content items by month, platform,
and category
COUNTER: Turnaway Reports
13. Total Searches, Result Clicks, and Record Views by Month
and Database
Database Report 1 (DB1)
14.
15.
16.
17. Full stats collected twice a year
Half-year report (Jan-June) collected in July/Aug
Full year report (Jan-Dec) collected in Jan/Feb
Stored on Library site for self-service use
Custom stats run on request
Email Zhongren Lin and Angela Sidman
Sent directly to requestor
COUNTER at Yale
21. Consider parameters
What report am I reviewing?
What date range is covered?
Look for patterns
Are there any outliers in these numbers?
Working with COUNTER data
25. Interrogate the numbers
JR2: Access Denied to Full-text Articles
by Month, Journal and Category
Journal Report 2 (R4)
Yale University
Period covered by Report:
2013-01-01 to 2013-12-31
Date run:
2015-03-02
Journal Access Denied Category
Reporting
Period Total Jan-2013 Feb-2013 Mar-2013 Apr-2013 May-2013 Jun-2013 Jul-2013 Aug-2013 Sep-2013 Oct-2013 Nov-2013 Dec-2013
Journal of Employment Counseling
Access denied: content item not
licenced 0 0 0 0 0 0 0 0 0 1 0 1
Journal of Engineering Education
Access denied: content item not
licenced 33 0 2 2 0 1 2 13 2 5 2 2 2
Journal of Evidence‐Based Medicine
Access denied: content item not
licenced 34 0 0 5 5 7 3 12 0 0 0 1 1
Journal of Flood Risk Management
Access denied: content item not
licenced 16634 1 0 2 3 1 16615 0 6 4 2 0 0
26. Consider parameters
What report am I reviewing?
What date range is covered?
Look for patterns
Are there any outliers in these numbers?
Contextualize the data
Bring in price information
Consider outside events like security breaches or platform
changes
Look for meaningful comparisons with a similar product
Working with COUNTER data
27. Cost-per-use example
Databases
2011/12 cost
2011 usage
(projected*)
Year 1 cost/use 2012/13 cost 2012 usage Year 2 cost/use
2013/14 cost
2013 usage
Year 3 cost/use
Total Searches Run $15,720 252 $62.38 $16,349 413 $39.59 $17,003 238 $71.44
Total Sessions $15,720 82 $191.71 $16,349 66 $247.71 $17,003 605 $28.10
Books
2011/12 cost
2011 usage
(projected*)
Year 1 cost/use 2012/13 cost 2012 usage Year 2 cost/use
2013/14 cost
2013
(projected**) Year 3 cost/use
Successful section requests $15,720 665 $23.64 $16,349 336 $48.66 $17,003 14 $1,214.50
*We only have 2011 usage data for both books and databases for August through December; I’ve projected it out for the entire year.
*We only have 2013 usage data for books for January through August; I’ve projected it out for the entire year.
30. Counts every time a Yale user
checks out a book.
WHO: User status is recorded
(Undergrad, Grad, Faculty)
WHEN: Date & time of
transaction
CIRCULATION
Counts every time a Yale user
accesses a book (BR1) or a
section(BR2).
WHO: User is from Yale (on
campus or on VPN)
WHEN: Monthly and annual
totals
COUNTER (BR1 / BR2)
Books: COUNTER & CIRCULATION
33. 0
1,000
2,000
3,000
4,000
5,000
6,000
7,000
8,000
9,000
10,000
Naxos - 2013
Tracks Played Logins
Recordings
Naxos Music Library
Music Online
(Alexander Street Press)
American Song
Classical Music Library
Contemporary World
Music
Smithsonian Global
Sound
Beyond COUNTER…
Vendors with content offering is not currently compatible with COUNTER initiative.
34. Video
Digital Theatre Plus
Lynda.com
Met Opera on
Demand
Naxos Video
Library
Theatre in Video
Beyond COUNTER…
Vendors with content offering is not currently compatible with COUNTER initiative.
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
16,000
Jan-13
Feb-13
Mar-13
Apr-13
May-13
Jun-13
Jul-13
Aug-13
Sep-13
Oct-13
Nov-13
Dec-13
Jan-14
Feb-14
Mar-14
Apr-14
May-14
Jun-14
Jul-14
Aug-14
Sep-14
Oct-14
Nov-14
Dec-14
Lynda.com
Views Distinct Videos Viewed Accounts
36. Consider parameters
What report am I reviewing?
What date range is covered?
Look for patterns
Are there any outliers in these numbers?
Contextualize the data
Bring in price information.
Consider outside events like security breaches or platform changes.
Look for meaningful comparisons with a similar product.
Ask questions
Can’t explain it? Ask for an explanation.
COUNTER Report Analysis Checklist
Angela
Three Codes of Practice:
CoP for E-resources. Release 4 valid from Jan. 2014 onward
CoP for Articles. Valid from March 2014 onward
CoP of Usage Factors
Angela
Angela
Angela
Excel usage examples available at: http://www.projectcounter.org/code_practice.html
Sarah
Sarah
Journal Report 1 – Number of successful title requests by month & title
From COUNTER Compliance – A step by step Guide for Vendors
Sarah
Cell is the most popular journal on the Elsevier ScienceDirect platform.
Sarah
Book Report 1 – Number of successful title requests by month & title
“This report applies only to those titles where the entire title may only be requested by customers as a single file, as opposed to by individual sections, in which case Book Report 2 applies”
From COUNTER Compliance – A step by step Guide for Vendors
Sarah
Example – Dictionary of Diplomacy (Palgrave Connect)
A title view is recorded when you go to the title and interact – either using the web viewer or when you select a download option. You could be there for a few seconds, or spend an hour with the title – the system record the first interaction.
Sarah
Book Report 2 – Number of successful section requests by month & title
“this report applies to all book titles not covered by Book Report 1. A Section is a subdivision of a book or reference work (eg a chapter or encyclopaedia entry), which is the next organizational level down from the complete title. ”
From COUNTER Compliance – A step by step Guide for Vendors
Sarah
Example: Venceremos – The Erotics of Black Self-Making in Cuba (Project MUSE)
A section view is recorded every time someone downloads a PDF chapter.
Sarah
Database Report 1 (DB1)
“this report applies to all book titles not covered by Book Report 1. A Section is a subdivision of a book or reference work (eg a chapter or encyclopaedia entry), which is the next organizational level down from the complete title. ”
From COUNTER Compliance – A step by step Guide for Vendors
Sarah
Sarah
Sarah
Angela
Angela
Julie
For example, for Gale, the usage statistics site has JR, DB, and BR reports. You may need to open them up to see in which report a particular product is counted. Note that not all COUNTER reports are posted to the usage statistics site – but you can always request those.
Look at 3 years to get a feel for usage trends – increasing, holding steady, decreasing? Factors such as growth in the amount of content (more titles?) and cost changes are relevant.
Julie
In fact, Gale counts ECCO in two places. The database report provides search and record views info, while the book report provides section request info. (The section requests in BR2 does not equal the record views in DB1 – but it’s close!)
You might ask of DB1 – why so few result clicks?
Julie
We just saw what seems to be an outlier in the Gale data. Maybe we don’t worry about the “result clicks” number too much, because we have several other metrics that add up to a consistent picture of use. It’s helpful to understand the patterns so that you know an outlier when you see one.
Julie
Julie
Vogue – what do you think explains the September 2013 spike in Vogue usage?
Julie
It’s OK to set the outliers aside to get a truer picture of usage patterns.
Julie
Categories are: content item not licensed
simultaneous/concurrent user license limit exceeded
JR2 report for Wiley journals, 2013. You might look at the denial number for Journal of Flood Risk Management and think: “whoa, we have to subscribe to that!”
We asked Wiley about that outlier. They were able to look at what IP addresses were attempting to access the journal. Their reply was: ““the denials seem to come from a small a few IPs centered around 130.132 which YALE have registered on their account therefore either the customers Ips were hacked or someone has run a crawler. I would discard this usage as it is too inflated to be done be a real person.”
Julie
“Sage Research Methods Online.” Nathan Rupp calculated cost per use on three years of usage data (although he had to do projections for two of those years). Both DB and BR reports were available, so he used both. We checked to make sure the resource was discoverable – e.g., in Orbis, were there title-level records for the SRMO books? (There were.) This was a cost-shared database, so consultation with CSSSI. Decision to cancel.
Julie
Sarah
Sarah
Sarah
Sarah
Ebrary provides a variety of alternate statistics. By maintaining these proprietary statistics, we have data back to the beginning of the product. The COUNTER data collection did not start until 2009.