Getting the Most Out of Your E-Resources: Measuring SuccessPresentation Transcript
Getting the Most Out of Your E-Resources: Measuring Success Todd Carpenter Managing Director, NISO
Where are we headed this afternoon?
A bit about NISO
Overview of usage measurement of e-resources
COUNTER & SUSHI
The application of usage data
Issues and concerns with use data
A glimpse into the future
What is NISO?
NISO - National Information Standards Organization
NISO is the only ANSI-accredited organization tasked with the development of standards in the field of Information and Documentation
Work with publishers, libraries, agents and other systems vendors to develop community consensus
Develop wide range of standards
Paper permanence and steal shelving
Bibliographic formats and exchange
Web-based delivery, OpenURL, Metasearch, SUSHI
Big Challenges, Modest Resources
Revenue: $900K, up 20% in 2007
Primary income: Member dues (60%)
Other income: Seminars, Publishing (20%)
New sources of revenue in 2007 - Grants
Mellon $196K, IMLS - $24K (20%)
Staff: 4 Professional full-time
Virtual staff: 10+ (Consultants, Partners)
83 Voting Members, 25 LSA members as of 2007
Maintenance Agencies: 12
Volunteers: 300+ spread out across the world
Standards – Why should I care?
Standards accelerate production, ordering/sales, dissemination, locating, storing and preserving information
Key standards which NISO has developed and helping to bring consensus around
ISSN, OpenURL, Z39.50, NCIP
In development: DOI, SUSHI, SERU, LEWG
In planning: Institutional ID, Performance Measures, OpenURL Expansion,
Certainly, there’s a lot of data
The difference between meaningless and meaningful data is APPLICATION
The Early Days of E-Resources
Thinking back to 1998 - Many open questions
How do you record traffic?
What is a hit?
Is a hit different than a download?
What about reloading?
What about images and links?
What should a report include?
Eventually, counting different versions of texts
How often do you need to provide stats
Traffic to abstracts, TOCs or other elements?
Content over multiple pages?
Slow development of consensus
ICOLC - Guidelines for Statistical Measurement of Usage of Web-Based Information Resources
Released in 1998, updated in 2000
Minimum Requirements– Data elements, timeframe, etc
National Commission on Libraries and Information Science (NCLIS) Electronic Access and Use-Related Measures
Released in 2001
ANSI/NISO Z39.7: 2004 - Information Services and Use Metrics & Statistics for Libraries and Information Providers -- Data Dictionary
Technical Committee 46 - Information and Documentations, SC 8 - Statistics and Performance Indicators
ISO 2789: 2006 Information and documentation -- International library statistics
ISO 11620: 1998 Information and documentation -- Library performance indicators
COUNTER (Counting Online Usage of NeTworked Electronic Resources)
Formed in 2002
Membership organization (as of 3/15/08)
Industry Organizations - 13
Library Consortia - 62
Libraries - 84
Publishers - 66
Establishes Codes of Practice on the gathering, compiling and storage of publishing usage data
COUNTER Codes of Practice
Specifications for Usage Reports
What they should include
What they should look like
How and when they should be delivered
Data processing guidelines
Auditing (New in 2006)
Maintenance and development of the Codes of Practice
Governance of COUNTER
COUNTER: Current Codes of Practice
1) Journals and databases
Release 1 Code of Practice launched January 2003
Release 2 replaced Release 1 in January 2006
Release 3 under consideration - to include SUSHI compliance and consortia reporting
Now a widely adopted standard by publishers and librarians
60%+ of Science Citation Index articles now covered
2) Books and reference works
Code of Practice for Books was launched March 2006
Relevant usage metrics less clear than for journals
Different issues than for journals
Direct comparisons between books less relevant
Understanding how different categories of book are used is more relevant
Journal Report 1 Example
Need for easier access to usage data
As a community, we need to reduce the time and effort necessary to collect, format and compile usage data
“ Time for meaningful analysis is compromised by the time required just to gather and record the statistics.”
Median percentage of time spent on analysis is only 25 percent
More than half of the time is spent on gathering and formatting
Average number of hours spent working on usage data is 96 hours, but ranged on the high end up to 1-2 FTEs entirely focused on data
Usage reports to help them make subscription decisions (94%) and justify expenditures (86%) for their electronic resources
DATA FROM: Gayle Baker, Eleanor J. Read, Vendor Usage Data for Electronic Resources: A Survey of Libraries http://smartech.gatech.edu/handle/1853/13611
One example of the need
One university with more than 75 online resources from which they draw usage data
They have a 80-page booklet containing the details of how to access and gather usage data!
How much time does it take not just compiling and maintaining this notebook, but even just going through it?
Need: Simplify and automate the gathering of usage data for librarians
Librarians spending months gathering data
Server/Client system to exchange COUNTER reports
Easily incorporated into usage systems (on publisher side) or into ERM (on library side)
Client calls to server, asks for report, and server runs the report and sends it on
Data exchange is taking place by machine talking with machine
Content Provider Library SUSHI Server Usage Data SUSHI Client Internet ERM SUSHI is a Web Service which sends an XML request to a content provider to obtain an XML response containing the usage report. ? Response COUNTER Request SOAP Slide courtesy of Oliver Pesch, EBSCO Information Services, Co-Chair SUSHI
SUSHI: Where now, where to?
Passed unanimously by NISO membership in September, 2007
Formally approved as ANSI/NISO Z39.93:2007
Working toward broad ADOPTION
Ask that it be included in your ERM solution
Demand your content providers become SUSHI and COUNTER (rev 3) compliant
Talk to your vendors and your consortia
Careful the conclusions you draw
What is the most used resource?
BioOne’s most viewed article
The nest architecture of the Florida harvester ant, Pogonomyrmex badius
Walter R. Tschinkel
“ Coolest images on the net”
Link Prefectching affecting data?
Link prefetching is a browser mechanism, which utilizes browser idle time to download or prefetch documents that the user might visit in the near future.
Based on previous use data, the site provides a set of prefetching hints to the browser, and after the browser is finished loading the page, it begins silently prefetching specified documents and stores them in its cache.
When the user visits a prefetched document, it can be served up quickly out of the browser's cache.
Source: Mozzila .org
User Interface Issues Affecting Data?
How a publisher system is designed could affect reported usage