Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage

•Download as PPTX, PDF•

1 like•1,867 views

McDonald, John, Jason Price, and Michael Levine-Clark, “Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage,” Plenary. UKSG Annual Conference, Harrogate, U.K., April 16, 2014.

Education Business

Discovery or Displacement?
A Large-Scale Longitudinal Study of the
Effect of Discovery Systems on Online
Journal Usage
UKSG
Harrogate
April 16, 2014
Michael Levine-Clark, University of Denver
John McDonald, University of Southern California
Jason Price, SCELC Consortium
http://tinyurl.com/pg686r4

Does implementation of a discovery
service impact usage of publisher-
hosted journal content?

Publisher-hosted journals are
only part of the picture
eBooks, pBooks, aggregator journal content,
etc.
publisher journal content
The six publishers in this study

What did we measure?
• Whether there is an
effect
• NOT why that effect
exists (that’s a future
study!)

Data collection
• List of libraries with discovery services
> Searched on lib-web-cats
• Surveyed Libraries
> Discovery service Implemented
> Implementation Date (month/year)
> Search box location
> Marketing effort
• 149 Libraries Gave Approval
> 33 libraries selected for this phase
> 6 for each of the 4 major discovery services and a
group of 9 libraries with no service

Dataset• 33 Libraries
– 28 US, 2 CA, 1 each from UK, AUS, NZ
– WorldCat book holdings
> Average: 1,114,193 ; Range: ~300k to ~2.6mil
• Implementation dates (Discovery Libraries):
> 2010 (3), 2011 (19), 2012 (2)
• 6 Publishers
• 9,206 Journals
• 163,545 Usable Observations

Methodology
Compared COUNTER JR1 total full text article views for the
12 months before vs 12 months after implementation date
June2010Start
Implementation
May2011
May2012
End
Year 1 Year 2
Included implementation month in Year 1 to ensure that
both periods included an entire academic year

Journals by Library & Service
5327
3262
5328
6294
4384

Average Usage Change By Discovery & Publisher
Per Journal &
Per 10,000 FTE

Full Model
Including Discovery Service, Publisher, and Library
Including Discovery Service, Publisher, and Library

Testable Effects
• Discovery Tool
– Implemented by multiple libraries
– Used to find content from all publishers
• Publisher
– Accessible in all discovery tools
– Accessible across multiple libraries
• Library
– Uses content from multiple publishers
– Uses only one discovery tool (so only within DT)

Nested ANOVA Model
[all three factors – preliminary results]

Does usage change vary across libraries?
Institution (sorted by Mean Change)

Does usage change vary across libraries using the same service?
Library 10-15 Library 16-21 Library 22-27 Library 28-33Library 1-9

Does usage change vary across publishers?
Publisher (sorted by Mean Change)
B
AAA A A

Does usage change vary across discovery services?
A
BB
C
D

Publisher
Does the effect of discovery service differ across publishers?

Results
Can we detect differences between Discovery
Services, Publishers, and/or Libraries and/or
their interactions?
• Library – Yes
• Publisher – No
• Discovery Service – Yes
• Differential discovery service effect by
publisher – Yes

Next Steps
• Design & test for effects of:
– Aggregator full text availability
– Publisher Size
– Journal Subject
– Overall usage trends
– Configuration options in Discovery services
• Expand pool of libraries
• Perhaps explore WHY

Past Presentations
• Ithaka Sustainable Scholarship Conference (October 2013)
• Charleston Conference (November 2013)
• ER&L/Library Journal Webinar (December 2013)
• Shangai Jiao Tong Univ / Beijing Univ (Jan 2014)
• SCELC Colloquium (March 2014)
• ER&L (March 2014)
• Presentations posted on slideshare :
– http://visualcv.com/lpq4t1s
– http://tinyurl.com/pg686r4
michael.levine-clark@du.edu | johndmcd@usc.edu | jason@scelc.org

This document summarizes a major longitudinal study examining the effect of web-scale discovery services on online journal usage. The study analyzed usage data from 33 academic libraries across multiple discovery service platforms and publishers. Preliminary results found statistically significant differences in journal usage changes between libraries and across different discovery services. The study aims to help libraries and publishers better understand the impact of discovery services on accessing online content.

Levine-Clark, Michael, “Measuring Discovery: The Impact of Discovery Systems ...

Michael Levine-Clark

Discovery impact erl2014

Jason Price, PhD

This document summarizes a study on the impact of discovery services on usage of publisher-hosted journal content. The study analyzed usage data from 33 academic libraries before and after implementing a discovery service, finding that usage generally increased after implementation. However, the degree of impact varied between discovery services, publishers, and individual libraries. While discovery services were found to significantly increase usage overall, the effect differed depending on the specific publisher and service used. Further analysis is needed to understand the factors influencing these differences in impact.

Discovery or Displacement? A Large Scale Longitudinal Study of the Effect of ...

Jason Price, PhD

This document summarizes a large scale longitudinal study examining the effect of discovery systems on online journal usage. The study analyzed journal usage data from 24 academic libraries before and after implementing a discovery service. It found that while some publishers saw an increase in usage and some saw a decrease, the change in usage varied significantly depending on both the discovery service and the individual library. The study utilized ANOVA models to determine that discovery service, library, and the interaction between discovery service and publisher were significant predictors of changes in journal usage. The results indicate the effect of discovery systems on usage is complex and depends on multiple factors.

Discovery or Displacement?: A Large Scale Longitudinal Study of the Effect of...

John McDonald

The document describes a large-scale study analyzing the effect of discovery systems on online journal usage across multiple libraries and publishers. Statistical analyses were conducted to determine if observed differences in journal usage before and after implementing discovery services were significant. The analyses found that while the impact varied, discovery service, publisher, and library were all significant predictors of usage change. Specifically, the interaction between discovery service and publisher significantly impacted usage. The study suggests analyzing journal usage is complex with many factors requiring control.

Discovery or Displacement?: A Large Scale Longitudinal Study of the Effect of...

Michael Levine-Clark

Levine-Clark, Michael, John McDonald, and Jason Price, "Discovery or Displacement?: A Large Scale Longitudinal Study of the Effect of Discovery Systems on Online Journal Usage," Charleston Conference, November 7, 2013. Plenary session for Charleston Conference 2013. Authors: Michael Levine-Clark, John McDonald, Jason Price. In this first large scale study of the effect of discovery systems on electronic resource usage, the authors present initial findings on how these systems alter online journal usage by academic library researchers. The study examines usage of content hosted by four major academic journal publishers at 24 libraries that have implemented one of the major discovery systems, EBSCO's EDS, Ex Libris' Primo, OCLC's Worldcat Local, or SerialsSolutions’ Summon. A statistically rigorous comparison of COUNTER-compliant journal usage at each library from the 12 months before and after implementation will determine the degree to which usage rises or falls after discovery tool implementation and address rumors that discovery tools differ in their impact on electronic resource usage.

Discovery study detailed results 2014 december

Michael Levine-Clark

1. A study analyzed the impact of four discovery services on journal article usage across six publishers and 33 libraries over two years. 2. The study found that every discovery service increased journal usage compared to the control group, but the size of the increase differed between services and across libraries and publishers. 3. Usage changes were influenced by factors like library configurations, metadata quality, and availability of full text in aggregators. More research is needed on how discovery impacts other content types and why certain results occurred.

Alternative Avenues of Discovery: Competition or Potential

Jason Price, PhD

The document discusses alternative avenues of discovery for libraries, focusing on three emerging examples that correspond to the themes of reaching out, providing intuitive services, and gaining insights from analytics. The first example is Libhub via Zepheira, which uses linked data to extend library catalogs onto the web. The second is 1science Open Access Solutions, which expands discoverable content by making institutional repository publications freely available. The third is Yewno's inference engine, which supports discovery by revealing connections between concepts based on underlying scholarly content.

A recent bibliometrics study found that 54% of 4.6 million scientific papers from peer-reviewed journals indexed in Scopus during the years 2011-2013 could be downloaded for free on the internet in April of 2014 (Archambault, et al. 2014). As time rolls on, authors and researchers are increasingly using more-and-less legal scholarly article sharing services to "take back the literature," or even just to access it more conveniently (Bohannon, 2016). The objective of this study was to evaluate a manageable sample of journal articles across the sciences, social sciences and humanities for their availability in gold, green and rogue open access forms, including ResearchGate and Sci-Hub. Attendees will gain a greater appreciation of the extent of open access availability through Google Scholar, Google and commercial discovery systems, and will be challenged to roll with the times by expanding the role of libraries in broadening access to the freely available literature.

UKSG webinar - Impact of Library Discovery Technologies (Spezi)

UKSG: connecting the knowledge community

In November 2013, UKSG published a UKSG and Jisc-funded research project “Impact of Library Discovery Technology” that evaluates the impact of library discovery technologies, specifically Resources Discovery Systems, on the usage of academic content. The report provides a wealth of useful information and a practical set of recommendations for actions that libraries, publishers and others in the academic information supply chain should take to engage with such technologies to best support the discovery of resources for teaching, learning and research. Valérie Spezi discussed the key findings of the report and the implications of these findings for librarians, publishers and content providers, RDS suppliers and other national and international organisations with an interest in the information chain.

GWAS and DAS

Verena139

This document discusses mining data availability statements from publications in Europe PMC to find statements about genomic data from genome-wide association studies (GWAS). It describes how the GWAS Catalog contains over 4,000 publications and 7,600 studies linking genetic variants to traits. Machine learning has improved the efficiency of identifying relevant publications for the catalog compared to manual searching. Data availability statements commonly mention making data publicly available in repositories like dbGaP and EGA which are cited in millions of publications.

A review of Open Access publishing in Poland and Eastern Europe – a study by...

Platforma Otwartej Nauki

A Decade of Discovery: What We Know and Where We Will Go

Charleston Conference

1) The document summarizes a decade of research at the University of Illinois at Urbana-Champaign Library on user search behavior and the effectiveness of different discovery systems. 2) Analysis of transaction logs from the library's Easy Search system showed that between May and June 2014, 15,068 searches led users to the Primo discovery system. 3) A sample of 473 of these searches found that Primo and databases like EBSCO, Scopus, and CrossRef were generally effective at retrieving known items, but that different systems were better for different types of searches.

It’S Been Geometric! Genco Ppt For Ifla Session212 Final

bgenco

BioDiscovery: Advanced Open Access Journal in Life Sciences and Medicine

Pensoft Publishers

Feedback from the NMFP on Member States actions

European Center for Disease Prevention and Control (ECDC)

Sju ifla presentation patron driven acquisitions of e-journal articles-1

mamboxena

The document discusses the use of patron-driven acquisitions (PDA) of ejournal articles as an alternative to large "Big Deal" subscription packages. It describes how St. John's University Libraries in New York implemented a PDA program through Wiley-Blackwell, purchasing article tokens to provide access to a wider range of journals. An analysis found that 50% of accessed articles were from non-subscribed journals, demonstrating PDA increased access while saving 40% of costs compared to the previous Big Deal subscription. The document also discusses challenges encountered and opportunities for improvements in PDA programs.

NISO Open Discovery Initiative January 2019

National Information Standards Organization (NISO)

The Open Discovery Initiative (ODI) aims to improve library discovery services by standardizing how content providers participate in those services. The ODI Standing Committee is working on revising recommended practices to address issues like ensuring content coverage is disclosed, fair linking between discovery and content, and providing meaningful usage statistics. The committee is also conducting surveys of libraries and content providers to understand barriers to participation and ensure all stakeholder needs are addressed. The goal is to make content more discoverable through these services while providing transparency around what is included.

NISO Altmetrics Initiative, ALA Update January 21, 2017

National Information Standards Organization (NISO)

Pda charleston 2010: Patron-Driven Acquisition of Monographs

Michael Levine-Clark

This document summarizes presentations from the 2010 Charleston Conference on patron-driven acquisition (PDA) of ebooks. It discusses: 1) Results from the University of Denver's PDA program with EBL, which saw over 1,400 short-term loans of ebooks, saving the university over $226,000 compared to purchasing all browsed titles. 2) A survey of university presses that found over half were unfamiliar with their library's PDA activities and most believed PDA could negatively impact monograph sales and their ability to forecast sales. 3) Challenges in budgeting, maintaining collections, and rethinking interlibrary loan models under PDA discussed by presenters.

Building better collections: Demand-Driven Acquisition as a Strategy for Mono...

Michael Levine-Clark

Michael Levine-Clark presented on demand-driven acquisition (DDA) as a strategy for building monographic collections. He discussed how DDA allows libraries to provide access to a much larger collection by only paying for content that is used, matching acquisitions to immediate demand. The University of Denver implemented a DDA program through EBL in 2010 that has expanded access while spending less than traditional purchasing models. DDA provides both challenges and opportunities for managing the consideration pool and defining the long-term collection.

From Archive to Gateway: The Evolution of the Research Library

Michael Levine-Clark

Levine-Clark, Michael, “Diving into E-Book Usage: ALA Update

Michael Levine-Clark

Levine-Clark, Michael and Rebecca Seger, “Reaching Sustainable Models for E-B...

Michael Levine-Clark

Buy Only What You Need: Demand-Driven Acquisition as a Strategy for Academic ...

Michael Levine-Clark

The document summarizes the University of Denver's implementation of demand-driven acquisition (DDA) for ebooks and print books. It discusses data showing a high percentage of unused books purchased under the previous just-in-case model. The new DDA model allows books to be purchased only after a certain number of uses or short-term loans, reducing unnecessary spending. The transition involves setting up plans with ebook vendors EBL and YBP to provide access and integrate purchasing workflows with the library system. Assessment of the new model will examine use data and purchasing patterns over time.

Levine-Clark, Michael, and Barbara Kawecki, “NISO’s Initiative for Best Pract...

Michael Levine-Clark

The document outlines recommendations from the NISO DDA Working Group for demand-driven acquisition of monographs. It recommends establishing goals for DDA programs, choosing content and models, profiling criteria, loading and removing records, assessment, preservation, and consortial and public library DDA. The working group gathered information over two years from surveys and interviews with libraries, publishers, vendors and aggregators. A final report with the recommendations was open for public comment until April 2014.

Building Better Collections on Demand: DDA at the University of Denver

Michael Levine-Clark

This document discusses demand-driven acquisition (DDA) at the University of Denver (DU). It summarizes DU's experience with DDA programs like netLibrary and EBL. Some key points: - DDA allows DU to provide a much broader collection by matching acquisitions to immediate demand through short-term loans and purchase-on-demand. - Through EBL, DU was able to provide access to over 10,000 ebook titles while spending less per transaction than anticipated list prices. - DU aims to expand its multi-format DDA model to include more vendors and formats like print-on-demand. - Long-term, DU hopes to maintain a permanent collection through DDA while

Prospective Collection Development: Impacts on Library Collaboration

Michael Levine-Clark

Levine-Clark, Michael, “Questioning Assumptions: E-Book Usage on a Global Sca...

Michael Levine-Clark

Levine-Clark, Michael, “Analyzing and Describing Collection Use to Inform Sto...

Michael Levine-Clark

What's hot

Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...

Jason Price, PhD

UKSG webinar - Impact of Library Discovery Technologies (Spezi)

UKSG: connecting the knowledge community

GWAS and DAS

Verena139

A review of Open Access publishing in Poland and Eastern Europe – a study by...

Platforma Otwartej Nauki

A Decade of Discovery: What We Know and Where We Will Go

Charleston Conference

It’S Been Geometric! Genco Ppt For Ifla Session212 Final

bgenco

BioDiscovery: Advanced Open Access Journal in Life Sciences and Medicine

Pensoft Publishers

Feedback from the NMFP on Member States actions

European Center for Disease Prevention and Control (ECDC)

Sju ifla presentation patron driven acquisitions of e-journal articles-1

mamboxena

NISO Open Discovery Initiative January 2019

National Information Standards Organization (NISO)

NISO Altmetrics Initiative, ALA Update January 21, 2017

National Information Standards Organization (NISO)

What's hot (11)

Access to Freely Available Journal Articles: Gold, Green, and Rogue Open Ac...

UKSG webinar - Impact of Library Discovery Technologies (Spezi)

GWAS and DAS

A review of Open Access publishing in Poland and Eastern Europe – a study by...

A Decade of Discovery: What We Know and Where We Will Go

It’S Been Geometric! Genco Ppt For Ifla Session212 Final

BioDiscovery: Advanced Open Access Journal in Life Sciences and Medicine

Feedback from the NMFP on Member States actions

Sju ifla presentation patron driven acquisitions of e-journal articles-1

NISO Open Discovery Initiative January 2019

NISO Altmetrics Initiative, ALA Update January 21, 2017

Viewers also liked

Pda charleston 2010: Patron-Driven Acquisition of Monographs

Michael Levine-Clark

Building better collections: Demand-Driven Acquisition as a Strategy for Mono...

Michael Levine-Clark

From Archive to Gateway: The Evolution of the Research Library

Michael Levine-Clark

Levine-Clark, Michael, “Diving into E-Book Usage: ALA Update

Michael Levine-Clark

Levine-Clark, Michael and Rebecca Seger, “Reaching Sustainable Models for E-B...

Michael Levine-Clark

Buy Only What You Need: Demand-Driven Acquisition as a Strategy for Academic ...

Michael Levine-Clark

Levine-Clark, Michael, and Barbara Kawecki, “NISO’s Initiative for Best Pract...

Michael Levine-Clark

Building Better Collections on Demand: DDA at the University of Denver

Michael Levine-Clark

Prospective Collection Development: Impacts on Library Collaboration

Michael Levine-Clark

Levine-Clark, Michael, “Questioning Assumptions: E-Book Usage on a Global Sca...

Michael Levine-Clark

Levine-Clark, Michael, “Analyzing and Describing Collection Use to Inform Sto...

Michael Levine-Clark

Purchasing Articles on Demand: Implications for Libraries and Publishers

Michael Levine-Clark

Levine-Clark, Michael, “eBooks’ Impact on Print: A Library Perspective,” Invi...

Michael Levine-Clark

Levine-Clark, Michael, “eBooks’ Impact on Print: A Library Perspective,” Invited. Transforming Libraries for an Enriching Community, Jiao Tong University, Shanghai, January 6, 2014. Levine-Clark, Michael, “eBooks’ Impact on Print: A Library Perspective,” Invited. Transforming Libraries for an Enriching Community, Beijing University, Beijing, January 9, 2014. This is the English version. The Chinese/English version is available via my Slideshare account as well

Reinventing the library collection through demand-driven acquisition

Michael Levine-Clark

Academic Library Monograph Collections and Mobile Technology: Trends and Oppo...

Michael Levine-Clark

Levine-Clark ebooks

Michael Levine-Clark

eBooks as Textbooks: Implications for Libraries and Publishers

Michael Levine-Clark

Is Demand-Driven Acquisition Ready for Prime TIme?

Michael Levine-Clark

This document summarizes a presentation on demand-driven acquisition (DDA) given at the Charleston Conference in 2011. It defines DDA and patron-driven acquisition (PDA) and discusses why libraries are adopting these models. Data is presented showing the decline in print book purchases and rise in ebook purchases. The presentation addresses challenges in DDA like availability of ebooks from publishers and how a multi-format DDA model could work to expand collections on demand within budget constraints.

Discovery or Not?发现与否？A Major Longitudinal Study of the Effect of Web-Scale ...

Michael Levine-Clark

Levine-Clark, Michael, John McDonald, and Jason Price, “Discovery or Not? A Major Longitudinal Study of the Effect of Web-Scale Discovery Services on Online Journal Usage,” Invited. Transforming Libraries for an Enriching Community, Beijing University, Beijing, January 9, 2014. Discovery or Not?发现与否？A Major Longitudinal Study of the Effect of Web-Scale Discovery Services on Online Journal Usage网络规模发现系统对在线期刊使用的影响的重要纵向研究 Transforming Libraries for an Enriching Community “蜕变：为不断发展的学术界打造全新的图书馆” Koguan Law School, Shanghai Jiao Tong University 上海交通大学（徐汇校区）凯原法学楼 January 6, 2014 2014年1月6日 Beijing University 北京大学 January 9, 2014 2014年1月9日 Michael Levine-Clark 迈克尔•莱文•克拉克 University of Denver 丹佛大学 John McDonald 约翰• 麦克唐纳 University of Southern California 南加利福尼亚大学 Jason Price 詹森•普莱斯 SCELC Consortium 加州电子图书馆联盟 Levine-Clark, Michael, John McDonald, and Jason Price, “Discovery or Not? A Major Longitudinal Study of the Effect of Web-Scale Discovery Services on Online Journal Usage,” Invited. Transforming Libraries for an Enriching Community, Jiao Tong University, Shanghai, January 6, 2014.

Inforum ebooks 2015 levine clark

Michael Levine-Clark

Viewers also liked (20)