Today’s library discovery services are primarily based upon indexes derived from journals, e-books and other electronic information of a scholarly nature. The content comes from a range of information providers and products--commercial, open access, institutional, etc. By indexing the content in advance, discovery services have the ability to deliver more sophisticated services with instant performance, compared to the federated search techniques used previously. Libraries increasingly rely on index-based discovery services as their strategic interfaces through which their patrons gain access to the rapidly growing breadth of information that may be available to them.
This webinar will discuss the challenges of operating a centralized index-based discovery system. Learn about their strengths, and their weaknesses, the needs for standards and best practices in this arena, how libraries and providers can assess the usage, and how libraries can satisfy audiences with different needs--ranging from undergraduates to faculty across every discipline.
Todd Carpenter's presentation to the Amigos Library Services "Discovery Tools Now and in the Future" Virtual conference on the NISO Open Discovery Initiative. November 18, 2014
The Future of Library Resource DiscoveryTed Lin (林泰宏)
NISO White Papers are contributed or solicited papers that address an issue that has implications for
standards development. White Papers can be viewed as a pre-standardization activity. A NISO White
Paper might define and explore some of the questions that come into play before formal
standardization work is started. Or, a NISO White Paper might identify areas that are opportunities for
standards development and suggest possible approaches. All White Papers are posted on the NISO
website (www.niso.org).
The Open Discovery Initiative (ODI) is a National Information Standards Organization (NISO) Working Group formed to develop a recommended practice in the area of index-based library discovery services. These single search services, ever-more relied upon as a primary basis for accessing a library’s collections, have improved the research experience immensely, but they remain firmly seated in a heterogeneous ecosystem consisting of diverse players with individual interests. With the intent of streamlining communications and processes in order to better serve library end users, ODI is investigating the stakeholder landscape in the following areas: data format and data transfer; communication of libraries’ rights to specific content; level of indexing performed for content; definition of fair linking to published content; exchange of usage data between discovery providers and information providers. This session will report on the progress of the group’s research work, including interviews and surveys of stakeholders, and preview the Draft ODI Recommended Practice, expected to be released for public comment soon after the Coalition for Networked Information spring 2013 membership meeting.
This presentation was provided by Marshall Breeding, Independent Consultant and Founder of Library Technology Guides; Co-Chair, ODI Working Group, at the
2012 NISO Standards Update at ALA.
The NISO Update provides the latest news about NISO's current efforts, including standards, recommended practices and community meetings covering many areas of interest to the library community. Working group members will provide updates on projects newly underway or recently completed.
NISO Altmetrics Initiative, Todd Carpenter, Executive Director, NISO
Todd Carpenter's presentation to the Amigos Library Services "Discovery Tools Now and in the Future" Virtual conference on the NISO Open Discovery Initiative. November 18, 2014
The Future of Library Resource DiscoveryTed Lin (林泰宏)
NISO White Papers are contributed or solicited papers that address an issue that has implications for
standards development. White Papers can be viewed as a pre-standardization activity. A NISO White
Paper might define and explore some of the questions that come into play before formal
standardization work is started. Or, a NISO White Paper might identify areas that are opportunities for
standards development and suggest possible approaches. All White Papers are posted on the NISO
website (www.niso.org).
The Open Discovery Initiative (ODI) is a National Information Standards Organization (NISO) Working Group formed to develop a recommended practice in the area of index-based library discovery services. These single search services, ever-more relied upon as a primary basis for accessing a library’s collections, have improved the research experience immensely, but they remain firmly seated in a heterogeneous ecosystem consisting of diverse players with individual interests. With the intent of streamlining communications and processes in order to better serve library end users, ODI is investigating the stakeholder landscape in the following areas: data format and data transfer; communication of libraries’ rights to specific content; level of indexing performed for content; definition of fair linking to published content; exchange of usage data between discovery providers and information providers. This session will report on the progress of the group’s research work, including interviews and surveys of stakeholders, and preview the Draft ODI Recommended Practice, expected to be released for public comment soon after the Coalition for Networked Information spring 2013 membership meeting.
This presentation was provided by Marshall Breeding, Independent Consultant and Founder of Library Technology Guides; Co-Chair, ODI Working Group, at the
2012 NISO Standards Update at ALA.
The NISO Update provides the latest news about NISO's current efforts, including standards, recommended practices and community meetings covering many areas of interest to the library community. Working group members will provide updates on projects newly underway or recently completed.
NISO Altmetrics Initiative, Todd Carpenter, Executive Director, NISO
The NISO Update provides the latest news about NISO's current efforts, including standards, recommended practices and community meetings covering many areas of interest to the library community. Working group members will provide updates on projects newly underway or recently completed.
Open Discovery Initiative (ODI), Laura Morse, Director, Library Systems, Harvard University
This presentation was given during the ALA 2016 NISO Standards Update on June 26, 2016. The presenter is Marlene Van Ballegoie of the University of Toronto
Todd Carpenter's presentation at the 3:AM conference in Bucharest, Romania on September 29, 2016 describing the NISO Alternative Assessment Project final output and next steps.
Speakers: Laurie Kaplan, ProQuest; Nettie Lagace, NISO. This program provides an update on several NISO projects potentially of interest to serials librarians, including PIE-J (Presentation and Identification of E-Journals), ODI (Open Discovery Initiative), KBART (KnowledgeBases and Related Tools), and OAMI (Open Access Metadata and Indicators). The projects are at different stages in their creation, publication and revision lifecycles, but all require community understanding and input. Participants will receive practical information on how the initiatives affect their daily work and how their experiences can shape the creation and uptake of consensus-based community standards in the library and information industry.
Libraries, collections, technology: presented at Pennylvania State University...lisld
Library collections are changing in a network environment. This presentation considers how collections are being reconfigured, it looks at research support services, and it explores the shift from the purchased/licensed collection to the facilitated collection.
RDAP13 Mark Parsons: The Research Data Alliance: Making Data WorkASIS&T
Mark Parsons, Rensselaer Polytechnic Institute
Mark A. Parsons and Francine Berman: "The Research Data Alliance: Making Data Work"
Panel: Global scientific data infrastructure
Research Data Access & Preservation Summit 2013
Baltimore, MD April 4, 2013 #rdap13
An introduction to the background, history, scope, and activities of the NISO Open Discovery Initiative. Part of the "Everyone's a player: Creation of standards in a fast-paced shared world" session.
Presenter: Marshall Breeding
What does success look like when it comes to library discoverability? Index based discovery systems have seen a dramatic rate of adoption since introduction to the research ecosystem in 2009, with more than 9,000 libraries relying on a discovery system to provide users with a comprehensive index to their offerings. Some issues bar the way to providing this comprehensive view, but many challenges have been overcome through collaboration between libraries, content providers and discovery partners. The NISO ODI initiative began to examine these issues in 2011, and released a best practice in June 2014.
Speakers will highlight examples of successful collaboration, note continued areas of challenge, and provide insight on how the Open Discovery Initiative Conformance Checklists can be used as a mechanism to evaluate content provider or discovery provider conformance with the best practice.
Presented at the OCLC Research Library Partnership meeting by Senior Program Officer, Karen Smith-Yoshimura and hosted by the University of Sydney in Sydney, NSW Australia, 17 February 2017. This meeting provided an opportunity for Research Library Partners to touch base with each other on issues of common concern and explore possible areas of future engagement with the OCLC Research Library Partnership and OCLC Research.
2.24.16 Slides, “VIVO plus SHARE: Closing the Loop on Tracking Scholarly Acti...DuraSpace
Hot Topics: The DuraSpace Community Webinar Series
Series 13: “VIVO plus SHARE: Closing the Loop on Scholarly Activity”
Webinar 1: , “VIVO plus SHARE: Closing the Loop on Tracking Scholarly Activity” 2.24.16
Curated by Rick Johnson, Program Co-Director, Digital Initiatives and Scholarship Head, Data Curation and Digital Library Solutions Hesburgh Libraries, University of Notre Dame; Visiting Program Officer for SHARE at the Association of Research Libraries. Presented by Rick Johnson & Mike Conlon, VIVO Project Director, DuraSpace
You Can’t Browse The Stacks In A Digital Library: Indexed Discovery, Fair Linking & NISO’s Open Discovery Initiative. A presentation by Todd Carpenter at the 2014 Charleston Library Conference #CHS14 on November 6, 2014.
NISO access related projects (presented at the Charleston conference 2016)Christine Stohn
Presentation by Pascal Calarco (University of Windsor), Christine Stohn (Ex Libris/ProQuest), John G. Dove (Paloma Associates), covering NISO D2D work, ResourceSync, KBART and KBART automation, ODI (Open Discovery Initiative), Link origin tracking, ALI (Access and License Indicators), and a discussion around improvements and challenges for open access discovery
The NISO Update provides the latest news about NISO's current efforts, including standards, recommended practices and community meetings covering many areas of interest to the library community. Working group members will provide updates on projects newly underway or recently completed.
Open Discovery Initiative (ODI), Laura Morse, Director, Library Systems, Harvard University
This presentation was given during the ALA 2016 NISO Standards Update on June 26, 2016. The presenter is Marlene Van Ballegoie of the University of Toronto
Todd Carpenter's presentation at the 3:AM conference in Bucharest, Romania on September 29, 2016 describing the NISO Alternative Assessment Project final output and next steps.
Speakers: Laurie Kaplan, ProQuest; Nettie Lagace, NISO. This program provides an update on several NISO projects potentially of interest to serials librarians, including PIE-J (Presentation and Identification of E-Journals), ODI (Open Discovery Initiative), KBART (KnowledgeBases and Related Tools), and OAMI (Open Access Metadata and Indicators). The projects are at different stages in their creation, publication and revision lifecycles, but all require community understanding and input. Participants will receive practical information on how the initiatives affect their daily work and how their experiences can shape the creation and uptake of consensus-based community standards in the library and information industry.
Libraries, collections, technology: presented at Pennylvania State University...lisld
Library collections are changing in a network environment. This presentation considers how collections are being reconfigured, it looks at research support services, and it explores the shift from the purchased/licensed collection to the facilitated collection.
RDAP13 Mark Parsons: The Research Data Alliance: Making Data WorkASIS&T
Mark Parsons, Rensselaer Polytechnic Institute
Mark A. Parsons and Francine Berman: "The Research Data Alliance: Making Data Work"
Panel: Global scientific data infrastructure
Research Data Access & Preservation Summit 2013
Baltimore, MD April 4, 2013 #rdap13
An introduction to the background, history, scope, and activities of the NISO Open Discovery Initiative. Part of the "Everyone's a player: Creation of standards in a fast-paced shared world" session.
Presenter: Marshall Breeding
What does success look like when it comes to library discoverability? Index based discovery systems have seen a dramatic rate of adoption since introduction to the research ecosystem in 2009, with more than 9,000 libraries relying on a discovery system to provide users with a comprehensive index to their offerings. Some issues bar the way to providing this comprehensive view, but many challenges have been overcome through collaboration between libraries, content providers and discovery partners. The NISO ODI initiative began to examine these issues in 2011, and released a best practice in June 2014.
Speakers will highlight examples of successful collaboration, note continued areas of challenge, and provide insight on how the Open Discovery Initiative Conformance Checklists can be used as a mechanism to evaluate content provider or discovery provider conformance with the best practice.
Presented at the OCLC Research Library Partnership meeting by Senior Program Officer, Karen Smith-Yoshimura and hosted by the University of Sydney in Sydney, NSW Australia, 17 February 2017. This meeting provided an opportunity for Research Library Partners to touch base with each other on issues of common concern and explore possible areas of future engagement with the OCLC Research Library Partnership and OCLC Research.
2.24.16 Slides, “VIVO plus SHARE: Closing the Loop on Tracking Scholarly Acti...DuraSpace
Hot Topics: The DuraSpace Community Webinar Series
Series 13: “VIVO plus SHARE: Closing the Loop on Scholarly Activity”
Webinar 1: , “VIVO plus SHARE: Closing the Loop on Tracking Scholarly Activity” 2.24.16
Curated by Rick Johnson, Program Co-Director, Digital Initiatives and Scholarship Head, Data Curation and Digital Library Solutions Hesburgh Libraries, University of Notre Dame; Visiting Program Officer for SHARE at the Association of Research Libraries. Presented by Rick Johnson & Mike Conlon, VIVO Project Director, DuraSpace
You Can’t Browse The Stacks In A Digital Library: Indexed Discovery, Fair Linking & NISO’s Open Discovery Initiative. A presentation by Todd Carpenter at the 2014 Charleston Library Conference #CHS14 on November 6, 2014.
NISO access related projects (presented at the Charleston conference 2016)Christine Stohn
Presentation by Pascal Calarco (University of Windsor), Christine Stohn (Ex Libris/ProQuest), John G. Dove (Paloma Associates), covering NISO D2D work, ResourceSync, KBART and KBART automation, ODI (Open Discovery Initiative), Link origin tracking, ALI (Access and License Indicators), and a discussion around improvements and challenges for open access discovery
Web-scale Discovery Services are becoming an integral part of libraries' information gathering arsenal. These services are able to use a single interface to seamlessly integrate results from a wide range of online sources, emulating the experience patrons have come to expect from Internet search engines. But despite their ability to streamline searching, discovery services provide a wide set of challenges for libraries who implement them. This virtual conference will touch on both the potential of discovery services as well as some of the issues involved.
This presentation was provided by Tracy Bergstrom of Ithaka S+R, Todd Carpenter of NISO, Filip Jakobsen of Samhæng, Eva Jurczyk of the University of Toronto Libraries, Stacy McKenna of the University of California, Los Angeles (UCLA) Libraries, Jill Morris of PALCI and Boaz Nadav-Manes of Lehigh University, during the "Collaborative Collections Lifecycle Project Fall Update Webinar." The event was held virtually on September 27, 2023
2014 EVA/Minerva Jerusalem International Conference on Digitisation of Cultural Heritage
http://2014.minervaisrael.org.il
http://www.digital-heritage.org.il
This presentation was provided by the following members of the ODI Standing Committee: Tereza Hazen, of the University of Arizona, Laura Morse, of Harvard University, Geoff Morse, or Northwestern University, and Ken Varnum of The University of Michigan Library. The slides were used during the "ODI Conformance Statement Workshop for Libraries," held on July 12, 2021
Web-Scale Discovery: Post ImplementationRachel Vacek
Discovery services provide users a single
search box to access a library’s entire prei-ndexed collection. Representatives from
two academic libraries serving different
user populations will discuss marketing,
instructing users, evaluating the product,
and maintaining the resource after a
discovery service is implemented
2014 EVA/Minerva Jerusalem International Conference on Digitisation of Cultural Heritage
http://2014.minervaisrael.org.il
http://www.digital-heritage.org.il
The Canadian Linked Data Initiative: Charting a Path to a Linked Data FutureNASIG
As libraries prepare to shift away from MARC to a linked data framework, new convergences in the metadata production activities of our libraries' technical services units, special collections, and digital libraries are becoming possible. In September 2015, the Canadian Linked Data Initiative (CLDI) was formed to leverage the existing collaboration between the Technical Services departments of Canada’s top 5 research libraries and the Library and Archives of Canada. Working cooperatively, our objective is to provide a path to linked data readiness for our institutions and leadership for the adoption of linked data by libraries across Canada. To achieve this goal, partner libraries are working across departments and institutions to create new workflows and tools and adapt to a new conceptual understanding of descriptive metadata. This presentation is a preliminary report on the progress made in five key areas of interest: digital collections, education and training, MARC record enhancement, evaluation of linked data tools and vendor supplied metadata. Building on existing initiatives, the CLDI is investigating the potential of integrating linked data elements into digitized collections, as well as MARC-based bibliographic and authority records, with the aim of fostering new and interesting pathways for resource discovery. To strengthen and expand the professional knowledge of staff, partner institutions are collaborating in the production of educational and training materials related to linked data principles and practices. The evaluation and potential development of linked data tools is another area of concentration. Finally, with the goal of changing workflows upstream, the CLDI is working to engage publishers and vendors in the linked data conversation. In addition to reporting on the work undertaken in the first year of the project, this presentation will also cover lessons learned and outline some of the new opportunities gained from working on a collaborative project that spans across multiple boundaries.
Marlene van Ballegooie, Metadata Librarian,
University of Toronto
Juliya Borie, University of Toronto Libraries
Andrew Senior, Coordinator,
E-Resources and Serials, McGill University
Neil Grindley (JISC)
Jisc has led on a strategy (known as 'Plan M') to improve the efficiency of the library data ecosystem in the UK. This session will contextualise the objectives of the plan, give an update on progress, and look ahead to the opportunities that may be afforded if a more open bibliographic data ecosystem can be realised that empowers novel research, learning and teaching. A key part of the session will report on the outcome of a negotiation between Jisc and OCLC to facilitate a national WorldCat licence.
This presentation was provided by Teresa Hazen of the University of Arizona, Geoff Morse of Northwestern University, and Ken Varnum of The University of Michigan. It served as the slide deck for the NISO event "ODI Conformance Statement Workshop for Libraries," and was held on October 17, 2022.
Similar to NISO Webinar: Discovery & Delivery: Innovations & Challenges (20)
This presentation was provided by Steph Pollock of The American Psychological Association’s Journals Program, and Damita Snow, of The American Society of Civil Engineers (ASCE), for the initial session of NISO's 2024 Training Series "DEIA in the Scholarly Landscape." Session One: 'Setting Expectations: a DEIA Primer,' was held June 6, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, during the closing segment of the NISO training series "AI & Prompt Design." Session Eight: Limitations and Potential Solutions, was held on May 23, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, during the seventh segment of the NISO training series "AI & Prompt Design." Session 7: Open Source Language Models, was held on May 16, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, during the sixth segment of the NISO training series "AI & Prompt Design." Session Six: Text Classification with LLMs, was held on May 9, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, during the fifth segment of the NISO training series "AI & Prompt Design." Session Five: Named Entity Recognition with LLMs, was held on May 2, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, during the fourth segment of the NISO training series "AI & Prompt Design." Session Four: Structured Data and Assistants, was held on April 25, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, during the third segment of the NISO training series "AI & Prompt Design." Session Three: Beginning Conversations, was held on April 18, 2024.
This presentation was provided by Kaveh Bazargan of River Valley Technologies, during the NISO webinar "Sustainability in Publishing." The event was held April 17, 2024.
This presentation was provided by Dana Compton of the American Society of Civil Engineers (ASCE), during the NISO webinar "Sustainability in Publishing." The event was held April 17, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, during the second segment of the NISO training series "AI & Prompt Design." Session Two: Large Language Models, was held on April 11, 2024.
This presentation was provided by Teresa Hazen of the University of Arizona, Geoff Morse of Northwestern University. and Ken Varnum of the University of Michigan, during the Spring ODI Conformance Statement Workshop for Libraries. This event was held on April 9, 2024
This presentation was provided by William Mattingly of the Smithsonian Institution, during the opening segment of the NISO training series "AI & Prompt Design." Session One: Introduction to Machine Learning, was held on April 4, 2024.
This presentation was provided by William Mattingly of the Smithsonian Institution, for the eight and final session of NISO's 2023 Training Series on Text and Data Mining. Session eight, "Building Data Driven Applications" was held on Thursday, December 7, 2023.
This presentation was provided by William Mattingly of the Smithsonian Institution, for the seventh session of NISO's 2023 Training Series on Text and Data Mining. Session seven, "Vector Databases and Semantic Searching" was held on Thursday, November 30, 2023.
This presentation was provided by William Mattingly of the Smithsonian Institution, for the sixth session of NISO's 2023 Training Series on Text and Data Mining. Session six, "Text Mining Techniques" was held on Thursday, November 16, 2023.
This presentation was provided by William Mattingly of the Smithsonian Institution, for the fifth session of NISO's 2023 Training Series on Text and Data Mining. Session five, "Text Processing for Library Data" was held on Thursday, November 9, 2023.
This presentation was provided by Todd Carpenter, Executive Director, during the NISO webinar on "Strategic Planning." The event was held virtually on November 8, 2023.
This presentation was provided by Rhonda Ross of CAS, a division of the American Chemical Society, and Jonathan Clark of the International DOI Foundation, during the NISO webinar on "Strategic Planning." The event was held virtually on November 8, 2023.
This presentation was provided by William Mattingly of the Smithsonian Institution, for the fourth session of NISO's 2023 Training Series on Text and Data Mining. Session four, "Data Mining Techniques" was held on Thursday, November 2, 2023.
More from National Information Standards Organization (NISO) (20)
Biological screening of herbal drugs: Introduction and Need for
Phyto-Pharmacological Screening, New Strategies for evaluating
Natural Products, In vitro evaluation techniques for Antioxidants, Antimicrobial and Anticancer drugs. In vivo evaluation techniques
for Anti-inflammatory, Antiulcer, Anticancer, Wound healing, Antidiabetic, Hepatoprotective, Cardio protective, Diuretics and
Antifertility, Toxicity studies as per OECD guidelines
Safalta Digital marketing institute in Noida, provide complete applications that encompass a huge range of virtual advertising and marketing additives, which includes search engine optimization, virtual communication advertising, pay-per-click on marketing, content material advertising, internet analytics, and greater. These university courses are designed for students who possess a comprehensive understanding of virtual marketing strategies and attributes.Safalta Digital Marketing Institute in Noida is a first choice for young individuals or students who are looking to start their careers in the field of digital advertising. The institute gives specialized courses designed and certification.
for beginners, providing thorough training in areas such as SEO, digital communication marketing, and PPC training in Noida. After finishing the program, students receive the certifications recognised by top different universitie, setting a strong foundation for a successful career in digital marketing.
Acetabularia Information For Class 9 .docxvaibhavrinwa19
Acetabularia acetabulum is a single-celled green alga that in its vegetative state is morphologically differentiated into a basal rhizoid and an axially elongated stalk, which bears whorls of branching hairs. The single diploid nucleus resides in the rhizoid.
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Dr. Vinod Kumar Kanvaria
Exploiting Artificial Intelligence for Empowering Researchers and Faculty,
International FDP on Fundamentals of Research in Social Sciences
at Integral University, Lucknow, 06.06.2024
By Dr. Vinod Kumar Kanvaria
A review of the growth of the Israel Genealogy Research Association Database Collection for the last 12 months. Our collection is now passed the 3 million mark and still growing. See which archives have contributed the most. See the different types of records we have, and which years have had records added. You can also see what we have for the future.
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
Introduction to AI for Nonprofits with Tapp NetworkTechSoup
Dive into the world of AI! Experts Jon Hill and Tareq Monaur will guide you through AI's role in enhancing nonprofit websites and basic marketing strategies, making it easy to understand and apply.
A workshop hosted by the South African Journal of Science aimed at postgraduate students and early career researchers with little or no experience in writing and publishing journal articles.
Francesca Gottschalk - How can education support child empowerment.pptxEduSkills OECD
Francesca Gottschalk from the OECD’s Centre for Educational Research and Innovation presents at the Ask an Expert Webinar: How can education support child empowerment?
Azure Interview Questions and Answers PDF By ScholarHat
NISO Webinar: Discovery & Delivery: Innovations & Challenges
1. [insert web address for NISO webinar page]
Discovery and Delivery: Innovations and
Challenges
September 26, 2012
Speakers: Lucy Harrison,
Timothy Babbitt, David Bietila
2. Introducing the
Open Discovery Initiative
NISO Webinar: Discovery and Delivery:
Innovations and Challenges
Lucy Harrison, Florida Virtual Campus, D2D Liaison
September 26, 2012
2
3. Topics
• What are centralized indexes?
• What are their strengths and
weaknesses?
• What is the NISO ODI initiative?
• How will it help improve the discovery
landscape?
3
5. Discovery Interfaces ILS Data
Digital
Search: Local Collections
Index
ProQuest
Search Results
EBSCOhost
Federated
Search
Engine
…
MLA
Bibliography
ABC-CLIO
Real-time query
and responses
6. Index-based Discovery ILS Data
Digital
Search: Collections
Consolidated Index
ProQuest
Search Results EBSCOhost
…
MLA
Bibliography
ABC-CLIO
Harvesting and indexing performed in advance
7. Strengths of Index-based
Discovery
• Fast response time (vs. federated search)
• Structured metadata:
– Improves search & retrieval
– Faceted navigation
– Improves integration of search results
• Indexing full-text of content amplifies
access
7
8. Issues with Index-based
Discovery
• Important to understand depth of indexing
– Currency, dates covered, full-text or citation,
quality of metadata
• Uneven participation diminishes impact
• Ecosystem dominated by private
agreements
• Complexity and uncertainty poses barriers
for participation
9. Need to Bring Order to Chaos
• Libraries need the ability to understand
and evaluate tools, content, providers
• Information providers need the confidence
that their content is being treated fairly
• Service providers need the ability to more
efficiently integrate content
9
10. Key Areas for Libraries
• Strategic investments (in subscriptions and
discovery solutions)
• Expect comprehensive representation of
resources in discovery indexes
• Need to be able to evaluate the depth and
quality of these index-based discovery
products
• Usage reporting
11. Collection Coverage Questions
• How well does the index cover the body of scholarly
content?
• Why do some publishers not participate?
• How can libraries understand the differences in coverage
among competing services?
• How are your library’s content packages represented by
the discovery service?
• Which resources are not represented in index?
• Is content indexed at the citation or full-text level?
• What is the quality of the metadata?
• What are the restrictions for non-authenticated users?
12. Key Areas for Service Providers
• Encourage information providers to
participate
• Lower thresholds of technical involvement
• Clarify the business rules associated with
involvement
• Common industry standards and
definitions
• Usage reporting
13. Key Areas for Information
Providers
• Discovery brings uncertainty
• Want to expose content widely (increase
usage), but
• There are trust issues
– With Access / Authentication
– With ―Fair‖ Linking
• Private agreements
• Usage reporting
16. ODI Pre-History
• June 26, 2011: Exploratory meeting @
ALA Annual
• July 2011: NISO expresses interest
• Aug 7, 2011: Proposal drafted by
participants submitted to NISO
16
17. ODI Proposal
Define standards and/or best practices for
index-based discovery services
– Evaluate the breadth and depth of content
– Evaluate availability of content to different
institutions and to different users
– Streamline workflows
– Define models for fair linking
– Determine what usage statistics should be
collected and disseminated
17
18. ODI Pre-History
• June 26, 2011: Exploratory meeting @
ALA Annual
• July 2011: NISO expresses interest
• Aug 7, 2011: Proposal drafted by
participants submitted to NISO
• Aug 2011: Proposal accepted by D2D
• Vote of approval by NISO membership
• Oct 2011: ODI launched
• Feb 2012: ODI Workgroup Formed 18
19. ODI Charge and Objectives
• Improve information services to end users
as mediated through index-based
discovery services
• Create an environment that broadens
stakeholder participation and ensures
confidence
• Foster development of best practices and
effective means of assessment
19
20. Specific Benefits
Librarians
– Can offer their users as wide a range of
content as possible via their discovery
service of choice
– Can better evaluate discovery services
to address their needs
20
21. Specific Benefits
Information providers
– Have the confidence that the discovery
service providers are handling their
content in an appropriate manner
– Are therefore encouraged to make
available the widest range of content—
in terms of breadth and depth – for
indexing by the discovery service
providers
21
22. Specific Benefits
Discovery service providers
– Receive more standardized and efficient
integration with the information
providers through common industry
definitions and communications
22
23. Balance of Constituents
Libraries
Marshall Breeding, Co-Chair Michele Newberry, Florida Virtual Campus
Jamene Brooks-Kieffer, Kansas State University Sara Brownmiller, University of Oregon
Laura Morse, Harvard University Lucy Harrison, Florida Virtual Campus (D2D
Ken Varnum, University of Michigan liaison/observer)
Information Providers
Lettie Conrad, SAGE Publications Linda Beebe, American Psychological Assoc
Roger Schonfeld, ITHAKA/JSTOR/Portico Aaron Wood, Alexander Street Press
Jeff Lang, Thomson Reuters Peter Noerr, MuseGlobal
Service Providers
Jenny Walker, Ex Libris Group (Co-Chair) David Lindahl, University of Rochester (XC)
John Law, Serials Solutions Jeff Penka, OCLC (D2D liaison/observer)
Michael Gorrell, EBSCO Information Services
23
24. Organization
• Reports in NISO through Document to
Delivery topic committee (D2D)
• Staff support from NISO (Nettie Lagace)
• Co-Chairs
– Jenny Walker (Ex Libris)
– Marshall Breeding (Library Consultant)
• D2D Observers:
– Jeff Penka (OCLC), Lucy Harrison (FLVC)
24
25. ODI Project Goals
1. Identify, possibly through surveys or other
questionnaires, the needs and requirements of
the three stakeholder groups in this area of
work
• Created subgroups for information gathering:
– Level of Indexing
– Library Rights
– Technical formats
– Usage Statistics
– Fair Linking
25
26. ODI Project Goals
1. Identify, possibly through surveys or other
questionnaires, the needs and requirements of
the three stakeholder groups in this area of
work
• Created subgroups for information gathering
• Conducted interviews with stakeholders
• Created survey with input from all sub groups
• Survey is currently live (closes October 4)
26
28. ODI Project Goals
1. Identify, possibly through surveys or other
questionnaires, the needs and requirements of
the three stakeholder groups in this area of
work
• Created subgroups for information gathering
• Conducted interviews with stakeholders
• Created survey with input from all sub groups
• Survey is currently live (closes October 4)
• Analyze results as input to Goal 2
28
29. ODI Project Goals:
2. Create recommendations and tools to
streamline the process by which information
providers, discovery service providers, and
librarians work together to better serve libraries
and their users
30. ODI Project Goals:
3. Provide effective means for librarians to assess
the level of participation by information
providers in discovery services, to evaluate the
breadth and depth of content indexed and the
degree to which this content is made available
to the user
31. Specific deliverables
• Standard Vocabulary
• NISO Recommended Practice:
– Data format & transfer
– Communicating content rights
– Levels of indexing, content availability
– Linking to content
– Usage statistics
– Evaluate compliance
• Inform and Promote Adoption
31
32. Timeline
Milestone Target Date Status
Appointment of working group December 2011
Approval of charge and initial work plan March 2012
Agreement on process and tools June 2012
Survey completed Oct 4, 2012
Completion of information gathering October 2012
Completion of initial draft January 2013
Completion of final draft May 2013
32
33. Connect with ODI
• ODI Project website:
http://www.niso.org/workrooms/odi/
• Interest group mailing list:
http://www.niso.org/lists/opendiscovery/
• Email ODI:
odi@niso.org
33
34. Seeing Discovery Through User Colored Glasses
NISO Webinar: Discovery and Delivery: Innovations and Challenges
Timothy Babbitt, Senior Vice President, Platform Management, ProQuest
35. Understanding What Is Valuable to Users
Foundation of Librarianship
S.R. Ranganathan’s The Five Laws of Library
Science (Madras India: Madras Library Association, 1931)
1. Books are for use.
2. Every reader his [or her] book.
3. Every book its reader.
4. Save the time of the reader.
5. The library is a growing organism.
Even at a time when the emphasis was entirely on
physical media the focus was on the individual goals
and needs each type of user (the reader)
36. The Five Laws Updated
Ranganathan Updated Laws
1. Books are for use. 1. Information in all of its forms is for
2. Every reader his [or her] book. use.
2. Every researcher their
3. Every book its reader.
information.
4. Save the time of the reader. 3. Every medium and delivery
5. The library is a growing platform its user.
organism. 4. Enable efficient discovery by the
user.
5. The library is part of an evolving
research ecosystem.
The proliferation of web based information tools allows us to track users and
their behavior with increasing precision but understanding the unique needs and
behaviors of different researchers requires deep analysis and interpretation of a
variety of data – traditional usage data does not tell the whole story.
37. How do we measure value in the evolving
research landscape?
Traditional Model
Usage data to measure value (searches and retrievals) –
more usage = more value
Growing Trend
Web based analytics – behavioral and attitudinal dimensions
segmented by types of users
Key Question
How can we combine both approaches and what can they provide
that traditional usage data cannot?
Usage Data = what they did
Other Analytics = what they were trying to do; did they succeed; what
was the context; and who was doing it?
38. Value Differs by User
Who is doing the research matters
Librarians
Making their patrons successful
Promoting services of library to students and faculty with
confidence
Delivering services that are convenient for their users
Faculty
Extending their influence and reach in their discipline
through published research
Efficiently directing students to materials that meet
learning objectives
Obtaining research grants
Students
Completing coursework in accordance with faculty
directives
Remaining in compliance with source attribution policies
Accessing information conveniently
39. Conventional Wisdom Might Tell Us
High use = high value
High satisfaction = high value
Use (search and retrievals) is homogenous
Including Attitudinal and Behavioral dimensions to
traditional usage data allows us to challenge many long
held assumptions
40. Three Dimensions of Analysis
Focus of Analysis:
The discovery and
consumption of
documents (COUNTER
Usage Reporting e.g. Searches
and Retrieves) etc.
Focus of Analysis: Focus of Analysis:
What is the user’s
What is the user Attitudinal Behavioral context?
satisfaction? (Page Views per
visit, Time on Site,
and Clickstream
etc.)
41. Three Dimensions of Analysis
Focus of Analysis:
The discovery and
consumption of
documents (COUNTER
Usage Reporting e.g. Searches
and Retrieves) etc.
Attitudinal Behavioral
42. Usage in the new age of discovery
A case study
Earlier this year, a library contacted us about a large
increase in search usage in one of their databases:
Month 11-Jan 11-Feb 11-Mar 11-Apr …
Searches Run 50 250 43 199
Month 12-Jan 12-Feb 12-Mar 12-Apr …
Searches Run 265 616 1176 847
43. Web scale discovery and workflow
By default, the user runs an all database search
(thus showing as a ―hit‖ against all DB’s in the library’s subscription.)
In this scenario, the user starts their search for ―space tourism‖ via a discovery service such
as Summon. Finding a document they like, they click through to the ProQuest platform and
land at the document level. Then decide to run another search, which ―hits‖ all databases.
44. Usage in the new age of discovery
The cause? Heavily utilization of a new web scale discovery
service.
Users now used our website differently than users who started
at the library ―Databases A-Z‖ page. The change in how their
users were coming to our site led to a change in usage.
Usage data showed the effect of the change of their patrons’
research environment. Determining the cause required looking
beyond the usage data.
For more details see the white paper ―Usage in the New Age of Discovery‖
45. Three Dimensions of Analysis
Usage
Focus of Analysis:
What is the user’s
Attitudinal Behavioral context?
(Page Views per
visit, Time on Site,
and Clickstream
etc.)
48. Three Dimensions of Analysis
Usage
Focus of Analysis:
What is the user Attitudinal Behavioral
satisfaction?
49. Attitudinal – Satisfaction Comparison
Survey Methodology
Over 19,500 Surveys
Data from November 2011 through September 2012
Continuous monitoring
Predictive modeling
Librarians Faculty Students
59. “Deeper Dive” with Segment Analysis:
Data: Nov. 8, 2011 through Aug 7, 2012
60. Seeing Value from a User
Perspective
We need the triangulation of
Usage data
Behavioral data
Attitudinal data
Drive understanding of
What did the users do?
What was the context of use?
What were they trying to do and were they successful?
Important because the research ecosystem is
changing
i.e. Web scale discovery
61. Toward understanding what is
valuable to users
Updated Laws
1. Information in all of its forms is for use.
2. Every researcher their information.
3. Every medium and delivery platform its
user.
4. Enable efficient discovery by the user.
5. The library is part of an evolving
research ecosystem.
62. Next steps
Complete integration and analysis of
Usage data
Behavioral data
Attitudinal data
Give libraries a deep understanding of value from
user segments
Next stop…content and search analysis!
63. Collecting Patron Perspectives on
Discovery Tools
NISO Webinar
Discovery and Delivery: Innovations and
Challenges
September 26, 2012
David Bietila
Web Program Director
The University of Chicago Library
64.
65. Data Sources
Finding
Aids
Databases Digital
& Indexes Collections
Discovery
Catalog Tool
Web Pages
66.
67.
68.
69. Assessment Questions
Product Characteristics
Technical
Functional
Interface
Relevance to Users
Define use case
Novice users of databases and electronic resources who need to
find articles on a topic.
Assess product’s applicability to this use case
70. 1. User Comments
Topic User attitudes toward the product, and specific aspects valued by
users.
Method Posted link to a comment form in the header.
Set up an info table for three days.
Required minimal effort to collect data.
Sample Questions What type of resource were you looking for with the Articles Plus?
Please share any positive or negative comments about your
experience.
Results Unprecedented proportion of positive comments.
Users valued the speed of this search, and the ability to search
both books and articles in one place.
Functional & Interface Assessment
71. Resource sought Journal article
Successful? Yes
Affiliation Graduate or Professional School Student
Comment This was a quick search and gave me exactly what I needed.
Resource sought Academic journal articles
Successful? No
Affiliation Graduate or Professional School Student
Record included books, needed a way to filter this out
Comment
results from Time magazine, not what I was looking for at all
Both books and articles on certain topics (ones related to philosophy, psychology and
Resource sought
literature).
Successful? Partial
Affiliation Graduate or Professional School Student
It's wonderful to have ONE place where you can search for both articles and books! However, it
seems like more books should show up because some books relevant to my search showed up
Comment
in lens but not in Articles Plus. If you don't choose this search tool, please do adopt some search
tool that allows comprehensive searching of both books and articles!
72.
73. 2. Usage Statistics
Topic Usage relative to major databases
Method Examined data presented in the discovery tool’s admin interface.
Compared usage with that of high traffic databases (Web of
Science, JSTOR, Academic Search Premier).
Results Observed increasing usage, reaching parity in the initial year with
Academic Search Premier.
Verified that users were finding and using the tool.
Interface Assessment
74. Searches per Month - Articles Plus and Major Databases
50000
45000
40000
EDS Foundation Index
35000
(ArticlesPlus)
30000 Web of Science
25000
JSTOR
20000
15000
Academic Search
10000 Premier
5000
0
75. 3. Usability Testing
Topic Clarity of search interface, including functional elements and
labels.
User ability to complete article discovery tasks.
Method Assigned representative article searching tasks.
Recording screen activity and spoken comments for analysis.
Sample Questions Can you locate full text of the following article? Mary L.
Dudziak, “Desegregation as a Cold War Imperative,” 41 Stanford
Law Review 61 (1988)
You are working to prepare a summary of developments in the
field of astronomy. Can you locate five articles on astronomy that
were published in Nature in 2010?
Functional & Interface Assessment
77. 3. Usability Testing
Results
• Cut or relabeled certain facets
• Made heavily used features more prominent.
• Removed unused or confusing features
• Determined collections to be retained or removed from coverage.
Functional & Interface Assessment
82. Other Use Cases
Experienced researchers
Searching interdisciplinary topics
Searching outside their primary area
Searching within their primary area
83. 4. Subject Assessments
Topic Applicability of the discovery tool for use by advanced researchers
in disciplines with a variety of requirements.
Method Enlisted bibliographers and subject specialists as proxies for
different user constituencies.
Created an evaluation rubric to ensure comparable results across
over 40 disciplines assessed.
Results Determined which disciplines would be best served by the tool.
Identified strength of coverage in numerous disciplines.
Functional Assessment
86. Compared to Compared to
Subjects – Social
First 25 Results Core Database JSTOR/ Google
Sciences Results Scholar Results
Anthropology/Geography/Maps ~ ~ ~
Gender Studies ~ ~ -
History + + +
International Political Economy ~ - ~
Psychology + - ~
Sexuality Studies + + +
87. Outcomes & Future Assessment
Recommendation to purchase
Improvements
Local configuration
Enhancement requests
Marketing & Communication
Benefit of Iterative Assessment
Future assessment
Applicability of new coverage
Revisiting usability
Overlap with other search tools
88. THANK YOU
Thank you for joining us today.
Please take a moment to fill out the brief online survey.
We look forward to hearing from you!
Editor's Notes
Publishers must decide what content is appropriate and at what level. respect the rights of the publisher and be sensitive to their business needs. Trust by the information provider that the information indexed is correct and updated. Sharing of information on the use of the indexed content. Show users only what they are allowed to see. Authority – indicate the source of the record. 3. Fair linking by discovery providers – typically in the hands of the library via OpenURL link resolvers.4. How can publishers assess use of their content in Discovery ServicesCmplexity and uncertainty pose barriers to participation
Currently working OK but still governed by private agreements between discovery service provider and content providers and relies on a wide range of formats and data exchange processes; Complexity and uncertainty pose barriers to participation.
The goal of this work item is to create a working group to define standards and/or best practices for the new generation of library discovery services that are based on indexed search. These discovery services are primarily based upon indexes derived from journals, ebooks and other electronic information of a scholarly nature. Project goals include: provision of effective means for libraries to evaluate the breadth and depth of content indexed by discovery services and the degree of availability of content to different institutions and to different users; development of a set of best practices that can help streamline the process by which information providers work with discovery service vendors, including creation of a common vocabulary; streamlining of the interaction and communication between vendors and information providers, including activation of libraries' subscriptions; definition of models for fair linking from the discovery service to the publisher content; and determination of what usage statistics should be collected, for whom, and how these should be disseminated.
Talking PointsThe Five Laws were proposed by S.R. Ranganathan (a Mathematician and Librarian from India) to outline his view for operating a library systemHe is considered to be one of the early thinkers leading the view that librarianship was a science While his original vision was focused on a world of physical media, his laws are founded in providing a library system that is focused on the user (the “reader” in his terminology).
Given there is such a wide array of media, devices, professional networks, and platforms that are available to users today, we propose the following revision to the 5 Laws…The Five Laws can be updated and reinterpreted to accommodate the variety of media that are now available – but the focus must remain on the varying needs and goals of users.
At the highest level, the goals of users are very different and what they value is very different.
In our industry, the focus of analytics has been on “Usage”.The focus of Usage Analytics is understanding the discovery and consumption of documents. This includes Counter reporting of variables such as “Searches” and “Retrieves”. ProQuest has begun to weave in analysis from two other sources which have lead to some opportunities for “break through” research which will allow ProQuest to become more efficient and effective with its platform over time. Behavioral Analytics allow us to understand how users are getting to our site. Visits, page views, time on site and specific actions can be tracked. Attitudinal Analytics allow us to see who the user is and what do they want. This leads to the ability to track satisfaction, which we think may hold promise as a proxy for the performance from a user perspective. It also allows us to perform segment analysis on specific personas so we can match visitors with actions.
In our industry, the focus of analytics has been on “Usage”.The focus of Usage Analytics is understanding the discovery and consumption of documents. This includes Counter reporting of variables such as “Searches” and “Retrieves”. ProQuest has begun to weave in analysis from two other sources which have lead to some opportunities for “break through” research which will allow ProQuest to become more efficient and effective with its platform over time. Behavioral Analytics allow us to understand how users are getting to our site. Visits, page views, time on site and specific actions can be tracked. Attitudinal Analytics allow us to see who the user is and what do they want. This leads to the ability to track satisfaction, which we think may hold promise as a proxy for the performance from a user perspective. It also allows us to perform segment analysis on specific personas so we can match visitors with actions.
In this scenario, the group starts their search for “space tourism” via a discovery service such as Summon. They click through to the ProQuest platform and land on the Washington Post article on the subject. They decide to run another search, which “hits” all databases in their subscription.Notice when they arrive at the ProQuest platform, they are searching all databases in their subscription. Therefore, subsequent searches will hit every database on their subscription. This activity shows up on usage reports.
In the talk, mention that we discovered the cause by analyzing some referring URL data. That’s part of the behavioral data that we now segue to.
This is view of visits to our new platform per day. [Should we hide the Y-Axis label?]We have included the 30 day moving average.Precise measurement of visits on a daily basis allow us to see exactly when there are deviations. Notice how there is a very consistent pattern for 6 straight weeks. In the 7th week, there is anomaly? Why?... That is February 14th, Valentine’s day. Apparently, not many were studying on that day.Notice spike in traffic near the end of March (just before most US Spring Break) and the dip in early April (vacation, Easter). Continuous monitoring allow us to see regular patterns in the data, which give us a credible baseline. We can then detect even small changes that deviate from the pattern.
After making a new release, we found that the pages viewed/ visit were down.This was considered a Key Performance Indicator. However, after reviewing data from Satisfaction and Time Spent on Site, we found that my making our platform more efficient and effective, we may have been making improvement our platform despite diminishing this metric.
In our industry, the focus of analytics has been on “Usage”.The focus of Usage Analytics is understanding the discovery and consumption of documents. This includes Counter reporting of variables such as “Searches” and “Retrieves”. ProQuest has begun to weave in analysis from two other sources which have lead to some opportunities for “break through” research which will allow ProQuest to become more efficient and effective with its platform over time. Behavioral Analytics allow us to understand how users are getting to our site. Visits, page views, time on site and specific actions can be tracked. Attitudinal Analytics allow us to see who the user is and what do they want. This leads to the ability to track satisfaction, which we think may hold promise as a proxy for the performance from a user perspective. It also allows us to perform segment analysis on specific personas so we can match visitors with actions.
We can confidently state that End Users (Students and Professors) have a higher satisfaction than Librarians The numbers are so polarized that we may run the risk of diminishing satisfaction with End Users if we improve satisfaction with Librarians. Is difference due to Task, Visit Frequency or Persona differences?
We can confidently state that End Users (Students and Professors) have a higher satisfaction than Librarians The numbers are so polarized that we may run the risk of diminishing satisfaction with End Users if we improve satisfaction with Librarians. Is difference due to Task, Visit Frequency or Persona differences?
This chart shows a trend-line of Student Satisfaction.Notice that there is a December dip… perhaps due to exam season, tight deadlines.. End of the exam season.Would have expected a similar drop in May. However, we were able to maintain similar satisfaction levels.It will be interesting to see if we are able to gain satisfaction in September.
This graphic shows Student Satisfaction by Week. The trend-line is satisfaction, the bars in the background show the number of surveys collected for the week. The green boxes (that fade in) show our performance leading up to academic semesters. In both cases our satisfaction was at relatively low
This chart shows the primary purpose for visitors to our platform and their Satisfaction differences.Those that are working on an ongoing research project, are selecting or exploring a research project and are looking for 2-3 good articles have slight higher than average SatisfactionThose that are on our platform to find a quote, statistics or fact, looking for a specific document or have followed a link to a specific article have lower than average satisfaction.This chart shows that expectations of the audience can have a dramatic impact on satisfaction.
What you see on this graph is a comparison the Satisfaction of students by School Type (Community College, Undergrad, Graduate School and Elementary/High School)We are able to perform segment analysis on the data with the goal of finding out if there are significant differences in Satisfaction by group.The blue dots represent the indexed satisfaction score on a 100 points scale. The upper bound (green dash) and the lower bound (red dash) represent the 90% confidence interval range (as calculated by the sample size of respondents and the standard deviation of the satisfaction data). The highest satisfaction group is community colleges. The lowest Satisfaction group is Elementary/High Schools. It is interesting to note that the Undergrads have a slightly higher than average satisfaction and Graduate students have a slightly lower than average Satisfaction, though both are close to the overall average. This reinforces that we are matching intended “sweet spot” for our platform, which is “intermediate searchers”.
What you see on this graph is a comparison the Satisfaction of students by School Type (Community College, Undergrad, Graduate School and Elementary/High School)We are able to perform segment analysis on the data with the goal of finding out if there are significant differences in Satisfaction by group.The blue dots represent the indexed satisfaction score on a 100 points scale. The upper bound (green dash) and the lower bound (red dash) represent the 90% confidence interval range (as calculated by the sample size of respondents and the standard deviation of the satisfaction data). The highest satisfaction group is community colleges. The lowest Satisfaction group is Elementary/High Schools. It is interesting to note that the Undergrads have a slightly higher than average satisfaction and Graduate students have a slightly lower than average Satisfaction, though both are close to the overall average. This reinforces that we are matching intended “sweet spot” for our platform, which is “intermediate searchers”.
Depending on the school type – the tasks are different. 4 key columns Select or explore topicArticles for an assignmentResearch project (high for graduate school)Specific Article (elementary in alignment with graduate)
1. Retrieves per search is higher with hospitals with lower satisfaction while the inverse is true for the Nursing Medical Schools.