This document summarizes Rafal Kasprowski's presentation on the NISO Annual Standards Update regarding IOTA (Improving OpenURLs Through Analytics). IOTA aims to improve the quality of OpenURL links by measuring the importance of OpenURL elements and providing recommendations. It developed a recommended practice for link resolver providers and a technical report summarizing its activities. IOTA calculates an OpenURL completeness score based on weighted elements and found a correlation between higher scores and successful linking. Content providers and link resolvers can use IOTA data and recommendations to enhance OpenURL quality.
Evaluating the Quality of OpenURLs Through Analytics (TLA 2012)Rafal Kasprowski
IOTA is an initiative that analyzes OpenURL links to improve their quality and success in resolving to the correct resource. It evaluates elements like journal title, ISSN, and DOI in OpenURLs to determine their relative importance. IOTA creates reports comparing OpenURL quality across providers and assigns element weightings based on failure rates. While a completeness index provides useful information, element importance depends on the specific link resolver and target used. IOTA's goal is to improve OpenURL linking through a data-driven, community-based approach.
The document discusses the development of an index by NISO's IOTA Working Group to measure the quality of OpenURL links. The index aims to address frequent failures in OpenURL linking by benchmarking links and identifying elements missing from citation metadata. IOTA has developed an OpenURL analysis tool and begun collecting OpenURLs to analyze element frequencies and inform the creation of a quality scoring system for OpenURL providers.
IOTA @ NASIG 2011: Measuring the Quality of OpenURL LinksRafal Kasprowski
The document summarizes the NISO IOTA Initiative, which aims to measure and improve the quality of OpenURL links. It discusses the history and problems of proprietary and OpenURL linking. IOTA analyzes OpenURL log files to produce reports comparing how vendors and databases use OpenURL elements. These reports can help identify problems and areas for improvement. IOTA is developing an OpenURL Quality Index to score OpenURL completeness and provide a standardized way to evaluate and compare OpenURL quality across providers. IOTA is working with the KBART initiative to address OpenURL quality more broadly across the entire linking process.
The EBSCOhost CustomLinks feature offers certain advantages over OpenURL linking when used in conjunction with the EBSCO Discovery Service (EDS) Partner Databases as well as with OCLC's freely available WorldCat Local "quick start" service. The latter is customized and branded locally by Rice University and used as an intermediary to augment the metadata available for linking from EDS to the desired item when not enough metadata is available in the EDS record alone for OpenURL linking to work effectively.
Expanded presentation from 2012 Charleston Conference on how to complete missing metadata in certain EDS records by obtaining it from WorldCat to ensure linking to desired item held by local library.
Evaluating the Quality of OpenURLs Through Analytics (TLA 2012)Rafal Kasprowski
IOTA is an initiative that analyzes OpenURL links to improve their quality and success in resolving to the correct resource. It evaluates elements like journal title, ISSN, and DOI in OpenURLs to determine their relative importance. IOTA creates reports comparing OpenURL quality across providers and assigns element weightings based on failure rates. While a completeness index provides useful information, element importance depends on the specific link resolver and target used. IOTA's goal is to improve OpenURL linking through a data-driven, community-based approach.
The document discusses the development of an index by NISO's IOTA Working Group to measure the quality of OpenURL links. The index aims to address frequent failures in OpenURL linking by benchmarking links and identifying elements missing from citation metadata. IOTA has developed an OpenURL analysis tool and begun collecting OpenURLs to analyze element frequencies and inform the creation of a quality scoring system for OpenURL providers.
IOTA @ NASIG 2011: Measuring the Quality of OpenURL LinksRafal Kasprowski
The document summarizes the NISO IOTA Initiative, which aims to measure and improve the quality of OpenURL links. It discusses the history and problems of proprietary and OpenURL linking. IOTA analyzes OpenURL log files to produce reports comparing how vendors and databases use OpenURL elements. These reports can help identify problems and areas for improvement. IOTA is developing an OpenURL Quality Index to score OpenURL completeness and provide a standardized way to evaluate and compare OpenURL quality across providers. IOTA is working with the KBART initiative to address OpenURL quality more broadly across the entire linking process.
The EBSCOhost CustomLinks feature offers certain advantages over OpenURL linking when used in conjunction with the EBSCO Discovery Service (EDS) Partner Databases as well as with OCLC's freely available WorldCat Local "quick start" service. The latter is customized and branded locally by Rice University and used as an intermediary to augment the metadata available for linking from EDS to the desired item when not enough metadata is available in the EDS record alone for OpenURL linking to work effectively.
Expanded presentation from 2012 Charleston Conference on how to complete missing metadata in certain EDS records by obtaining it from WorldCat to ensure linking to desired item held by local library.
The document discusses NISO's IOTA Initiative, which aims to improve OpenURL linking through analytics. IOTA measures the importance of OpenURL elements to help vendors enhance OpenURL strings and increase successful linking. IOTA delivers OpenURL reports comparing vendors, a technical report, and a recommended practice. It seeks to benchmark OpenURLs and identify sources of linking problems through a quality index scoring vendors based on inclusion of core elements. Further investigation is needed to refine the scoring system and account for other linking factors beyond just OpenURLs.
Oliver Pesch presentation on SUSHI and IOTA projects, part of the LITA/ALCTS Electronic Resources Management Interest Group meeting held at ALA Midwinter in Seattle, WA, on January 27, 2013
- Part I discusses the history of OpenURL linking and introduces IOTA's reports comparing OpenURL strings and preliminary OpenURL Quality Index.
- Part II examines a study analyzing e-book OpenURLs that found including ISBNs and genre metadata improved full-text linking.
- Part III addresses improving IOTA's Quality Index through more systematic element weighting and considering additional linking factors.
The document discusses the Improving OpenURLs Through Analytics (IOTA) Working Group, which was created by NISO to address problems with OpenURL linking. IOTA analyzes OpenURL data to produce reports that compare the quality of OpenURLs generated by different content providers. The goal is to help providers improve their OpenURLs by identifying common errors or missing elements. IOTA is also working on a proposed OpenURL Quality Index to measure how complete OpenURLs are based on the presence of important elements. Community involvement from libraries and providers is important for the success of IOTA's efforts.
NISO's IOTA Working Group: Creating an Index for Measuring the Quality of Ope...Rafal Kasprowski
The document summarizes the NISO's IOTA Working Group, which aims to create a quality index for measuring OpenURL links. It discusses problems with OpenURL linking and how IOTA was created in response. IOTA develops community reports on OpenURL element frequencies and patterns to help providers compare quality and make improvements. The work involves establishing a scoring system based on element weights and completeness. Reports and documentation are available on the IOTA project site to involve libraries and vendors.
E-Books & OpenURL Linking: A collaborative study by the 2CUL E-Books Task ForceColumbia University
The document summarizes a study by the 2CUL E-Books Task Force on improving OpenURL linking for e-books. They analyzed OpenURL request data to evaluate how well different providers incorporated key fields like ISBN that help lead to full text access. Providers including Summon and EBSCO included these fields in the majority of requests and saw higher success rates, while others like OUP included them less frequently and had lower success. The task force recommends best practices like always including ISBN for books to improve the user experience in accessing full text.
This presentation was provided by Oliver Pesch, Chief Strategist, E-Resources
EBSCO Information Services during the ALA Midwinter Meeting, held on January 22, 2012.
Partnering to Improve Library Discovery ServicesJulie Zhu
IEEE, the world’s largest technical professional association, has made a long-term commitment to partner with discovery service vendors, libraries and NISO to improve all aspects of library discovery services and workflows, so as to aid better discoverability and ultimately usage of its content. This presentation focuses on how IEEE collaborates with EBSCO, which provides EBSCO Discovery Service (EDS), and Stony Brook University, which uses EDS and subscribes to IEEE content, to make the IEEE content more discoverable, visible and accessible in the library's EDS implementations.
The document summarizes an update on the NISO Open Discovery Initiative standards. It provides an overview of the ODI, which defines recommendations for data exchange between libraries, content providers, and discovery service vendors. The ODI aims to help libraries assess content provider participation in discovery services and ensure fair and unbiased indexing. It also outlines the roles and responsibilities of each party to ensure transparency and conformance with ODI practices. Recent updates to the ODI recommended practice in 2020 focused on metadata elements, fair linking, open access indicators, and statistical reporting.
This document summarizes the history and development of OpenURL and link servers. It discusses how OpenURL and link servers like SFX were created to solve the problem of linking to the appropriate copy of an article by introducing a link server as a new component. The document outlines the key events in the development of OpenURL and commercial link servers. It provides examples of how OpenURL and link servers work to determine the appropriate links from a source to various targets. It also discusses benefits of OpenURL linking and the role of link servers like SFX.
Levine-Clark, Michael, John McDonald, and Jason Price. Discovery or Displacement? A Large-Scale Longitudinal Study of the Effect of Discovery Systems on Online Journal Usage. July 23, 2014.
Elsevier - Smart Data and Algorithms for the Publishing IndustryAntonio Gulli
This document provides an overview of Elsevier's platforms and capabilities related to smart data and algorithms. It discusses how Elsevier uses data from its publications, authors, and readers to power platforms like ScienceDirect, Scopus, Mendeley, and recommendation engines. It also describes some of Elsevier's work using algorithms and machine learning, including entity fingerprinting, research trend analysis, and content recommendation. Elsevier aims to develop smart data capabilities that can benefit readers, editors, authors and other stakeholders across the publishing and research landscape.
BioSolr - Searching the stuff of life - Lucene/Solr Revolution 2015Charlie Hull
BioSolr, funded by the BBSRC, is a collaboration between open source search experts Flax and the European Bioinformatics Institute (EBI), aiming to significantly advance the state of the art with regard to indexing and querying biomedical data with freely available open source software
This document summarizes how libraries use publisher-provided metadata to provide access to content. It describes how metadata is used in the library catalog, link resolvers, and discovery systems. Publisher metadata must be accurate and distributed to various library systems and standards to effectively support discovery and access for users.
Description of a method for creating transparent and scalable openURL quality metrics. This system compares metadata quality across content providers. The reports can be used to inform acquisition decisions when evaluating content providers that offer openURL linking from their sites.
This document provides an overview of the NISO IOTA (Improving OpenURLs Through Analytics) project. The project aims to improve OpenURL linking by analyzing OpenURL data from various sources to identify problems and recommend solutions. The project has analyzed over 9 million OpenURLs and produced reports on element usage. Upcoming work includes developing a vendor completeness index and element weighting system. The document also briefly describes the NISO/UKSG KBART (Knowledge Bases and Related Tools) Recommended Practice for exchanging holdings data.
Searching the Stuff of Life - BioSolr: Presented by Matt Pearce & Alan Woodwa...Lucidworks
This document summarizes work done as part of the BioSolr project to improve indexing and querying of biomedical data using Apache Solr. It describes approaches taken to index ontologies and related data, enable federated search across multiple data sources, and develop new Solr features like xjoin for searching external data sources. The project has led to enhancements in ontology indexing, faceted browsing of ontologies, and integration of Apache Jena with Solr to allow SPARQL queries over indexed ontologies. Upcoming events are also announced to discuss experiences from the project.
Novinky u Elsevier: Citace, metriky, spolupráceKnihovnaUTB
The document discusses new features and updates from Elsevier, including Mendeley, Scopus, and ScienceDirect. It summarizes:
Mendeley now offers institutional editions with more storage space, teams, collaborators, and analytics dashboards. A new certification program provides Mendeley Premium upgrades for librarians.
Scopus is re-evaluating journal content to ensure high quality. It is expanding cited references back to 1996 and books to provide better coverage. New metrics and APIs will integrate article-level data and citations into Scopus.
ScienceDirect is working with institutional repositories through new APIs to retrieve metadata, check access entitlements, and retrieve full-text content in order to better support sharing
The document discusses NISO's IOTA Initiative, which aims to improve OpenURL linking through analytics. IOTA measures the importance of OpenURL elements to help vendors enhance OpenURL strings and increase successful linking. IOTA delivers OpenURL reports comparing vendors, a technical report, and a recommended practice. It seeks to benchmark OpenURLs and identify sources of linking problems through a quality index scoring vendors based on inclusion of core elements. Further investigation is needed to refine the scoring system and account for other linking factors beyond just OpenURLs.
Oliver Pesch presentation on SUSHI and IOTA projects, part of the LITA/ALCTS Electronic Resources Management Interest Group meeting held at ALA Midwinter in Seattle, WA, on January 27, 2013
- Part I discusses the history of OpenURL linking and introduces IOTA's reports comparing OpenURL strings and preliminary OpenURL Quality Index.
- Part II examines a study analyzing e-book OpenURLs that found including ISBNs and genre metadata improved full-text linking.
- Part III addresses improving IOTA's Quality Index through more systematic element weighting and considering additional linking factors.
The document discusses the Improving OpenURLs Through Analytics (IOTA) Working Group, which was created by NISO to address problems with OpenURL linking. IOTA analyzes OpenURL data to produce reports that compare the quality of OpenURLs generated by different content providers. The goal is to help providers improve their OpenURLs by identifying common errors or missing elements. IOTA is also working on a proposed OpenURL Quality Index to measure how complete OpenURLs are based on the presence of important elements. Community involvement from libraries and providers is important for the success of IOTA's efforts.
NISO's IOTA Working Group: Creating an Index for Measuring the Quality of Ope...Rafal Kasprowski
The document summarizes the NISO's IOTA Working Group, which aims to create a quality index for measuring OpenURL links. It discusses problems with OpenURL linking and how IOTA was created in response. IOTA develops community reports on OpenURL element frequencies and patterns to help providers compare quality and make improvements. The work involves establishing a scoring system based on element weights and completeness. Reports and documentation are available on the IOTA project site to involve libraries and vendors.
E-Books & OpenURL Linking: A collaborative study by the 2CUL E-Books Task ForceColumbia University
The document summarizes a study by the 2CUL E-Books Task Force on improving OpenURL linking for e-books. They analyzed OpenURL request data to evaluate how well different providers incorporated key fields like ISBN that help lead to full text access. Providers including Summon and EBSCO included these fields in the majority of requests and saw higher success rates, while others like OUP included them less frequently and had lower success. The task force recommends best practices like always including ISBN for books to improve the user experience in accessing full text.
This presentation was provided by Oliver Pesch, Chief Strategist, E-Resources
EBSCO Information Services during the ALA Midwinter Meeting, held on January 22, 2012.
Partnering to Improve Library Discovery ServicesJulie Zhu
IEEE, the world’s largest technical professional association, has made a long-term commitment to partner with discovery service vendors, libraries and NISO to improve all aspects of library discovery services and workflows, so as to aid better discoverability and ultimately usage of its content. This presentation focuses on how IEEE collaborates with EBSCO, which provides EBSCO Discovery Service (EDS), and Stony Brook University, which uses EDS and subscribes to IEEE content, to make the IEEE content more discoverable, visible and accessible in the library's EDS implementations.
The document summarizes an update on the NISO Open Discovery Initiative standards. It provides an overview of the ODI, which defines recommendations for data exchange between libraries, content providers, and discovery service vendors. The ODI aims to help libraries assess content provider participation in discovery services and ensure fair and unbiased indexing. It also outlines the roles and responsibilities of each party to ensure transparency and conformance with ODI practices. Recent updates to the ODI recommended practice in 2020 focused on metadata elements, fair linking, open access indicators, and statistical reporting.
This document summarizes the history and development of OpenURL and link servers. It discusses how OpenURL and link servers like SFX were created to solve the problem of linking to the appropriate copy of an article by introducing a link server as a new component. The document outlines the key events in the development of OpenURL and commercial link servers. It provides examples of how OpenURL and link servers work to determine the appropriate links from a source to various targets. It also discusses benefits of OpenURL linking and the role of link servers like SFX.
Levine-Clark, Michael, John McDonald, and Jason Price. Discovery or Displacement? A Large-Scale Longitudinal Study of the Effect of Discovery Systems on Online Journal Usage. July 23, 2014.
Elsevier - Smart Data and Algorithms for the Publishing IndustryAntonio Gulli
This document provides an overview of Elsevier's platforms and capabilities related to smart data and algorithms. It discusses how Elsevier uses data from its publications, authors, and readers to power platforms like ScienceDirect, Scopus, Mendeley, and recommendation engines. It also describes some of Elsevier's work using algorithms and machine learning, including entity fingerprinting, research trend analysis, and content recommendation. Elsevier aims to develop smart data capabilities that can benefit readers, editors, authors and other stakeholders across the publishing and research landscape.
BioSolr - Searching the stuff of life - Lucene/Solr Revolution 2015Charlie Hull
BioSolr, funded by the BBSRC, is a collaboration between open source search experts Flax and the European Bioinformatics Institute (EBI), aiming to significantly advance the state of the art with regard to indexing and querying biomedical data with freely available open source software
This document summarizes how libraries use publisher-provided metadata to provide access to content. It describes how metadata is used in the library catalog, link resolvers, and discovery systems. Publisher metadata must be accurate and distributed to various library systems and standards to effectively support discovery and access for users.
Description of a method for creating transparent and scalable openURL quality metrics. This system compares metadata quality across content providers. The reports can be used to inform acquisition decisions when evaluating content providers that offer openURL linking from their sites.
This document provides an overview of the NISO IOTA (Improving OpenURLs Through Analytics) project. The project aims to improve OpenURL linking by analyzing OpenURL data from various sources to identify problems and recommend solutions. The project has analyzed over 9 million OpenURLs and produced reports on element usage. Upcoming work includes developing a vendor completeness index and element weighting system. The document also briefly describes the NISO/UKSG KBART (Knowledge Bases and Related Tools) Recommended Practice for exchanging holdings data.
Searching the Stuff of Life - BioSolr: Presented by Matt Pearce & Alan Woodwa...Lucidworks
This document summarizes work done as part of the BioSolr project to improve indexing and querying of biomedical data using Apache Solr. It describes approaches taken to index ontologies and related data, enable federated search across multiple data sources, and develop new Solr features like xjoin for searching external data sources. The project has led to enhancements in ontology indexing, faceted browsing of ontologies, and integration of Apache Jena with Solr to allow SPARQL queries over indexed ontologies. Upcoming events are also announced to discuss experiences from the project.
Novinky u Elsevier: Citace, metriky, spolupráceKnihovnaUTB
The document discusses new features and updates from Elsevier, including Mendeley, Scopus, and ScienceDirect. It summarizes:
Mendeley now offers institutional editions with more storage space, teams, collaborators, and analytics dashboards. A new certification program provides Mendeley Premium upgrades for librarians.
Scopus is re-evaluating journal content to ensure high quality. It is expanding cited references back to 1996 and books to provide better coverage. New metrics and APIs will integrate article-level data and citations into Scopus.
ScienceDirect is working with institutional repositories through new APIs to retrieve metadata, check access entitlements, and retrieve full-text content in order to better support sharing
Similar to IOTA Update - NISO Update, ALA Annual Chicago 2013 (20)
हिंदी वर्णमाला पीपीटी, hindi alphabet PPT presentation, hindi varnamala PPT, Hindi Varnamala pdf, हिंदी स्वर, हिंदी व्यंजन, sikhiye hindi varnmala, dr. mulla adam ali, hindi language and literature, hindi alphabet with drawing, hindi alphabet pdf, hindi varnamala for childrens, hindi language, hindi varnamala practice for kids, https://www.drmullaadamali.com
Strategies for Effective Upskilling is a presentation by Chinwendu Peace in a Your Skill Boost Masterclass organisation by the Excellence Foundation for South Sudan on 08th and 09th June 2024 from 1 PM to 3 PM on each day.
The simplified electron and muon model, Oscillating Spacetime: The Foundation...RitikBhardwaj56
Discover the Simplified Electron and Muon Model: A New Wave-Based Approach to Understanding Particles delves into a groundbreaking theory that presents electrons and muons as rotating soliton waves within oscillating spacetime. Geared towards students, researchers, and science buffs, this book breaks down complex ideas into simple explanations. It covers topics such as electron waves, temporal dynamics, and the implications of this model on particle physics. With clear illustrations and easy-to-follow explanations, readers will gain a new outlook on the universe's fundamental nature.
How to Setup Warehouse & Location in Odoo 17 InventoryCeline George
In this slide, we'll explore how to set up warehouses and locations in Odoo 17 Inventory. This will help us manage our stock effectively, track inventory levels, and streamline warehouse operations.
A workshop hosted by the South African Journal of Science aimed at postgraduate students and early career researchers with little or no experience in writing and publishing journal articles.
This presentation includes basic of PCOS their pathology and treatment and also Ayurveda correlation of PCOS and Ayurvedic line of treatment mentioned in classics.
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Dr. Vinod Kumar Kanvaria
Exploiting Artificial Intelligence for Empowering Researchers and Faculty,
International FDP on Fundamentals of Research in Social Sciences
at Integral University, Lucknow, 06.06.2024
By Dr. Vinod Kumar Kanvaria
This slide is special for master students (MIBS & MIFB) in UUM. Also useful for readers who are interested in the topic of contemporary Islamic banking.
it describes the bony anatomy including the femoral head , acetabulum, labrum . also discusses the capsule , ligaments . muscle that act on the hip joint and the range of motion are outlined. factors affecting hip joint stability and weight transmission through the joint are summarized.
IOTA Update - NISO Update, ALA Annual Chicago 2013
1. NISO Annual Standards Update
Interoperability and Its Role in Standardization
IOTA
OpenURL Quality Initiative
American Library Association, Annual Meeting,
Chicago, IL, June 30, 2013
Rafal Kasprowski, Electronic Resources Librarian, Rice University, Houston, TX
2. What is IOTA?
• IOTA = Improving OpenURLs Through Analytics
• Objective: Improving the quality of OpenURL links
• Initiative that measures the relative importance of the elements
that make up OpenURL links to help vendors improve their
OpenURL strings so that the maximum number of OpenURL
requests resolve to a correct record.
Elements:
• journal title book title ISBN
• ISSN start page DOI
• volume author PMID
• issue date …
3. Topic: Deliverables published April 2013
Recommended Practice
• NISO RP-21-2013, Improving OpenURLs Through
Analytics (IOTA): Recommendations for Link Resolver
Providers
Technical Report
• NISO TR-05-2013, IOTA Working Group Summary of
Activities and Outcomes
4. OpenURL and Interoperability (1)
• Interoperability: capacity of different products to be compatible
with each other.
• Standard exists for OpenURL syntax: how links should be
constructed.
• Has the OpenURL syntax standard have bearing on the
OpenURL links generated by different vendors?
• Is it possible to apply a quality metric to OpenURL links
across all content providers and link resolvers?
• Global metric would be welcome as reliance on OpenURL
linking continues to increase
• E.g. Use in new web-scale discovery products
5. OpenURL and Interoperability (2)
• Library product landscape is diversified
• Multiple vendors, many products, variety of components
• A-Z vendors operate independently of each other
• in selecting and organizing content providers in knowledge bases
• in developing link resolvers
• Content metadata keeps changing
• Publisher changes, title changes, increasingly greater holdings
available online
• Content providers’ work methods vary
• Apply their own content indexing schemes
• Provide updates to A-Z vendors at different times
6. A, Bernand, et al. "A versatile nanotechnology to connect individual nano-objects for the
fabrication of hybrid single-electron devices." Nanotechnology 21, no. 44 (November 5,
2010): 445201. Academic Search Complete, EBSCOhost.
OpenURL: syntax, resolver, linking nodes
http://www.anytarget.com/?issn=0957-4484&volume=21&issue=44&date=20101105
&spage=445201&title=Nanotechnology&atitle=A+versatile+nanotechnology+to+
connect+individual+nano-objects+for+the+ fabrication+of+hybrid+single-
electron+devices.&aulast=A++Bernand
Source Citation (used to populate source OpenURL link)
Target Link (uses OpenURL syntax or other consistent, proprietary URL structure)
7. Which OpenURL Link Works Better?
http://link.resolver1.com/institution?issn=09277765&volume=110&spage=163
&epage=170&title=Colloids+and+Surfaces+B%3a+Biointerfaces&pages=
163-170&atitle=Anti-metastatic+activity+of+biologically+synthesized+gold
+nanoparticles+on+human+fibrosarcoma+cell+line+HT&date=20131080
&aufirst=P.&aulast=Karuppaiya&id=doi:10.1016%2fj.colsurfb.2013.04.037
&sid=contentProviderA
http://link.resolver2.com/institution?genre=article&atitle=Dirty%2c+White+
Candles%3a+Ernest+Hemingway%27s+Encounter+with+the+East.&title=Texas
+Studies+in+Literature+%26+Language&volume=54&issue=4&date=20121201
&aulast=Kenne%2c+Mel&spage=494&sid=contentProviderB
8. IOTA’s Objectives
A. Produce qualitative reports that will help OpenURL
providers quickly compare their OpenURL quality to
that of their peers.
B. Develop community-recognized index for
measuring the quality of OpenURL links generated
by content providers:
scalable across all OpenURLs and their providers
9. Usefulness of comparing OpenURLs
• Content providers that generate OpenURLs can:
• compare their OpenURLs with other providers;
• make improvements to their OpenURLs.
• Institutions can:
• compare links between OpenURL providers;
• make local adjustments to OpenURL setup.
• Resolver vendors can:
• compare links between OpenURL providers;
• change their link settings for OpenURL providers.
11. Report types
• Metric reports
• Viewing how often a particular element or element format
• A. is used across vendors
• B. is used across databases
• Source reports
• Viewing how often a particular (A) vendor or (B) database
• uses the metrics collected in the data logs
12. OpenURL Quality Metric:
Components & Premises
1. Core Elements:
• Any element contained in IOTA's OpenURL reporting system;
• 25M OpenURLs obtained from libraries & content providers.
2. Scoring System:
• Assumption: Correlation exists between
o # of core elements ("OpenURL completeness") &
o ability of OpenURLs to link to specific content.
3. Element Weighting:
• Assigned based on their relative importance:
o spage vs atitle
o issn vs jtitle
o doi/pmid vs date, etc.
13. The premise behind IOTA
• Simple example assuming equal element weights
Element Description Weight This OpenURL
ATitle Article title 1
AuLast Author’s last name 1
Date Date of publication 1
ISSN ISSN 1
Issue Issue number 1
SPage Start page 1
Title Journal Title 1
Volume Volume number 1
TOTAL 8
14. The premise behind IOTA
• Simple example assuming equal element weights
Element Description Weight This OpenURL
ATitle Article title 1
AuLast Author’s last name 1
Date Date of publication 1
ISSN ISSN 1
Issue Issue number 1
SPage Start page 1
Title Journal Title 1
Volume Volume number 1
TOTAL 8
1
1
1
1
1
5
Completeness Score...
(Total for This OpenURL)
Total Weights
5 / 8
= .625
15. Initial Weights
OpenURL data element Description Weight
ATitle Article title 1
AuLast Author’s last name 1
Date Date of publication 5
eISSN Online ISSN 3
ISSN Print ISSN 3
Issue Issue number 3
Jtitle Journal Title 1
Pmid PubMed ID 8
SPage Start page 3
Title Journal Title 1
Volume Volume number 3
DOI Digital Object Identifier 8
16. Initial Weights
OpenURL data element Description Weight
ATitle Article title 1
AuLast Author’s last name 1
Date Date of publication 5
eISSN Online ISSN 3
ISSN Print ISSN 3
Issue Issue number 3
Jtitle Journal Title 1
Pmid PubMed ID 8
SPage Start page 3
Title Journal Title 1
Volume Volume number 3
DOI Digital Object Identifier 8
Initial weights were
somewhat subjective.
17. Initial Weights
OpenURL data element Description Weight
ATitle Article title 1
AuLast Author’s last name 1
Date Date of publication 5
eISSN Online ISSN 3
ISSN Print ISSN 3
Issue Issue number 3
Jtitle Journal Title 1
Pmid PubMed ID 8
SPage Start page 3
Title Journal Title 1
Volume Volume number 3
DOI Digital Object Identifier 8
Most link resolver
knowledge bases can
handle look-ups by either
Print ISSN or Online ISSN
(both are not needed)
18. Initial Weights
OpenURL data element Description Weight
ATitle Article title 1
AuLast Author’s last name 1
Date Date of publication 5
eISSN Online ISSN 3
ISSN Print ISSN 3
Issue Issue number 3
Jtitle Journal Title 1
Pmid PubMed ID 8
SPage Start page 3
Title Journal Title 1
Volume Volume number 3
DOI Digital Object Identifier 8
Most link resolvers will
enhance identifiers like
PubMed ID and DOI;
therefore, having an
identifier is like having all
metadata elements.
19. OpenURL Completeness
Completeness Score
• measure of the “completeness” of a single OpenURL
• sum of element weights found in an OpenURL divided by
the maximum score possible
Completeness Index
• attributed to the content provider as an overall measure
of the completeness of their OpenURLs
• average of Completeness Scores of OpenURLs coming
from that content provider
20. OpenURL linking “success”
• Need to evaluate correlation between completeness score and
ability of OpenURL to generate item-level link.
• The link generated should populate resolver menu.
• Success concept within bounds of OpenURL node (1st node) in
link resolving process.
Matthew Reidsma,
“Rethinking Stock User Interfaces",
http://matthew.reidsrow.com/articles/11
• Initial OpenURL
completeness /
success correlation
not high enough
21. A Statistical Approach to Determining
Element Weights
• Select a set of “perfect” OpenURLs
• include all key data elements and resolve to full text
• Perform step-wise regression
• Test failure rates for each element by removing that element
• Use failure rates as basis for weights
• Use new weights to test for correlation between weights
and success for larger sample
22. Calculated Element Weights
Core Element Failure Percentage* Element Weight**
ATitle 0.74% 1.87
AuLast 0.07% 0.83
Date 0.40% 1.61
ISSN 22.02% 3.34
Issue 20.27% 3.31
SPage 33.27% 3.52
Title 0.61% 1.78
Volume 74.14% 3.87
*Failure Rates from 1,500 OpenURL test sample.
**Element weight calculation: log10 (failure-rate-per-10,000 OpenURLs).
Most important:
Volume, Spage,
ISSN, Issue
23. Validating the Completeness Score
• Use real OpenURLs and a commercial link resolver.
(tested with LinkSource and 360 Link)
• Remove institutional holdings as a limit to resolution
• Process each OpenURL through the link resolver to
determine “Success”
• Score 1 point for finding at least one full text target; 0 for no success
• Calculate the completeness score for each OpenURL
• Look for a statistical correlation between the
completeness score and the success score
• OpenURL completeness / success correlation close to 1
using statistical weights
24. Observations
Testing the same OpenURLs on LinkSource and 360 Link
results in different numbers but consistent trends.
Differences may be attributed to:
• Variations in metadata enhancement techniques
• Strictness in target link rules (e.g. required elements
before link shows – tied to level of forgiveness of target)
• Link syntax used for target
25. Conclusions
• Step-wise regression approach to element weights works
• Completeness Index scores can be correlated to actual
OpenURL “success”
• KB and resolver technology influence results and prevent
a universal set of element weights
The Completeness Index is a mechanism
individual link resolver vendors can use to provide
metrics to help improve their service quality
26. Recommendations and Next Steps
1. Link Resolver Vendors to make use of IOTA Recommended
Practice (NISO RP-21-2013)
2. Content providers to include volume, spage, and issn in
article OpenURLs: critical for success
3. Content providers, link resolver vendors, librarians to use
IOTA data repository to improve OpenURL linking
4. Stakeholders to continue contributing log data to IOTA
repository
5. NISO to assemble working group to investigate standard for
link syntaxes between link resolvers and full-text providers
27. IOTA
Recommended Practice and Technical Reports
• NISO RP-21-2013, Improving OpenURLs Through
Analytics (IOTA): Recommendations for Link Resolver
Providers
• NISO TR-05-2013, IOTA Working Group Summary of
Activities and Outcomes
Websites
• http://www.niso.org/workrooms/openurlquality
• http://www.openurlquality.org/