Williams Open Refine for Librarians

This document summarizes a presentation about the data cleaning tool Open Refine and how librarians are using it. The presentation has three parts: an introduction to Open Refine describing it as a popular but unknown library tool, a comparison of Open Refine to Excel explaining why Open Refine is better for handling larger datasets, and examples of how librarians have used Open Refine for tasks like migrating 50,000 catalog records between library management systems.

Open Refine for Librarians
How a power tool for Google is now
being used by librarians to clean up
data and connect it to the world
Mita Williams
Scholarly Communications Librarian
University of Windsor
October 24, 2018 : 2:45 - 3:15 pm
NISO: That Cutting Edge: Technology’s Impact on Scholarly
Research Processes in the Library

PART ONE:
AN INTRODUCTION
TO OPEN REFINE
The most popular library tool you’ve never heard of…

PART TWO:
WHY NOT KEEP USING EXCEL?
The most popular library tool you’ve never heard of…

Why use Open Refine?
• Ability to handle more types of data
TSV, CSV, *SV, Excel (.xls and .xlsx), JSON, XML, RDF as XML
• Ability to handle larger amounts of data
Excel’s max: 1,048,576 rows by 16,384 columns
• Better control of data
• Ability to script processes
• Ability share and reproduce these scripts

PART THREE:
HOW ARE LIBRARIANS
USING OPENREFINE?
!!! OpenRefine is NOT Excel !!!

• Institution changing their library management system
and wished to migrate their catalogue data
• Approximately 50,000 bibliographic records
• MARC output from existing system would not load into
new system
link

Been there! Done that! Bought the t-shirt!
(Any questions?)

The document summarizes the collaboration between research libraries and computational research. It discusses how libraries traditionally provided curation, preservation, and sharing functions but now face challenges in continuing these roles with large computational analyses. The libraries must collaborate with research computing to address issues like data preservation requirements conflicting with computational resource needs. Recent projects between Hesburgh Libraries and research computing are highlighted as successful examples of such collaboration, including initiatives to develop tools for reproducible computational research and preservation of executable software and datasets.

Orcutt ivey New Needs New Approaches: Libraries as Technology Collaborators

University of Michigan Taubman Health Sciences Library

NISO — Cutting Edges with Company: Emerging Technologies as a Collective Effort

Maness Trusted Citizen: Libraries in a Shifting IT Environment

Jack Maness from the University of Denver Libraries gave a presentation about how libraries can serve as trusted partners in a shifting IT environment. The University of Denver is undergoing changes with a newly centralized IT operation and issues around legacy systems. The libraries aim to support research and teaching technologies, manage research objects and metadata, help address technical debt issues on campus, serve as a true repository, and provide expertise on preservation, intellectual property, and community values, thereby positioning themselves as a trusted citizen in the university's IT strategies. Maness argued that by keeping campus priorities and larger partnership opportunities at the forefront, libraries can punch above their weight.

Arlitsch may4-3

Linked Open Data: Identifying Opportunities

Library_Connect

Freedman Center for Digital Scholarship Colloquium - 14_1106

jeffreylancaster

The Digital Centers at Columbia University were established to support collaborative work across disciplines through the creation of specialized facilities in the libraries. The centers provide experts, resources, technology services and space to support digital scholarship. They collaborate through a working group and advisory board to facilitate communication, address common needs, and strategize services holistically. This includes collaboration on software selection, workshops, projects and budgets to best support the diverse needs of students, faculty and researchers at Columbia University.

Bruce Crocco CBBD 2013

OCLC LAC

The document discusses how libraries can better integrate their collections with the modern web environment. It notes that while library patrons are using search engines and other online resources more, the problem is that library collections are not being exposed or connected to the web as well as they could be. The presentation discusses using linked data and metadata standards to better describe, aggregate, and syndicate library collections online in order to improve discovery and access for users.

The Radboud University Library has established itself as a one-stop-shop for research data management support by building expertise, trust, and symbiotic relationships across the university. It offers traditional library services like workshops and individual support for writing data management plans and archiving data, as well as more extensive services like developing disciplinary RDM policies and checking data quality before archiving. By serving as an accessible linking pin between researchers, policymakers, and IT, and giving researchers the sense they are not alone, the library aims to remain an indispensable part of the university's RDM support even as infrastructure projects are fully implemented.

Metrics Matter

What do Digital Humanists want from a National Library?

Library Analytics and Metrics Project

This was a presentation delivered at the 10th Northumbria Conference in York during July 2013. It provides a background, and introduction and overview to the Library Analytics and Metrics Project (LAMP) work that Jisc, Mimas (University of Manchester) and University of Huddersfield are collaborating on. The project will develop a prototype shared library analytics service for UK universities and colleges.

Knowledge Unlatched – Navigating Through the Rapids of Change

SMART Library

Bryant Confusing World of RIM

CAVAL ANDS Workshop - Managing library teams for a research and data-intensiv...

ARDC

In a data-intensive world, data-related knowledge and skills are becoming ever increasingly important, not just for researchers, but also for those who make up the human infrastructure that scaffolds research, such as academic librarians. This half-day workshop was an opportunity for library directors and managers to develop strategies for building a data-skilled library workforce. This presentation was part of the CAVAL/ANDS Workshop - Managing library teams for a research and data-intensive future (Melbourne, 28 July 2017). Workshop program and presentations from other speakers: http://www.ands.org.au/news-and-events/presentations/2017

Allard - Research Data Services in Libraries

Ogier Virginia Tech's RIS Ecosystem

Warren & Rauh Creating a Culture of Research Reputation

From industry to academia: user-centred design driving library service innova...

From industry to academia: user-centred design driving library service innovation at Cambridge University Library. The library has adopted techniques from industry like user-centered design to better understand student and faculty needs. Research methods like diary studies, interviews and observations have provided insights into user behaviors. Personas, journey maps and an experience map were created. The Futurelib program rapidly prototypes new services, with Spacefinder - a tool finding study spaces on campus - being an example. It has been successful, with nearly 13,000 sessions in 8 months. Overall findings show user experiences are complex, small changes can have big impacts, and moving quickly helps deliver benefits to users.

Increase usage of online resources Edina presentation

JISC RSC Eastern

This document outlines a plan to promote online resources using the SPARE framework: 1) Set the scene by considering the background context and why promotion is needed. 2) Prepare by getting ready before taking action and evaluating resources. 3) Act by carrying out agreed promotion activities. 4) Review usage and gather feedback to assess how promotion went. 5) Evaluate to decide next steps based on the review. The document discusses challenges in promoting resources and getting user feedback, and provides tips for effective promotion through curation, updates, enthusiasm, multiple channels, and responsiveness.

2015 NISO Forum: The Future of Library Resource Discovery

Western Sydney University

Relationship Management Conference - expanded slides

Peter Hickey

The document discusses how libraries can demonstrate their value to universities. It provides examples from UCD Library of how they gather usage statistics and feedback to show how resources and services are used. The library uses these metrics in quality reviews, benchmarking, and strategic planning. Survey results and quotes from a quality review indicate that students and faculty value the library's resources, services, and support of teaching and research. The document emphasizes that a library's worth is perceived differently by various stakeholders and advocates for libraries to clearly communicate their value through data.

Data are the New Black

2015 NISO Forum: The Future of Library Resource

Fransen From Researcher Profiling to System of Record

RDN Lightning talk - Open Research Leeds (@OpenResLeeds): networks, metrics a...

Nick Sheppard

This document discusses the use of social media and open access to increase the impact and discoverability of research. It notes that simply making research available online is not enough and additional promotion is needed. It provides examples of metrics and tools to track the usage and dissemination of research articles and datasets, including altmetrics, IRUS-UK, and Figshare. The importance of using hashtags and engaging on social media platforms like Twitter to promote research is also emphasized.

Javed - VIVO: Community Driven RIM

Open Ed Global LibreTexts Presentation

Joshua Halpern

LibreTexts is a community platform for open educational resources (OER) that aims to provide a comprehensive and curated digital library of free educational content. It has over 80 million annual pageviews and continues growing each year. The platform allows for collaborative and distributed development of OER through features like customizable course shells and a content remixing tool. Its goal is to eliminate costs for students and faculty while improving learning through data-driven improvements to open resources.

Transparent Licenses: Making user rights clear (OLA Super Conference 2015)

Hong (Jenny) Jing

Recent changes to Canada’s Copyright Act have propelled copyright and licensed use into the spotlight at colleges and universities in Canada. This session will look at Queen’s and University of Toronto libraries’ experience implementing a licensing permissions workflow using OCUL Usage Rights database (OUR). The systems will be covered are: 360 Link, Summon, Voyager OPAC, Endeca. We will explain how to implement the license links with and without using API.

What's hot

Data management support as core business of research libraries

Metrics Matter

What do Digital Humanists want from a National Library?

Library Analytics and Metrics Project

Knowledge Unlatched – Navigating Through the Rapids of Change

SMART Library

Bryant Confusing World of RIM

CAVAL ANDS Workshop - Managing library teams for a research and data-intensiv...

ARDC

Allard - Research Data Services in Libraries

Ogier Virginia Tech's RIS Ecosystem

Warren & Rauh Creating a Culture of Research Reputation

From industry to academia: user-centred design driving library service innova...

Increase usage of online resources Edina presentation

JISC RSC Eastern

2015 NISO Forum: The Future of Library Resource Discovery

Western Sydney University

Relationship Management Conference - expanded slides

Peter Hickey

Data are the New Black

2015 NISO Forum: The Future of Library Resource

Fransen From Researcher Profiling to System of Record

RDN Lightning talk - Open Research Leeds (@OpenResLeeds): networks, metrics a...

Nick Sheppard

Javed - VIVO: Community Driven RIM

Maha Barathi Engineering College

What's hot (20)

Data management support as core business of research libraries

Metrics Matter

What do Digital Humanists want from a National Library?

Library Analytics and Metrics Project

Knowledge Unlatched – Navigating Through the Rapids of Change

SMART Library

Bryant Confusing World of RIM

CAVAL ANDS Workshop - Managing library teams for a research and data-intensiv...

Allard - Research Data Services in Libraries

Ogier Virginia Tech's RIS Ecosystem

Warren & Rauh Creating a Culture of Research Reputation

From industry to academia: user-centred design driving library service innova...

Increase usage of online resources Edina presentation

2015 NISO Forum: The Future of Library Resource Discovery

Relationship Management Conference - expanded slides

Data are the New Black

2015 NISO Forum: The Future of Library Resource

Fransen From Researcher Profiling to System of Record

RDN Lightning talk - Open Research Leeds (@OpenResLeeds): networks, metrics a...

Javed - VIVO: Community Driven RIM

Similar to Williams Open Refine for Librarians

Open Ed Global LibreTexts Presentation

Joshua Halpern

Transparent Licenses: Making user rights clear (OLA Super Conference 2015)

Hong (Jenny) Jing

Meeting the e-resources challenge through collaboration: an OCLC perspective ...

NASIG

Libraries have been evolving their methods and approaches to managing the increasing range and number of electronic collections; however, much of the technology that has been developed to support this evolution involves the use of closed, disparate systems that each supports a single aspect of electronic resource management. At this session, OCLC staff and experts from member libraries will look at specific challenges of the e-resource management life cycle and share their perspectives about the opportunities to simplify and streamline processes at each step of the workflowselect, acquire, describe, discover, access and renew. Particular focus will be given to the potential for libraries (and providers) to share data, tools and processes within OCLC's suite of WorldShare applications. These include: working with publishers to provide comprehensive, timely, good quality, reusable metadata to drive the discovery and usage of electronic resources; providing APIs that foster the development of functional enhancements that benefit everyone; working with a range of partners to embed metadata about, and drive discovery of, library collections in the sites and tools where users start their search. OCLC is a worldwide cooperative of more than 16,000 libraries, archives and museums, working with members to provide a range of cloud-based, cooperative services that manage the complete library management life cycleOCLC WorldShare. OCLC's unique community-led approach to cataloging has resulted in widespread acknowledgment of the richness and accuracy of libraries' metadata. We are now applying this approach to the description, management and discovery of electronic resources. By offering applications that address acquisitions, link resolution, authentication, license management, discovery, metadata synchronization and analyticson an open, shared platformOCLC is working with libraries to share the work of managing and delivering licensed resources with services that streamline and automate critical functions at every step of the library's workflow. Presenters: Maria Collins Head, Acquisitions and Discovery, North Carolina State University Rene Erlandson Director of Virtual Services, University of Nebraska Omaha Jill Fluvog Director of eSolutions, OCLC Dawn Hale Head of Technical Services, Johns Hopkins University Andrew Pace Executive Director for Networked Library Services, OCLC

Open to Opportunity: Possibilities for libraries in open education

Sarah Cohen

Libraries around the country, and the world, are increasingly devoting time and resources to open education. But why? In what way are libraries part of this movement and how does it serve our missions and services? This presentation will describe the value that libraries’ engagement in this space can offer to our institutions, our students, and our profession; and, to outline possible ways forward for libraries that are interested in committing their limited resources to this transformative effort.

We Can and We Should: libraries' role in open education

Sarah Cohen

We can and we should: the libraries' role in open education Libraries around the country, and the world, are increasingly devoting time and resources to open education. But why? In what way are libraries part of this movement and how does it serve our missions and services? This presentation will describe the value that libraries’ engagement in this space can offer to our institutions, our students, and our profession; and, to outline possible ways forward for libraries that are interested in committing their limited resources to this transformative effort.

Discovery Systems: Connecting the 21st Century Academic User to Content

Athena Hoeppner

Discovery systems couple a central index of metadata and content with a feature-rich discovery layer to help users find information. UCF's discovery service indexes over 690 million records from various sources and links users to full text over 80% of the time. Studies found it included relevant high-quality content for nursing and science papers. Embedding discovery into learning management systems reduces cognitive load for online students and simplifies accessing full text from courses. Discovery services also expose open access outputs by including them prominently.

LibreTexts: Ful filling the 5R Dream Worldwide WCOL19 Halpern

Joshua Halpern

Getting in the Flow! : How libraries can adapt to changing users and environm...

Guus van den Brekel

http://kib.ki.se/kibkonferens/2007/program.html This presentation provides an overview of causes why library services are fading out of sight for most user groups and how these users and their expectations have changed without us realizing. It contains a strong plea for a focus shift for librarians, a focus into the environments where the users are, instead of expecting them come to us, or our resources. Exploration of all relevant user environments for you organization, the use of new web-based technologies with Web 2.0 elements and certainly a more structural technical re-design of library information systems is needed to deliver library services and resources at the place of need. Examples of short term possibilities are shown (i.e. Library Toolbar), as well as more long-term solutions clarified by examples from the Libraries of the University of Groningen and the Central Medical Library of the University Medical Center Groningen.

Collection Directions - Research collections in the network environment

Constance Malpas

1. The document discusses trends in research collections in the networked environment and directions for collections. 2. Key trends include collections as a service across a spectrum from owned to borrowed, workflow becoming the new content as researchers organize around different systems and services, and a shift from curation to creation as libraries take on new roles in research lifecycles. 3. Collection directions involve right-scaling stewardship through shared print collections and partnerships for coordination, and positioning libraries as experts that support the full research process.

A Brief Overview of BIBFRAME, by Angela Kroeger

Angela Kroeger

Short presentation given ALCTS CaMMS Forum on Bibframe: Notes From the Field, at ALA Midwinter, February 1, 2015. ABSTRACT: Overview of the current status of BIBFRAME development, including a brief introduction to what BIBFRAME is and what it does, which tools are available or under development, a glimpse what fully-implemented linked data looks like, a closer look at the four core classes of the BIBFRAME model, and a dab of philosophy.

The Power of Sharing Linked Data: Bibliothekartag 2014

Richard Wallis

The document discusses OCLC's efforts to share library data as linked open data on the web. It describes OCLC releasing WorldCat data including 311 million records as linked data, using schemas like Schema.org and linking to other sources like VIAF. It also discusses the release of 197 million linked data work descriptions from WorldCat in April 2014. The goal is to make library data part of the web by giving search engines and users what they want, like structured data at web scale with identifiers and links.

Institutional Repository (IR) and Open Access in Academic Libraries

Hong (Jenny) Jing

This document discusses institutional repositories (IRs) and open access in academic libraries. It provides an overview of IR trends, including a move toward collaboration between libraries through consortia to share costs and expertise. The document also describes common IR systems and functions, such as collecting and curating digital scholarly output. Workflow processes for IRs are discussed, as well as metrics for evaluating an IR's success. Best practices from libraries like COPPUL that have developed shared IR tools are also acknowledged.

Library websites of the future

Rachel Vacek

confernece paper

The document discusses the next generation of integrated library systems moving towards modularity and outward integration. Key points are: 1) Future integrated library systems will be more modular, allowing components to be combined more flexibly like Lego blocks. This will enable linking between different systems rather than building monolithic systems. 2) Integration should focus outwardly, making library collections visible on the open web where users search. This allows pulling users from search engines into library resources. 3) A longer term vision sees a more coherent global system for discovery and delivery of information across open, loosely connected systems. Libraries play a role alongside other providers and search engines.

Valencia Marshall Breeding Jornada Perspectiva Tecnologia Bibliotecas

Col·legi Oficial de Bibliotecaris i Documentalistes de la Comunitat Valenciana (COBDCV)

The document discusses trends in library technologies from an international perspective. It describes the emergence of a new generation of library services platforms that have a different scope and architecture than traditional integrated library systems. These new platforms aim to provide comprehensive management of print, electronic, and digital materials. The document also discusses the transition to cloud-based library systems and the importance of open APIs and interoperability.

Katalog dan Pengatalog: tantangan kini dan masa depan

hendrowicaksonogmailcom

The document discusses the challenges of cataloging and metadata today and in the future, including changes in technology, user behavior, and the types of information objects that need to be described. It provides biographical information about Hendro Wicaksono and his experience working in libraries and developing cataloging systems. The document touches on the evolving nature of libraries, catalogs, metadata standards, and the tasks and skills needed for cataloging in the digital age.

Open Science, Open Data: towards a new transparent and reproducible ecosystem

Presented at the Preforma Open Source Workshop 8 April 2016 As a library membership organization, LIBER works on addressing Open Science barriers. Standardisation of file formats can really help in overcoming some of these barriers: it enables us to process and preserve data in a controlled way, it helps ensure that outputs are really open and accessible in the long term and it improves interoperability of new tools and services. Making sure data is stored in a controlled way and can be (re) used today and in the future is an important element in Open Science. We see this as not only a technical challenge but also a social one: awareness, trust and community building is needed in order to ensure uptake of these standards. Libraries therefore have a valuable role to play in the development of good research data management throughout all phases of the Open Data lifecycle.

eResources in Academic Libraries

ottumtk

The document lists challenges and opportunities related to electronic resources in academic libraries. Some of the key challenges mentioned include reduced budgets, ever-increasing journal prices, a decline in print monographs, difficulties managing collections, issues with access and security, and usability problems. Opportunities discussed focus on areas like open access initiatives, collaboration, marketing collections globally, improving discovery tools and interfaces, and developing new definitions and standards. The document provides sources for further reading on topics related to e-resources in libraries.

How Libraries Use Publisher Metadata Redux (Steven Shadle)

Charleston Conference

Rodriguez CV 2017

Michael Rodriguez

Michael Rodriguez has over 10 years of experience in library acquisitions and licensing. He currently serves as the Licensing/Acquisitions Librarian at UConn Library, where he manages a $6.8 million collections budget. Some of his responsibilities include negotiating licenses, assessing collections, and troubleshooting access issues. Prior to his current role, he worked at Hodges University, where he managed electronic resources and implemented a major website redesign. He regularly presents at conferences and has published several book chapters and articles.

Similar to Williams Open Refine for Librarians (20)

Open Ed Global LibreTexts Presentation

Transparent Licenses: Making user rights clear (OLA Super Conference 2015)

Meeting the e-resources challenge through collaboration: an OCLC perspective ...

Open to Opportunity: Possibilities for libraries in open education

We Can and We Should: libraries' role in open education

Discovery Systems: Connecting the 21st Century Academic User to Content

LibreTexts: Ful filling the 5R Dream Worldwide WCOL19 Halpern

Getting in the Flow! : How libraries can adapt to changing users and environm...

Collection Directions - Research collections in the network environment

A Brief Overview of BIBFRAME, by Angela Kroeger

The Power of Sharing Linked Data: Bibliothekartag 2014

Institutional Repository (IR) and Open Access in Academic Libraries

Library websites of the future

confernece paper

Valencia Marshall Breeding Jornada Perspectiva Tecnologia Bibliotecas

Katalog dan Pengatalog: tantangan kini dan masa depan

Open Science, Open Data: towards a new transparent and reproducible ecosystem

eResources in Academic Libraries

How Libraries Use Publisher Metadata Redux (Steven Shadle)

Rodriguez CV 2017

More from National Information Standards Organization (NISO)

Jemison, MacLaughlin, and Majumder "Broadening Pathways for Editors and Authors"

Benner "Expanding Pathways to Publishing Careers"

Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...

Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"

Mattingly "AI and Prompt Design: LLMs with Text Classification and Open Source"

Mattingly "AI and Prompt Design: LLMs with NER"

Mattingly "AI & Prompt Design: Named Entity Recognition"

Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"

Mattingly "AI & Prompt Design: The Basics of Prompt Design"

Bazargan "NISO Webinar, Sustainability in Publishing"

Rapple "Scholarly Communications and the Sustainable Development Goals"

Compton "NISO Webinar, Sustainability in Publishing"

Mattingly "AI & Prompt Design: Large Language Models"

Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...

Mattingly "AI & Prompt Design" - Introduction to Machine Learning"

Mattingly "Text and Data Mining: Building Data Driven Applications"

Mattingly "Text and Data Mining: Searching Vectors"

Mattingly "Text Mining Techniques"

Mattingly "Text Processing for Library Data: Representing Text as Data"

Carpenter "Designing NISO's New Strategic Plan: 2023-2026"