This document summarizes the New York Art Resources Consortium's (NYARC) efforts to implement a web archiving program to preserve born-digital art resources. It discusses NYARC's pilot projects from 2010-2013 and the objectives of its 2014/2015 web archiving program funded by The Andrew W. Mellon Foundation. The program aims to archive approximately 2 TB of content from websites related to art using the Archive-It platform. It also outlines the staffing, collaboration, collection scope, tools, and sustainability efforts of the new web archiving initiative.
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising Anna Perricci
In this presentation we'll review common issues and approaches to small scale (human scale) web archiving. Examples given demonstrate successful use of Webrecorder.io and can help others envision good outcomes within similar scenarios.
In 2015, I created a web archiving fundamentals course for the Society of American Archivists (SAA) Digital Archives Specialist (DAS) program. This is a portion of the slide deck I used for that course.
DPC Web Archiving & Preservation Webinar #4: Outreach & Awareness Raising Anna Perricci
In this presentation we'll review common issues and approaches to small scale (human scale) web archiving. Examples given demonstrate successful use of Webrecorder.io and can help others envision good outcomes within similar scenarios.
In 2015, I created a web archiving fundamentals course for the Society of American Archivists (SAA) Digital Archives Specialist (DAS) program. This is a portion of the slide deck I used for that course.
Creativity is about looking at things through fresh eyes. When you look at things from a different perspective, it can spark imagination and exciting ideas. Andy Goldsworthy is an artist who has an interesting approach to his art.
Diaporama sur Niki de Saint Phalle (29 octobre 1930- 21 mai 2002) et sur les nouveaux réalistes, réalisé à l'occasion de la rétrospective de l'artiste au Grand-Palais, Paris (novembre 2014-février 2015)
Making the Black Hole Gray: Implementing the Web Archiving of Specialist Art ...The Frick Collection
Report on the New York Art Resources Consortium's investigation into web archiving born-digital art research materials.
Presented at the Archive-It Partner Meeting, Salt Lake CIty, Utah, November 12, 2013
Digitization Basics for Archives and Special Collections – Part 1: Select and...WiLS
Emily Pfotenhauer, Recollection Wisconsin Program Manager, WiLS
This is the first part of a two-part, full-day workshop introducing the core elements of creating digital collections of historic photographs, documents and other archival materials. Part 1 focuses on selecting materials to digitize and the basics of reformatting. We’ll start with some recommendations for planning a successful project and consider how your digital collections can fit into the statewide and national landscape of digital content. We’ll discuss copyright concerns in order to help you answer the question “CAN I put this online?” And we’ll explore the vocabulary of digital images, including pixels, resolution and bit depth as well as tools and best practices for scanning photographs and documents.
Building the Digital Library in Practice: Collaboration Across Borders and Pl...OurDigitalWorld
OLA SuperConference 2018 presentation by Loren Fantin and Matt Barry of OurDigitalWorld and Caroline Daniels and Dan Sifton of the BC PDL working group.
Web-scale Discovery Services are becoming an integral part of libraries' information gathering arsenal. These services are able to use a single interface to seamlessly integrate results from a wide range of online sources, emulating the experience patrons have come to expect from Internet search engines. But despite their ability to streamline searching, discovery services provide a wide set of challenges for libraries who implement them. This virtual conference will touch on both the potential of discovery services as well as some of the issues involved.
Creativity is about looking at things through fresh eyes. When you look at things from a different perspective, it can spark imagination and exciting ideas. Andy Goldsworthy is an artist who has an interesting approach to his art.
Diaporama sur Niki de Saint Phalle (29 octobre 1930- 21 mai 2002) et sur les nouveaux réalistes, réalisé à l'occasion de la rétrospective de l'artiste au Grand-Palais, Paris (novembre 2014-février 2015)
Making the Black Hole Gray: Implementing the Web Archiving of Specialist Art ...The Frick Collection
Report on the New York Art Resources Consortium's investigation into web archiving born-digital art research materials.
Presented at the Archive-It Partner Meeting, Salt Lake CIty, Utah, November 12, 2013
Digitization Basics for Archives and Special Collections – Part 1: Select and...WiLS
Emily Pfotenhauer, Recollection Wisconsin Program Manager, WiLS
This is the first part of a two-part, full-day workshop introducing the core elements of creating digital collections of historic photographs, documents and other archival materials. Part 1 focuses on selecting materials to digitize and the basics of reformatting. We’ll start with some recommendations for planning a successful project and consider how your digital collections can fit into the statewide and national landscape of digital content. We’ll discuss copyright concerns in order to help you answer the question “CAN I put this online?” And we’ll explore the vocabulary of digital images, including pixels, resolution and bit depth as well as tools and best practices for scanning photographs and documents.
Building the Digital Library in Practice: Collaboration Across Borders and Pl...OurDigitalWorld
OLA SuperConference 2018 presentation by Loren Fantin and Matt Barry of OurDigitalWorld and Caroline Daniels and Dan Sifton of the BC PDL working group.
Web-scale Discovery Services are becoming an integral part of libraries' information gathering arsenal. These services are able to use a single interface to seamlessly integrate results from a wide range of online sources, emulating the experience patrons have come to expect from Internet search engines. But despite their ability to streamline searching, discovery services provide a wide set of challenges for libraries who implement them. This virtual conference will touch on both the potential of discovery services as well as some of the issues involved.
Academic Makerspaces: Connections & Conversations - presentation at Internet ...Patrick "Tod" Colegrove
Despite traditional/conservative academic library roots on the campus of the UNR, the DeLaMare Science & Engineering Library is partnering with broader community- based "maker" and "coworking" groups in the Northern Nevada area, actively revolutionizing the levels of student and faculty engagement with the library. From hacknights and Arduino microcontroller workshops to concrete canoes and Rube Goldberg Machine competitions, the library is actively building connections and conversations. UNR Libraries is leveraging engaged participants to take the library beyond a collections-based hotbed of student learning and collaboration to being an engine of innova- tion transforming learning experiences at UNR. Hear gritty details of rapid prototyping, what’s working, what’s failed, and the reception of 3D printers and scanners in the library.
Capture All the URLs: First Steps in Web ArchivingKristen Yarmey
Presentation for a Society of American Archivists Web Archiving Roundtable professional development webinar.
Session Description:
Two co-authors, Alexis Antracoli, Records Management Archivist at Drexel University and Kristen Yarmey, Associate Professor and Digital Services Librarian at the University of
Scranton will share their experiences and engage in discussion about their web archiving projects. The work they will be talking about is covered in “Capture All the URLs: First Steps in Web Archiving” (http://palrap.pitt.edu/ojs/index.php/palrap/article/view/67).
Kristen will discuss her and her colleagues’ first steps in web archiving at the University of Scranton, including making the case to campus stakeholders, finding funding, choosing Archive-It as well as selecting content and seeds to capture. Alexis will talk about establishing policies and implementing QA procedures. Both Alexis and Kristen will provide
insights on stumbling blocks, lessons learned, and future plans. Plenty of time will be allotted for questions and discussion.
The Avalon Media System: Open Source Audio and Video Access for Libraries and...Avalon Media System
Presented at the session OSDPA (Open Source Digital Preservation and Access): One Body, Many Heads: Preservation and Access From Project Hydra on October 9, 2014 at the Association of Moving Image Archivists Annual Conference (October 8-11, 2014) by Jon Dunn of Indiana University
View the recording of Jon's presentation: http://youtu.be/wAtc-nZeFNk?t=18m57s
Jon W. Dunn presented this overview of the Avalon Media System at the start of the "Avalon Media System: Implementation and Community" session at the 2014 Digital Library Federation (DLF) Forum on October 28, 2014.
See session description and community notes: http://www.diglib.org/forums/2014forum/program/60z/
Filling in the Blanks: Capturing Dynamically Generated ContentJustin Brunelle
JCDL 2012 Doctoral Consortium presentation by Justin F. Brunelle. Covers the problem Web 2.0 creates for preservation, and proposes a solution for client-side capture of content.
Hot Topics: The DuraSpace Community Webinar Series
Series 1: Knowledge Futures: Digital Preservation Planning
Webinar 2: Preservation Planning Success Stories
Curated by Liz Bishoff
Presentation Slides
Making the Black Hole Gray: Web Archiving Art Resources at New York Art Resources Consortium (NYARC)
1. Pebbles around a hole, Kinagashima-Cho, Japan (1987). Photo by Andy Goldsworthy
Making the Black Hole Gray:
Implementing NYARC Web Archiving Program of Specialist Art Resources
Deborah Kempe
April 11, 2014
2. “Going forward, one of the biggest challenges
scholars and curators of contemporary art and
architecture face currently, and will increasingly
face, is how to store, retrieve, and investigate
born-digital materials.”
James Cuno, President and CEO of the J. Paul Getty Trust, How Art History
is Failing at the Internet (November 19, 2012)
5. What we mean when we say
Digital Black Hole
Content being produced Content being archived
6.
7. NOT
Why Archive the Web?
BUT
How to Archive the Web?
Who Should Archive the Web?
Who Pays for Archiving the Web?
How do People Navigate Web Archives?
8. ARCHIVING BORN DIGITAL CULTURAL HERITAGE OBJECTS-
NYARC’s EVOLUTION
2010- 2013: Archive-It partnership for pilot studies and intern
projects
9. Capturing born-digital content from auction
house websites
2010 Pilot Project with Mets’ Watson Library
Sean Leahy, Pratt MLIS Student
Intern, Principal Investigator
10.
11.
12.
13. ARCHIVING BORN DIGITAL CULTURAL HERITAGE OBJECTS-
NYARC’s EVOLUTION
2010-2013: Archive-It partnership for pilot studies and intern
projects
Grant support from The Andrew W. Mellon Foundation:
2012-2013 planning grant ($50,000)
‘Reframing Collections for a Digital Age’
14. THE TIPPING POINT
Reframing Collections
Findings 2012/2013
Digital Shift 3> years
Born-Digital “ephemeral”
literature rapidly proliferating
Art historians and museum
staff do not have a clear
understanding of web
obsolescence
But their focus drove our
collecting targets…
15. 2013 PLANNING GRANT RECOMMENDATIONS
• Use Archive-It as the web archiving tool
• Plan incremental growth of collection
• Develop an open nominations tool
• Establish a permissions framework
• Join the National Digital Stewardship Alliance (NDSA)
• Look for ways to further automate metadata creation
• Enlist students into the program, especially for quality assurance
• Collaborate, Collaborate, Collaborate
16. ARCHIVING BORN DIGITAL CULTURAL HERITAGE OBJECTS-
NYARC’s EVOLUTION
2010- 2013: Archive-It partnership for pilot studies and intern
projects
Grant support from The Andrew W. Mellon Foundation:
2012-2013 planning grant ($50.000):
‘Reframing Collections for a Digital Age’
2013-2015 grant-funded program ($340,000):
‘Making the Black Hole Gray: Implementing the Web Archiving
of Specialist Art Resources’
17. PROJECT OBJECTIVES
• During the 2-year grant period NYARC seeks to implement a
program for capturing, making accessible, and preserving
websites for art research
• Harvest and catalog approximately 2 TB of WARC (Web
ARChive file format) files from websites
• Workflow documentation
• Develop and share best practices with the community
18. STAFFING & PARTNER COLLABORATION
• 1 FT Program Coordinator for 2 years
• 3 PT web archiving paid interns per semester for 2 years
(each based at a NYARC library)
• 2 IMLS-funded M-LEAD paid interns based at the Frick
Art Reference Library
• Columbia University Library web archiving staff
• Existing NYARC staff support
• Hardware/software service providers
25. ARCHIVE-IT
• Annual Subscription Service
• Crawls, harvests and hosts web
content, using Open Source tools
and standards developed and
maintained by the Internet Archive:
• Heritrix web crawler /+ Umbra
• Nutchwax search engine
• Wayback Machine browser
• WARC files, ISO Standard
26. More than 275 partners in 16 countries use Archive-It
27.
28.
29.
30. What is a seed?
A seed is any URL that you want to capture:
an entire website:
http://www.intenttodeceive.org/
a specific part of a website:
http://www.intenttodeceive.org/videos/
a specific URL:
http://www.intenttodeceive.org/forger-profiles/han-van-meegeren/
We will use each level
31. Oy, Metadata….Dublin Core, Marc21, RDA, BIBFRAME, Collection vs. Item
But can we have it all??
Rebecca Goldman, Derangement and Description, July 13, 2009, http://derangementanddescription.wordpress.com/page/14/
38. Links to resources cited, and other useful information on born digital content
http://www.dailydot.com/opinion/art-history-failing-internet/
http://www.exlibrisgroup.com/category/PrimoOverview
http://www.deepwebtech.com/products/explorit-everywhere-for-libraries/
http://www.serialssolutions.com/en/services/aquabrowser/
NDSA Web Archiving Survey Report June 2012 (2013 report expected soon!)
http://www.digitalpreservation.gov/ndsa/working_groups/documents/ndsa_web_archiving_survey_report_2012.pdf
http://blog.emilyreynolds.com/2014/04/09/ndsr14-symposium-in-seven-tweets/
Columbia University Web Archiving Summit 2012 https://webarch.cul.columbia.edu./
Archiving the Web for Scholars, by Steve Kolowich
http://www.insidehighered.com/news/2011/05/06/libraries_try_to_preserve_and_archive_websites_for_academic_study
Overview of Web Archiving, by Jinfang Niu http://dlib.org/dlib/march12/niu/03niu1.html
Rebecca Goldman, Derangement and Description, July 13, 2009, http://derangementanddescription.wordpress.com/page/14/
Web Archives for Researchers: Representations, Expectations and Potential Uses, by Peter Stirling, Philippe Chevallier and Gildas Illien. D-
Lib Magazine March/April 2012, Volume 18, Number 3-4, http://www.dlib.org/dlib/march12/stirling/03stirling.print.html
A Memory of Webs Past, Ariel Bleicher, 28 February, 2011
http://spectrum.ieee.org/telecom/internet/a-memory-of-webs-past/0
Digital Scholarship’s Digital Curation Resource Guide http://digital-scholarship.org/dcrg/dcrg.htm
http://nyarc.org/content/reframing-collections-digital-age, blog posting by Stephen Bury, June 18, 2012
Ricky Erway, OCLC Program Officer. Swatting the Long Tail of Digital Media: A Call for Collaboration—Sept. 2012
http://www.oclc.org/content/dam/research/publications/library/2012/2012-08.pdf
39. Further Resources
Library of Congress, The Signal: Digital Preservation blog:
http://blogs.loc.gov/digitalpreservation/
http://www.loc.gov/webarchiving/ Library of Congress Web Archiving
http://netpreserve.org/ website of the International Internet Preservation Consortium (IIPC)
SAA Web Archiving Roundtable http://webarchivingrt.wordpress.com/
Archive-It Knowledge Center https://webarchive.jira.com/wiki/display/ARIH/Welcome
Guidelines for Preservable Websites / Columbia University Libraries
https://library.columbia.edu/bts/web_resources_collection/guidelines_for_preservable_websites
.html
kempe@frick.org