As more and more artifacts of our cultural heritage and scholarly work product become digitally created and disseminated, long-term preservation becomes increasingly challenging for archives, libraries and other memory organizations. To help these institutions fulfill their mission, software manufacturers and service providers have developed specialized digital preservation solutions for a variety of scholarly and cultural materials. These solutions utilize many of the current standards and best practices for assuring the authenticity, findability, accessibility and usability of digital content.
NISO is pleased to host a 90-minute webinar that will present an overview of several digital preservation standards, describe how preservation is distinct from general repository maintenance, and describe preservation applications in multiple environments.
2. Preservation Standards
(& Specifications)
(&& Best Practices)
Discoverable, Available, Accessible: Preserving Digital Content
NISO Webinar
By Amy Kirchhoff
Archive Service Product Manager, Portico, JSTOR
September 14, 2011
4. Portico - Third Party Preservation
Portico is among the largest community-
supported digital archives in the world.
Working with libraries, publishers,
and funders, we preserve e-
journals, e-books, and other
electronic scholarly content to
ensure researchers and students
will have access to it in the future.
Speaker: Amy Kirchhoff
11. Context: Digital Preseravtion
Digital preservation is the series of management policies and activities
necessary to ensure the enduring usability, authenticity, discoverability, and
accessibility of content over the very long-term. The key goals of digital
preservation include:
Usability Authenticity Discoverability Accessibility
• the intellectual • the provenance of • the content must • the content must
content of the item the content must have logical be available for
must remain be proven and the bibliographic use to the
usable via the content an metadata so that it appropriate
delivery authentic replica can be found by community
mechanism of of the original end users through
current technology time
11 Speaker: Amy Kirchhoff
12. Context: Content
some some digital
metadata files song
some some digital
metadata files slide
digital
some some
journal
metadata files
article
some some digital
metadata files book
12 Speaker: Amy Kirchhoff
22. some some digital
metadata files song
some some digital
metadata files slide
digital
some some
journal
metadata files
article
some some digital
metadata files book
22 Speaker: Amy Kirchhoff
42. Role of the Library
“The
role
of
libraries
in
the
print
world
-‐
collec5ng,
providing
access
to,
and
preserving
our
cultural
heritage
–
does
not
change
when
we
move
to
the
digital
realm.
We
must
take
on
new
challenges
in
determining
how
to
fulfill
this
role”
Jay
Schafer,
Director
of
Libraries
at
UMass
Amherst
Speaker: Ido Peled 42
43. Traditional Library Services
Collect
diverse
digital
collecBons
Collect
Print
Materials
Provide
Catalog
Discovery
and
Metadata
Delivery
Allow
online,
Describe,
select
and
offsite,
on
assign
copy
and
demand
access
access
rights
Preserve
Physical
Content
Ensure
long-‐
term
access
Speaker: Ido Peled 43
44. Digital Library Services
Collect
diverse
digital
collecBons
Collect
Digitized
Print
Materials
and Digi
tally Bor
n
Provide
Catalog
Discovery
and
Metadata
Delivery
Allow
online,
Describe,
select
and
offsite,
on
assign
copy
and
demand
access
access
rights
Preserve
Physical
Content
Digital Ensure
long-‐
term
access
Speaker: Ido Peled 44
45. Digital Preservation as Part of the Digital Library
Cost
Effec5ve
Online Access
Sustainable
Digital
Preservation
Ongoing Actions
Ri
Ana sk tion
lysi Migra
s
Bit Preservation
Speaker: Ido Peled 45
46. Digital Preservation vs. Digital Repository
Digital Preservation Digital Repository
• Focus on data integrity and • Focus on access
long-term access
• Strong cataloging
• Complete risk analysis,
• Usually integrated resource
preservation planning and
discovery
actions component
• Single process
• On-going actions
Speaker: Ido Peled 46
48. The Strategy – Sustainable Digital Preservation
CONSOLIDATE OPTIMIZE EXTEND
Extend the library
Consolidate all digital Optimize through
offering and
collections automation
collaborations
Speaker: Ido Peled 48
49. The Strategy – Sustainable Digital Preservation
CONSOLIDATE OPTIMIZE EXTEND
Extend the library
Consolidate all digital Optimize through
offering and
collections automation
collaborations
Speaker: Ido Peled 49
50. Consolidate
Faculty
Archives
Publications
Data Sets Newsletters
Unified Digital
System
Student Research
Publications Paper
Institutional
Alumni
Photos
Speaker: Ido Peled 50
51. The Strategy – Sustainable Digital Preservation
CONSOLIDATE OPTIMIZE EXTEND
Extend the library
Consolidate all digital Optimize through
offering and
collections automation
collaborations
Speaker: Ido Peled 51
52. Optimize
“As
the
rate
of
digital
informa5on
produc5on
con5nues
to
escalate,
it
is
vitally
important
to
reduce
the
cost
of
preserva5on
for
all
types
of
digital
assets”
Sustainable
Economics
for
a
Digital
Planet,
Final
Report
of
the
Blue
Ribbon
Task
Force
Taken
from
‘ The
2011
IDC
Digital
Universe
Study’
x75
x1.5
Digital
Staff
Informa5on
Speaker: Ido Peled 52
53. Optimize - LIFE Project
• Collaboration between British Library and UCL
• Developed a generic lifecycle costing formula
• See http://www.life.ac.uk/
Speaker: Ido Peled 53
62. The Strategy – Sustainable Digital Preservation
CONSOLIDATE OPTIMIZE EXTEND
Extend the library
Consolidate all digital Optimize through
offering and
collections automation
collaborations
Speaker: Ido Peled 62
64. Extend The Library Reach
Faculty Students
Administration Alumni
Finance Other Stakeholders
Speaker: Ido Peled 64
65. The Strategy – Sustainable Digital Preservation
CONSOLIDATE OPTIMIZE EXTEND
Extend the library
Consolidate all digital Optimize through
offering and
collections automation
collaborations
Speaker: Ido Peled 65
66. Extend The Library Reach
Faculty Students
Administration Alumni
Finance Other Stakeholders
Speaker: Ido Peled 66
68. Ex Libris Rosetta
Ex Libris Rosetta helps institutions in collecting, managing,
archiving and preserving their digital collections, ensuring its
data integrity and access over time
Preserve
Manage
Collect Deliver
Archive
Speaker: Ido Peled 68
70. Rosetta Customers
Background Collections in Rosetta
Binghamton, NY, USA Special collections
Part of the SUNY system (Edwin A. Link
FTE: ~14K students collection)
Staff: 1.5FTE (not Born digital
dedicated) newsletters
University photographs
Background Key Areas of Collaboration
Munich, Germany Scanned manuscripts
Service providers for and rare books
Bavaria Legal deposit
Part of the Google documents
Books project Websites
Speaker: Ido Peled 70
71. Rosetta Customers
Background Collections in Rosetta
Zurich, Switzerland Research data
Leading technological Special collections
institution Dissertations
DataCite partners
Background Key Areas of Collaboration
Wellington, New Nation’s Cultural
Zealand heritage
Development partner Private collections
Mandate for digital Websites
preservation
Speaker: Ido Peled 71
75. Why Should You Choose to Rosetta?
>30%
DIV
ROI
TCO
Demonstrated
Return On Institutional Value
Investment • Extended cross-
Total Cost of
institution digital
Ownership • Ensure online access preservation service
• Sustainable model for • Improved distribution • Increased
digital preservation mechanism collaboration with
researchers
• Single enterprise • Optimized digital
solution content management • Enhanced emphasis on
strategic initiatives
• Minimal staff • Confirm to funding
requirements agencies
requirements
Efficiency Effectiveness Value
Speaker: Ido Peled 75
76. Become a Trusted Digital Library
Rosetta as a strategic initiative (TDR)
Extending the library offering
Reducing TCO
Library & IT
Directors Offering new career paths
Focus on curation, not IT
Consolidate work efforts
Extend digital collections
Digital
Modern working environment Initiatives
Librarian
Complying with grant proposal
Preserving research data
Head of Increasing re-use of data
Research
Speaker: Ido Peled 76
78. Meeting the Expectations of the
Community : CRL & the Auditing
of Digital Repositories
Marie Waltz
Center for Research Libraries
79. What is the Center for Research Libraries
(CRL)
• A consortium of over 260 College and
University Library’s, primarily in the U.S.
and Canada.
• Our members have an interest in auditing
and certification because they are
investing in digital repositories.
Speaker: Marie Waltz
11/28/2007 Practices & Challenges in Preservation
80. Research libraries are changing...content
is no longer on library shelves
• The collections of 80% of U.S. research libraries are duplicating the contents
of other research libraries. Most of what is owned will be digitized within the
next ten years.
• Google has digitized more than 12 million volumes.
• Born digital material is now the norm for many types of academic materials
(course syllabi, articles, and many manuscripts submitted to publishers.)
Speaker: Marie Waltz
Practices & Challenges in Preservation
81. CRL & Digital Preservation
2002 - 2004 – Political Communications
Web Archiving Project
2005 - 2006 – Test audits of TRAC
2008 - 2010 – NSF Case Studies
Speaker: Marie Waltz
Practices & Challenges in Preservation
82. CRL & Test Audits using TRAC
RLG/CRL Mellon Foundation Project to
audits digital repositories
– ICPSR, Portico, KB, LOCKSS
– Tested the TRAC metrics
– Understanding of the auditing process.
Speaker: Marie Waltz
Practices & Challenges in Preservation
83. CRL & NSF Case Studies
• Looked at eight organizations of various
sizes who house digital content
• Gave us a broader understanding of what
makes a “successful” organization
• Allowed us to see how technology
decisions effect a repository.
Speaker: Marie Waltz
Practices & Challenges in Preservation
84. Current Digital Preservation Projects at
CRL
• Certifying digital repositories of interest to
members.
• Participation in establishment of ISO
16363
• Human Rights Archives & Documentation.
Speaker: Marie Waltz
Practices & Challenges in Preservation
85. NISO Presentation
What is a Trusted Digital Repository?
A trusted digital repository is one whose
mission is to provide reliable, long-term
access to managed digital resources to its
designated community, now and in the
future
– Trusted Digital Repositories : Attributes and
Responsibilities, An RLG-OCLC Report (RLG, 2002)
Speaker: Marie Waltz
Practices & Challenges in Preservation
86. NISO Presentation
Why Auditing?
An audit establishes the soundness and
dependability of a repository.
Speaker: Marie Waltz
Practices & Challenges in Preservation
87. NISO Presentation
Auditing a Digital Repository
• Advisory Panel
• Audit Criteria
• Time table
• Standards in auditing
• Certification and reporting to community
Speaker: Marie Waltz
Practices & Challenges in Preservation
88. Current Advisory Panel
• Martha Brogan (Chair) • Anne Pottier
Director of Collection Development & Associate University Librarian
Management McMaster University
University of Pennsylvania
• Oya Y. Rieger
• Winston Atkins Associate University Librarian for
Preservation Officer Information Technologies
Duke University Cornell University
• William Parod • Perry Willett
Senior Repository Developer Digital Preservation Services Manager
Northwestern University Libraries California Digital Library
• Mark Phillips
Assistant Dean for Digital Libraries
University of North Texas Libraries
Speaker: Marie Waltz
Practices & Challenges in Preservation
89. NISO Presentation
Criteria
• Advisory Panel
• ISO 16363 (TDR) / TRAC
• Community feedback
Speaker: Marie Waltz
Practices & Challenges in Preservation
90. NISO Presentation
Timetable for an Audit
1. Logistics for the audit
2. Request for Documentation
3. Identify activities, policies etc. of key
significance for preservation
4. Evaluation of Repository (includes site visit)
5. Review findings with panel
6. Report findings
Speaker: Marie Waltz
Practices & Challenges in Preservation
91. NISO Presentation
Standards Used in Auditing
• Metadata Standards, Dublin Core, Content
Standard for Digital Geospatial Metadata
(CSDGM)
• Technical Standards, ISO 27001
• Data and format standards, PDF/A, etc.
Speaker: Marie Waltz
Practices & Challenges in Preservation
92. NISO Presentation
Certification
• Means the Repository is “Trusted”
• We report findings to the Research
Community
• Considerations for: Length of Certification
and Re-Certification
Speaker: Marie Waltz
Practices & Challenges in Preservation
93. NISO Presentation
Certification of HathiTrust & Portico
• More information about preservation on
their websites
• Assurance they are adhering to standards
and preservation strategies
• Assurance that changes will take
preservation into account
Speaker: Marie Waltz
Practices & Challenges in Preservation
94. NISO Presentation
ISO Standard 16363
• Work on the standard: PTAB Group
• Test audits
• Future plans for auditing using ISO 16363
Speaker: Marie Waltz
Practices & Challenges in Preservation
95. NISO Presentation
Test Audits of ISO 16363
• May-July 2011. Tested six digital
repositories, three in the U.S. and three in
Europe.
• Future plans for auditing using ISO 16363.
– European Framework for Certification
and Auditing.
Speaker: Marie Waltz
Practices & Challenges in Preservation
96. NISO Presentation
Future Plans for CRL Auditing
• Use ISO 16363
• Audit repositories of interest to academic
and independent researchers in the United
States and Canada.
• Encourage community feedback
• Become a resource for information about
digital repositories
Speaker: Marie Waltz
Practices & Challenges in Preservation
97. NISO Presentation
Community involvement
• Without community feedback we will not
be successful at targeting our audits
• We want to audit repositories of interest to
academic and independent researchers.
Speaker: Marie Waltz
Practices & Challenges in Preservation
98. NISO Presentation
CRL is becoming a Resource for
Information about Digital Repositories
• Global Resources Forum (GRF) Reviews
and Profiles
• Audit reports
• Webinars
Speaker: Marie Waltz
Practices & Challenges in Preservation
99. NISO Presentation
Summary
CRL will continue to audit digital repositories
of interest on behalf of our members using
ISO 16363.
Speaker: Marie Waltz
Practices & Challenges in Preservation