SlideShare a Scribd company logo
1 of 32
Active Digital Preservation
and Data/Metadata
Migration
Nick Ruest, York University Karen Estlund, Penn State University
Focusing on Movement
NDSA Preservation Activities
- Check fixity of all content in
response to specific events
or activities
- Ability to replace / repair
computed data
- Ensure no one person...
Store standard
preservation metadata
Lund, Ken. (2012). Timpanogos Cave National Monument.
https://www.flickr.com/photos/kenlund/7187382348/ CC-BY 2.0
MoabAdventurer. (2010). Cataract Canyon.
https://www.flickr.com/photos/tag-a-long/4818668522/ CC-BY 2.0
Digital Preservation Storage
PROBLEM STATEMENT
Repository Migrations
Connecting Access & Preservation Copies
<institutal_id.item_uid[.b###.of###]>/
| bagit.txt
| manifest-md5.txt
| bag-info.txt
| aptrust-info.txt
----data/
| [payload files]
Big Data - Lack of Movement
Federal Communications Center. (2010). Data Center.
https://www.flickr.com/photos/fccdotgov/albums/72157624535788708
ADDRESSING THE PROBLEMS
Staffing and Skills Required
● Understanding of issues related to both
digitized and born-digital formats, media,
and migration is required
● METS & PREMIS (metadata standards)
● Fedora, Hydra, Islandora….
● Familiarity with national and international
collaborative digital preservation efforts
● Digital preservation tools such as
BitCurator, Archivematica, Preservica,
BagIT and
● Application of Linked Data URIs in
metadata records
● + all sorts of good standard language
Missing Abilities:
• Ability to communicate and
understand networking and data
center environments
• Ability to identify metadata
necessary to preserve and track data
in changing technical environments
• Ability to identify and manage
copyright-related concerns for data
preservation and metadata
management
• Ability to forecast access needs and
identify content preservation
Current Ads
Export & Import
Infrastructure & Local Collaborations Required
Federal Communications Center. (2010). Data Center.
https://www.flickr.com/photos/fccdotgov/albums/72157624535788708
Open Source Commitment
NASA. A Precocious Black Hole. (2015). https://www.nasa.gov/image-feature/a-precocious-
black-hole
Decision Trees – Where to Preserve & How to
Access*
Preservation Strategy Back-up Local
Preservation
Strategies**
MetaArchive APTrust Digital
Preservation
Network
Research Data X X
ETDs X X
PA unique CHO materials X X X
Purchased content X
High value, at risk unique
materials
X X X
* Draft decision tree
** May include off-site storage
NEXT STEPS
What Does Digital Preservation Look Like Now
Federal Communications Commission. (2010). Data Center
https://www.flickr.com/photos/fccdotgov/4808782554/
Fedora Import/Export
Background
Stakeholders
Esmé Cowles, Princeton University
Ben Armintor, Columbia University
Mike Durbin, University of Virginia
Josh Westgard, University of Maryland
Youn Noh, Yale University
Mike Giarlo, Stanford University
Jon Stroop, Princeton University
Karen Estlund, Penn State University
Jim Tuttle, Duke University
Planning
Use Cases
Design
Requirements
Requirements
Requirements
Sprints
August, 2016
Devs
Esmé Cowles
Ben Arminator
Nick Ruest
Mike Durbin
Testing & Validation
Mike Durbin
Josh Westgard
Justin Simpson
Youn Noh
Yinlin Chen
Bethany Seegar
Documentation
Youn Noh
Josh Westgard
September, 2016
(Penn State)
Devs
Esmé Cowles
Nick Ruest
Andrew Woods
Testing & Validation
Adam Wead
Nick Ruest
Andrew Woods
Karen Estlund
Documentation
Adam Wead
Nick Ruest
December, 2016
Devs
Esmé Cowles
Nick Ruest
Jared Whiklo
Danny Bernstein
Testing & Validation
Josh Westgard
Nick Ruest
Kieran Etienne
Adam Wead
Justin Simpson
Documentation
Josh Westgard
Nick Ruest
Stakeholder evaluation
Where we’re at now
Next steps

More Related Content

What's hot

2008 04 22 Jun Zhao Ldow
2008 04 22 Jun Zhao Ldow2008 04 22 Jun Zhao Ldow
2008 04 22 Jun Zhao LdowJun Zhao
 
鏈結資料在圖書館的應用20131107
鏈結資料在圖書館的應用20131107鏈結資料在圖書館的應用20131107
鏈結資料在圖書館的應用20131107皓仁 柯
 
Linked Open Data for Cultural Heritage
Linked Open Data for Cultural HeritageLinked Open Data for Cultural Heritage
Linked Open Data for Cultural HeritageNoreen Whysel
 
DataUp Lightning Talk for #iEvoBio
DataUp Lightning Talk for #iEvoBioDataUp Lightning Talk for #iEvoBio
DataUp Lightning Talk for #iEvoBioCarly Strasser
 
Digital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content ManagementDigital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content ManagementNoreen Whysel
 
DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"
DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"
DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"Bogdan Trifunovic
 
Open Science Globally: Some Developments/Dr Simon Hodson
Open Science Globally: Some Developments/Dr Simon HodsonOpen Science Globally: Some Developments/Dr Simon Hodson
Open Science Globally: Some Developments/Dr Simon HodsonAfrican Open Science Platform
 
Oxford University Geospatial Metadata Workshop 20110415
Oxford University Geospatial Metadata Workshop 20110415Oxford University Geospatial Metadata Workshop 20110415
Oxford University Geospatial Metadata Workshop 20110415EDINA, University of Edinburgh
 
Getting started in digital preservation
Getting started in digital preservationGetting started in digital preservation
Getting started in digital preservationSarah Jones
 
Cal Poly - Data Management for Researchers
Cal Poly - Data Management for ResearchersCal Poly - Data Management for Researchers
Cal Poly - Data Management for ResearchersCarly Strasser
 
Digital Preservation
Digital PreservationDigital Preservation
Digital Preservationtrbeck
 
Data Management Solutions from Libraries at NSF Large Facilities Workshop
Data Management Solutions from Libraries at NSF Large Facilities WorkshopData Management Solutions from Libraries at NSF Large Facilities Workshop
Data Management Solutions from Libraries at NSF Large Facilities WorkshopCarly Strasser
 
Digital Preservation
Digital PreservationDigital Preservation
Digital PreservationMichael Day
 
EUDAT Research Data Management | www.eudat.eu |
EUDAT Research Data Management | www.eudat.eu | EUDAT Research Data Management | www.eudat.eu |
EUDAT Research Data Management | www.eudat.eu | EUDAT
 
Principle Violations: Revisiting the Dublin Core 1:1 Principle
Principle Violations:  Revisiting the Dublin Core 1:1 PrinciplePrinciple Violations:  Revisiting the Dublin Core 1:1 Principle
Principle Violations: Revisiting the Dublin Core 1:1 PrincipleRichard Urban
 
Preservation Metadata Initiatives and Standards
Preservation Metadata Initiatives and StandardsPreservation Metadata Initiatives and Standards
Preservation Metadata Initiatives and StandardsKEEP_project
 

What's hot (20)

2008 04 22 Jun Zhao Ldow
2008 04 22 Jun Zhao Ldow2008 04 22 Jun Zhao Ldow
2008 04 22 Jun Zhao Ldow
 
鏈結資料在圖書館的應用20131107
鏈結資料在圖書館的應用20131107鏈結資料在圖書館的應用20131107
鏈結資料在圖書館的應用20131107
 
Linked Open Data for Cultural Heritage
Linked Open Data for Cultural HeritageLinked Open Data for Cultural Heritage
Linked Open Data for Cultural Heritage
 
DataUp Lightning Talk for #iEvoBio
DataUp Lightning Talk for #iEvoBioDataUp Lightning Talk for #iEvoBio
DataUp Lightning Talk for #iEvoBio
 
Digital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content ManagementDigital Infrastructure: Storage and Content Management
Digital Infrastructure: Storage and Content Management
 
Cornell 2011 05-13
Cornell 2011 05-13Cornell 2011 05-13
Cornell 2011 05-13
 
DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"
DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"
DIGITAL LIBRARIES AND THE CHALLENGE OF A "DIGITAL DARK AGES"
 
Open Science Globally: Some Developments/Dr Simon Hodson
Open Science Globally: Some Developments/Dr Simon HodsonOpen Science Globally: Some Developments/Dr Simon Hodson
Open Science Globally: Some Developments/Dr Simon Hodson
 
Oxford University Geospatial Metadata Workshop 20110415
Oxford University Geospatial Metadata Workshop 20110415Oxford University Geospatial Metadata Workshop 20110415
Oxford University Geospatial Metadata Workshop 20110415
 
Getting started in digital preservation
Getting started in digital preservationGetting started in digital preservation
Getting started in digital preservation
 
Cal Poly - Data Management for Researchers
Cal Poly - Data Management for ResearchersCal Poly - Data Management for Researchers
Cal Poly - Data Management for Researchers
 
IASSIST 2009
IASSIST 2009IASSIST 2009
IASSIST 2009
 
Digital Preservation
Digital PreservationDigital Preservation
Digital Preservation
 
Data Management Solutions from Libraries at NSF Large Facilities Workshop
Data Management Solutions from Libraries at NSF Large Facilities WorkshopData Management Solutions from Libraries at NSF Large Facilities Workshop
Data Management Solutions from Libraries at NSF Large Facilities Workshop
 
Open Science - Global Perspectives/Simon Hodson
Open Science - Global Perspectives/Simon HodsonOpen Science - Global Perspectives/Simon Hodson
Open Science - Global Perspectives/Simon Hodson
 
Digital Preservation
Digital PreservationDigital Preservation
Digital Preservation
 
EUDAT Research Data Management | www.eudat.eu |
EUDAT Research Data Management | www.eudat.eu | EUDAT Research Data Management | www.eudat.eu |
EUDAT Research Data Management | www.eudat.eu |
 
Principle Violations: Revisiting the Dublin Core 1:1 Principle
Principle Violations:  Revisiting the Dublin Core 1:1 PrinciplePrinciple Violations:  Revisiting the Dublin Core 1:1 Principle
Principle Violations: Revisiting the Dublin Core 1:1 Principle
 
Fedora Oxford Dec09
Fedora Oxford Dec09Fedora Oxford Dec09
Fedora Oxford Dec09
 
Preservation Metadata Initiatives and Standards
Preservation Metadata Initiatives and StandardsPreservation Metadata Initiatives and Standards
Preservation Metadata Initiatives and Standards
 

Similar to Active Digital Preservation and Data/Metadata Migration

DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...lindlar
 
DURAARK Preserving Architectural Knowledge
DURAARK Preserving Architectural KnowledgeDURAARK Preserving Architectural Knowledge
DURAARK Preserving Architectural KnowledgeRuggero Lancia
 
Digital Preservation
Digital PreservationDigital Preservation
Digital PreservationSmita Chandra
 
Digital Preservation
Digital PreservationDigital Preservation
Digital Preservationsmtcd
 
Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations
Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations
Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations EDINA, University of Edinburgh
 
Introduction to data management
Introduction to data managementIntroduction to data management
Introduction to data managementCunera Buys
 
IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...
IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...
IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...IFLAAcademicandResea
 
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...aceas13tern
 
Improving Stewardship of Scientific Data Through Use of a Maturity Matrix
Improving Stewardship of Scientific Data Through Use of a Maturity MatrixImproving Stewardship of Scientific Data Through Use of a Maturity Matrix
Improving Stewardship of Scientific Data Through Use of a Maturity MatrixGe Peng
 
GBIF and reuse of research data, Bergen (2016-12-14)
GBIF and reuse of research data, Bergen (2016-12-14)GBIF and reuse of research data, Bergen (2016-12-14)
GBIF and reuse of research data, Bergen (2016-12-14)Dag Endresen
 
Planning Beyond Digitization: Digital Preservation for Audiovisual Collections
Planning Beyond Digitization: Digital Preservation for Audiovisual Collections Planning Beyond Digitization: Digital Preservation for Audiovisual Collections
Planning Beyond Digitization: Digital Preservation for Audiovisual Collections Kara Van Malssen
 
Informatics Transform : Re-engineering Libraries for the Data Decade
Informatics Transform : Re-engineering Libraries for the Data DecadeInformatics Transform : Re-engineering Libraries for the Data Decade
Informatics Transform : Re-engineering Libraries for the Data DecadeLiz Lyon
 
Internet2 Support for Biomedical Research
Internet2 Support for Biomedical ResearchInternet2 Support for Biomedical Research
Internet2 Support for Biomedical ResearchEd Dodds
 
Christensen dunlop dublin_core
Christensen dunlop dublin_coreChristensen dunlop dublin_core
Christensen dunlop dublin_coredunlopd.si
 
Introduction to data management
Introduction to data managementIntroduction to data management
Introduction to data managementcunera
 

Similar to Active Digital Preservation and Data/Metadata Migration (20)

DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...
DURAARK presentation at DEDICATE final seminar, October 21st 2013, Michelle L...
 
DURAARK Preserving Architectural Knowledge
DURAARK Preserving Architectural KnowledgeDURAARK Preserving Architectural Knowledge
DURAARK Preserving Architectural Knowledge
 
Dig c curr
Dig c currDig c curr
Dig c curr
 
Digital Preservation
Digital PreservationDigital Preservation
Digital Preservation
 
Digital Preservation
Digital PreservationDigital Preservation
Digital Preservation
 
Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations
Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations
Edinburgh DataShare – A DSpace Data Repository: Achievements and Aspirations
 
Dataset Metadata, Tools and Approaches for Access and Preservation
Dataset Metadata, Tools and Approaches for Access and PreservationDataset Metadata, Tools and Approaches for Access and Preservation
Dataset Metadata, Tools and Approaches for Access and Preservation
 
Introduction to data management
Introduction to data managementIntroduction to data management
Introduction to data management
 
IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...
IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...
IFLA ARL Webinar Series: Digital Preservation - Managing Publications and Dat...
 
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...
SPatially Explicit Data Discovery, Extraction and Evaluation Services (SPEDDE...
 
CAEPIA 2011
CAEPIA 2011CAEPIA 2011
CAEPIA 2011
 
Improving Stewardship of Scientific Data Through Use of a Maturity Matrix
Improving Stewardship of Scientific Data Through Use of a Maturity MatrixImproving Stewardship of Scientific Data Through Use of a Maturity Matrix
Improving Stewardship of Scientific Data Through Use of a Maturity Matrix
 
GBIF and reuse of research data, Bergen (2016-12-14)
GBIF and reuse of research data, Bergen (2016-12-14)GBIF and reuse of research data, Bergen (2016-12-14)
GBIF and reuse of research data, Bergen (2016-12-14)
 
Intro to RDM
Intro to RDMIntro to RDM
Intro to RDM
 
Planning Beyond Digitization: Digital Preservation for Audiovisual Collections
Planning Beyond Digitization: Digital Preservation for Audiovisual Collections Planning Beyond Digitization: Digital Preservation for Audiovisual Collections
Planning Beyond Digitization: Digital Preservation for Audiovisual Collections
 
LeafletMedici_f2f
LeafletMedici_f2fLeafletMedici_f2f
LeafletMedici_f2f
 
Informatics Transform : Re-engineering Libraries for the Data Decade
Informatics Transform : Re-engineering Libraries for the Data DecadeInformatics Transform : Re-engineering Libraries for the Data Decade
Informatics Transform : Re-engineering Libraries for the Data Decade
 
Internet2 Support for Biomedical Research
Internet2 Support for Biomedical ResearchInternet2 Support for Biomedical Research
Internet2 Support for Biomedical Research
 
Christensen dunlop dublin_core
Christensen dunlop dublin_coreChristensen dunlop dublin_core
Christensen dunlop dublin_core
 
Introduction to data management
Introduction to data managementIntroduction to data management
Introduction to data management
 

More from Karen Estlund

IIIF, Annotations, & Discourse
IIIF, Annotations, & DiscourseIIIF, Annotations, & Discourse
IIIF, Annotations, & DiscourseKaren Estlund
 
Open Peer Review with Ada
Open Peer Review with AdaOpen Peer Review with Ada
Open Peer Review with AdaKaren Estlund
 
Newspapers, IIIF, and ALTO
Newspapers, IIIF, and ALTONewspapers, IIIF, and ALTO
Newspapers, IIIF, and ALTOKaren Estlund
 
Open ONI and IIIF: NDNP data in an IIIF Viewer
Open ONI and IIIF: NDNP data in an IIIF ViewerOpen ONI and IIIF: NDNP data in an IIIF Viewer
Open ONI and IIIF: NDNP data in an IIIF ViewerKaren Estlund
 
Portland Common Data Model (PCDM): Creating and Sharing Complex Digital Objects
Portland Common Data Model (PCDM): Creating and Sharing Complex Digital ObjectsPortland Common Data Model (PCDM): Creating and Sharing Complex Digital Objects
Portland Common Data Model (PCDM): Creating and Sharing Complex Digital ObjectsKaren Estlund
 
Open-ONI: Online Newspaper Initiative
Open-ONI: Online Newspaper InitiativeOpen-ONI: Online Newspaper Initiative
Open-ONI: Online Newspaper InitiativeKaren Estlund
 
Local content storage & integration
Local content storage & integrationLocal content storage & integration
Local content storage & integrationKaren Estlund
 
Beyond NDNP: Technical Specifications Working Group
Beyond NDNP: Technical Specifications Working GroupBeyond NDNP: Technical Specifications Working Group
Beyond NDNP: Technical Specifications Working GroupKaren Estlund
 
Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...
Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...
Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...Karen Estlund
 
Rights Technical Design
Rights Technical DesignRights Technical Design
Rights Technical DesignKaren Estlund
 
Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...
Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...
Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...Karen Estlund
 
Oregon Digital: Collaborative Hydra Development
Oregon Digital: Collaborative Hydra DevelopmentOregon Digital: Collaborative Hydra Development
Oregon Digital: Collaborative Hydra DevelopmentKaren Estlund
 
Converting Metadata to Linked Data
Converting Metadata to Linked DataConverting Metadata to Linked Data
Converting Metadata to Linked DataKaren Estlund
 
APIs & Open Data with Oregon Digital Newspapers
APIs & Open Data with Oregon Digital NewspapersAPIs & Open Data with Oregon Digital Newspapers
APIs & Open Data with Oregon Digital NewspapersKaren Estlund
 
Collaborative Digital Collection Management: Briefing on Oregon Digital & th...
Collaborative Digital Collection Management:  Briefing on Oregon Digital & th...Collaborative Digital Collection Management:  Briefing on Oregon Digital & th...
Collaborative Digital Collection Management: Briefing on Oregon Digital & th...Karen Estlund
 
Fostering A Graduate Research Community with Digital Scholarship Programs and...
Fostering A Graduate Research Community with Digital Scholarship Programs and...Fostering A Graduate Research Community with Digital Scholarship Programs and...
Fostering A Graduate Research Community with Digital Scholarship Programs and...Karen Estlund
 
RDF in Hydra Summit Overview
RDF in Hydra Summit OverviewRDF in Hydra Summit Overview
RDF in Hydra Summit OverviewKaren Estlund
 

More from Karen Estlund (20)

IIIF, Annotations, & Discourse
IIIF, Annotations, & DiscourseIIIF, Annotations, & Discourse
IIIF, Annotations, & Discourse
 
IIIF Development
IIIF DevelopmentIIIF Development
IIIF Development
 
Open Peer Review with Ada
Open Peer Review with AdaOpen Peer Review with Ada
Open Peer Review with Ada
 
Newspapers, IIIF, and ALTO
Newspapers, IIIF, and ALTONewspapers, IIIF, and ALTO
Newspapers, IIIF, and ALTO
 
Open ONI and IIIF: NDNP data in an IIIF Viewer
Open ONI and IIIF: NDNP data in an IIIF ViewerOpen ONI and IIIF: NDNP data in an IIIF Viewer
Open ONI and IIIF: NDNP data in an IIIF Viewer
 
Newspapers & IIIF
Newspapers & IIIFNewspapers & IIIF
Newspapers & IIIF
 
Portland Common Data Model (PCDM): Creating and Sharing Complex Digital Objects
Portland Common Data Model (PCDM): Creating and Sharing Complex Digital ObjectsPortland Common Data Model (PCDM): Creating and Sharing Complex Digital Objects
Portland Common Data Model (PCDM): Creating and Sharing Complex Digital Objects
 
Open-ONI: Online Newspaper Initiative
Open-ONI: Online Newspaper InitiativeOpen-ONI: Online Newspaper Initiative
Open-ONI: Online Newspaper Initiative
 
Local content storage & integration
Local content storage & integrationLocal content storage & integration
Local content storage & integration
 
Beyond NDNP: Technical Specifications Working Group
Beyond NDNP: Technical Specifications Working GroupBeyond NDNP: Technical Specifications Working Group
Beyond NDNP: Technical Specifications Working Group
 
Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...
Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...
Library Support for Journal Publishing: Emphasis on multi-modal open peer rev...
 
Newspapers
NewspapersNewspapers
Newspapers
 
Rights Technical Design
Rights Technical DesignRights Technical Design
Rights Technical Design
 
Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...
Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...
Publishing Ada: A Retrospective Look at the First Three Years of an Open Peer...
 
Oregon Digital: Collaborative Hydra Development
Oregon Digital: Collaborative Hydra DevelopmentOregon Digital: Collaborative Hydra Development
Oregon Digital: Collaborative Hydra Development
 
Converting Metadata to Linked Data
Converting Metadata to Linked DataConverting Metadata to Linked Data
Converting Metadata to Linked Data
 
APIs & Open Data with Oregon Digital Newspapers
APIs & Open Data with Oregon Digital NewspapersAPIs & Open Data with Oregon Digital Newspapers
APIs & Open Data with Oregon Digital Newspapers
 
Collaborative Digital Collection Management: Briefing on Oregon Digital & th...
Collaborative Digital Collection Management:  Briefing on Oregon Digital & th...Collaborative Digital Collection Management:  Briefing on Oregon Digital & th...
Collaborative Digital Collection Management: Briefing on Oregon Digital & th...
 
Fostering A Graduate Research Community with Digital Scholarship Programs and...
Fostering A Graduate Research Community with Digital Scholarship Programs and...Fostering A Graduate Research Community with Digital Scholarship Programs and...
Fostering A Graduate Research Community with Digital Scholarship Programs and...
 
RDF in Hydra Summit Overview
RDF in Hydra Summit OverviewRDF in Hydra Summit Overview
RDF in Hydra Summit Overview
 

Recently uploaded

Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptxVS Mahajan Coaching Centre
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajanpragatimahajan3
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...anjaliyadav012327
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Russian Call Girls in Andheri Airport Mumbai WhatsApp 9167673311 💞 Full Nigh...
Russian Call Girls in Andheri Airport Mumbai WhatsApp  9167673311 💞 Full Nigh...Russian Call Girls in Andheri Airport Mumbai WhatsApp  9167673311 💞 Full Nigh...
Russian Call Girls in Andheri Airport Mumbai WhatsApp 9167673311 💞 Full Nigh...Pooja Nehwal
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxShobhayan Kirtania
 

Recently uploaded (20)

Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions  for the students and aspirants of Chemistry12th.pptxOrganic Name Reactions  for the students and aspirants of Chemistry12th.pptx
Organic Name Reactions for the students and aspirants of Chemistry12th.pptx
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Russian Call Girls in Andheri Airport Mumbai WhatsApp 9167673311 💞 Full Nigh...
Russian Call Girls in Andheri Airport Mumbai WhatsApp  9167673311 💞 Full Nigh...Russian Call Girls in Andheri Airport Mumbai WhatsApp  9167673311 💞 Full Nigh...
Russian Call Girls in Andheri Airport Mumbai WhatsApp 9167673311 💞 Full Nigh...
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptx
 

Active Digital Preservation and Data/Metadata Migration

  • 1. Active Digital Preservation and Data/Metadata Migration Nick Ruest, York University Karen Estlund, Penn State University
  • 3. NDSA Preservation Activities - Check fixity of all content in response to specific events or activities - Ability to replace / repair computed data - Ensure no one person... Store standard preservation metadata
  • 4. Lund, Ken. (2012). Timpanogos Cave National Monument. https://www.flickr.com/photos/kenlund/7187382348/ CC-BY 2.0 MoabAdventurer. (2010). Cataract Canyon. https://www.flickr.com/photos/tag-a-long/4818668522/ CC-BY 2.0 Digital Preservation Storage
  • 7. Connecting Access & Preservation Copies <institutal_id.item_uid[.b###.of###]>/ | bagit.txt | manifest-md5.txt | bag-info.txt | aptrust-info.txt ----data/ | [payload files]
  • 8. Big Data - Lack of Movement Federal Communications Center. (2010). Data Center. https://www.flickr.com/photos/fccdotgov/albums/72157624535788708
  • 10. Staffing and Skills Required ● Understanding of issues related to both digitized and born-digital formats, media, and migration is required ● METS & PREMIS (metadata standards) ● Fedora, Hydra, Islandora…. ● Familiarity with national and international collaborative digital preservation efforts ● Digital preservation tools such as BitCurator, Archivematica, Preservica, BagIT and ● Application of Linked Data URIs in metadata records ● + all sorts of good standard language Missing Abilities: • Ability to communicate and understand networking and data center environments • Ability to identify metadata necessary to preserve and track data in changing technical environments • Ability to identify and manage copyright-related concerns for data preservation and metadata management • Ability to forecast access needs and identify content preservation Current Ads
  • 12. Infrastructure & Local Collaborations Required Federal Communications Center. (2010). Data Center. https://www.flickr.com/photos/fccdotgov/albums/72157624535788708
  • 13. Open Source Commitment NASA. A Precocious Black Hole. (2015). https://www.nasa.gov/image-feature/a-precocious- black-hole
  • 14. Decision Trees – Where to Preserve & How to Access* Preservation Strategy Back-up Local Preservation Strategies** MetaArchive APTrust Digital Preservation Network Research Data X X ETDs X X PA unique CHO materials X X X Purchased content X High value, at risk unique materials X X X * Draft decision tree ** May include off-site storage
  • 16. What Does Digital Preservation Look Like Now Federal Communications Commission. (2010). Data Center https://www.flickr.com/photos/fccdotgov/4808782554/
  • 19. Stakeholders Esmé Cowles, Princeton University Ben Armintor, Columbia University Mike Durbin, University of Virginia Josh Westgard, University of Maryland Youn Noh, Yale University Mike Giarlo, Stanford University Jon Stroop, Princeton University Karen Estlund, Penn State University Jim Tuttle, Duke University
  • 27. August, 2016 Devs Esmé Cowles Ben Arminator Nick Ruest Mike Durbin Testing & Validation Mike Durbin Josh Westgard Justin Simpson Youn Noh Yinlin Chen Bethany Seegar Documentation Youn Noh Josh Westgard
  • 28. September, 2016 (Penn State) Devs Esmé Cowles Nick Ruest Andrew Woods Testing & Validation Adam Wead Nick Ruest Andrew Woods Karen Estlund Documentation Adam Wead Nick Ruest
  • 29. December, 2016 Devs Esmé Cowles Nick Ruest Jared Whiklo Danny Bernstein Testing & Validation Josh Westgard Nick Ruest Kieran Etienne Adam Wead Justin Simpson Documentation Josh Westgard Nick Ruest