The “obsession” with checksums by Helen Hockx-Yu
•
0 likes•55 views
Checksums are used to verify the integrity of digital files and objects by determining if they have remained fixed or unchanged over time. Checksum-based fixity checking workflows are commonly used by libraries and archives to preserve digital assets. While bit flips are not a major cause of data loss, risks like human error, viruses, bugs in software, and malicious actors threaten the long-term preservation of digital content. There is a debate around whether checksumming all files is necessary for preservation or if storage services that provide hashes can be trusted instead.
Report
Share
Report
Share
Download to read offline
Recommended
Paul Stokes (Jisc) - A provocation about preservation
This document discusses the importance of digital preservation and some of the challenges involved. Digital preservation involves actively maintaining digital information so it remains accessible and usable into the future. Key challenges include hardware and software obsolescence, data loss or corruption, and the growing environmental costs of storing large amounts of digital data. While backups are important, digital preservation requires an ongoing process of migration and maintenance. There are also technical, expertise, awareness, and budgetary hurdles to addressing the preservation of valuable digital content over the long term.
Digital Preservation Discussion Group
The document summarizes key discussion points from Axiell East Coast Roadshow 2018's Digital Preservation Discussion Group. The group discussed: 1) the types of digital materials cultural heritage organizations manage like images, documents, and born-digital files; 2) who has organizational digital preservation policies in place; and 3) what digital preservation means and current challenges organizations face in preserving digital collections over time given risks like file formats becoming unreadable and materials becoming lost or unrecoverable without preservation planning. The group also explored options for on-site and cloud-based preservation solutions and factors to consider when developing a digital preservation program and policy.
Managing active data: storage, access, academic dropbox services
Researchers need to store and access active data for their work. They often use local storage devices and email to manage their data, but these methods lack resilience. Institutions provide network storage, but their systems are rarely used by researchers for active data access and sharing. An ideal solution would transparently synchronize local and network storage, providing both the convenience of local access and the resilience of network attached storage. However, there are challenges to managing active research data at large scales, including file sizes, storage locations, costs, ease of use, network transfers, versions, and access rights that institutions aim to address.
CARLIdigpres
This document discusses digital preservation and common misconceptions about it. Digital preservation involves maintaining digital content, context, and metadata over time despite technological changes. It requires ongoing maintenance and migration to new formats. While challenging, digital preservation is necessary, achievable through collaboration, and can be planned for with proper education and resources. The document urges starting the conversation on campus to understand digital assets and develop preservation plans and funding.
Carl idigpres
This document discusses digital preservation and common misconceptions about it. Digital preservation involves maintaining digital content, context, and metadata over time despite technological changes. It requires ongoing maintenance and migration to new formats. While challenging, digital preservation is necessary, achievable through collaboration, and can be planned for with current skills and resources. The document urges education about digital preservation and taking initial steps like collection planning and seeking funding.
What are some of the things that the ‘Feds’ are doing about Digital ‘Stuff’?
What are some of the things that the ‘Feds’ are doing about Digital ‘Stuff’?National Library of Australia
This presentation discusses what digital ‘stuff’ the National Library of Australia is responsible for and explores some of the main issues regarding digital preservation of this ‘stuff’. It was delivered at the New South Wales State Library on February 15, 2011 by David PearsonArchiving documents mes hybrid
Microfilming documents provides long-term preservation of vital information for organizations in a cost-effective manner. While digitizing documents seems convenient, digital archives are vulnerable over long periods of time due to technological obsolescence and risks of data loss. The best approach is to use both digital and microfilm backups, with microfilm providing a reliable method of preserving information for decades to come due to its stability and ability to withstand disasters and errors. Microfilming eliminates storage costs and risks associated with digital preservation alone, making it a wise choice for critical information that needs to be retained and accessible over very long periods.
Hoe enterprise information structureren?
This document outlines an agenda for a workshop on structuring enterprise information at Port of Ghent. The agenda includes an introduction to Port of Ghent's information architecture, breakout sessions on this architecture and on topics like managing content and data, IT landscape/strategy, and intelligent analytics. It also discusses challenges organizations face in integrating content and data as well as priorities like knowledge sharing and collaboration.
Recommended
Paul Stokes (Jisc) - A provocation about preservation
This document discusses the importance of digital preservation and some of the challenges involved. Digital preservation involves actively maintaining digital information so it remains accessible and usable into the future. Key challenges include hardware and software obsolescence, data loss or corruption, and the growing environmental costs of storing large amounts of digital data. While backups are important, digital preservation requires an ongoing process of migration and maintenance. There are also technical, expertise, awareness, and budgetary hurdles to addressing the preservation of valuable digital content over the long term.
Digital Preservation Discussion Group
The document summarizes key discussion points from Axiell East Coast Roadshow 2018's Digital Preservation Discussion Group. The group discussed: 1) the types of digital materials cultural heritage organizations manage like images, documents, and born-digital files; 2) who has organizational digital preservation policies in place; and 3) what digital preservation means and current challenges organizations face in preserving digital collections over time given risks like file formats becoming unreadable and materials becoming lost or unrecoverable without preservation planning. The group also explored options for on-site and cloud-based preservation solutions and factors to consider when developing a digital preservation program and policy.
Managing active data: storage, access, academic dropbox services
Researchers need to store and access active data for their work. They often use local storage devices and email to manage their data, but these methods lack resilience. Institutions provide network storage, but their systems are rarely used by researchers for active data access and sharing. An ideal solution would transparently synchronize local and network storage, providing both the convenience of local access and the resilience of network attached storage. However, there are challenges to managing active research data at large scales, including file sizes, storage locations, costs, ease of use, network transfers, versions, and access rights that institutions aim to address.
CARLIdigpres
This document discusses digital preservation and common misconceptions about it. Digital preservation involves maintaining digital content, context, and metadata over time despite technological changes. It requires ongoing maintenance and migration to new formats. While challenging, digital preservation is necessary, achievable through collaboration, and can be planned for with proper education and resources. The document urges starting the conversation on campus to understand digital assets and develop preservation plans and funding.
Carl idigpres
This document discusses digital preservation and common misconceptions about it. Digital preservation involves maintaining digital content, context, and metadata over time despite technological changes. It requires ongoing maintenance and migration to new formats. While challenging, digital preservation is necessary, achievable through collaboration, and can be planned for with current skills and resources. The document urges education about digital preservation and taking initial steps like collection planning and seeking funding.
What are some of the things that the ‘Feds’ are doing about Digital ‘Stuff’?
What are some of the things that the ‘Feds’ are doing about Digital ‘Stuff’?National Library of Australia
This presentation discusses what digital ‘stuff’ the National Library of Australia is responsible for and explores some of the main issues regarding digital preservation of this ‘stuff’. It was delivered at the New South Wales State Library on February 15, 2011 by David PearsonArchiving documents mes hybrid
Microfilming documents provides long-term preservation of vital information for organizations in a cost-effective manner. While digitizing documents seems convenient, digital archives are vulnerable over long periods of time due to technological obsolescence and risks of data loss. The best approach is to use both digital and microfilm backups, with microfilm providing a reliable method of preserving information for decades to come due to its stability and ability to withstand disasters and errors. Microfilming eliminates storage costs and risks associated with digital preservation alone, making it a wise choice for critical information that needs to be retained and accessible over very long periods.
Hoe enterprise information structureren?
This document outlines an agenda for a workshop on structuring enterprise information at Port of Ghent. The agenda includes an introduction to Port of Ghent's information architecture, breakout sessions on this architecture and on topics like managing content and data, IT landscape/strategy, and intelligent analytics. It also discusses challenges organizations face in integrating content and data as well as priorities like knowledge sharing and collaboration.
Solving Document Security
This document discusses document security and introduces Covertix as a solution. It summarizes that Covertix provides seamless control and protection of data through embedded access and permissions within files to ensure protection both internally and externally. Covertix SmartCipher extends these protections beyond networks and allows protection of sensitive information without changing existing tools or workflows. It provides benefits like policy enforcement, auditing and transparency to users.
In Search of Simplicity: Redesigning the Digital Bleek and Lloyd
DESIDOC Journal of Library & Information Technology: Special Issue on Digital Preservation original submission.
Publication URL: http://goo.gl/yUERj
BibTeX Citation
@article{D2524,
author = {Lighton Phiri and Hussein Suleman},
title = {In Search of Simplicity: Redesigning the Digital Bleek and Lloyd},
journal = {DESIDOC Journal of Library & Information Technology},
volume = {32},
number = {4},
year = {2012},
keywords = {},
abstract = {The Digital Bleek and Lloyd is a collection of digitised historical artefacts on the Bushman people ofSouthern Africa. The underlying software was initially designed to enable access from as many people aspossible so usage requirements were minimal – it was not even necessary to use a web server or database.However, the system was not focused on preservation, extensibility, or reusability. In this article, it is arguedthat such desirable attributes could manifest themselves in a natural evolution of the Bleek and Lloyd softwaresystem in the direction of greater simplicity. A case study demonstrates that this is indeed feasible in the caseof the Digital Bleek and Lloyd and potentially more generally applicable in digital libraries.},
issn = {0976-4658}, url = {http://publications.drdo.gov.in/ojs/index.php/djlit/article/view/2524}
}
Filling the Digital Preservation Gap - Acting on Change
This presentation was delivered by Jenny Mitcham (University of York) at PERICLES final project conference 'Acting on Change: New Approaches and Future Practices in LTDP' (Wellcome Collection Conference Centre, London, 30 Nov -1 Dec 2016).
This thematic session was also joined by Matthew Addis (Arkivum), Dan Gillean (Artefactual), Angela Dappert (British Library) and Rob Baxter (University of Edinburgh/PERICLES).
According to the DCMM (Digital Preservation Capability Maturity Model ©) newsletter in January 2016, “There are positive signs that digital preservation is finally entering the mainstream of professional practice and information technology infrastructure.”
The accelerating impact of change on long-term preservation might contradict the optimisms that we are coming closer to bridging the digital preservation capability gap between the problem owners and the solution providers. A lot of cutting-edge technology and research has been done out there over the past decade to support preservation, but who is ready to take on the risk of being an early adopter of cutting-edge solutions? When it seems many organisations are still struggling to understand what they need to be doing and what fits their context and purposes.
So what does it take to close that chasm? What type of collaborations are needed? Are we ready to build that bridge?
http://pericles-project.eu/
15 Minute Friday: Tips for The Weekend - Stop the Unstructured Data Madness
Join Storage Switzerland and Igneous for another Fifteen Minute Friday: Storage Tips for the Weekend. Most organizations are not satisfied with their ability to backup, recovery and correctly retain unstructured data. The combination of unprecedented growth and increased scrutiny caused by regulations like GDPR and CCPA is pushing organizations to the brink. It's time to stop the madness!
By joining this short webinar, you’ll learn tips to overcome:
- The Unstructured Data Backup Challenge
- The Archive Challenge
- The Data Privacy / Data Retention Challenge
Cassie findlay
The document discusses strategies for planning and resourcing digital archives and recordkeeping over the long term. It emphasizes understanding information needs, designing systems to support records, using open formats, applying metadata, managing migration, educating staff, and securing funding for projects through building support and linking to popular ideas. Free tools and resources are also mentioned.
Keith prabhu global high on cloud summit
The document discusses big data, including what it is, why it is exciting, key concerns around security and privacy, and recommended measures to address these concerns. It was written by Keith Prabhu, who is the Executive Director of Confidis Advisory Services and Founder & Director of the Cloud Security Alliance Mumbai Chapter. The document provides an overview of big data and security issues and recommendations related to big data.
Blockchain in Healthcare
Episode-of-care payment and comprehensive care payment systems can help providers prevent health problems; avoid the occurrence of acute episodes among individuals who have health conditions; prevent poor outcomes during major acute episodes, such as infections, complications, and hospital readmissions; and reduce the costs of successful treatment.
Using cryptography to keep exchanges secure, blockchain provides a decentralised database, or “digital ledger”, of transactions that everyone on the network can see. This network is essentially a chain of computers that must all approve an exchange before it can be verified and recorded.
Knowledge Management And Small Business
This was a quick 5 minute presentation I gave to the Wollongong Small Business Club on the tools that are available to assist Small Business in managing their Knowledge.
Cloud computing - When is Deletion Deletion?
This document discusses cloud computing and the challenges of complete data deletion. It notes that cloud storage allows for infinite storage and rapid resource provisioning, but deleted data may still remain accessible due to technical challenges. Specifically, it outlines that data is often stored in multiple copies and locations, making full deletion difficult. The document argues that complete and verifiable deletion is important for sensitive data and privacy rights, but remains an unsolved problem due to the complex and distributed nature of cloud infrastructure.
Blockchain Technology for Public and Commercial Libraries
The document discusses how blockchain technology can revolutionize public and commercial libraries by creating an immutable and decentralized system for verification, payments, acquisitions, records keeping, and more. It explores opportunities like enhanced cooperation and management of collections, as well as challenges around regulation, user experience, and standards. The document also addresses how blockchain could enable a subscription model for commercial libraries and digital rights management for ebooks.
Global bigdata conf_01282013
Presentation from Dr. Flavio Villanustre, VP Technology Architecture and Product for LexisNexis on Security and Privacy in a Big Data World from the Global Big Data conference Jan 28, 2013.
CloudDOCX_SellSheet_GSmith_V2
CloudDOCX provides secure electronic document storage and management. They scan hard copy documents and make them digitally searchable and accessible from any device. This allows easy access to important documents while reducing reliance on physical storage. Customers benefit from reduced paperwork burdens as well as enhanced document organization and searchability through CloudDOCX's cloud-based services.
The rise of big data on cloud computing
Cloud computing is a powerful technology to perform massive-scale and complex computing. It eliminates the need to maintain expensive computing hardware, dedicated space, and software.
Open Data Conference - Rufus Pollock - Open Knowledge Foundation & CKAN
The document discusses the Open Knowledge Foundation's work in opening data and building tools to make data openly accessible and usable. It highlights CKAN, an open-source data publishing platform, and OpenSpending, a project creating an open map of government spending globally. The Foundation believes that open data, when made available in a standard format and of reasonable quality, can be used in ways not originally anticipated to create new insights when combined and analyzed by others.
Todd Carpenter VM#3 Privacy Publisher Systems Introduction
Todd Carpenter VM#3 Privacy Publisher Systems IntroductionNational Information Standards Organization (NISO)
May 22, 2015
NISO Patron Privacy in Digital Library and Information Systems
http://www.niso.org/topics/tl/patron_privacy/Briefing room 2016-ep03-novetta-hadoop_data_lakes-dez_slides-20160209
Big data projects often fail to deliver on promises of working out of the box for any data with regular DBAs. Extracting data from legacy systems into big data systems can result in loss of important controls and governance from the original systems around security, access controls, and metadata. It is important to have hoses securely attached before opening the fire hydrant by mapping security, controls, and developing a vocabulary before combining disparate data sources or implementing complex big data technologies.
Bluzelle - A Decentralized World Database
This document provides an overview of Bluzelle, a decentralized database project. It discusses the current centralized cloud-based data model and how Bluzelle aims to create a decentralized world database using a key-value store on the blockchain. The document outlines Bluzelle's history and technology, including its 2D partitioning and swarming consensus. It also discusses the project's open source approach and upcoming Lovelace release, as well as use cases and resources for developers.
Xact aceds 5-7-14 webcast
The document discusses eDiscovery best practices including litigation readiness, preservation obligations, cooperation with opposing counsel, and the importance of communication. It provides guidance on identifying relevant data sources, implementing litigation holds, conducting custodian interviews, and utilizing meet and confers to agree on discovery procedures. The document emphasizes that following best practices helps ensure ethical and competent representation while avoiding unnecessary costs and motion practice.
Towards Blockchain Tactics: Building Hybrid Decentralized Software Architectu...
Presentation slides of the paper "Towards Blockchain Tactics: Building Hybrid Decentralized Software Architectures" at the IEEE International Conference on Software Architecture Companion (ICSA 2019), Hamburg, Germany
For more information see https://florianblum.com/
Destroying Data Silos
This document discusses ING NL's efforts to create a data lake architecture using Hadoop to integrate all of the bank's data sources onto a single processing platform. The data lake aims to collect data in a unified format, securely store it to prevent manipulation and unauthorized access, and make it available for analytical applications. Some of the challenges discussed include managing security, aligning with legacy systems, and facilitating interdepartmental cooperation on agile delivery. The presentation focuses on one part of the data lake, the archive, and how a Hadoop cluster can effectively address the goals of collecting, storing, and accessing data for business intelligence and data science purposes.
Destroying Data Silos
1) The document discusses ING NL's efforts to integrate all of its data sources into a single data lake platform using open source software like Hadoop where possible.
2) It focuses on one part of creating a data lake archive to collect, securely store, and make data available to analytical applications in a unified format.
3) Challenges discussed include replacing legacy systems, addressing policies and security requirements, and ensuring agile delivery through interdisciplinary cooperation.
Alex Hanway - Securing the Breach: Using a Holistic Data Protection Framework
From this presentation you will learn:
· A brief history of encryption
· How encryption is now deployed in the enterprise
· Encryption and key management best practices to keep data safe
More Related Content
What's hot
Solving Document Security
This document discusses document security and introduces Covertix as a solution. It summarizes that Covertix provides seamless control and protection of data through embedded access and permissions within files to ensure protection both internally and externally. Covertix SmartCipher extends these protections beyond networks and allows protection of sensitive information without changing existing tools or workflows. It provides benefits like policy enforcement, auditing and transparency to users.
In Search of Simplicity: Redesigning the Digital Bleek and Lloyd
DESIDOC Journal of Library & Information Technology: Special Issue on Digital Preservation original submission.
Publication URL: http://goo.gl/yUERj
BibTeX Citation
@article{D2524,
author = {Lighton Phiri and Hussein Suleman},
title = {In Search of Simplicity: Redesigning the Digital Bleek and Lloyd},
journal = {DESIDOC Journal of Library & Information Technology},
volume = {32},
number = {4},
year = {2012},
keywords = {},
abstract = {The Digital Bleek and Lloyd is a collection of digitised historical artefacts on the Bushman people ofSouthern Africa. The underlying software was initially designed to enable access from as many people aspossible so usage requirements were minimal – it was not even necessary to use a web server or database.However, the system was not focused on preservation, extensibility, or reusability. In this article, it is arguedthat such desirable attributes could manifest themselves in a natural evolution of the Bleek and Lloyd softwaresystem in the direction of greater simplicity. A case study demonstrates that this is indeed feasible in the caseof the Digital Bleek and Lloyd and potentially more generally applicable in digital libraries.},
issn = {0976-4658}, url = {http://publications.drdo.gov.in/ojs/index.php/djlit/article/view/2524}
}
Filling the Digital Preservation Gap - Acting on Change
This presentation was delivered by Jenny Mitcham (University of York) at PERICLES final project conference 'Acting on Change: New Approaches and Future Practices in LTDP' (Wellcome Collection Conference Centre, London, 30 Nov -1 Dec 2016).
This thematic session was also joined by Matthew Addis (Arkivum), Dan Gillean (Artefactual), Angela Dappert (British Library) and Rob Baxter (University of Edinburgh/PERICLES).
According to the DCMM (Digital Preservation Capability Maturity Model ©) newsletter in January 2016, “There are positive signs that digital preservation is finally entering the mainstream of professional practice and information technology infrastructure.”
The accelerating impact of change on long-term preservation might contradict the optimisms that we are coming closer to bridging the digital preservation capability gap between the problem owners and the solution providers. A lot of cutting-edge technology and research has been done out there over the past decade to support preservation, but who is ready to take on the risk of being an early adopter of cutting-edge solutions? When it seems many organisations are still struggling to understand what they need to be doing and what fits their context and purposes.
So what does it take to close that chasm? What type of collaborations are needed? Are we ready to build that bridge?
http://pericles-project.eu/
15 Minute Friday: Tips for The Weekend - Stop the Unstructured Data Madness
Join Storage Switzerland and Igneous for another Fifteen Minute Friday: Storage Tips for the Weekend. Most organizations are not satisfied with their ability to backup, recovery and correctly retain unstructured data. The combination of unprecedented growth and increased scrutiny caused by regulations like GDPR and CCPA is pushing organizations to the brink. It's time to stop the madness!
By joining this short webinar, you’ll learn tips to overcome:
- The Unstructured Data Backup Challenge
- The Archive Challenge
- The Data Privacy / Data Retention Challenge
Cassie findlay
The document discusses strategies for planning and resourcing digital archives and recordkeeping over the long term. It emphasizes understanding information needs, designing systems to support records, using open formats, applying metadata, managing migration, educating staff, and securing funding for projects through building support and linking to popular ideas. Free tools and resources are also mentioned.
Keith prabhu global high on cloud summit
The document discusses big data, including what it is, why it is exciting, key concerns around security and privacy, and recommended measures to address these concerns. It was written by Keith Prabhu, who is the Executive Director of Confidis Advisory Services and Founder & Director of the Cloud Security Alliance Mumbai Chapter. The document provides an overview of big data and security issues and recommendations related to big data.
Blockchain in Healthcare
Episode-of-care payment and comprehensive care payment systems can help providers prevent health problems; avoid the occurrence of acute episodes among individuals who have health conditions; prevent poor outcomes during major acute episodes, such as infections, complications, and hospital readmissions; and reduce the costs of successful treatment.
Using cryptography to keep exchanges secure, blockchain provides a decentralised database, or “digital ledger”, of transactions that everyone on the network can see. This network is essentially a chain of computers that must all approve an exchange before it can be verified and recorded.
Knowledge Management And Small Business
This was a quick 5 minute presentation I gave to the Wollongong Small Business Club on the tools that are available to assist Small Business in managing their Knowledge.
Cloud computing - When is Deletion Deletion?
This document discusses cloud computing and the challenges of complete data deletion. It notes that cloud storage allows for infinite storage and rapid resource provisioning, but deleted data may still remain accessible due to technical challenges. Specifically, it outlines that data is often stored in multiple copies and locations, making full deletion difficult. The document argues that complete and verifiable deletion is important for sensitive data and privacy rights, but remains an unsolved problem due to the complex and distributed nature of cloud infrastructure.
Blockchain Technology for Public and Commercial Libraries
The document discusses how blockchain technology can revolutionize public and commercial libraries by creating an immutable and decentralized system for verification, payments, acquisitions, records keeping, and more. It explores opportunities like enhanced cooperation and management of collections, as well as challenges around regulation, user experience, and standards. The document also addresses how blockchain could enable a subscription model for commercial libraries and digital rights management for ebooks.
Global bigdata conf_01282013
Presentation from Dr. Flavio Villanustre, VP Technology Architecture and Product for LexisNexis on Security and Privacy in a Big Data World from the Global Big Data conference Jan 28, 2013.
CloudDOCX_SellSheet_GSmith_V2
CloudDOCX provides secure electronic document storage and management. They scan hard copy documents and make them digitally searchable and accessible from any device. This allows easy access to important documents while reducing reliance on physical storage. Customers benefit from reduced paperwork burdens as well as enhanced document organization and searchability through CloudDOCX's cloud-based services.
The rise of big data on cloud computing
Cloud computing is a powerful technology to perform massive-scale and complex computing. It eliminates the need to maintain expensive computing hardware, dedicated space, and software.
Open Data Conference - Rufus Pollock - Open Knowledge Foundation & CKAN
The document discusses the Open Knowledge Foundation's work in opening data and building tools to make data openly accessible and usable. It highlights CKAN, an open-source data publishing platform, and OpenSpending, a project creating an open map of government spending globally. The Foundation believes that open data, when made available in a standard format and of reasonable quality, can be used in ways not originally anticipated to create new insights when combined and analyzed by others.
Todd Carpenter VM#3 Privacy Publisher Systems Introduction
Todd Carpenter VM#3 Privacy Publisher Systems IntroductionNational Information Standards Organization (NISO)
May 22, 2015
NISO Patron Privacy in Digital Library and Information Systems
http://www.niso.org/topics/tl/patron_privacy/Briefing room 2016-ep03-novetta-hadoop_data_lakes-dez_slides-20160209
Big data projects often fail to deliver on promises of working out of the box for any data with regular DBAs. Extracting data from legacy systems into big data systems can result in loss of important controls and governance from the original systems around security, access controls, and metadata. It is important to have hoses securely attached before opening the fire hydrant by mapping security, controls, and developing a vocabulary before combining disparate data sources or implementing complex big data technologies.
Bluzelle - A Decentralized World Database
This document provides an overview of Bluzelle, a decentralized database project. It discusses the current centralized cloud-based data model and how Bluzelle aims to create a decentralized world database using a key-value store on the blockchain. The document outlines Bluzelle's history and technology, including its 2D partitioning and swarming consensus. It also discusses the project's open source approach and upcoming Lovelace release, as well as use cases and resources for developers.
Xact aceds 5-7-14 webcast
The document discusses eDiscovery best practices including litigation readiness, preservation obligations, cooperation with opposing counsel, and the importance of communication. It provides guidance on identifying relevant data sources, implementing litigation holds, conducting custodian interviews, and utilizing meet and confers to agree on discovery procedures. The document emphasizes that following best practices helps ensure ethical and competent representation while avoiding unnecessary costs and motion practice.
Towards Blockchain Tactics: Building Hybrid Decentralized Software Architectu...
Presentation slides of the paper "Towards Blockchain Tactics: Building Hybrid Decentralized Software Architectures" at the IEEE International Conference on Software Architecture Companion (ICSA 2019), Hamburg, Germany
For more information see https://florianblum.com/
What's hot (19)
In Search of Simplicity: Redesigning the Digital Bleek and Lloyd
In Search of Simplicity: Redesigning the Digital Bleek and Lloyd
Filling the Digital Preservation Gap - Acting on Change
Filling the Digital Preservation Gap - Acting on Change
15 Minute Friday: Tips for The Weekend - Stop the Unstructured Data Madness
15 Minute Friday: Tips for The Weekend - Stop the Unstructured Data Madness
Blockchain Technology for Public and Commercial Libraries
Blockchain Technology for Public and Commercial Libraries
Open Data Conference - Rufus Pollock - Open Knowledge Foundation & CKAN
Open Data Conference - Rufus Pollock - Open Knowledge Foundation & CKAN
Todd Carpenter VM#3 Privacy Publisher Systems Introduction
Todd Carpenter VM#3 Privacy Publisher Systems Introduction
Briefing room 2016-ep03-novetta-hadoop_data_lakes-dez_slides-20160209
Briefing room 2016-ep03-novetta-hadoop_data_lakes-dez_slides-20160209
Towards Blockchain Tactics: Building Hybrid Decentralized Software Architectu...
Towards Blockchain Tactics: Building Hybrid Decentralized Software Architectu...
Similar to The “obsession” with checksums by Helen Hockx-Yu
Destroying Data Silos
This document discusses ING NL's efforts to create a data lake architecture using Hadoop to integrate all of the bank's data sources onto a single processing platform. The data lake aims to collect data in a unified format, securely store it to prevent manipulation and unauthorized access, and make it available for analytical applications. Some of the challenges discussed include managing security, aligning with legacy systems, and facilitating interdepartmental cooperation on agile delivery. The presentation focuses on one part of the data lake, the archive, and how a Hadoop cluster can effectively address the goals of collecting, storing, and accessing data for business intelligence and data science purposes.
Destroying Data Silos
1) The document discusses ING NL's efforts to integrate all of its data sources into a single data lake platform using open source software like Hadoop where possible.
2) It focuses on one part of creating a data lake archive to collect, securely store, and make data available to analytical applications in a unified format.
3) Challenges discussed include replacing legacy systems, addressing policies and security requirements, and ensuring agile delivery through interdisciplinary cooperation.
Alex Hanway - Securing the Breach: Using a Holistic Data Protection Framework
From this presentation you will learn:
· A brief history of encryption
· How encryption is now deployed in the enterprise
· Encryption and key management best practices to keep data safe
4.1 Introduction to cloud storage.pptx
Cloud storage allows users to store data on remote servers owned by hosting companies, rather than local hard drives. It provides access to data from any device with an internet connection. While concerns about security and performance issues exist, cloud storage offers benefits like easy collaboration, automatic updates, disaster recovery, scalability, and cost savings over local storage solutions.
ChodonKumar.pptx
Cloud storage allows users to store and access their data over the internet from any device. It provides benefits like accessibility of data from anywhere, automatic updates, and redundancy of data across multiple servers which protects the data from hardware failures or natural disasters. While cloud storage reduces costs by eliminating on-site storage hardware and management, some disadvantages include security concerns about handing over sensitive data and potential performance issues if cloud providers experience outages.
26-170918023441.pptx
Cloud storage allows users to store data on remote servers owned by hosting companies, rather than local hard drives. It provides access to data from any device with an internet connection. While concerns about security and performance issues exist, cloud storage offers benefits like easy collaboration, automatic updates, low costs due to lack of physical infrastructure needs, and protection from local hardware failures.
26-170918023441 (1).pptx
Cloud storage allows users to store data on remote servers owned by hosting companies, rather than local hard drives. It provides access to data from any device with an internet connection. While concerns about security and performance issues exist, cloud storage offers benefits like easy collaboration, automatic updates, low costs due to lack of physical infrastructure needs, and protection from local hardware failures.
somee.pptx
The document discusses cloud storage, including what it is, how it works, benefits for businesses, costs for users, advantages, and disadvantages. Cloud storage refers to storing digital data in logical pools across multiple servers owned by hosting companies. It allows data access from anywhere at anytime over the internet. While cloud storage provides benefits like automatic data backup and access from any device, concerns include security of data with external organizations and potential outages.
Webinar: 10 Reasons Why Backup Breaks and How to Fix It
In this on demand webinar experts from Storage Switzerland and Commvault discuss the top 10 reasons that backup breaks and how to fix it. Attendees will learn how they can make backup a reliable and cost-effective IT process, that their organization can count on when they need it most.
Introduction to Digital Preservation
This document provides an overview of digital preservation challenges and strategies. It defines key terms and outlines issues like vast data volumes, technological dependencies, and approaches to preservation including bit preservation, migration, and emulation. Non-technical challenges are also discussed, like collaboration, costs, and legal issues. Personal archiving, digital forensics, and working with current and obsolete digital data are additional topics.
Group 4
This document discusses cloud storage, including definitions, classifications, architecture, applications, uses, pros, and cons. Cloud storage refers to storing digital data in logical pools across multiple servers owned by hosting companies. It can be used at the enterprise or consumer level. Cloud storage uses virtualization technologies and is scalable, accessible from anywhere, and offers metered resources. Popular applications include YouTube, Gmail, Google Drive, and Dropbox. Cloud storage is used for data backup, archiving, and disaster recovery. Benefits include data integration, long-term preservation, privacy, capacity, and cost reduction. Risks relate to data security, intellectual property, and service disruption. Users should employ strong, unique passwords, two-factor authentication
Group 4
This document discusses cloud storage, including definitions, classifications, architecture, applications, uses, pros, and cons. Cloud storage refers to storing digital data in logical pools across multiple servers owned by hosting companies. It can be used at the enterprise or consumer level. Cloud storage uses virtualization technologies and is scalable, accessible from anywhere, and offers metered resources. Popular applications include YouTube, Gmail, Google Drive, and Dropbox. Cloud storage is used for data backup, archiving, and disaster recovery. Benefits include data integration, long-term preservation, privacy, capacity, and cost reduction. Risks relate to data security, intellectual property, and service disruption. Users should employ strong, unique passwords, two-factor authentication
Make the Upgrade: Data protection in the cloud
This document describes Raxsonic's cloud-based data protection solution. It provides complete backup and recovery for servers, applications, desktops, laptops, and mobile devices. The solution protects data across multiple locations through server backup, endpoint backup, archiving, file sharing, and disaster recovery. It uses a unique three-tier encryption process to securely store data in their private and public cloud infrastructure or on-premise with a cloud-connected appliance. The solution is affordable and scalable to meet the needs of organizations of any size.
An Introduction to Digital Preservation
This presentation will provide an overview of issues in digital preservation. Presentation was delivered during the joint DPE/Planets/CAPAR/nestor training event, ‘The Preservation challenge: basic concepts and practical applications’ (Barcelona, March 2009)
Software Defined Networking in the ATMOSPHERE project
The ATMOSPHERE project aims to develop a federated cloud platform and associated tools to enable trustworthy distributed data processing and management across international borders. Key expected results include a development framework, mechanisms for evaluating and monitoring trustworthiness, and a pilot use case involving medical imaging processing in Brazil. The platform will provide various services while addressing challenges like sensitive data access, privacy, and infrastructure management across multiple cloud providers and regions.
Securing Your Containers is Not Enough: How to Encrypt Container Data
Slides from webinar by Mirantis and Zettaset about how to encrypt containerized data. Watch the recording at: https://bit.ly/container-data-encryption
Digital preservation: an introduction
Digital preservation Joanna Fleming and Matthew Burgess presented at Digital collecting for NSW public library staff
27 May 2019
Tsc2021 cyber-issues
This document provides guidance on cybersecurity best practices for organizations. It notes that no network is completely secure and individuals often enable hacking through mistakes. It recommends establishing an incident response plan, purchasing cyber insurance, developing security policies and procedures, considering outsourcing security monitoring, regularly backing up data in multiple secure locations, and using a password manager. The document also warns against common pitfalls like not sustaining long-term security resources and provides links to additional cybersecurity resources.
Cloud slide
The document proposes a CloudDrop technique for securely storing files in the cloud. It divides files into fragments that are duplicated across multiple cloud nodes. This makes it difficult for attackers to retrieve meaningful data even if one node is compromised, improving security. The method also considers factors like node selection and access time to enhance performance during file retrieval from the cloud.
Intelligent Cloud Enablement
Data continues to grow exponentially – especially with the advent of social content. Approximately 70% of data is unstructured. This impacts on storage costs and management, Data Protection, and SLAs.
New deployment options such as cloud provide alternatives but how do you know what you should move to the cloud?
Similar to The “obsession” with checksums by Helen Hockx-Yu (20)
Alex Hanway - Securing the Breach: Using a Holistic Data Protection Framework
Alex Hanway - Securing the Breach: Using a Holistic Data Protection Framework
Webinar: 10 Reasons Why Backup Breaks and How to Fix It
Webinar: 10 Reasons Why Backup Breaks and How to Fix It
Software Defined Networking in the ATMOSPHERE project
Software Defined Networking in the ATMOSPHERE project
Securing Your Containers is Not Enough: How to Encrypt Container Data
Securing Your Containers is Not Enough: How to Encrypt Container Data
More from CLOCKSS
How CLOCKSS ingests and preserves content by Thib Guicherd-Callin
The document summarizes how CLOCKSS ingests and preserves content in its digital preservation network. It discusses:
1. Each CLOCKSS node independently obtains a copy of content, typically via web crawl. The nodes then establish cryptographic proof that they hold the same content through challenges.
2. If damage is detected, a node can obtain a repair from the original source or proven peer nodes.
3. CLOCKSS operates multiple LOCKSS networks around the world to ingest and preserve content through web crawls, file transfers, and physical media delivery from content providers into a distributed digital preservation system.
Kim Smilay - One day at CLOCKSS
Kim Smilay is the Director of Publisher and Library Relations at CLOCKSS. Their responsibilities include:
1) Outreach to new and existing publishers and libraries through inquiries, conferences, and annual updates.
2) Negotiating agreements and onboarding new publishers by establishing requirements, quotes, and finalizing documentation.
3) Liaising between CLOCKSS and publishers to resolve any issues or questions about content ingestion or access.
4) Managing annual billing by calculating publisher amounts from ingest statistics and communicating invoices.
5) Providing reports to executive leadership and publishers on contributions, individual archive health, and ingest amounts.
Jeremy Morse - nasig lightning talk model digital preservation policy
As Director of Publishing Technology, I manage a team of programmers in developing and supporting the software that enables the Library's publishing efforts, which include the University of Michigan Press and Michigan Publishing Services. I manage the development of the Fulcrum publishing platform and serve on the Digital Repository Services Steering Committee and Digital Preservation Steering Committee. Digital preservation and sustainability is at the center of all of my work, as I strive for everything we publish to endure as part of the scholarly record.
Roxanne Missingham - CLOCKSS presentation
Roxanne Missingham is an inspiration to the CLOCKSS team! She is the University Librarian at the Australian National University.
She graduated from ANU with a Bachelor of Science degree, majoring in pure and applied mathematics and psychology. She added to her undergraduate degree with a Graduate Diploma in Librarian Studies and combined the two when she was selected for the graduate program at the National Library of Australia.
From there a flourishing library career took off which saw her work for CSIRO, Australian Nature Conservation Agency, Department of Environment and the Parliamentary Library before she returned to where it all started, the ANU.
Tim Martin - strategic perspectives on digital preservation from OCLC
OCLC focuses on digital preservation for libraries in three key areas:
1) Providing workflow support for digital curation and preservation through products like CONTENTdm that integrate with preservation and asset management systems.
2) Supporting initiatives like CLOCKSS that have similar missions to libraries in supporting access to content. OCLC operates one of 12 mirrored repository sites for CLOCKSS.
3) Conducting research through projects and publications to help address challenges libraries face in selecting digital content for long-term preservation with limited budgets and technology constraints.
Gaelle Bequet - Project JASPER
This document discusses a project called JASPER that aims to preserve open access journals that do not have an existing preservation policy. It notes that about 7,000 journals in the Directory of Open Access Journals fall into this category. The project will use three archiving options - the PKP Private Network, CLOCKSS Dark Archive, and the Internet Archive - to preserve journals based on criteria like whether they use Open Journal Systems or provide detailed metadata to DOAJ. Next steps include surveying these journals, improving archiving tools and documentation, and applying for grants to expand the preservation efforts.
Alicia Wise - About CLOCKSS
This document appears to be the agenda for two sessions on digital preservation. The summaries are:
1) The first session agenda includes presentations on the strategic importance of digital preservation from various organizations, as well as a discussion. Presenters will discuss topics like the CLOCKSS and LOCKSS programs, digital preservation projects, and challenges.
2) The second session continues with more presentations on digital preservation topics, challenges, and policies. Presenters will discuss strategic issues, working with libraries and publishers, technical aspects like checksums, and a university's digital preservation policy. Both sessions will conclude with a question and discussion period.
3) The document provides introductory context on the importance of digital preservation, as
More from CLOCKSS (7)
How CLOCKSS ingests and preserves content by Thib Guicherd-Callin
How CLOCKSS ingests and preserves content by Thib Guicherd-Callin
Jeremy Morse - nasig lightning talk model digital preservation policy
Jeremy Morse - nasig lightning talk model digital preservation policy
Tim Martin - strategic perspectives on digital preservation from OCLC
Tim Martin - strategic perspectives on digital preservation from OCLC
Recently uploaded
Sharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Sharlene Leurig - Enabling Onsite Water Use with Net Zero WaterTexas Alliance of Groundwater Districts
Presented at June 6-7 Texas Alliance of Groundwater Districts Business MeetingDeep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless ReproducibilityUniversity of Rennes, INSA Rennes, Inria/IRISA, CNRS
The ability to recreate computational results with minimal effort and actionable metrics provides a solid foundation for scientific research and software development. When people can replicate an analysis at the touch of a button using open-source software, open data, and methods to assess and compare proposals, it significantly eases verification of results, engagement with a diverse range of contributors, and progress. However, we have yet to fully achieve this; there are still many sociotechnical frictions.
Inspired by David Donoho's vision, this talk aims to revisit the three crucial pillars of frictionless reproducibility (data sharing, code sharing, and competitive challenges) with the perspective of deep software variability.
Our observation is that multiple layers — hardware, operating systems, third-party libraries, software versions, input data, compile-time options, and parameters — are subject to variability that exacerbates frictions but is also essential for achieving robust, generalizable results and fostering innovation. I will first review the literature, providing evidence of how the complex variability interactions across these layers affect qualitative and quantitative software properties, thereby complicating the reproduction and replication of scientific studies in various fields.
I will then present some software engineering and AI techniques that can support the strategic exploration of variability spaces. These include the use of abstractions and models (e.g., feature models), sampling strategies (e.g., uniform, random), cost-effective measurements (e.g., incremental build of software configurations), and dimensionality reduction methods (e.g., transfer learning, feature selection, software debloating).
I will finally argue that deep variability is both the problem and solution of frictionless reproducibility, calling the software science community to develop new methods and tools to manage variability and foster reproducibility in software systems.
Exposé invité Journées Nationales du GDR GPL 2024
Cytokines and their role in immune regulation.pptx
This presentation covers the content and information on "Cytokines " and their role in immune regulation .
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
Context. With a mass exceeding several 104 M⊙ and a rich and dense population of massive stars, supermassive young star clusters
represent the most massive star-forming environment that is dominated by the feedback from massive stars and gravitational interactions
among stars.
Aims. In this paper we present the Extended Westerlund 1 and 2 Open Clusters Survey (EWOCS) project, which aims to investigate
the influence of the starburst environment on the formation of stars and planets, and on the evolution of both low and high mass stars.
The primary targets of this project are Westerlund 1 and 2, the closest supermassive star clusters to the Sun.
Methods. The project is based primarily on recent observations conducted with the Chandra and JWST observatories. Specifically,
the Chandra survey of Westerlund 1 consists of 36 new ACIS-I observations, nearly co-pointed, for a total exposure time of 1 Msec.
Additionally, we included 8 archival Chandra/ACIS-S observations. This paper presents the resulting catalog of X-ray sources within
and around Westerlund 1. Sources were detected by combining various existing methods, and photon extraction and source validation
were carried out using the ACIS-Extract software.
Results. The EWOCS X-ray catalog comprises 5963 validated sources out of the 9420 initially provided to ACIS-Extract, reaching a
photon flux threshold of approximately 2 × 10−8 photons cm−2
s
−1
. The X-ray sources exhibit a highly concentrated spatial distribution,
with 1075 sources located within the central 1 arcmin. We have successfully detected X-ray emissions from 126 out of the 166 known
massive stars of the cluster, and we have collected over 71 000 photons from the magnetar CXO J164710.20-455217.
Nucleophilic Addition of carbonyl compounds.pptx
Nucleophilic addition is the most important reaction of carbonyls. Not just aldehydes and ketones, but also carboxylic acid derivatives in general.
Carbonyls undergo addition reactions with a large range of nucleophiles.
Comparing the relative basicity of the nucleophile and the product is extremely helpful in determining how reversible the addition reaction is. Reactions with Grignards and hydrides are irreversible. Reactions with weak bases like halides and carboxylates generally don’t happen.
Electronic effects (inductive effects, electron donation) have a large impact on reactivity.
Large groups adjacent to the carbonyl will slow the rate of reaction.
Neutral nucleophiles can also add to carbonyls, although their additions are generally slower and more reversible. Acid catalysis is sometimes employed to increase the rate of addition.
Applied Science: Thermodynamics, Laws & Methodology.pdf
When I was asked to give a companion lecture in support of ‘The Philosophy of Science’ (https://shorturl.at/4pUXz) I decided not to walk through the detail of the many methodologies in order of use. Instead, I chose to employ a long standing, and ongoing, scientific development as an exemplar. And so, I chose the ever evolving story of Thermodynamics as a scientific investigation at its best.
Conducted over a period of >200 years, Thermodynamics R&D, and application, benefitted from the highest levels of professionalism, collaboration, and technical thoroughness. New layers of application, methodology, and practice were made possible by the progressive advance of technology. In turn, this has seen measurement and modelling accuracy continually improved at a micro and macro level.
Perhaps most importantly, Thermodynamics rapidly became a primary tool in the advance of applied science/engineering/technology, spanning micro-tech, to aerospace and cosmology. I can think of no better a story to illustrate the breadth of scientific methodologies and applications at their best.
bordetella pertussis.................................ppt
Bordettela is a gram negative cocobacilli spread by air born drop let
8.Isolation of pure cultures and preservation of cultures.pdf
Isolation of pure culture, its various method.
Micronuclei test.M.sc.zoology.fisheries.
Current Ms word generated power point presentation covers major details about the micronuclei test. It's significance and assays to conduct it. It is used to detect the micronuclei formation inside the cells of nearly every multicellular organism. It's formation takes place during chromosomal sepration at metaphase.
Randomised Optimisation Algorithms in DAPHNE
Slides from talk:
Aleš Zamuda: Randomised Optimisation Algorithms in DAPHNE .
Austrian-Slovenian HPC Meeting 2024 – ASHPC24, Seeblickhotel Grundlsee in Austria, 10–13 June 2024
https://ashpc.eu/
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...University of Maribor
Slides from:
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Track: Artificial Intelligence
https://www.etran.rs/2024/en/home-english/Phenomics assisted breeding in crop improvement
As the population is increasing and will reach about 9 billion upto 2050. Also due to climate change, it is difficult to meet the food requirement of such a large population. Facing the challenges presented by resource shortages, climate
change, and increasing global population, crop yield and quality need to be improved in a sustainable way over the coming decades. Genetic improvement by breeding is the best way to increase crop productivity. With the rapid progression of functional
genomics, an increasing number of crop genomes have been sequenced and dozens of genes influencing key agronomic traits have been identified. However, current genome sequence information has not been adequately exploited for understanding
the complex characteristics of multiple gene, owing to a lack of crop phenotypic data. Efficient, automatic, and accurate technologies and platforms that can capture phenotypic data that can
be linked to genomics information for crop improvement at all growth stages have become as important as genotyping. Thus,
high-throughput phenotyping has become the major bottleneck restricting crop breeding. Plant phenomics has been defined as the high-throughput, accurate acquisition and analysis of multi-dimensional phenotypes
during crop growing stages at the organism level, including the cell, tissue, organ, individual plant, plot, and field levels. With the rapid development of novel sensors, imaging technology,
and analysis methods, numerous infrastructure platforms have been developed for phenotyping.
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills of Minnesota developed a method to convert waste into high-value dry fertilizer, significantly enriching soil quality. By providing farmers with a valuable resource derived from waste, Travis Hills helps enhance farm profitability while promoting environmental stewardship. Travis Hills' sustainable practices lead to cost savings and increased revenue for farmers by improving resource efficiency and reducing waste.
SAR of Medicinal Chemistry 1st by dk.pdf
In this presentation include the prototype drug SAR on thus or with their examples .
Syllabus of Second Year B. Pharmacy
2019 PATTERN.
Equivariant neural networks and representation theory
Or: Beyond linear.
Abstract: Equivariant neural networks are neural networks that incorporate symmetries. The nonlinear activation functions in these networks result in interesting nonlinear equivariant maps between simple representations, and motivate the key player of this talk: piecewise linear representation theory.
Disclaimer: No one is perfect, so please mind that there might be mistakes and typos.
dtubbenhauer@gmail.com
Corrected slides: dtubbenhauer.com/talks.html
Recently uploaded (20)
aziz sancar nobel prize winner: from mardin to nobel
aziz sancar nobel prize winner: from mardin to nobel
Sharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Sharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Deep Software Variability and Frictionless Reproducibility
Deep Software Variability and Frictionless Reproducibility
Cytokines and their role in immune regulation.pptx
Cytokines and their role in immune regulation.pptx
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Weste...
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
bordetella pertussis.................................ppt
bordetella pertussis.................................ppt
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Equivariant neural networks and representation theory
Equivariant neural networks and representation theory
The “obsession” with checksums by Helen Hockx-Yu
- 1. The “obsession” with checksums Helen Hockx-Yu Office of Information Technologies University of Notre Dame
- 2. Fixity and Checksums ● Fixity refers to the property of a digital file / object being fixed, or unchanged ● Checksums are a means for determining fixity, or the sameness between two copies of a digital object or the same object at different times, and/or before and after certain events ● Checksums feature prominently in digital preservation ● Checksum-based fixity checking workflows are commonly used by libraries and archives
- 3. IT use cases ● 5 years at ND, 3 roles ○ Strategy development for digital asset management (including digital archiving and preservation, in collaboration with the ND Libraries and Archives) ○ Implementation of enterprise Digital Asset Management (DAM) service ○ Now an Enterprise Architect ● Verify software packages before distributing to many endpoints ● Data migration - correctness ● Mostly rely on built-in fault-tolerance features of storage systems or data management systems for data storage and transfer integrity ○ Isilon, Globus
- 4. Digital Preservation risks ● Bit flip is not a top reason for data loss ● “The real culprits are a combination of human error, viruses, bugs in application software, and malicious employees or intruders. Almost everyone has accidentally erased or overwritten a file. “ ● 13 threats in Requirements for Digital Preservation Systems: A Bottom-Up Approach
- 5. A matter of where to spend energy ● Format migration - another prominently featured digital preservation task, on which our thoughts have evolved ○ relaxed approach to format obsolescence - preserving the bits and dealing with format obsolescence if and when it happens ● We still need to preserve the bits - but does this mean we need to run checksums on everything by ourselves? ○ Can we make use of hash of data stored by Cloud services - trust and egress ○ Pass hash values with upload ● More importantly, what other things have overlooked that can lead to data loss ○ Not collecting content ○ Dependency on storage technology (storage intermediary) that ■ Challenges the notion of “redundancy” or “lots of copies” ■ Introducing single point of failure ■ Holds the unique knowledge of file to object mapping ■ Hidden and invisible files could be added to the storage location inadvertently ● Scalability and automation ● Work together!