SlideShare a Scribd company logo
First Reaction: Stupid Question
• Well, a silly question, at least.
• It suggests that all archives are the same,
but we know better…
– Active archive: data still referenced but
seldom changed
– Deep archive: data rarely re-referenced
and never changed
• Different kinds of archive suggest
different requirements from the archive
platform: no “one size fits all” Historical data, intellectual property,
data retained for regulatory compliance,
conforming to an archive strategy…
Production data, usually files, with limited
re-reference rates, stored economically…
Platform Design 101
Anyway, Disk is Already Used by Many Firms to
Platform Data Archives
…both on-premise and in the cloud
Foundation of the Case for Disk-Based Archiving
• Familiarity of the technology
• Ease of deployment*
• Data migration and copy support*
• Improving disk capacity/performance
• Availability of value-add data
reduction/compression technology *well, sort of, maybe
But Also a Few Drawbacks…
• Acquisition cost (value-add
software is cost accelerator)
• Bit error rate of disk
• Energy consumption
• Silo-ing and proprietary design
(lock-in costs/difficult migration)
• Lack of data reduction standards
• Poor hardware management
capabilities
Tape Provides an Alternative
• Linear Tape File System (LTFS)
• BlackPearl and Object
Storage
• BaFe tape coatings
• Capacity, resiliency, economy National Petascale Computing Facility’s Blue
Waters supercomputer uses 380 PB of tape
storage, 26 PB of disk…
Tape, too, has some Rough Edges
• Unfamiliar to “millennials”
• Access speeds can be an issue
• File systems like LTFS
optimized for “long block”
files, not small files
But Not Sufficient Cause to
Count Tape Out…
• Even the de-duplicating
disk array folks have
agreed on this score…in
the past, at least!
Time for Some Sanity
• Archive is an application
with a “personality”
• Rather than Disk vs Tape…
• …Maybe All of the Above is
the better strategy!
What About Front-Ending Tape
with a Disk Cache
• Remember Disk to Disk to
Tape?
• Why not tier your archive:
– Low cost, high capacity disk
for Active Archive
– Tape for Deep Archive
Disk Makes a Good Tape Cache
• Whether LTFS or BlackPearl
– In LTFS, disk cache can expedite
access to tape-based files by
spoofing access latency
– With BlackPearl, disk provides a
preparatory area for coalescing
objects into buckets before
writing to LTFS tape…
“All of the Above”
• The best strategy
– Matching infrastructure to data
access requirements and anticipated
data growth
– Leveraging the complementarity of
magnetic storage media
technologies, even in “clouds”…
Six Criteria for Building an Effective Archive
Platform
1. Know your data
2. Think about ingestion
3. Think about verification
4. Think about space
5. Think about skills
6. Think about TCO
Know
Your
Data
How to
Ingest
How to
Verify
Space
Needed
Skills
Needed
TCO
Number 7 and Beyond…
• We could go on, but…
• Introducing Bruce Kornfeld, CMO,
Spectra Logic Corporation
– Premiere provider of both tape and
disk archive platforms
– Innovator with Deep Storage and
BlackPearl technologies
• Thank you and welcome, Bruce
nTier Verde –
Simply Affordable File Storage
• No previous storage experience required
• Half the cost of traditional file storage
• Never lose data
• Effortless Setup
– 30 minutes from box to production!
• Fast online expansion and
management
– Disk pools can be expanded in < 1
minute
– Thin provisioning for automated
expansion
No Previous Storage Experience Required
• Store more, spend less
– List price as low as 48¢ per GB
– No software fees
• Compression, Snapshots and Replication included
• Quick Installation
– PS dollars focus on solution, not install
• PriceLock Support Pricing
– Avoid the support hockey stick
Half the Cost of Traditional File Storage
• Software eliminates data corruption and loss
– Advanced checksums and multiple parity options
– All writes committed instantaneously
• Rock Solid Hardware
– High quality, Enterprise SAS capacity drives
• Everything you need… Nothing you don’t
– Intelligent rebuilds
– Compression
– Data Integrity
Never Lose Your Data
Verde Customers
nTier Verde 2U nTier Verde 4U
Supported Hard Drives 4 TB 7200 RPM SAS Hard Drives
Master Node Capacity* 6 to 11 Drives
24 TB to 44 TB RAW
10 to 35 Drives
40 TB to 140 TB RAW
Expansion Node Support 1 Expansion Node 9 Expansion Nodes
Max Capacity* 220 TB RAW Max 1.7 PB RAW Max
Parity Options Mirroring, Single Parity, Double Parity, Triple Parity
Software Options Intelligent Rebuilds, Compression, Replication,
Hot Spares Unlimited
Supported Protocols NFS, CIFS
3 x 1 GigE Data Ports Standard Standard
2 x 10 GigE Data Ports Optional Standard
nTier Verde
* Using 4 TB drives
1. Know your data
2. Think about ingestion
3. Think about verification
4. Think about space
5. Think about skills
6. Think about TCO
Six Criteria for Building
an Effective Archive Platform
Know Your Data
Think About
Ingestion
TAPE Libraries
10 GigE
10 GigE
Unlimited
Scalability
Gigabit Ethernet
10 GigE (standard)
Gigabit Ethernet
10 GigE (standard)
DATA CREATION
UsersUsers
Objects
DS3Data Management
APPSFILES
CIFS and NFS
BlackPearl
nTierVerde
NAS Disk
Library Lifecycle
Management
Media Lifecycle
Management
Drive Lifecycle
Management
Data Integrity
Verification
Think About Verification
Tape library footprint comparisons for storage of 50PB
Spectra T-Finity capable of expanding to 380PB
Spectra Verde
10-Unit Disk Rack
1.7PB
Think About Space
Think About Skills
Verde-Unbox Verde-Into Rack
Verde-Plug IN Verde-Turn ON
Verde-Configure
Verde User Interface Home Screen
Think About TCO

More Related Content

What's hot

Raid data recovery Tips
Raid data recovery TipsRaid data recovery Tips
Raid data recovery Tips
Hone Software
 
Raid level 4
Raid level 4Raid level 4
Raid level 4
Muhammad Ishaq
 
Understanding RAID Controller
Understanding RAID ControllerUnderstanding RAID Controller
Understanding RAID Controller
Raid Data Recovery
 
Storage basics
Storage basicsStorage basics
Storage basics
Luis Juan Koffler
 
Hadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop EncryptionHadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop Encryption
Erik Krogen
 
Efficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using DatabasesEfficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using Databases
Joseph Elwin Fernandes
 
Raid
RaidRaid
Raid
dinaselim
 
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, DatatypesHDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
The HDF-EOS Tools and Information Center
 
Vancouver bug enterprise storage and zfs
Vancouver bug   enterprise storage and zfsVancouver bug   enterprise storage and zfs
Vancouver bug enterprise storage and zfs
Rami Jebara
 
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen StoragePros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Eric Carter
 
HDF5 I/O Performance
HDF5 I/O PerformanceHDF5 I/O Performance
Performance Tuning in HDF5
Performance Tuning in HDF5 Performance Tuning in HDF5
Performance Tuning in HDF5
The HDF-EOS Tools and Information Center
 
Ozone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR complianceOzone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR compliance
Dinesh Chitlangia
 
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...
Alluxio, Inc.
 
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDsSeagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Red_Hat_Storage
 
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
andyseaborne
 
Adapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency mediaAdapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency media
Harald Seipp
 
Ceph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtCeph Object Storage at Spreadshirt
Ceph Object Storage at Spreadshirt
Jens Hadlich
 
Raid
RaidRaid
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red_Hat_Storage
 

What's hot (20)

Raid data recovery Tips
Raid data recovery TipsRaid data recovery Tips
Raid data recovery Tips
 
Raid level 4
Raid level 4Raid level 4
Raid level 4
 
Understanding RAID Controller
Understanding RAID ControllerUnderstanding RAID Controller
Understanding RAID Controller
 
Storage basics
Storage basicsStorage basics
Storage basics
 
Hadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop EncryptionHadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop Encryption
 
Efficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using DatabasesEfficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using Databases
 
Raid
RaidRaid
Raid
 
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, DatatypesHDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
 
Vancouver bug enterprise storage and zfs
Vancouver bug   enterprise storage and zfsVancouver bug   enterprise storage and zfs
Vancouver bug enterprise storage and zfs
 
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen StoragePros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
 
HDF5 I/O Performance
HDF5 I/O PerformanceHDF5 I/O Performance
HDF5 I/O Performance
 
Performance Tuning in HDF5
Performance Tuning in HDF5 Performance Tuning in HDF5
Performance Tuning in HDF5
 
Ozone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR complianceOzone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR compliance
 
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...
 
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDsSeagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
 
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
 
Adapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency mediaAdapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency media
 
Ceph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtCeph Object Storage at Spreadshirt
Ceph Object Storage at Spreadshirt
 
Raid
RaidRaid
Raid
 
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
 

Similar to Is Disk Now a Viable Solution for Archive - Jon Toigo

Meeting the Challenges of Archival Storage
Meeting the Challenges of Archival StorageMeeting the Challenges of Archival Storage
Meeting the Challenges of Archival Storage
spectralogic
 
2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The Trenches2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The Trenches
George Ang
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinar
Kognitio
 
Webinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseWebinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the Enterprise
Storage Switzerland
 
Pros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdfPros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdf
HernanKlint
 
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-WarWebinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Storage Switzerland
 
19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdf19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdf
JESUNPK
 
Cloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation inCloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation in
RahulBhole12
 
Guide to computer forensics and investigation.ppt
Guide to computer forensics and investigation.pptGuide to computer forensics and investigation.ppt
Guide to computer forensics and investigation.ppt
MaluOffice
 
SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)
Lars Marowsky-Brée
 
FAT.pptx
FAT.pptxFAT.pptx
FAT.pptx
madhavigulhane1
 
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Community
 
Unit 4 DBMS.ppt
Unit 4 DBMS.pptUnit 4 DBMS.ppt
Unit 4 DBMS.ppt
HARRSHITHAASCSE
 
Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016
spectralogic
 
Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis
PyData
 
High Performance Hardware for Data Analysis
High Performance Hardware for Data AnalysisHigh Performance Hardware for Data Analysis
High Performance Hardware for Data Analysis
Mike Pittaro
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinar
Michael Hiskey
 
Managing Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using ElasticsearchManaging Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using Elasticsearch
Joe Alex
 
Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2
BradDesAulniers2
 
Developing a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure EnvironmentsDeveloping a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure Environments
Ceph Community
 

Similar to Is Disk Now a Viable Solution for Archive - Jon Toigo (20)

Meeting the Challenges of Archival Storage
Meeting the Challenges of Archival StorageMeeting the Challenges of Archival Storage
Meeting the Challenges of Archival Storage
 
2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The Trenches2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The Trenches
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinar
 
Webinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseWebinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the Enterprise
 
Pros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdfPros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdf
 
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-WarWebinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
 
19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdf19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdf
 
Cloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation inCloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation in
 
Guide to computer forensics and investigation.ppt
Guide to computer forensics and investigation.pptGuide to computer forensics and investigation.ppt
Guide to computer forensics and investigation.ppt
 
SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)
 
FAT.pptx
FAT.pptxFAT.pptx
FAT.pptx
 
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
 
Unit 4 DBMS.ppt
Unit 4 DBMS.pptUnit 4 DBMS.ppt
Unit 4 DBMS.ppt
 
Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016
 
Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis
 
High Performance Hardware for Data Analysis
High Performance Hardware for Data AnalysisHigh Performance Hardware for Data Analysis
High Performance Hardware for Data Analysis
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinar
 
Managing Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using ElasticsearchManaging Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using Elasticsearch
 
Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2
 
Developing a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure EnvironmentsDeveloping a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure Environments
 

Recently uploaded

20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Zilliz
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
Pixlogix Infotech
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 

Recently uploaded (20)

20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 

Is Disk Now a Viable Solution for Archive - Jon Toigo

  • 1.
  • 2. First Reaction: Stupid Question • Well, a silly question, at least. • It suggests that all archives are the same, but we know better… – Active archive: data still referenced but seldom changed – Deep archive: data rarely re-referenced and never changed • Different kinds of archive suggest different requirements from the archive platform: no “one size fits all” Historical data, intellectual property, data retained for regulatory compliance, conforming to an archive strategy… Production data, usually files, with limited re-reference rates, stored economically…
  • 4. Anyway, Disk is Already Used by Many Firms to Platform Data Archives …both on-premise and in the cloud
  • 5. Foundation of the Case for Disk-Based Archiving • Familiarity of the technology • Ease of deployment* • Data migration and copy support* • Improving disk capacity/performance • Availability of value-add data reduction/compression technology *well, sort of, maybe
  • 6. But Also a Few Drawbacks… • Acquisition cost (value-add software is cost accelerator) • Bit error rate of disk • Energy consumption • Silo-ing and proprietary design (lock-in costs/difficult migration) • Lack of data reduction standards • Poor hardware management capabilities
  • 7. Tape Provides an Alternative • Linear Tape File System (LTFS) • BlackPearl and Object Storage • BaFe tape coatings • Capacity, resiliency, economy National Petascale Computing Facility’s Blue Waters supercomputer uses 380 PB of tape storage, 26 PB of disk…
  • 8. Tape, too, has some Rough Edges • Unfamiliar to “millennials” • Access speeds can be an issue • File systems like LTFS optimized for “long block” files, not small files
  • 9. But Not Sufficient Cause to Count Tape Out… • Even the de-duplicating disk array folks have agreed on this score…in the past, at least!
  • 10. Time for Some Sanity • Archive is an application with a “personality” • Rather than Disk vs Tape… • …Maybe All of the Above is the better strategy!
  • 11. What About Front-Ending Tape with a Disk Cache • Remember Disk to Disk to Tape? • Why not tier your archive: – Low cost, high capacity disk for Active Archive – Tape for Deep Archive
  • 12. Disk Makes a Good Tape Cache • Whether LTFS or BlackPearl – In LTFS, disk cache can expedite access to tape-based files by spoofing access latency – With BlackPearl, disk provides a preparatory area for coalescing objects into buckets before writing to LTFS tape…
  • 13. “All of the Above” • The best strategy – Matching infrastructure to data access requirements and anticipated data growth – Leveraging the complementarity of magnetic storage media technologies, even in “clouds”…
  • 14. Six Criteria for Building an Effective Archive Platform 1. Know your data 2. Think about ingestion 3. Think about verification 4. Think about space 5. Think about skills 6. Think about TCO Know Your Data How to Ingest How to Verify Space Needed Skills Needed TCO
  • 15. Number 7 and Beyond… • We could go on, but… • Introducing Bruce Kornfeld, CMO, Spectra Logic Corporation – Premiere provider of both tape and disk archive platforms – Innovator with Deep Storage and BlackPearl technologies • Thank you and welcome, Bruce
  • 16. nTier Verde – Simply Affordable File Storage • No previous storage experience required • Half the cost of traditional file storage • Never lose data
  • 17. • Effortless Setup – 30 minutes from box to production! • Fast online expansion and management – Disk pools can be expanded in < 1 minute – Thin provisioning for automated expansion No Previous Storage Experience Required
  • 18. • Store more, spend less – List price as low as 48¢ per GB – No software fees • Compression, Snapshots and Replication included • Quick Installation – PS dollars focus on solution, not install • PriceLock Support Pricing – Avoid the support hockey stick Half the Cost of Traditional File Storage
  • 19. • Software eliminates data corruption and loss – Advanced checksums and multiple parity options – All writes committed instantaneously • Rock Solid Hardware – High quality, Enterprise SAS capacity drives • Everything you need… Nothing you don’t – Intelligent rebuilds – Compression – Data Integrity Never Lose Your Data
  • 21. nTier Verde 2U nTier Verde 4U Supported Hard Drives 4 TB 7200 RPM SAS Hard Drives Master Node Capacity* 6 to 11 Drives 24 TB to 44 TB RAW 10 to 35 Drives 40 TB to 140 TB RAW Expansion Node Support 1 Expansion Node 9 Expansion Nodes Max Capacity* 220 TB RAW Max 1.7 PB RAW Max Parity Options Mirroring, Single Parity, Double Parity, Triple Parity Software Options Intelligent Rebuilds, Compression, Replication, Hot Spares Unlimited Supported Protocols NFS, CIFS 3 x 1 GigE Data Ports Standard Standard 2 x 10 GigE Data Ports Optional Standard nTier Verde * Using 4 TB drives
  • 22. 1. Know your data 2. Think about ingestion 3. Think about verification 4. Think about space 5. Think about skills 6. Think about TCO Six Criteria for Building an Effective Archive Platform
  • 24. Think About Ingestion TAPE Libraries 10 GigE 10 GigE Unlimited Scalability Gigabit Ethernet 10 GigE (standard) Gigabit Ethernet 10 GigE (standard) DATA CREATION UsersUsers Objects DS3Data Management APPSFILES CIFS and NFS BlackPearl nTierVerde NAS Disk
  • 25. Library Lifecycle Management Media Lifecycle Management Drive Lifecycle Management Data Integrity Verification Think About Verification
  • 26. Tape library footprint comparisons for storage of 50PB Spectra T-Finity capable of expanding to 380PB Spectra Verde 10-Unit Disk Rack 1.7PB Think About Space
  • 27. Think About Skills Verde-Unbox Verde-Into Rack Verde-Plug IN Verde-Turn ON Verde-Configure Verde User Interface Home Screen