SlideShare a Scribd company logo
1 of 28
First Reaction: Stupid Question
• Well, a silly question, at least.
• It suggests that all archives are the same,
but we know better…
– Active archive: data still referenced but
seldom changed
– Deep archive: data rarely re-referenced
and never changed
• Different kinds of archive suggest
different requirements from the archive
platform: no “one size fits all” Historical data, intellectual property,
data retained for regulatory compliance,
conforming to an archive strategy…
Production data, usually files, with limited
re-reference rates, stored economically…
Platform Design 101
Anyway, Disk is Already Used by Many Firms to
Platform Data Archives
…both on-premise and in the cloud
Foundation of the Case for Disk-Based Archiving
• Familiarity of the technology
• Ease of deployment*
• Data migration and copy support*
• Improving disk capacity/performance
• Availability of value-add data
reduction/compression technology *well, sort of, maybe
But Also a Few Drawbacks…
• Acquisition cost (value-add
software is cost accelerator)
• Bit error rate of disk
• Energy consumption
• Silo-ing and proprietary design
(lock-in costs/difficult migration)
• Lack of data reduction standards
• Poor hardware management
capabilities
Tape Provides an Alternative
• Linear Tape File System (LTFS)
• BlackPearl and Object
Storage
• BaFe tape coatings
• Capacity, resiliency, economy National Petascale Computing Facility’s Blue
Waters supercomputer uses 380 PB of tape
storage, 26 PB of disk…
Tape, too, has some Rough Edges
• Unfamiliar to “millennials”
• Access speeds can be an issue
• File systems like LTFS
optimized for “long block”
files, not small files
But Not Sufficient Cause to
Count Tape Out…
• Even the de-duplicating
disk array folks have
agreed on this score…in
the past, at least!
Time for Some Sanity
• Archive is an application
with a “personality”
• Rather than Disk vs Tape…
• …Maybe All of the Above is
the better strategy!
What About Front-Ending Tape
with a Disk Cache
• Remember Disk to Disk to
Tape?
• Why not tier your archive:
– Low cost, high capacity disk
for Active Archive
– Tape for Deep Archive
Disk Makes a Good Tape Cache
• Whether LTFS or BlackPearl
– In LTFS, disk cache can expedite
access to tape-based files by
spoofing access latency
– With BlackPearl, disk provides a
preparatory area for coalescing
objects into buckets before
writing to LTFS tape…
“All of the Above”
• The best strategy
– Matching infrastructure to data
access requirements and anticipated
data growth
– Leveraging the complementarity of
magnetic storage media
technologies, even in “clouds”…
Six Criteria for Building an Effective Archive
Platform
1. Know your data
2. Think about ingestion
3. Think about verification
4. Think about space
5. Think about skills
6. Think about TCO
Know
Your
Data
How to
Ingest
How to
Verify
Space
Needed
Skills
Needed
TCO
Number 7 and Beyond…
• We could go on, but…
• Introducing Bruce Kornfeld, CMO,
Spectra Logic Corporation
– Premiere provider of both tape and
disk archive platforms
– Innovator with Deep Storage and
BlackPearl technologies
• Thank you and welcome, Bruce
nTier Verde –
Simply Affordable File Storage
• No previous storage experience required
• Half the cost of traditional file storage
• Never lose data
• Effortless Setup
– 30 minutes from box to production!
• Fast online expansion and
management
– Disk pools can be expanded in < 1
minute
– Thin provisioning for automated
expansion
No Previous Storage Experience Required
• Store more, spend less
– List price as low as 48¢ per GB
– No software fees
• Compression, Snapshots and Replication included
• Quick Installation
– PS dollars focus on solution, not install
• PriceLock Support Pricing
– Avoid the support hockey stick
Half the Cost of Traditional File Storage
• Software eliminates data corruption and loss
– Advanced checksums and multiple parity options
– All writes committed instantaneously
• Rock Solid Hardware
– High quality, Enterprise SAS capacity drives
• Everything you need… Nothing you don’t
– Intelligent rebuilds
– Compression
– Data Integrity
Never Lose Your Data
Verde Customers
nTier Verde 2U nTier Verde 4U
Supported Hard Drives 4 TB 7200 RPM SAS Hard Drives
Master Node Capacity* 6 to 11 Drives
24 TB to 44 TB RAW
10 to 35 Drives
40 TB to 140 TB RAW
Expansion Node Support 1 Expansion Node 9 Expansion Nodes
Max Capacity* 220 TB RAW Max 1.7 PB RAW Max
Parity Options Mirroring, Single Parity, Double Parity, Triple Parity
Software Options Intelligent Rebuilds, Compression, Replication,
Hot Spares Unlimited
Supported Protocols NFS, CIFS
3 x 1 GigE Data Ports Standard Standard
2 x 10 GigE Data Ports Optional Standard
nTier Verde
* Using 4 TB drives
1. Know your data
2. Think about ingestion
3. Think about verification
4. Think about space
5. Think about skills
6. Think about TCO
Six Criteria for Building
an Effective Archive Platform
Know Your Data
Think About
Ingestion
TAPE Libraries
10 GigE
10 GigE
Unlimited
Scalability
Gigabit Ethernet
10 GigE (standard)
Gigabit Ethernet
10 GigE (standard)
DATA CREATION
UsersUsers
Objects
DS3Data Management
APPSFILES
CIFS and NFS
BlackPearl
nTierVerde
NAS Disk
Library Lifecycle
Management
Media Lifecycle
Management
Drive Lifecycle
Management
Data Integrity
Verification
Think About Verification
Tape library footprint comparisons for storage of 50PB
Spectra T-Finity capable of expanding to 380PB
Spectra Verde
10-Unit Disk Rack
1.7PB
Think About Space
Think About Skills
Verde-Unbox Verde-Into Rack
Verde-Plug IN Verde-Turn ON
Verde-Configure
Verde User Interface Home Screen
Think About TCO

More Related Content

What's hot

Raid data recovery Tips
Raid data recovery TipsRaid data recovery Tips
Raid data recovery TipsHone Software
 
Hadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop EncryptionHadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop EncryptionErik Krogen
 
Efficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using DatabasesEfficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using DatabasesJoseph Elwin Fernandes
 
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, DatatypesHDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, DatatypesThe HDF-EOS Tools and Information Center
 
Vancouver bug enterprise storage and zfs
Vancouver bug   enterprise storage and zfsVancouver bug   enterprise storage and zfs
Vancouver bug enterprise storage and zfsRami Jebara
 
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen StoragePros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen StorageEric Carter
 
Ozone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR complianceOzone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR complianceDinesh Chitlangia
 
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Alluxio, Inc.
 
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDsSeagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDsRed_Hat_Storage
 
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStoreandyseaborne
 
Adapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency mediaAdapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency mediaHarald Seipp
 
Ceph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtCeph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtJens Hadlich
 
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red_Hat_Storage
 

What's hot (20)

Raid data recovery Tips
Raid data recovery TipsRaid data recovery Tips
Raid data recovery Tips
 
Raid level 4
Raid level 4Raid level 4
Raid level 4
 
Understanding RAID Controller
Understanding RAID ControllerUnderstanding RAID Controller
Understanding RAID Controller
 
Storage basics
Storage basicsStorage basics
Storage basics
 
Hadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop EncryptionHadoop Meetup Jan 2019 - Hadoop Encryption
Hadoop Meetup Jan 2019 - Hadoop Encryption
 
Efficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using DatabasesEfficient data maintaince in GlusterFS using Databases
Efficient data maintaince in GlusterFS using Databases
 
Raid
RaidRaid
Raid
 
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, DatatypesHDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
HDF5 Advanced Topics - Object's Properties, Storage Methods, Filters, Datatypes
 
Vancouver bug enterprise storage and zfs
Vancouver bug   enterprise storage and zfsVancouver bug   enterprise storage and zfs
Vancouver bug enterprise storage and zfs
 
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen StoragePros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
Pros and Cons of Erasure Coding & Replication vs. RAID in Next-Gen Storage
 
HDF5 I/O Performance
HDF5 I/O PerformanceHDF5 I/O Performance
HDF5 I/O Performance
 
Performance Tuning in HDF5
Performance Tuning in HDF5 Performance Tuning in HDF5
Performance Tuning in HDF5
 
Ozone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR complianceOzone: Evolution of HDFS scalability & built-in GDPR compliance
Ozone: Evolution of HDFS scalability & built-in GDPR compliance
 
Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...Scalable and High available Distributed File System Metadata Service Using gR...
Scalable and High available Distributed File System Metadata Service Using gR...
 
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDsSeagate Implementation of Dense Storage Utilizing HDDs and SSDs
Seagate Implementation of Dense Storage Utilizing HDDs and SSDs
 
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
2014-11 ApacheConEU : Lizard - Clustering an RDF TripleStore
 
Adapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency mediaAdapting Swift for Tape Storage or other high-latency media
Adapting Swift for Tape Storage or other high-latency media
 
Ceph Object Storage at Spreadshirt
Ceph Object Storage at SpreadshirtCeph Object Storage at Spreadshirt
Ceph Object Storage at Spreadshirt
 
Raid
RaidRaid
Raid
 
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
 

Similar to Is Disk Now a Viable Solution for Archive - Jon Toigo

Meeting the Challenges of Archival Storage
Meeting the Challenges of Archival StorageMeeting the Challenges of Archival Storage
Meeting the Challenges of Archival Storagespectralogic
 
2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The Trenches2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The TrenchesGeorge Ang
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarKognitio
 
Webinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseWebinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseStorage Switzerland
 
Pros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdfPros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdfHernanKlint
 
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-WarWebinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-WarStorage Switzerland
 
19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdf19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdfJESUNPK
 
Cloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation inCloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation inRahulBhole12
 
SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)Lars Marowsky-Brée
 
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...Ceph Community
 
Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016spectralogic
 
High Performance Hardware for Data Analysis
High Performance Hardware for Data AnalysisHigh Performance Hardware for Data Analysis
High Performance Hardware for Data AnalysisMike Pittaro
 
Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis PyData
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMichael Hiskey
 
Managing Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using ElasticsearchManaging Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using ElasticsearchJoe Alex
 
Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2BradDesAulniers2
 
Developing a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure EnvironmentsDeveloping a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure EnvironmentsCeph Community
 
Lessons learned from running Spark on Docker
Lessons learned from running Spark on DockerLessons learned from running Spark on Docker
Lessons learned from running Spark on DockerDataWorks Summit
 

Similar to Is Disk Now a Viable Solution for Archive - Jon Toigo (20)

Meeting the Challenges of Archival Storage
Meeting the Challenges of Archival StorageMeeting the Challenges of Archival Storage
Meeting the Challenges of Archival Storage
 
2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The Trenches2010 AIRI Petabyte Challenge - View From The Trenches
2010 AIRI Petabyte Challenge - View From The Trenches
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinar
 
Webinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the EnterpriseWebinar: Sizing Up Object Storage for the Enterprise
Webinar: Sizing Up Object Storage for the Enterprise
 
Pros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdfPros_and_Cons_of_DW_Apps pdf.pdf
Pros_and_Cons_of_DW_Apps pdf.pdf
 
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-WarWebinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
 
19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdf19IS305_U4_LP10_LM10-22-23.pdf
19IS305_U4_LP10_LM10-22-23.pdf
 
Cloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation inCloud computing UNIT 2.1 presentation in
Cloud computing UNIT 2.1 presentation in
 
SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)SUSE Storage: Sizing and Performance (Ceph)
SUSE Storage: Sizing and Performance (Ceph)
 
FAT.pptx
FAT.pptxFAT.pptx
FAT.pptx
 
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
Ceph Day London 2014 - Best Practices for Ceph-powered Implementations of Sto...
 
Unit 4 DBMS.ppt
Unit 4 DBMS.pptUnit 4 DBMS.ppt
Unit 4 DBMS.ppt
 
Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016Spectra Logic's BlackPearl Developers Summit 2016
Spectra Logic's BlackPearl Developers Summit 2016
 
High Performance Hardware for Data Analysis
High Performance Hardware for Data AnalysisHigh Performance Hardware for Data Analysis
High Performance Hardware for Data Analysis
 
Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis Mike Pittaro - High Performance Hardware for Data Analysis
Mike Pittaro - High Performance Hardware for Data Analysis
 
Meta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinarMeta scale kognitio hadoop webinar
Meta scale kognitio hadoop webinar
 
Managing Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using ElasticsearchManaging Security At 1M Events a Second using Elasticsearch
Managing Security At 1M Events a Second using Elasticsearch
 
Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2Elastic storage in the cloud session 5224 final v2
Elastic storage in the cloud session 5224 final v2
 
Developing a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure EnvironmentsDeveloping a Ceph Appliance for Secure Environments
Developing a Ceph Appliance for Secure Environments
 
Lessons learned from running Spark on Docker
Lessons learned from running Spark on DockerLessons learned from running Spark on Docker
Lessons learned from running Spark on Docker
 

Recently uploaded

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024BookNet Canada
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 

Recently uploaded (20)

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
New from BookNet Canada for 2024: BNC BiblioShare - Tech Forum 2024
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 

Is Disk Now a Viable Solution for Archive - Jon Toigo

  • 1.
  • 2. First Reaction: Stupid Question • Well, a silly question, at least. • It suggests that all archives are the same, but we know better… – Active archive: data still referenced but seldom changed – Deep archive: data rarely re-referenced and never changed • Different kinds of archive suggest different requirements from the archive platform: no “one size fits all” Historical data, intellectual property, data retained for regulatory compliance, conforming to an archive strategy… Production data, usually files, with limited re-reference rates, stored economically…
  • 4. Anyway, Disk is Already Used by Many Firms to Platform Data Archives …both on-premise and in the cloud
  • 5. Foundation of the Case for Disk-Based Archiving • Familiarity of the technology • Ease of deployment* • Data migration and copy support* • Improving disk capacity/performance • Availability of value-add data reduction/compression technology *well, sort of, maybe
  • 6. But Also a Few Drawbacks… • Acquisition cost (value-add software is cost accelerator) • Bit error rate of disk • Energy consumption • Silo-ing and proprietary design (lock-in costs/difficult migration) • Lack of data reduction standards • Poor hardware management capabilities
  • 7. Tape Provides an Alternative • Linear Tape File System (LTFS) • BlackPearl and Object Storage • BaFe tape coatings • Capacity, resiliency, economy National Petascale Computing Facility’s Blue Waters supercomputer uses 380 PB of tape storage, 26 PB of disk…
  • 8. Tape, too, has some Rough Edges • Unfamiliar to “millennials” • Access speeds can be an issue • File systems like LTFS optimized for “long block” files, not small files
  • 9. But Not Sufficient Cause to Count Tape Out… • Even the de-duplicating disk array folks have agreed on this score…in the past, at least!
  • 10. Time for Some Sanity • Archive is an application with a “personality” • Rather than Disk vs Tape… • …Maybe All of the Above is the better strategy!
  • 11. What About Front-Ending Tape with a Disk Cache • Remember Disk to Disk to Tape? • Why not tier your archive: – Low cost, high capacity disk for Active Archive – Tape for Deep Archive
  • 12. Disk Makes a Good Tape Cache • Whether LTFS or BlackPearl – In LTFS, disk cache can expedite access to tape-based files by spoofing access latency – With BlackPearl, disk provides a preparatory area for coalescing objects into buckets before writing to LTFS tape…
  • 13. “All of the Above” • The best strategy – Matching infrastructure to data access requirements and anticipated data growth – Leveraging the complementarity of magnetic storage media technologies, even in “clouds”…
  • 14. Six Criteria for Building an Effective Archive Platform 1. Know your data 2. Think about ingestion 3. Think about verification 4. Think about space 5. Think about skills 6. Think about TCO Know Your Data How to Ingest How to Verify Space Needed Skills Needed TCO
  • 15. Number 7 and Beyond… • We could go on, but… • Introducing Bruce Kornfeld, CMO, Spectra Logic Corporation – Premiere provider of both tape and disk archive platforms – Innovator with Deep Storage and BlackPearl technologies • Thank you and welcome, Bruce
  • 16. nTier Verde – Simply Affordable File Storage • No previous storage experience required • Half the cost of traditional file storage • Never lose data
  • 17. • Effortless Setup – 30 minutes from box to production! • Fast online expansion and management – Disk pools can be expanded in < 1 minute – Thin provisioning for automated expansion No Previous Storage Experience Required
  • 18. • Store more, spend less – List price as low as 48¢ per GB – No software fees • Compression, Snapshots and Replication included • Quick Installation – PS dollars focus on solution, not install • PriceLock Support Pricing – Avoid the support hockey stick Half the Cost of Traditional File Storage
  • 19. • Software eliminates data corruption and loss – Advanced checksums and multiple parity options – All writes committed instantaneously • Rock Solid Hardware – High quality, Enterprise SAS capacity drives • Everything you need… Nothing you don’t – Intelligent rebuilds – Compression – Data Integrity Never Lose Your Data
  • 21. nTier Verde 2U nTier Verde 4U Supported Hard Drives 4 TB 7200 RPM SAS Hard Drives Master Node Capacity* 6 to 11 Drives 24 TB to 44 TB RAW 10 to 35 Drives 40 TB to 140 TB RAW Expansion Node Support 1 Expansion Node 9 Expansion Nodes Max Capacity* 220 TB RAW Max 1.7 PB RAW Max Parity Options Mirroring, Single Parity, Double Parity, Triple Parity Software Options Intelligent Rebuilds, Compression, Replication, Hot Spares Unlimited Supported Protocols NFS, CIFS 3 x 1 GigE Data Ports Standard Standard 2 x 10 GigE Data Ports Optional Standard nTier Verde * Using 4 TB drives
  • 22. 1. Know your data 2. Think about ingestion 3. Think about verification 4. Think about space 5. Think about skills 6. Think about TCO Six Criteria for Building an Effective Archive Platform
  • 24. Think About Ingestion TAPE Libraries 10 GigE 10 GigE Unlimited Scalability Gigabit Ethernet 10 GigE (standard) Gigabit Ethernet 10 GigE (standard) DATA CREATION UsersUsers Objects DS3Data Management APPSFILES CIFS and NFS BlackPearl nTierVerde NAS Disk
  • 25. Library Lifecycle Management Media Lifecycle Management Drive Lifecycle Management Data Integrity Verification Think About Verification
  • 26. Tape library footprint comparisons for storage of 50PB Spectra T-Finity capable of expanding to 380PB Spectra Verde 10-Unit Disk Rack 1.7PB Think About Space
  • 27. Think About Skills Verde-Unbox Verde-Into Rack Verde-Plug IN Verde-Turn ON Verde-Configure Verde User Interface Home Screen