SlideShare a Scribd company logo
Simplified File Migrations
ShadowFS
Pain of Data Growth
Managing rapidly growing fixed content is a never ending and
escalating pain for IT organizations. The source of this pain
includes:
The storage industry through scale out clustering is addressing
the capacity issue of storage systems. Unfortunately the pain
and cost of moving legacy data into these next generation
storage devices has been left largely unaddressed.
Transition Problems
In order for an organization to run smoothly users need access
to their application data, when they want it. Degraded
performance or outage windows are classical problems IT
faces when transitioning legacy data to new storage.
The tight coupling of a file to a file system and a storage
device, is a proven model and has worked for decades. These
silos are great until the day comes when they are full or reach
the end of service dates. Then the complexity of transitioning
the data from the legacy storage system to the new one is fully
understood. Typically data is copied as a background process
and this is the easy part. Synchronizing the files as they are
updates, deleted or created during a storage transition is a
major IT headache, especially for active archives. Transferring
the permissions, preserving the file attributes, passing
retention dates, legal hold, setting WORM add additional
levels of complexity to the process.
Proven
Shadow FS was developed by DataTrust Solutions (DTS) to
solve the pain both line of business organizations and IT
experience when transitioning files from legacy to new file
system storage. Our data mover is multi-threaded and can run
across multiple worker systems in parallel. It has successfully
migrated billions of files for single applications at numerous
Financial and Healthcare organizations. The performance and
scale are impressive, but this is not what makes Shadow FS
special.
Transparent to applications / users
Works immediately, no trolling
Operates in-band or out of band
Easy installation and removal
Filters to exclude unwanted files
Copies all ACLS, permissions, meta data
Pass or adjust retention
Every file verified with crypto hashes
Chain-of-custody reports
Key Benefits • Most data out lives the storage system that hosts it
• Adhering to compliance and retention requirements
• Tight coupling of the file and the storage system
• Limited size and scalability of storage systems
• Managing CIFS ACLS and permissions
Works Instantly, Removed Simply
Shadow FS drops into the legacy environment and takes
over presentation of the shares and file systems of the
legacy storage system. ShadowFS has an auto-discover
feature for storage systems with large number of shares.
This coupled with the ability to import a list of
administrative sign-ins help to simplify the administrative
setup process. ShadowFS does not need to crawl the legacy
file system(s) to work. A key new feature is the ability to
maintain a file read request while simultaneously searching
for the file across all file systems in parallel. This file finder
eliminates the need to spend days or weeks crawling an
ever changing set of file systems to develop a catalogue and
enables ShadowFS to integrated into the environment and
up and running in minutes.
Transparent
Shadows FS provides a virtual file system that proxies both
the legacy storage as well as the new storage. This
preserves the application mount points and file pointers.
The Policy engine keeps all updates, deletes and new files
up to date on the new storage, thus eliminating time
consuming and painful nightly re-synchronization
processes.
The Right Data
Not all data is equal and subject to the same requirements
for retention and immutability. Shadow FS uses Policy
based filters for including or excluding data during a
transition. Filtering helps reduce capacity requirements and
legal risk from keeping unneeded data.
Retention
ShadowFS can pass retention set on one storage system to
another storage system with a different retention
mechanism. If needed retention parameters can be
adjusted on the fly during the migration process as well.
Supported retention mechanisms include: NetApp Snap
Lock, Isilon Smart Lock, and Data Domain Retention Lock.
Mirror Copy
ShadowFS not only copies the files, meta-data, extended
attributes and streams but also all time stamps, ACLS and
permissions. Alternatively you can adjust parameters in-
flight based upon policies .
Reporting and Chain-of-Custody
ShadowFS provides extensive logging and auditing
capabilities. In compliance mode every file that is
transitioned from one storage device to another is verified
using cryptographic hashes and chain-of-custody reports
are automatically generated.
For more information please contact us at:
+1 720-502-1031
info@DataTrustSolutions.com.
2015 DataTrust Solutions
In-Line Transparent Migration
Writes
ReadsFind
LegacyFS.old LegacyFS.ne
w
LegacyFS
Copies
Shadow FS
Application Layer
CIFS NFS Mixed

More Related Content

What's hot

Database Options
Database OptionsDatabase Options
Database Options
Connor McDonald
 
Database
DatabaseDatabase
Database
khei061391
 
Power saving in data centers
Power saving in data centersPower saving in data centers
Power saving in data centers
Álvaro López Medina
 
Sql Server 2008 Features
Sql Server 2008 FeaturesSql Server 2008 Features
Sql Server 2008 Features
Parul Sharma
 
Cohesity-One-Pager
Cohesity-One-PagerCohesity-One-Pager
Cohesity-One-Pager
Tyler Livingstone
 
Auditing security of Oracle DB (Karel Miko)
Auditing security of Oracle DB (Karel Miko)Auditing security of Oracle DB (Karel Miko)
Auditing security of Oracle DB (Karel Miko)
DCIT, a.s.
 
Sql intro
Sql introSql intro
Sql intro
Vikas Gupta
 
Data warehouseing
Data warehouseingData warehouseing
Data warehouseing
Sajan Sahu
 
What's hyperion
What's hyperionWhat's hyperion
What's hyperion
James Reed
 
01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring
01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring
01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring
Arunprasad Sukumar
 
Transform Your Mainframe with Microsoft Azure
Transform Your Mainframe with Microsoft AzureTransform Your Mainframe with Microsoft Azure
Transform Your Mainframe with Microsoft Azure
Precisely
 

What's hot (11)

Database Options
Database OptionsDatabase Options
Database Options
 
Database
DatabaseDatabase
Database
 
Power saving in data centers
Power saving in data centersPower saving in data centers
Power saving in data centers
 
Sql Server 2008 Features
Sql Server 2008 FeaturesSql Server 2008 Features
Sql Server 2008 Features
 
Cohesity-One-Pager
Cohesity-One-PagerCohesity-One-Pager
Cohesity-One-Pager
 
Auditing security of Oracle DB (Karel Miko)
Auditing security of Oracle DB (Karel Miko)Auditing security of Oracle DB (Karel Miko)
Auditing security of Oracle DB (Karel Miko)
 
Sql intro
Sql introSql intro
Sql intro
 
Data warehouseing
Data warehouseingData warehouseing
Data warehouseing
 
What's hyperion
What's hyperionWhat's hyperion
What's hyperion
 
01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring
01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring
01 - ACL - Solution Sheet - Team Collaboration & Continuous Control Monitoring
 
Transform Your Mainframe with Microsoft Azure
Transform Your Mainframe with Microsoft AzureTransform Your Mainframe with Microsoft Azure
Transform Your Mainframe with Microsoft Azure
 

Similar to Shadow-FS-datasheet-2015

Hitachi overview-brochure-hus-hnas-family
Hitachi overview-brochure-hus-hnas-familyHitachi overview-brochure-hus-hnas-family
Hitachi overview-brochure-hus-hnas-family
Hitachi Vantara
 
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
Niraj Tolia
 
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics
 
Data Orchestration Solution: An Integral Part of DataOps
Data Orchestration Solution: An Integral Part of DataOpsData Orchestration Solution: An Integral Part of DataOps
Data Orchestration Solution: An Integral Part of DataOps
Enov8
 
Survey of distributed storage system
Survey of distributed storage systemSurvey of distributed storage system
Survey of distributed storage system
Zhichao Liang
 
Consolidating File Servers into the Cloud
Consolidating File Servers into the CloudConsolidating File Servers into the Cloud
Consolidating File Servers into the Cloud
Buurst
 
Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...
Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...
Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...
LindaWatson19
 
An-Insight-about-Glusterfs-and-it's-Enforcement-Techniques
An-Insight-about-Glusterfs-and-it's-Enforcement-TechniquesAn-Insight-about-Glusterfs-and-it's-Enforcement-Techniques
An-Insight-about-Glusterfs-and-it's-Enforcement-Techniques
Manikandan Selvaganesh
 
Benefits of a data lake
Benefits of a data lake Benefits of a data lake
Benefits of a data lake
Sun Technologies
 
EMC Isilon Multitenancy for Hadoop Big Data Analytics
EMC Isilon Multitenancy for Hadoop Big Data AnalyticsEMC Isilon Multitenancy for Hadoop Big Data Analytics
EMC Isilon Multitenancy for Hadoop Big Data Analytics
EMC
 
Hitachi Content Platform Datasheet
Hitachi Content Platform DatasheetHitachi Content Platform Datasheet
Hitachi Content Platform Datasheet
Hitachi Vantara
 
ParaScale Cloud Storage Customer overview presentation
ParaScale Cloud Storage Customer overview presentationParaScale Cloud Storage Customer overview presentation
ParaScale Cloud Storage Customer overview presentation
ParaScale Marketing
 
Ans mi0034-database management system-sda-2012-ii
Ans mi0034-database management system-sda-2012-iiAns mi0034-database management system-sda-2012-ii
Ans mi0034-database management system-sda-2012-ii
zafarishtiaq
 
BR_U_UA8.0
BR_U_UA8.0BR_U_UA8.0
BR_U_UA8.0
Shawn Colvard
 
Why is Virtualization Creating Storage Sprawl? By Storage Switzerland
Why is Virtualization Creating Storage Sprawl? By Storage SwitzerlandWhy is Virtualization Creating Storage Sprawl? By Storage Switzerland
Why is Virtualization Creating Storage Sprawl? By Storage Switzerland
INFINIDAT
 
Silverton cleversafe-object-based-dispersed-storage
Silverton cleversafe-object-based-dispersed-storageSilverton cleversafe-object-based-dispersed-storage
Silverton cleversafe-object-based-dispersed-storage
Accenture
 
5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...
5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...
5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...
DuraSpace
 
Hitachi datasheet-hcp-and-bloombase-storesafe
Hitachi datasheet-hcp-and-bloombase-storesafeHitachi datasheet-hcp-and-bloombase-storesafe
Hitachi datasheet-hcp-and-bloombase-storesafe
Bloombase
 
Ds 354-a hitachi-datasheet-hcp-and-bloombase-storesafe
Ds 354-a hitachi-datasheet-hcp-and-bloombase-storesafeDs 354-a hitachi-datasheet-hcp-and-bloombase-storesafe
Ds 354-a hitachi-datasheet-hcp-and-bloombase-storesafe
Bloombase
 
Veritas Failover3
Veritas Failover3Veritas Failover3
Veritas Failover3
grogers1124
 

Similar to Shadow-FS-datasheet-2015 (20)

Hitachi overview-brochure-hus-hnas-family
Hitachi overview-brochure-hus-hnas-familyHitachi overview-brochure-hus-hnas-family
Hitachi overview-brochure-hus-hnas-family
 
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
(Speaker Notes Version) Architecting An Enterprise Storage Platform Using Obj...
 
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
 
Data Orchestration Solution: An Integral Part of DataOps
Data Orchestration Solution: An Integral Part of DataOpsData Orchestration Solution: An Integral Part of DataOps
Data Orchestration Solution: An Integral Part of DataOps
 
Survey of distributed storage system
Survey of distributed storage systemSurvey of distributed storage system
Survey of distributed storage system
 
Consolidating File Servers into the Cloud
Consolidating File Servers into the CloudConsolidating File Servers into the Cloud
Consolidating File Servers into the Cloud
 
Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...
Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...
Enterprise Archiving with Apache Hadoop Featuring the 2015 Gartner Magic Quad...
 
An-Insight-about-Glusterfs-and-it's-Enforcement-Techniques
An-Insight-about-Glusterfs-and-it's-Enforcement-TechniquesAn-Insight-about-Glusterfs-and-it's-Enforcement-Techniques
An-Insight-about-Glusterfs-and-it's-Enforcement-Techniques
 
Benefits of a data lake
Benefits of a data lake Benefits of a data lake
Benefits of a data lake
 
EMC Isilon Multitenancy for Hadoop Big Data Analytics
EMC Isilon Multitenancy for Hadoop Big Data AnalyticsEMC Isilon Multitenancy for Hadoop Big Data Analytics
EMC Isilon Multitenancy for Hadoop Big Data Analytics
 
Hitachi Content Platform Datasheet
Hitachi Content Platform DatasheetHitachi Content Platform Datasheet
Hitachi Content Platform Datasheet
 
ParaScale Cloud Storage Customer overview presentation
ParaScale Cloud Storage Customer overview presentationParaScale Cloud Storage Customer overview presentation
ParaScale Cloud Storage Customer overview presentation
 
Ans mi0034-database management system-sda-2012-ii
Ans mi0034-database management system-sda-2012-iiAns mi0034-database management system-sda-2012-ii
Ans mi0034-database management system-sda-2012-ii
 
BR_U_UA8.0
BR_U_UA8.0BR_U_UA8.0
BR_U_UA8.0
 
Why is Virtualization Creating Storage Sprawl? By Storage Switzerland
Why is Virtualization Creating Storage Sprawl? By Storage SwitzerlandWhy is Virtualization Creating Storage Sprawl? By Storage Switzerland
Why is Virtualization Creating Storage Sprawl? By Storage Switzerland
 
Silverton cleversafe-object-based-dispersed-storage
Silverton cleversafe-object-based-dispersed-storageSilverton cleversafe-object-based-dispersed-storage
Silverton cleversafe-object-based-dispersed-storage
 
5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...
5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...
5-16-13 Using the DuraCloud Service to archive content in Glacier Presentatio...
 
Hitachi datasheet-hcp-and-bloombase-storesafe
Hitachi datasheet-hcp-and-bloombase-storesafeHitachi datasheet-hcp-and-bloombase-storesafe
Hitachi datasheet-hcp-and-bloombase-storesafe
 
Ds 354-a hitachi-datasheet-hcp-and-bloombase-storesafe
Ds 354-a hitachi-datasheet-hcp-and-bloombase-storesafeDs 354-a hitachi-datasheet-hcp-and-bloombase-storesafe
Ds 354-a hitachi-datasheet-hcp-and-bloombase-storesafe
 
Veritas Failover3
Veritas Failover3Veritas Failover3
Veritas Failover3
 

Shadow-FS-datasheet-2015

  • 1. Simplified File Migrations ShadowFS Pain of Data Growth Managing rapidly growing fixed content is a never ending and escalating pain for IT organizations. The source of this pain includes: The storage industry through scale out clustering is addressing the capacity issue of storage systems. Unfortunately the pain and cost of moving legacy data into these next generation storage devices has been left largely unaddressed. Transition Problems In order for an organization to run smoothly users need access to their application data, when they want it. Degraded performance or outage windows are classical problems IT faces when transitioning legacy data to new storage. The tight coupling of a file to a file system and a storage device, is a proven model and has worked for decades. These silos are great until the day comes when they are full or reach the end of service dates. Then the complexity of transitioning the data from the legacy storage system to the new one is fully understood. Typically data is copied as a background process and this is the easy part. Synchronizing the files as they are updates, deleted or created during a storage transition is a major IT headache, especially for active archives. Transferring the permissions, preserving the file attributes, passing retention dates, legal hold, setting WORM add additional levels of complexity to the process. Proven Shadow FS was developed by DataTrust Solutions (DTS) to solve the pain both line of business organizations and IT experience when transitioning files from legacy to new file system storage. Our data mover is multi-threaded and can run across multiple worker systems in parallel. It has successfully migrated billions of files for single applications at numerous Financial and Healthcare organizations. The performance and scale are impressive, but this is not what makes Shadow FS special. Transparent to applications / users Works immediately, no trolling Operates in-band or out of band Easy installation and removal Filters to exclude unwanted files Copies all ACLS, permissions, meta data Pass or adjust retention Every file verified with crypto hashes Chain-of-custody reports Key Benefits • Most data out lives the storage system that hosts it • Adhering to compliance and retention requirements • Tight coupling of the file and the storage system • Limited size and scalability of storage systems • Managing CIFS ACLS and permissions
  • 2. Works Instantly, Removed Simply Shadow FS drops into the legacy environment and takes over presentation of the shares and file systems of the legacy storage system. ShadowFS has an auto-discover feature for storage systems with large number of shares. This coupled with the ability to import a list of administrative sign-ins help to simplify the administrative setup process. ShadowFS does not need to crawl the legacy file system(s) to work. A key new feature is the ability to maintain a file read request while simultaneously searching for the file across all file systems in parallel. This file finder eliminates the need to spend days or weeks crawling an ever changing set of file systems to develop a catalogue and enables ShadowFS to integrated into the environment and up and running in minutes. Transparent Shadows FS provides a virtual file system that proxies both the legacy storage as well as the new storage. This preserves the application mount points and file pointers. The Policy engine keeps all updates, deletes and new files up to date on the new storage, thus eliminating time consuming and painful nightly re-synchronization processes. The Right Data Not all data is equal and subject to the same requirements for retention and immutability. Shadow FS uses Policy based filters for including or excluding data during a transition. Filtering helps reduce capacity requirements and legal risk from keeping unneeded data. Retention ShadowFS can pass retention set on one storage system to another storage system with a different retention mechanism. If needed retention parameters can be adjusted on the fly during the migration process as well. Supported retention mechanisms include: NetApp Snap Lock, Isilon Smart Lock, and Data Domain Retention Lock. Mirror Copy ShadowFS not only copies the files, meta-data, extended attributes and streams but also all time stamps, ACLS and permissions. Alternatively you can adjust parameters in- flight based upon policies . Reporting and Chain-of-Custody ShadowFS provides extensive logging and auditing capabilities. In compliance mode every file that is transitioned from one storage device to another is verified using cryptographic hashes and chain-of-custody reports are automatically generated. For more information please contact us at: +1 720-502-1031 info@DataTrustSolutions.com. 2015 DataTrust Solutions In-Line Transparent Migration Writes ReadsFind LegacyFS.old LegacyFS.ne w LegacyFS Copies Shadow FS Application Layer CIFS NFS Mixed