Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines

Index Engines Introduction
Product Overview

Introducing Index Engines
▪ Amazon partner – supports primary/secondary storage migration via S3
▪ Software company delivering enterprise indexing technology
▪ Direct indexing, reporting and access to backup data
▪ Supports data backed up by IBM, Dell EMC, Veritas, HP, etc.
▪ Cost effective migration from legacy tape to AWS S3
▪ Index Engines Overview
▪ Partners include: Amazon, Dell EMC, EY, FTI
▪ Clients include:
▪ JPMC, Citi, Barclays, TIAA-CREF, State of CA, DOJ, Catholic Health, Cincinnati Children’s, Qualcom, Merck
▪ Patented technology
Copyright Index Engines Inc. 2017 All rights reserved. 2

Unstructured Data & Email in the Enterprise
Documents
Spreadsheets
Presentations
Email
Archives (SharePoint)
Backups (Disk or Tape)
© Index Engines Inc. All Rights Reserved. 2016 3
 Dark data
 Difficult to develop/execute/audit data policies
 Hidden sensitive records/PII
 Unleveraged intellectual property
 ROT – Redundant, obsolete and trivial data

Gartner Recommendations*
Organizations are struggling with uncontrolled data growth. Risk-aware and
cost-conscious organizations are realizing they need a better understanding of
their data in order to:
▪ Effectively reduce the risk and inefficiencies buried in
unstructured data
▪ Better manage data in line with governance and policies
▪ Optimize data management and storage infrastructure
▪ Provide better access to unstructured data
▪ Facilitate business use of data that has previously been
deemed "dark"
*Market Guide for File Analysis Software Published: 19 September 2016

Index Engines Overview
Know IT
Manage IT
Govern IT
▪ Data Classification & Profiling
▪ Enterprise class indexing software
▪ Metadata, full text, pattern/regex/PII, security ACLs, activity logs
▪ Reporting & classification on user files and email
▪ Defensible Disposition
▪ Delete, copy or migrate
▪ Integrated archiving & preservation
▪ Defensible audit trails and logs
▪ Automation and Monitoring
▪ Ongoing monitoring
▪ Automated management based on policy
▪ Instant access to personal data

MANAGEMENTSEARCH/REPORTINDEX
Index Engines Overview
Unstructured
Network Data
(NFS, CIFS, NDMP)
Email Servers
(EDB, PST, NSF)
SharePoint
Enterprise Vault
Backup Data
(Tape or Disk)
(IBM, Symantec, CVLT,
HP, EMC, etc.)
Backup
Catalogs
(TSM, NBU, CVLT)
Deduped
Unified
Search of
Data
Stored
Queries
and
Automate
Jobs
Auditable
Continual
Defensible
Disposition
Abandoned
Aged
Redundant
Personal
Risk
Archive
Active
Fast
( Up to 1TB/hr)
Efficient
Index
(5% Footprint)
Supports
Federation
for
Distributed
Data
Classify
Manage
Based
On
Policy
Automate
Schedule
Policies
Archive
Deletion
Cloud
Disk

Index Engines Advantages
Speed
The fastest indexing
engine on the market
today, reaching
speeds up to
1TB/hr/node
High speed queries
across large data sets
Access
Supports the widest
range of enterprise
data sources,
including backup data
Recognizes duplicate
content across
network and backup
data sources
Scale
Extreme scalability, to
PBs, with index
footprint of 5% or less
Supports federated
environments –
locally or
geographically
Flexible
Supports a range of
indexing from light
metadata to full
content
Extensive search and
reporting options
Enterprise
Ready
Active Directory
integration allowing
for reporting by group
membership
Flexible deployment
options
Built from the ground up as an enterprise-class indexing platform

Search and Reporting Interface

Client Deployments
Client Business Challenge Index Engines Deployment Benefits
Electronics
Manufacturing
Aged & outdated data requiring
frequent storage capacity upgrades
ROT Clean Up: LAN indexing of 3PBs data.
Delete redundant data/no access in 5+ years
Reclaimed >30% capacity and
eliminated a pending upgrade
Mid-Market
Financial
Risk associated with unmanaged
email (PSTs) and PII on the network
Security Audit: LAN indexing of 100TB of files
and email to find, review and secure PSTs/PII
Mitigated legal risk and supported
regulatory policies
Government
Agency
Support strategy of migrating aged
retention data to lower cost cloud
Cloud Migration: LAN indexing of 500TB of
aged servers, migrating data based to cloud
Reduced data center footprint by 20%
and eliminated aged storage platforms
Global Financial
Backup tape migration of legal hold
email to online archive
Legal Hold: Backup indexing of 200,000 tapes
and restoration of mailboxes to disk archive
Support ongoing litigation, eliminated
large, legacy tape infrastructure
Global
Pharmaceutical
Eliminate legacy tape
infrastructure, go tapeless
Tapeless: Catalog ingestion and tape
indexing/migration of LTR data to disk archive
Eliminate legacy tape infrastructure
and improve time to data for legal
Large
Healthcare
Consolidate non-production backup
catalogs/retire legacy infrastructure
Catalog Consolidation: Catalog ingestion, 75
media servers, report/access data
Faster time to find and access legacy
data in support of regulatory reqs

LAN Overview
▪ High speed indexing of network files, email, archives (SharePoint)
▪ Comprehensive search, reporting and classification
▪ Intelligent management to support migration and corporate data polices
▪ Supports following use cases:
• Defensible Deletion of aged data
• SharePoint Migration
• Cloud Migration
• Data Profiling & Assessments
• Email Management
• PII/PST & Security Audits
• Archiving & Preservation

LAN Technology Overview
▪ Only solution on the market to support enterprise class data centers
▪ Agentless NFS/CIFS crawling for in-place indexing of files and email
▪ Supports NDMP for high speed ingestion of data
▪ Rapidly deployable, server or virtual options
▪ Enterprise scalability (5% index footprint) , supports petabytes
▪ Not a sampling of data, full scan of all content
▪ Support distributed environments via federation
▪ Fully integrated indexing, reporting, management and disposition

ROT Analysis and Disposition
▪ Classify content by metadata
▪ Redundant – based on MD5 hash/document signature or metadata only analysis
▪ Obsolete – Not accessed in more than 3 years
▪ Trivial – Personal multimedia files (photos, iTunes, movies, etc.)
▪ ROT disposition
▪ Defensible deletion
▪ Migrate to lower cost storage/cloud
▪ Archive sensitive content and intellectual property
▪ Monitor data in place and manage based on retention policy
▪ Up to 33% of all data in a shared file server is ROT!
▪ Organization grow storage capacity up to 40% annually!

Sample Client Deployments
Agriculture
Insurance
Internal auditing of
1,000 user
accounts/10TB data to
safeguard PII (SSN/Bank
Routing)
Key Features: Scale,
customized reporting,
comprehensive indexing
Financial
Holding
Internal auditing of
sensitive documents
across 20TB server
environment
Key Features: Flexible
indexing, speed and
automation, ease of use
Consumer
Goods
Reduce 1PB storage
footprint and migrate
data to the cloud for
LTR.
Key Features: Ease of
deployment, Speed,
PII/Keyword search,
flexible reporting
Technology
Networking
Profile 2.4PB of network
data to support clean up
of ROT and deeper
analysis of specific
content . Phase 2 will
expand to 60PB
Key features: Speed
and scalability,
comprehensive analysis
– not sampling.
Financial
Services
Implement
departmental
chargebacks to support
clean up/management
of 100TB
Key Features: Active
Directory integration,
Speed, automated
indexing, dynamic
reporting

Catalog Management
Ingestion TSM/NBU/CV/NW catalog
Rebuild HPDP/BUE/ARCServe/etc.
Retire legacy backup software
Use Index Engines to manage,
search and report on catalog
Restore On-Demand
Use Index Engines to search catalog
& find relevant tapes for restore
Index tape with IE, detailed search
for file/email
Restore individual files/email from
tape to disk
Legacy Data Migration
Profile legacy tape data based on
catalog reports
Select data of value for migration, or
single instance of everything
Migrate data from tape to
cloud/disk for LTR
Unlocking Backup
Index Engines’ software ingests and manages non-production backup catalogs
and delivers direct access to tape data without need for original software.

Why Index Engines
▪ Retire expensive legacy backup applications, infrastructure (libraries,
servers, etc.) and tape storage
▪ Profile LTR data to understand value and risk
▪ Improve access to legacy data to support legal and compliance
▪ Accelerate SLAs with faster time to data
▪ Migrate and manage LTR data on disk/cloud more effectively
▪ Go tapeless – apply go forward LTR policy on tape or disk backups

Direct Tape Processing
Create Original
Environment
Restore 100%
of Tape
Content
Index Restored
Content
Dedupe
Results
Search for
Relevant Data
Extract
Relevant Data
(<5%)
Traditional Restore Process
Direct Indexing of
Tape Content
Search for
DeDuped/Relevant
Data
Extract Relevant
Data (<5%)
Automated Approach
100% of Data Moves from Tape
Relevant Data (<5%) Moves from Tape

Use Case 1: Catalog Ingestion/Rebuild
Backup Catalog Ingestion
TSM NetBackup
Commvault
Maintaining non-production backup software to support restores
Planning on phasing out current backup software
NetWorker
Backup Catalog Rebuild
HP DP ArcServe
BackupExec Others
Consolidated Catalog Metadata
Single management for all backup catalogs
Search, report, manage, access legacy data

Use Case 2: On Demand Access
TSM NetBackup
Commvault
NetWorker
HP DP ArcServe
BackupExec Others
Support ongoing restoration needs (eDiscovery, compliance, etc.)
Tapes are maintained for LTR data
Restore native files and
email
Scan/Index tapes for
detailed search/restore
Search catalog find
relevant tapes/barcodes

Use Case 3: Tape to Cloud Migration
TSM NetBackup
Commvault
NetWorker
HP DP ArcServe
BackupExec Others
Two pass culling: Catalog cull followed by detailed culling
Culled data set or single instance archive migrated to cloud via S3
Legacy tapes are remediated
Analyze catalog, cull tapes
to relevant dataset
Migrate data to cloud
Restore native files and
email
Search catalog find
relevant tapes/barcodes

LTR data is managed in online archive containing LTR data
No longer store tapes in offsite storage, recycle the DR tapes
Eliminate the use of tape for LTR
Use Case 4: Go Tapeless
Backup to Disk
Media Server
TSM NetBackup
Commvault
Backing up to disk, creating tapes off the back end for DR
NetWorker
HP DP ArcServe
BackupExec Others
Search and filter data
Define retention policy
Migrate LTR data from
backup as forensic copy
Index nightly backups

Intuitive Interface

Hardware
• Servers (NDMP)
• Libraries
• Floor space
Resources
• Manpower
• Data center costs
Backup Software
• Maintenance
• Infrastructure
• Management
SLAs & Restores
• Time to restore data
• 3rd party restore
services
Tape Storage
• Offsite storage costs
• Tape management
• Tape purchases
Risk & Liability
• eDiscovery
• Regulatory
• Long-term risk
Key Performance Indicators

Cost Saving Using Cloud for LTR
0
50000
100000
150000
200000
250000
300000
350000
Business as Usual
(Yearly Costs)
Migration Costs
(One Time Charge)
Transformed Environment
(Yearly Costs)
Backup/Restore Infrastructure Servers, libraries, disk, maint, floor space, staff
Backup Software Maintenance costs, and staffing
Tape Storage Offsite storage costs
Tape Management Cost to retrieve tapes to support legal
Migration Project Software, hardware, services
Cloud Infrastructure Software, hardware to access cloud data
Cloud Storage Costs to store and retrieve data in cloud
Staffing Staff to support cloud archive
BAU
Annual Costs
Migration Costs
One Time Fee
Transformed
Annual Costs
3 Year Savings
ROI
$295,600 $275,000 $100,000 $311,800 (35%)

Classifying and Culling Backup Data
Redundancy 90%!
Aged Data – Outside Retention
Irrelevant Files
User Files
Email
LTR
Option 1:
• Most efficient
• Cull to specific LTR data
• Data on legal hold
• Typically a small subset (1% or less)
Option 2:
• Single instance
• Eliminate duplicates
• Migrate files, email, databases
• A larger subset (10% or more)

Migration Case Study
Client with approximately 5,000 legacy tapes - migrated all
unique files and email from past 3 years to a single instance
archive
▪ 1,000 LTO-4, 2,000 LTO- 3, 2,000 LTO-2 (all NBU, compressed tapes)
▪ Total data storage = 3.6PB
▪ Migrate all unique email, and user documents from past three years.
▪ Cull 30% of tapes (past retention, eliminate incrementals)
▪ Total data remaining = 2.52PB
▪ Total data for migration = 126TB (95% of data duplicate (5% unique))
▪ Utilize four Index Engines servers, four libraries
▪ Data will be migrated to cloud storage in ~9 months
▪ Tapes shredded
▪ Legacy backup software, libraries, and servers retired

IE Backup Migration Services
▪ Index Engines offers cost effective pricing that includes the
bundled software & services needed
▪ Legacy Data Migration Assurance Program
▪ Tapes remain on premise, IE engineers remotely manage the progress
▪ Client provides hardware and loads tapes
▪ Data Processing Lab
▪ Off premise, turnkey service
▪ IE manages the migration process in our secure lab based on clients
migration requirements

Questions?

Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines

Similar to Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Replacing Tape Backup with Cloud-Enabled Solutions by Index Engines