When building and deploying cloud backup & restore solutions, one of the most critical factors is your existing IT investments and how to integrate them with AWS capabilities. In this session, an AWS customer will talk about working with AWS and a third-party integrator to design and deploy company-wide backup & restore solutions. Learn how the customer was able to minimize disruptions to daily operations while bolstering backup capabilities with cloud storage services.
2. Massively Scalable Deduplication Software with a single namespace
Enables Primary and Secondary Backups to AWS and on the AWS
Cloud.
3. Problem: Legacy Storage for Backups
Server
Database
Backup
Appliance, e.g.
Data Domain
Tape
Primary Backups
• Daily backups retained for 30-90 days
• Hardware appliances
• Requires 2 appliances for redundancy
• Repurchase hardware every 3 years
Secondary Backups + Archival data
• Weekly, monthly, yearly backups,
retained from 1 month to forever
• Requires human time, hardware
• Not durable, hard and slow to recover
plus
Expensive hardware silos. Single points of failure and potential data loss. No scalability.
Limited durability. No “insight” into data using cloud services.
Data
Center
4. Solution:AWS Cloud + StorReduce
Backups
Server
Database
Private or
Public
Cloud
97% reduction in bandwidth
and storage with dedupe
Data
Center
+ Use cloud
services like
Search, AI, etc
5. Cloud
StorReduce
StorReduce
Purpose Built
Backup
Appliances:
e.g.Data Domain
Tape
Object Clone
Save 60%
Near instantaneous, unlimited copying of
an entire data set at PB scale, for free
Scale-out software, single namespace:
• Deduplication
• Replication between Clouds & Regions
• Cloning
Save up to 80%: Install on-premises in your
existing backup software to send backups and
archives to cloud. Remove PBBAs (like Data
Domain) and tape. Can also install on cloud.
Use any cloud service on backup data moved to
cloud.
6. How StorReduce Works
S3
Interface
REST API
Admin Interface
Backup
Software
File
System
Gateway
Cloud
Services
Cloud Storage
Amazon S3,
HGST Active Scale,
Cloudian, HDS HCP,
Swift Stack,
IBM COS, ECS etc
S3
Interface
REST API
StorReduce Server
SSD
Index Data
Raw
Data
Deduplicated
Data
S3
client
S3
client
S3
client
VM, RPM, Docker,
AMI…
On cloud and / or on
premises
On-premises - requires only 0.2% of the volume of data being written to cloud in commodity SSD.
7. Characteristics
Fast
2500MBps / Instance,
Clustering to hundreds of
instances with scale-out.
Inline & Multi-Threaded
Variable length block
size av. 64KB
Stateless
All Data & Metadata stored in
private /Public Cloud
Software Defined
Deploy as VM, Docker
Container or RPM,
on-premises &/or on-cloud
Secure
Client Side Encryption
or S3 SSE
KMS and KMIPS compliant
Enterprise Ready
High Availability, Read
Replicas, & Cloud
Replication
Scalable
Unlimited Instances, no charge per
instance.
Scale-out version- single name-space
8. Architecture
Object Storage
Applications (Backups, Big Data, Unstructured Data …)
Read / Write at
LAN Speed
10s – 100s Gbit/s
Single Namespace
Highly Available
Single Dedupe Pool
24/7 throughput
No buffering
Commodity H/W
LAN Speed
9. Performance
Results on a 15 server cluster. Throughputs increase at 95% linearly as you add servers
across an object store
• Ingesting at 13.77 GiB/s sustained throughput
• Recovering at 7 GiB/s sustained, does not slow down as the system does not fill up
• Deduplication ratio of 97% (equal to Data Domain).
10. Use Cloud Services on Backup Data Moved to Cloud
Cloud
Extract Metadata
& Data
Dark Data
Intelligence
E.g. Search inside all files for any
word or phrase for rather than look
through backup catalog document titles
Search,
Machine
Learning,
Analytics…
11. Backup to Cloud: Replace Backup Appliances and Tape
Cloud
StorReduce
Backupapplication
Ingest faster
Recover faster
Deduplication ratio = up to 95% reduction
Backup
Appliance
StorReduce
TCO Calculator
from AWS and on StorReduce website
Save up to 80%
StorReduce + Cloud:
1. No single point of failure
2. No silos
3. Scalable
4. Use cloud services on migrated
backups
StorReduce
Tape
StorReduce
Use cloud
services like
Search inside
all backups
Recover to on-premises or in
AWS Cloud and at multiple sites
12. Deduplicate Backups on Cloud: Enables lift & shift of all
Systems to AWS
Cloud
StorReduce
Backupapplication
Save up to 80%
StorReduce + Cloud:
1. No single point of failure
2. No silos
3. Scalable
4. Use cloud services on migrated
backups
StorReduce
StorReduce
Use cloud
services like
Search inside
all backups
Recover to in AWS Cloud – multiple Regions
Can also deduplicate Hadoop backups
13. Enterprises Keep their Existing Backup Applications
StorReduce is in NetBackup
Cloud Connector, and can send
deduplicated data to any cloud.
StorReduce enables NetBackup’s
OST features: Accelerator,
Accelerator for VMWare and
Optimized Synthetic Backups.
& any backup
system with a
S3 interface
Backup systems with a CIFS/ NFS interface, StorReduce is fully tested
with and uses QStar
NetBackup
14. Require excessive hardware
Ruin the TCO to move to object storage
Risk data loss
Create silos
(Some) require you to removal all existing backup
applications and replace with theirs and rehydrate and land
on expensive disk to migrate data off backup hardware to
cloud
Other Migration Systems