Automating Backup & Archiving with AWS and CommVault – Chris Gondek, Principal Architect, CommVault Australia and New Zealand

Automating Backup & Archiving with AWS and
CommVault
Chris Gondek

Physical Virtual Public Cloud
Applications
Servers
Network
Storage
Private Cloud
CommVault Simpana Software

Recovery Tier
Snapshot / Replica
Protection / Archive Tier
Disk / Appliance Based
Long Term Retention Tier
Object / Cloud / Tape Based
Software/IP
IntelliSnap Data Replicator
Hardware/Array
Datacore SANsymphony-V
Dell Compellent & EqualLogic
EMC Isilon, VMAX / Symmetrix,
VPLEX, VNX / Celerra & VNX /
CLARiiON
Fujitsu ETERNUS DX
HDS
HP 3PAR & EVA
Huawei
IBM SVC & XIV
LSI
NetApp
Nimble Storage
Oracle ZFS
SAN/DAS
FC
FoE
iSCSI
SCSI
NAS
CIFS
NFS
Appliance
Data Domain
Exagrid
VTL
Object / Cloud
Amazon S3 (Native)
Amazon S3 (Based)
Amazon Glacier
AT&T Synaptic Storage
Caringo
DDN WOS
EMC Atmos (Native)
EMC Atmos (Based)
Hitachi Content Platform
Microsoft Azure Storage
OpenStack Object Storage (Native)
OpenStack Object Storage (Based)
Rackspace Cloud Files
Tape
For full support details refer to:
http://documentation.commvault.com

Recovery Tier
Snapshot / Replica
Real World Example:
Global Investment Bank
Data Age
RestoreJobs

Recovery Tier
Snapshot / Replica
00
5,000
10,000
15,000
20,000
Less Than 7 Days 2 - 3 Weeks 1 - 2 Months 3 - 6 Months 9 - 12 Months Greater than 2 Years
2,396
1,384
4665629921,319
2,838
1,5881,716
3,547
19,447
Real World Example:
Global Investment Bank
Data Age
RestoreJobs
Number of Restore Jobs in a 12
Month Period Based on Data Age

Deployment
Models
Public Cloud Private
Cloud
Hybrid Cloud
Deployment Models

Deployment
Models
TO
AWS Cloud
Data
Management
Use Cases
DATA
Cloud
Hybrid Cloud
Deployment Models

Deployment
Models
TO
AWS Cloud
Data
Management
Use Cases
DATA
IN
AWS Cloud
DATA
Cloud
Hybrid Cloud
Deployment Models

Deployment
Models
TO
AWS Cloud
Data
Management
Use Cases
DATA
IN
AWS Cloud
DATA
FROM
AWS Cloud
DATA
Cloud
Hybrid Cloud
Deployment Models

AMI
Amazon EBS
Provisioni
ng
Lifecycle Management

AMI
Amazon EBS
Provisioni
ng
Snapshot
Managem
ent
PIT Snapshot(s)

AMI
Amazon EBS
Amazon S3 Bucket
Provisioni
ng
Snapshot
Managem
ent
Backup &
Archive
PIT Snapshot(s)

AMI
Amazon EBS
Amazon S3 Bucket
Bucket Amazon Glacier
Provisioni
ng
Snapshot
Managem
ent
Backup &
Archive
Vaulting
PIT Snapshot(s)

Traditional Server

Client
Amazon EC2

Client
/
Disk Cache
CommVault Archive File Container

Data Offset / Index
CommVault Media Agent

(Window / Linux / Unix)

- Deduplication Node

- Media / Library Manager
Memory Cache
Amazon S3
S3 Bucket
S3 Bucket
Cloud Storage Target

(REST / BLOB Storage)Client
Amazon S3 Support

Traditional Server

Client
Amazon EC2

Client
/
Disk Cache

Data Offset / Index



Memory Cache
Amazon S3
S3 Bucket
S3 Bucket

Amazon S3 Support
Natively Supported =
No Dedicated Appliances

Traditional Server

Client
Amazon EC2

Client
/
Disk Cache
Chunk File (Backup to Disk)

Sfile (Deduplication)

Data Offset / Index



Memory Cache
Amazon S3
S3 Bucket
S3 Bucket

(REST / BLOB Storage)
Data Pipe
Stream / Job)
Stream #1/2 / Job)
Stream #2/2 / Job)
Client
Amazon S3 Support

Traditional Server

Client
Amazon EC2

Client
/
Disk Cache


Data Offset / Index



Memory Cache
Amazon S3
S3 Bucket
S3 Bucket

Data Pipe
Stream / Job)
Stream #1/2 / Job)
Stream #2/2 / Job)
Client
Amazon S3 Support
More Streams =
Greater Performance!

Traditional Server

Client
Amazon EC2

Client
/
Disk Cache


Data Offset / Index



Memory Cache
Amazon S3
S3 Bucket
S3 Bucket

Amazon S3 Support
Data Pipe
Stream / Job)
Stream #1/2 / Job)
Stream #2/2 / Job)

Traditional Server

Client
Amazon EC2

Client
/
Disk Cache
Cloud
Connector
Cloud
Connector
Cloud
Connector


Data Offset / Index



Memory Cache
Amazon S3
S3 Bucket
S3 Bucket

Sub-File / BLOB (16MB Default)
Upload Threads (2 Default)
Client
Amazon S3 Support
Data Pipe
Stream / Job)
Stream #1/2 / Job)
Stream #2/2 / Job)

Traditional Server

Client
Amazon EC2

Client
/
Disk Cache
Cloud
Connector
Cloud
Connector
Cloud
Connector


Data Offset / Index



Memory Cache
Amazon S3
S3 Bucket
S3 Bucket

Client
Amazon S3 Support
Data Pipe
Stream / Job)
Stream #1/2 / Job)
Stream #2/2 / Job)
Tunable Parameters for
Optimised Read / Write

Data Mover
Disk Cache

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3 Bucket
#1

Amazon Glacier
Glacier Vault
Amazon Lifecycle Policies move
objects from S3 bucket into
Glacier archives
Amazon Glacier Support

Data Mover
Disk Cache

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3 Bucket
#1
S3 Bucket

#2

Amazon Glacier
Glacier Vault
Glacier archives

Data Mover
Disk Cache

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3 Bucket
#1
S3 Bucket

#2

Amazon Glacier
Glacier Vault
Glacier archives
Create a new S3 Bucket with
Glacier Lifecycle Policies Enabled

Data Mover
Disk Cache

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3
Bucket
#1

Amazon Glacier
Glacier archives
Glacier Vault
S3 Bucket

#2

Data Mover
Disk Cache
Cloud
Connector
Cloud
Connector

Re-Hydration

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3
Bucket
#1

Amazon Glacier
Glacier archives
Auxiliary Copy
Glacier Vault
S3 Bucket

#2

Data Mover
Disk Cache
Cloud
Connector
Cloud
Connector

Re-Hydration

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3
Bucket
#1

Amazon Glacier
Glacier archives
Auxiliary Copy
Glacier Vault
S3 Bucket

#2
Policy Based
Copy Management

Data Mover
Disk Cache
Cloud
Connector
Cloud
Connector

Re-Hydration

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3 Bucket
#1

Amazon Glacier
Glacier archives
Auxiliary Copy
Glacier Vault
S3 Bucket

#2

Data Mover
Disk Cache
Cloud
Connector
Cloud
Connector

Re-Hydration

Data Offset / Index

(Window / Linux )


Memory Cache
Amazon S3
S3 Bucket
#1

Amazon Glacier
Glacier archives
Auxiliary Copy
Glacier Vault
S3 Bucket

#2
Archive

CommVault Media Agent(s)

(Window / Linux)


Internet
CommVault CommServe

(Master Server)
Mobile
Client
Endpoint Protection
Amazon S3 S3 Bucket
user


(Window / Linux)


Internet
CommVault CommServe

(Master Server)
Mobile
Client
Endpoint Protection
Amazon S3 S3 Bucket
user
On-Demand
Self Service
CommVault infrastructure
running in the AWS Cloud


(Window / Linux)


Internet
CommVault CommServe

(Master Server)
Mobile
Client
Recovery to Amazon WorkSpaces
Amazon S3 S3 Bucket
user
Amazon
WorkSpaces


(Window / Linux)


Internet
CommVault CommServe

(Master Server)
Mobile
Client
Amazon S3 S3 Bucket
user
Amazon
WorkSpaces
Remote Lock &
Remote Wipe


(Window / Linux)


Internet
CommVault CommServe

(Master Server)
Mobile
Client
Amazon S3 S3 Bucket
user
Amazon
WorkSpaces
Maintain
Productivity

Internet

(Window / Linux)


CommVault CommServe

(Master Server)
Mobile
Client
File Sync
Amazon S3 S3 Bucket
user

Internet

(Window / Linux)


CommVault CommServe

(Master Server)
Mobile
Client
File Sync
Amazon S3 S3 Bucket
user
Mobile
Client

Internet

(Window / Linux)


CommVault CommServe

(Master Server)
Mobile
Client
File Sync
Amazon S3 S3 Bucket
user
Mobile
Client
Synchronise
Files / Folders

Internet

(Window / Linux)


CommVault CommServe

(Master Server)
Mobile
Client
File Share
Amazon S3 S3 Bucket
user

Internet

(Window / Linux)


CommVault CommServe

(Master Server)
Mobile
Client
File Share
Amazon S3 S3 Bucket
user
users


(Window / Linux)


Amazon S3 Bucket
Backup in the AWS Cloud
CommVault CommServe

(Master Server)


(Window / Linux)


Amazon S3 Bucket
Backup in the AWS Cloud
CommVault CommServe

(Master Server)
CommVault infrastructure
running in the AWS Cloud


(Window / Linux)


Corporate / Provider
Data Center
Physical Server
Amazon S3 Bucket
Backup to the AWS Cloud
CommVault CommServe

(Master Server)
Direct
Connect


(Window / Linux)


Data Center
Physical Server
Amazon S3 Bucket
CommVault CommServe

(Master Server)
Onsite / Local
Copy (Cache)
Direct
Connect


(Window / Linux)


Data Center
Physical Server
CommVault CommServe

(Master Server)
Amazon S3 Bucket
Direct
Connect


(Window / Linux)


Data Center
Physical Server
CommVault CommServe

(Master Server)
Offsite / DR
Copy
Amazon S3 Bucket
Direct
Connect


(Window / Linux)


Data Center
Physical Server
Vaulting to Glacier
CommVault CommServe

(Master Server)
Amazon S3 Bucket
Direct
Connect


(Window / Linux)


Data Center
Physical Server
Vaulting to Glacier
CommVault CommServe

(Master Server)
Amazon S3 Bucket
Policy Based
Copy Management
Direct
Connect

From retaining this…
Reduce LTR Costs with Reference Copy

From retaining this…
Relevant Data
to this…
Reduce LTR Costs with Reference Copy
Reduce up to 70% of retention costs


(Window / Linux)


Data Center
Physical Server
CommVault CommServe

(Master Server)
Amazon S3 Bucket
Automated Provisioning and Recovery


(Window / Linux)


Data Center
Physical Server
CommVault CommServe

(Master Server)
Amazon S3 Bucket
Policy Based
Provisioning
AMI


(Window / Linux)


Data Center
Physical Server
CommVault CommServe

(Master Server)
Amazon S3 Bucket
Increase Productivity, Reduce
Costs & Downtime

COMMVAULT@AWS ~ SMARTER, FASTER, EASIER

Introducing UberGlobal
• 3rd largest cloud hosting company
• One of Australia’s fastest growing technology companies
• SMB penetration with over 70,000 business customers
• Bespoke solutions: Enterprise & Govt., incl. ASD secure
• Wholesale enabled white labeled offering
• Fast moving innovations driven company

Uber’s Commvault Solution using Amazon S3
Benefits:
• Increased backup success
• Reduction in data protection costs
• Elimination of redundant data at source
• Seamless extension of data protection
• Smarter: Reduction of complexity
• Faster: Simplification of administrative tasks
• Easier: Self service data access & recovery

Uber’s Commvault Solution using Amazon S3

Why selecting Commvault was appropriate
• 50% reduction in storage-related costs
• Increased backup success rates to over 98%
• 90% of redundant data reduced at the source with global de-duplication
• Gap bridged between between physical and virtual server environments
• Ability to meet aggressive recovery SLAs with granular application recovery
• Minimized network and storage infrastructure costs on S3
• Leverage cloud services to lower operational costs

End Point Protection
Data Protection
Summary

Disaster Recovery
Data Protection
Summary

Archiving
Disaster Recovery
Data Protection
Summary

Archiving
eDiscovery
Disaster Recovery
Data Protection
Summary

Physical Virtual Public Cloud
Applications
Servers
Network
Storage
Private Cloud
Summary

Automating Backup & Archiving with AWS and CommVault – Chris Gondek, Principal Architect, CommVault Australia and New Zealand

Automating Backup & Archiving with AWS and CommVault – Chris Gondek, Principal Architect, CommVault Australia and New Zealand

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Automating Backup & Archiving with AWS and CommVault – Chris Gondek, Principal Architect, CommVault Australia and New Zealand

Similar to Automating Backup & Archiving with AWS and CommVault – Chris Gondek, Principal Architect, CommVault Australia and New Zealand (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Recently uploaded

Recently uploaded (20)

Automating Backup & Archiving with AWS and CommVault – Chris Gondek, Principal Architect, CommVault Australia and New Zealand