This sessions is for architects and storage admins seeking simple and non-disruptive ways to adopt cloud platforms in their organizations. You will learn how to deliver lower costs and greater scale with nearly seamless integration into your existing Backup ad Recovery processes to achieve fast, simple wins that demonstrate the scale and flexibility of cloud services for storage. Services mentioned: S3, Glacier, Snowball, 3rd party partners, Storage Gateway, and cloud data migration services.
2. Why hybrid cloud for backup and restore?
- Simple way to start using the cloud
- Addresses the cost and scale problems of data retention
- Capitalizes on your investments
- Third parties with cloud connectors
- Cloud gateway: local performance with cloud scale
- Takes it to the next level
- Migrate old backups from on-premises ($$$$) to the cloud ($).
- Eliminate tapes, trucks, trucks with tapes. Be green!
3. Batches and Streams
AWS Direct
Connect
AWS Snowball,
AWS Snowball
Edge, AWS
Snowmobile
3rd-Party
Connectors
Transfer
Acceleration
Storage
Gateway
Amazon Kinesis
Firehose
File
Amazon EFS
Block
Amazon EBS
(persistent)
Object
Amazon GlacierAmazon S3 Amazon EC2
Instance Store
(ephemeral)
4. Backup and recovery before the cloud
Application
servers
Local disk
Media
server
Tape storage
Data bunker
5. Backup and recovery to the cloud
Amazon S3
Amazon
Glacier
Direct
Connect
Internet
Amazon S3-IA
Application
servers
Cloud gateway
Local disk
Media
server
Cloud gateway
Application
servers
Cloud connector
Local disk
Media server
with cloud
connector
8. What should I use, and when?
Economics Easy to use Reduce risk Agility, scale
Pay as you go
No upfront investment
No commitment
No risky capacity
planning
Self-service
administration
SDKs for simple
integration
Durable and secure
Avoid risks of physical
media handling
Reduce time to market
Focus on your business,
not your infrastructure
Amazon S3
Durable object storage
for all types of data
Amazon EBS
Block storage for use
with Amazon EC2
Amazon Glacier
Archival storage
for infrequently
accessed data
Amazon EFS
File storage for use
with Amazon EC2
10. File Gateway
On-premises file storage maintained as objects in Amazon S3
Customer Premises
File
Gateway
Data stored and retrieved from your S3 buckets
One-to-one mapping from files-to-objects
File metadata stored in object metadata
Bucket access managed by IAM role that you own and manage
Use S3 Lifecycle Policies, versioning, or CRR to manage data
Amazon
Glacier
S3
Standard
S3
Standard
–
Infrequent
Access
HTTPS
NFS
v3 / v4.1
Application
Server
12. Application
Server
Volume Gateway
On-premises volume storage backed by Amazon S3 with EBS snapshots
Block storage in S3 accessed via the volume gateway
Compression of data in transit and at rest
Backup on-premises volumes to EBS snapshots
Create on-premises volumes from EBS snapshots
Up to 1 PB of total volume storage per gateway
Amazon
EBS
snapshots
Storage Gateway
bucket in
Amazon S3
Customer Premises
Volume
Gateway
iSCSI HTTPS
13. iSCSI AWS Storage
Gateway VM
TARGET
Client
Users
INITIATOR
Application
servers
INITIATOR
iSCSI
Amazon EBS
snapshots
AWS
Storage
Gateway service
Customer data center
HTTPS
Volume
storage backed
by Amazon S3
Volume Gateway Architecture
14. Tape Gateway
Virtual tape storage in Amazon S3 and Glacier with VTL management
Virtual tape storage in S3 and Glacier accessed via tape gateway
Compression of data in transit and at rest
Up to 1 PB total tape storage per gateway, unlimited archive capacity
Supports leading backup applications:
Archived tapes
stored in
Amazon Glacier
MEDIA
CHANGER
TAPE
DRIVE
Customer Premises
Tape
Gateway
Virtual tapes
stored in
Amazon S3
Backup
Server
HTTPSiSCSI
16. Cloud gateway: NetApp AltaVault
Common backup applications integrated with AltaVault:Solve backup and archive headaches with cloud-integrated
storage:
90% reduction in time, cost, and data volumes
Shrink recovery times from days to minutes
85% of backup and software providers supported
On Premises
Cloud-integrated
storage appliance
NetApp AltaVault
FAS
E-Series
Non-NetApp
storage
Seamlessly integrates into
existing storage and backup
software environment
Deduplicates, compresses,
and encrypts
Caches recent backups
locally, vaults older copies to
the cloud
NetApp SnapProtect
Arcserve
Commvault Simpana
EMC NetWorker
HP Data Protector
IBM Tivoli
Storage Manager
Symantec Backup
Exec
Symantec (Veritas)
NetBackup
Veeam
Microsoft SQL
Server
Oracle RMAN
AltaVault also available on Marketplace
to protect cloud-native workloads
Store data in the public or
private cloud of choice
Amazon S3
Amazon Glacier
Amazon S3-IA
21. Media
server
Amazon S3
Customer VPC
AWS-ENABLED NETBACKUP ARCHITECTURE IN EC2
Cloud connectors: Veritas NetBackup
Media
server
Cloud
storage
disk pool
EC2
instance
EC2
instance
Master
server
22. Media
server
Amazon S3
Customer VPC
AWS-ENABLED NETBACKUP ARCHITECTURE IN EC2
Cloud connectors: Veritas NetBackup
Media
server
Cloud
storage
disk pool
Amazon Glacier
EC2
instance
EC2
instance
Master
server
StorReduce
cluster
25. What is AWS Snowball? Petabyte-scale data transport
E Ink shipping
label
Ruggedized case
“8.5G impact”
All data encrypted
end-to-end
Rain- and dust-
resistant
Tamper-resistant
case and
electronics
80 TB
10GE network
27. How fast is AWS Snowball?
Less than 2 days to fill 5 Snowballs, 400 TB each, in parallel. Back to
AWS in less than 1 week, including shipping.
Number of days to transfer 400 TB via the Internet at typical utilizations:
Internet Connection Speed
Utilization 1 Gbps 500 Mbps 300 Mbps 150 Mbps
25% 152 304 505 1011
50% 74 152 252 505
75% 51 100 168 337
28. When to use AWS Snowball
Cloud
migration
Disaster
recovery
Data center
decommission
Content
distribution
29. S3 Transfer Acceleration: up to 300% faster, one click
Automatically changes the DNS name for the bucket (Amazon Route 53)
Bucket traffic moves to Amazon’s CDN network (Amazon CloudFront)
1 2
30. AWS Snowball S3 Transfer Acceleration
When to use AWS Snowball vs. S3 Transfer Acceleration
Supports import and export
Currently in US West (Oregon),
US East (N. Virginia)
Coming to US West (N.
California), GovCloud (US), Asia
Pacific (Sydney), and EU
(Ireland) regions; expected by
end of 2016
Supports large data transfers,
from TBs to PBs
Supports accelerating transfers
into and out of S3, using AWS
edge locations:
Checkbox WAN acceleration
Up to 6 times faster than regular
networks
Faster or free!
55 AWS edge locations globally
31. Use Amazon Glacier
for lowest-cost, durable cold
storage of archival data
Use Amazon S3
for reliable, durable
primary storage
Use Amazon S3
Infrequent Access
Storage
for secondary backups
at a lower cost
S3-IA
Tiering on AWS: optimize your storage spend
32. Key prefix “logs/”
Transition objects to Amazon Glacier 30 days after creation
Delete 365 days after creation date
<LifecycleConfiguration>
<Rule>
<ID>archive-in-30-days</ID>
<Prefix>logs/</Prefix>
<Status>Enabled</Status>
<Transition>
<Days>30</Days>
<StorageClass>GLACIER</StorageClass>
</Transition>
<Expiration>
<Days>365</Days>
</Expiration>
</Rule>
</LifecycleConfiguration
S3 lifecycle policies
33.
34. Related Sessions
STG213: Hybrid Cloud Storage Made Simple: The New
Storage Gateway File Interface and Customer Use Cases
PTS401: Using S3 Storage to Reduce Backup Costs on
AWS
STG209: Strategic Planning for Long-Term Data Archiving
with Amazon Glacier