STG 201 – Backup To The Cloud
Travis Greenstreet, 2nd Watch
November 13, 2013

© 2013 Amazon.com, Inc. and its affiliates....
Agenda
•
•
•
•
•

Backups - Traditional vs. Cloud
AWS Backup, Archival & DR Tools
DR – Traditional vs. AWS Solutions
HA Us...
What’s wrong with Traditional Backups
• Long/slow recovery time

• Low durability (higher probability for data loss)
What’s wrong with Traditional Backups
• Requires Tape Museums
• Expensive Tech Refresh
• Disaster Recovery
– Complex and h...
What makes AWS better than Traditional
Solutions?
• Eleven 9s (that’s 99.999999999%) of durability
(S3/Glacier)
• Seamless...
What makes AWS better than Traditional
Solutions?
• Numerous options for transferring data in/out
and syncing
• The typica...
AWS Backup, Archival, and DR tools
•
•
•
•

S3 (backup/recovery)
Glacier (archival)
EBS snapshots
AWS Import/Export (used ...
AWS Backup, Archival, and DR tools
• Storage Gateway
• Pilot Light (Disaster Recovery)
• Warm Standby (taking Pilot Light ...
Amazon S3 – Simple Storage Service
• Durable and low cost (1GB < $0.10 per month)
• Unlimited number of objects and volume...
Amazon S3 – Simple Storage Service


Easily create lifecycle rules
−
−



Delete or archive to Glacier
Single rule for t...
Amazon Glacier – Infinite Archival
Storage

• Secure and cost
effective offsite data
archiving
• Excellent for logs
• Long...
EBS Snapshots
 “SAN like snapshots” of EBS storage allow
recovery to a point in time – replicated across
the entire regio...
AWS Import/Export
• Quickly migrate large amounts of data in/out of
AWS
– Seeding initial datasets
– Copying offsite backu...
High Availability on AWS






Plan for failure at any level
Services within a Datacenter (AZs) can fail
Regions are ...
HA Example
•
•

•

•

HA at each tier
Can lose entire
datacenter and
maintain
production load
Auto-scaling at
web and API ...
Disaster Recovery
• Average fully managed costs of DR > $1 per GB
of protected data
• Recovering from backups can take day...
Disaster Recovery on AWS
Classes of RTO’s
• Critical – Real-time
availability or near real-time
(minutes) – Tier 0
infrast...
Advantages of a Pilot Light DR Scenario
• Warm standby for the price of cold storage
o Or Less!

• Super fast recovery tim...
Storage Gateway – Cached or Stored
•
•
•
•

Gateway-Cached
Frequently accessed data
is cached on premise
Cost savings on s...
Storage Gateway – VTL
• Enterprise cloud backup solution
• All the benefits of S3 and Glacier, in an easy to
use package
•...
Storage Gateway – VTL
• Works with your existing backup software
• Traditional tape durability is 90%, VTL achieves
99.999...
Virtual Tape Library
• Create tapes using the AWS Console or
programmatically with the Storage Gateway API
• Each gateway ...
Virtual Tape Shelf
• Iron Mountain for the 21st century
• Tapes moved to the Virtual Tape Shelf are stored
in Glacier
• Ex...
Watch that VTL
•

•

•

•

Leverage the existing
capabilities of CloudWatch to
monitor and alarm your backup
processes.
Au...
Please give us your feedback on this
presentation

STG201 – Backup To The Cloud
As a thank you, we will select prize
winne...
Backup to the Cloud
Backup to the Cloud
Backup to the Cloud
Upcoming SlideShare
Loading in...5
×

Backup to the Cloud

594

Published on

View our Backup to the Cloud presentation from AWS re:Invent 2013.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
594
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
34
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Backup to the Cloud

  1. 1. STG 201 – Backup To The Cloud Travis Greenstreet, 2nd Watch November 13, 2013 © 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.
  2. 2. Agenda • • • • • Backups - Traditional vs. Cloud AWS Backup, Archival & DR Tools DR – Traditional vs. AWS Solutions HA Using AWS Solutions Q&A
  3. 3. What’s wrong with Traditional Backups • Long/slow recovery time • Low durability (higher probability for data loss)
  4. 4. What’s wrong with Traditional Backups • Requires Tape Museums • Expensive Tech Refresh • Disaster Recovery – Complex and highly cost-prohibitive
  5. 5. What makes AWS better than Traditional Solutions? • Eleven 9s (that’s 99.999999999%) of durability (S3/Glacier) • Seamless integration with existing AWS infrastructure • Lifecycle Management built in via “Lifecycle Policies”
  6. 6. What makes AWS better than Traditional Solutions? • Numerous options for transferring data in/out and syncing • The typical reasons for using AWS apply (e.g. Reduce CapEx, Reduce TCO, industry compliances) • Affordable and manageable DR with “Pilot Light”
  7. 7. AWS Backup, Archival, and DR tools • • • • S3 (backup/recovery) Glacier (archival) EBS snapshots AWS Import/Export (used for seeding large data sets)
  8. 8. AWS Backup, Archival, and DR tools • Storage Gateway • Pilot Light (Disaster Recovery) • Warm Standby (taking Pilot Light a step further to achieve fault tolerance between on premise and AWS DR resources)
  9. 9. Amazon S3 – Simple Storage Service • Durable and low cost (1GB < $0.10 per month) • Unlimited number of objects and volume • Backup from any system directly to S3 buckets via HTTP/HTTPS – Create scripts using PowerShell, Perl, Python… – Numerous solutions for data copy and synch
  10. 10. Amazon S3 – Simple Storage Service  Easily create lifecycle rules − −  Delete or archive to Glacier Single rule for the bucket or multiple based on object prefix Security − − − − – Control access thru policies and ACLs Auditable access Encryption in flight and at rest (SSL & SSE) Versioning in case of accidental deletion
  11. 11. Amazon Glacier – Infinite Archival Storage • Secure and cost effective offsite data archiving • Excellent for logs • Long term preservation for potential future analytic sources
  12. 12. EBS Snapshots  “SAN like snapshots” of EBS storage allow recovery to a point in time – replicated across the entire region (3+ AZ/datacenters)  Auto-scaling and scripting allow backup server to be fully cost optimized Example: 2W Backup Server < $1 per month
  13. 13. AWS Import/Export • Quickly migrate large amounts of data in/out of AWS – Seeding initial datasets – Copying offsite backups into S3, EBS, Glacier – Retrieval of offsite backups and datasets
  14. 14. High Availability on AWS      Plan for failure at any level Services within a Datacenter (AZs) can fail Regions are N+2 (minimum) Reserve capacity (the other side of Reserved Instances) Use AWS Services that scale across AZs − VPC, S3, ELB, RDS, ...
  15. 15. HA Example • • • • HA at each tier Can lose entire datacenter and maintain production load Auto-scaling at web and API tier to support dynamic site load EBS Snapshots replicated to additional region(s)
  16. 16. Disaster Recovery • Average fully managed costs of DR > $1 per GB of protected data • Recovering from backups can take days • Backup tapes add risk and time to recovery – Do you have all the tapes you need – Are the resources available to do the restorations
  17. 17. Disaster Recovery on AWS Classes of RTO’s • Critical – Real-time availability or near real-time (minutes) – Tier 0 infrastructure, critical apps • Major – Applications to run the business (hours) – Tier 1 infrastructure and apps • Minor – Applications that can withstand a longer downtime (hours - days) AWS Solution • High Availability or Warm Standby • Pilot Light DR in AWS • Backup and Recovery in AWS
  18. 18. Advantages of a Pilot Light DR Scenario • Warm standby for the price of cold storage o Or Less! • Super fast recovery time o Entire recovery process could be 1-3 hours • Data replication can keep critical systems in sync Tip: include full domain controller to ensure all accounts are replicated and can be used at time of event for definitive source.
  19. 19. Storage Gateway – Cached or Stored • • • • Gateway-Cached Frequently accessed data is cached on premise Cost savings on storage Mount volumes up to 32TB With up to 150 TBs total storage • • • • Gateway-Stored Low-latency access to all your data Asynchronous backup to S3 as EBS Snapshots Mount volumes up to 1TB Up to 12TBs of total storage
  20. 20. Storage Gateway – VTL • Enterprise cloud backup solution • All the benefits of S3 and Glacier, in an easy to use package • No need for re-architecting your datacenter, no need for re-training your employees
  21. 21. Storage Gateway – VTL • Works with your existing backup software • Traditional tape durability is 90%, VTL achieves 99.999999999% • Pay for what you use. If you store 1GB on a 100GB virtual tape, you’ll only pay for the 1GB
  22. 22. Virtual Tape Library • Create tapes using the AWS Console or programmatically with the Storage Gateway API • Each gateway can contain up to 1500 tapes, with up to 150TB of data • S3 provides hyper durability, your backup software and Storage Gateway VTL do the rest
  23. 23. Virtual Tape Shelf • Iron Mountain for the 21st century • Tapes moved to the Virtual Tape Shelf are stored in Glacier • Extremely cost effective. You’ll pay 1 penny per gigabyte, per month. Archive 5 GB of data for less than $1 per year.
  24. 24. Watch that VTL • • • • Leverage the existing capabilities of CloudWatch to monitor and alarm your backup processes. Automatically send notifications to engineers when a backup process has exceeded a specified threshold. Examine weeks worth of data to identify patterns of behavior, all through a familiar interface. Trigger API calls based on backup activity.
  25. 25. Please give us your feedback on this presentation STG201 – Backup To The Cloud As a thank you, we will select prize winners daily for completed surveys!
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×