Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Backup to the Cloud


Published on

View our Backup to the Cloud presentation from AWS re:Invent 2013.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Backup to the Cloud

  1. 1. STG 201 – Backup To The Cloud Travis Greenstreet, 2nd Watch November 13, 2013 © 2013, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of, Inc.
  2. 2. Agenda • • • • • Backups - Traditional vs. Cloud AWS Backup, Archival & DR Tools DR – Traditional vs. AWS Solutions HA Using AWS Solutions Q&A
  3. 3. What’s wrong with Traditional Backups • Long/slow recovery time • Low durability (higher probability for data loss)
  4. 4. What’s wrong with Traditional Backups • Requires Tape Museums • Expensive Tech Refresh • Disaster Recovery – Complex and highly cost-prohibitive
  5. 5. What makes AWS better than Traditional Solutions? • Eleven 9s (that’s 99.999999999%) of durability (S3/Glacier) • Seamless integration with existing AWS infrastructure • Lifecycle Management built in via “Lifecycle Policies”
  6. 6. What makes AWS better than Traditional Solutions? • Numerous options for transferring data in/out and syncing • The typical reasons for using AWS apply (e.g. Reduce CapEx, Reduce TCO, industry compliances) • Affordable and manageable DR with “Pilot Light”
  7. 7. AWS Backup, Archival, and DR tools • • • • S3 (backup/recovery) Glacier (archival) EBS snapshots AWS Import/Export (used for seeding large data sets)
  8. 8. AWS Backup, Archival, and DR tools • Storage Gateway • Pilot Light (Disaster Recovery) • Warm Standby (taking Pilot Light a step further to achieve fault tolerance between on premise and AWS DR resources)
  9. 9. Amazon S3 – Simple Storage Service • Durable and low cost (1GB < $0.10 per month) • Unlimited number of objects and volume • Backup from any system directly to S3 buckets via HTTP/HTTPS – Create scripts using PowerShell, Perl, Python… – Numerous solutions for data copy and synch
  10. 10. Amazon S3 – Simple Storage Service  Easily create lifecycle rules − −  Delete or archive to Glacier Single rule for the bucket or multiple based on object prefix Security − − − − – Control access thru policies and ACLs Auditable access Encryption in flight and at rest (SSL & SSE) Versioning in case of accidental deletion
  11. 11. Amazon Glacier – Infinite Archival Storage • Secure and cost effective offsite data archiving • Excellent for logs • Long term preservation for potential future analytic sources
  12. 12. EBS Snapshots  “SAN like snapshots” of EBS storage allow recovery to a point in time – replicated across the entire region (3+ AZ/datacenters)  Auto-scaling and scripting allow backup server to be fully cost optimized Example: 2W Backup Server < $1 per month
  13. 13. AWS Import/Export • Quickly migrate large amounts of data in/out of AWS – Seeding initial datasets – Copying offsite backups into S3, EBS, Glacier – Retrieval of offsite backups and datasets
  14. 14. High Availability on AWS      Plan for failure at any level Services within a Datacenter (AZs) can fail Regions are N+2 (minimum) Reserve capacity (the other side of Reserved Instances) Use AWS Services that scale across AZs − VPC, S3, ELB, RDS, ...
  15. 15. HA Example • • • • HA at each tier Can lose entire datacenter and maintain production load Auto-scaling at web and API tier to support dynamic site load EBS Snapshots replicated to additional region(s)
  16. 16. Disaster Recovery • Average fully managed costs of DR > $1 per GB of protected data • Recovering from backups can take days • Backup tapes add risk and time to recovery – Do you have all the tapes you need – Are the resources available to do the restorations
  17. 17. Disaster Recovery on AWS Classes of RTO’s • Critical – Real-time availability or near real-time (minutes) – Tier 0 infrastructure, critical apps • Major – Applications to run the business (hours) – Tier 1 infrastructure and apps • Minor – Applications that can withstand a longer downtime (hours - days) AWS Solution • High Availability or Warm Standby • Pilot Light DR in AWS • Backup and Recovery in AWS
  18. 18. Advantages of a Pilot Light DR Scenario • Warm standby for the price of cold storage o Or Less! • Super fast recovery time o Entire recovery process could be 1-3 hours • Data replication can keep critical systems in sync Tip: include full domain controller to ensure all accounts are replicated and can be used at time of event for definitive source.
  19. 19. Storage Gateway – Cached or Stored • • • • Gateway-Cached Frequently accessed data is cached on premise Cost savings on storage Mount volumes up to 32TB With up to 150 TBs total storage • • • • Gateway-Stored Low-latency access to all your data Asynchronous backup to S3 as EBS Snapshots Mount volumes up to 1TB Up to 12TBs of total storage
  20. 20. Storage Gateway – VTL • Enterprise cloud backup solution • All the benefits of S3 and Glacier, in an easy to use package • No need for re-architecting your datacenter, no need for re-training your employees
  21. 21. Storage Gateway – VTL • Works with your existing backup software • Traditional tape durability is 90%, VTL achieves 99.999999999% • Pay for what you use. If you store 1GB on a 100GB virtual tape, you’ll only pay for the 1GB
  22. 22. Virtual Tape Library • Create tapes using the AWS Console or programmatically with the Storage Gateway API • Each gateway can contain up to 1500 tapes, with up to 150TB of data • S3 provides hyper durability, your backup software and Storage Gateway VTL do the rest
  23. 23. Virtual Tape Shelf • Iron Mountain for the 21st century • Tapes moved to the Virtual Tape Shelf are stored in Glacier • Extremely cost effective. You’ll pay 1 penny per gigabyte, per month. Archive 5 GB of data for less than $1 per year.
  24. 24. Watch that VTL • • • • Leverage the existing capabilities of CloudWatch to monitor and alarm your backup processes. Automatically send notifications to engineers when a backup process has exceeded a specified threshold. Examine weeks worth of data to identify patterns of behavior, all through a familiar interface. Trigger API calls based on backup activity.
  25. 25. Please give us your feedback on this presentation STG201 – Backup To The Cloud As a thank you, we will select prize winners daily for completed surveys!