Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Disaster Recovery with AWS: Tiered Approaches to Balance Cost with Recovery Objectives - ENT322 - re:Invent 2017

686 views

Published on

Learn how to take advantage of AWS for disaster recovery. In this session, we examine how traditional disaster recovery concepts can be adapted to the cloud. We also explore ways to cost-effectively reinvent disaster recovery, so it can extend to applications and workloads that have never had it before. This session walks you through tiered technology approaches to apply as part of a disaster recovery strategy that aligns costs to intended business outcomes.

Disaster Recovery with AWS: Tiered Approaches to Balance Cost with Recovery Objectives - ENT322 - re:Invent 2017

  1. 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS re:Invent Disaster Recovery with AWS T i e r e d A p p r o a c h e s t o B a l a n c e C o s t w i t h R e c o v e r y O b j e c t i v e s E N T 3 2 2 N o v e m b e r 2 9 , 2 0 1 7
  2. 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What to expect from this session • 300 level session • Iteration of previous re:Invent talks • How to leverage AWS for disaster recovery scenarios • Examples • Cost information • Special demo
  3. 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. History does not repeat itself but it does rhyme – Mark Twain
  4. 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 1986-04-26 01:23:04 Begin experiment...
  5. 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  6. 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Recovery point © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  7. 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Panic Systems are not normal Manually interpret signals and intervene
  8. 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster Recovery point Data loss © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  9. 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “There must be an incredible amount of radiation here. We'll be lucky if we're all still alive in the morning.” – Anatoli Zakharov, Fire Station 2 Chernobyl
  10. 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster Recovery point Recovery time Data loss Down time © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  11. 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. And yet…
  12. 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  13. 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Unplanned event causes coolant failure • Uncontrolled fuel rod triggers meltdown event • Uncontrolled release of steam triggers explosion • Generator present, but failure occurs • Unplanned event causes coolant failure • Uncontrolled fuel rod triggers meltdown event • Uncontrolled release of steam triggers explosion • Generator present, but failure occurs C h e r n o b y lF u k u s h i m a D a i i c h i Shared failures
  14. 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Lessons learned? Failure is not one thing
  15. 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What are we really planning for?
  16. 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  17. 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  18. 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  19. 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Techniques: Common disaster recovery methods
  20. 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Pilot light
  21. 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Subordinate database server Pilot light—prep www.example.com Data mirroring replication Not running Pilot light system Reverse proxy/ caching server Data volume Application server Corporate data center Reverse proxy/ caching server Application server Master Database server
  22. 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Database server Pilot light—recovery www.example.com Start in minutes Add additional capacity, if needed Reverse proxy/ caching server Data volume Application server Corporate data center Reverse proxy/ caching server Application server Master Database server
  23. 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Warm standby
  24. 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Warm standby—prep Mirroring/replication Application data source cut over Elastic load balancerActive Not active for production traffic Amazon Route 53 www.example.com Scaled down standbyCorporate data center Data volume Application server Subordinate database server Reverse proxy/ caching server AWS Region Reverse proxy/ caching server Application server Master Database server
  25. 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Warm standby—recover Elastic load balancer Active Route 53 www.example.com Scaled-up production Corporate data center Data volume Application server Database server Reverse proxy/ caching server AWS Region Reverse proxy/ caching server Application Server Master Database server
  26. 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hot site
  27. 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hot site—prep Mirroring/replication Application data source cut over Elastic load balancerActive Route 53 www.example.com Corporate data center Data volume Application server Subordinate database server Reverse proxy/ caching server AWS Region Reverse proxy/ caching server Application server Master Database server Active
  28. 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hot site—recovery Elastic load balancer Route 53 www.example.com Corporate data center Data volume Application server Database server Reverse proxy/ caching server AWS Region Reverse proxy/ caching server Application server Master Database server Active Scaled up for production use
  29. 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Disaster recovery is not just backups
  30. 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 1 Basic backup and recovery use case
  31. 31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. $ aws s3 sync /backups s3://mybucket ;Back up and sync the backup folder $ aws s3 sync /backups s3://mybucket --delete ;Like the preceding, but now delete files not present $ aws s3 sync /backups s3://mybucket --delete –storage- class STANDARD_IA ;Like the preceding, but now leverages Infrequent access AWS CLI-based backup, manual DR failover
  32. 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What does it look like? S3 Amazon Glacier S3 bucket Remote location /mybucket S3 STANDARD_IA 1 2 Lifecycle policy
  33. 33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What does a recovery look like? Failover Remote location 2 AWS DR Region Amazon EC2 S3 Amazon Glacier S3 bucket /mybucket S3 STANDARD_IA 1 Lifecycle policy
  34. 34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What would it cost? S3 STANDARD_IA S3 Amazon Glacier $ 0.0125/GB $ 0.023/GB $ 0.004/GB Service Cost S3 10 GB images $0.23 S3–IA 100 GB of data $1.25 Amazon Glacier–1 TB archives $4.10 Total $5.58/mo Shown: us-east-1
  35. 35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 2 Large data archive and recovery
  36. 36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Large data set AWS cloud Corporate data center NGS On-premises compute /cluster Sequence data Flowcell-ID Amazon Glacier 2 3 AWS Snowball device AWS CLI 1 AWS Snowball
  37. 37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Large data set AWS cloud Corporate data center NGS On-premises Compute / cluster Virtual server ISCSI Cached volume 1 2 virtual tape library AWS Storage Gateway Amazon Glacier Amazon S3 AWS Storage Gateway Amazon S3
  38. 38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Large data set Corporate data center NGS On-premises Compute / cluster File Gateway NFS AWS cloud - US- West-2 Amazon S3 S3 bucket Lifecycle policy AWS cloud US- East-1 Amazon S3 S3 bucket File Gateway VM
  39. 39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Large data set—recovery AWS DR Region Sequence data Flowcell-ID Amazon Glacier Corporate DR facility Server infrastructure 1 AWS Snowball S3 VPC endpoint AWS DR Region 2 Amazon EC2
  40. 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Large data set—recovery AWS DR Region Corporate data center NGS On-premises Compute/cluster AWS Storage Gateway Virtual server ISCSI Cached volume 1 Amazon Glacier Amazon S3 instance 2 AWS DR Region EBS snapshot virtual tape library AWS DR Region instance AMI Amazon EBS
  41. 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Large data set—recovery AWS DR Region Amazon S3 S3 bucket Corporate data center NGS On-premises Compute/cluster File Gateway AWS DR Region Amazon EC2 1 2 3 S3 endpoint NFS File Gateway VM
  42. 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What did it cost? — scenario gateways File Storage Volume Storage VTL - Archived $ 0.023/GB $0.023/GB $ 0.004/GB Service Cost File Gateway—10 TB $235.40 Storage Gateway—32 TB $736 Storage Gateway VTL—250TB $1,000 Total $1,971.4/mo Shown: US-West-2
  43. 43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What did it cost? — scenario Snowball S3 Snowball -edge Amazon Glacier $ 0.023/GB $300/100TB $ 0.004/GB Service Cost AWS SnowBall * 10 $3,000.00 Amazon Glacier archive 1 PB $4,194.31 Total $ 7,194.31 $4,194.31 /mo Shown: US-West-2
  44. 44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Massive data move
  45. 45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 3 Onsite virtualization replication, backup, and failover
  46. 46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Corporate data center AWS cloud Storage Gateway iSCSI from Storage Gateway to ESX Hosts VMFS VMware ESX VMware ESXi Replication Appliance Onsite VM replication/convert Stored volume
  47. 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Corporate data center AWS cloud iSCSI from AWS Storage Gateway to ESX Hosts VMFS VMware ESX VMware ESXi AMI EBS VM Import Onsite VM replication/convert – recovery Storage Gateway Stored volume Amazon S3 Replication Appliance
  48. 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What did it cost? S3 Storage Gateway $ 0.023/GB $0.00 Service Cost Storage Gateway archive (32 TB) $753.67 Storage Gateway VM cost $0 Total $753.67/mo Shown: US-West-2
  49. 49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. VMware Cloud on AWS
  50. 50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Deploy and consume native AWS services Customer VPC VMware Cloud VPC Customer Data Center AWS Direct Connect VMware Cloud Endpoints VPC subnet VPC subnet VPC subnet Private Managed AWS ServicesCustomer Instances vSphere Environment VMware Endpoints Non-vSphere Environment ESXi ESXi Amazon EC2 Internet Private VIF Public VIF Regional AWS Services AWS Lambda Amazon S3 Amazon CloudFront Etc…
  51. 51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 3a High availability windows server storage
  52. 52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data center SMB server with SGW backend SMB hosted onsite, blocks stored durably in Amazon S3 Private Datacenter Storage Gateway VM us-west-2 Storage Gateway Volume Windows Clients Windows Server HTTPSiSCSISMB
  53. 53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. High availability Windows server storage Local HA with remote DR us-east-1 Data Center Windows Clients Storage Gateway VMMicrosoft DFS HTTPSiSCSI HTTPSiSCSI SMB Storage Gateway Service us-west-1 Microsoft DFS HTTPSiSCSI Storage Gateway Service
  54. 54. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 4 Multisite replication and failover
  55. 55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Corporate data center AWS Direct Connect VPN us-east-1 us-west-2 Server Server Availability Zone Availability Zone Failback Server Multisite failover customer gateway users Equinix DA1
  56. 56. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Corporate data center Direct Connect VPN us-east-1 us-west-2 Failback AWS CloudFormation Server Availability Zone Availability Zone Server Multisite failover Server users customer gateway Equinix DA1
  57. 57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What did it cost? (30 days)—remote site VPC VPN EC2 * (m4.xlarge) 1 Gb Direct Connect EBS Region data transfer fee $ 0.05/hr $ 0.20/hr $ 0.30/hr $ 0.10/GB $ 0.02/GB Service Cost 1 GB Direct Connect $219.60 VPN Fallback Connection $36 (2) EC2 instances $292.80 (2) EBS 60 GB volumes $12 (1) AMI copy to us-west-2 $1.20 Total $561.60 *US-West-2, Amazon Linux AMI
  58. 58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 5 Knowledge worker DR site
  59. 59. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  60. 60. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Workspaces for worker DR Customer VPC Active Directory Corp servers Direct Connect or VPN Customer corporate network Customer AD RO/Replica EC2 corporate servers MFA (RADIUS) (Optional) Archives S3
  61. 61. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Internet Users Standalone Network Customer VPC AD RO / Replica Public AWS endpoint Streaming Gateway 9 Amazon WorkSpaces (network entry point) Amazon EC2 corporate servers Customer corporate network Amazon S3 Workspaces for worker DR
  62. 62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What did it cost? — 30 Days Workspaces (Standard) EC2 * (m4.xlarge) EBS (GP SSD) S3 VPC VPN $ 35 / Workspace $ 0.20 / Hour $ 0.10 $ 0.023 / GB $ 0.05 / Hour Service Cost Workspaces for 25 users $875 (2) AD EC2 + 100GB EBS $312.80 VPC VPN $36 S3 file backups (500GB) $11.50 (1) Share point W/ 2TB EBS $346.40 Total $1,581.70/Mo Shown: US-West-2, Windows Standard AMI
  63. 63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 6 Compliance DR site
  64. 64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. C5 [Germany] Cyber Essentials Plus [UK] DoD SRG FedRAMP FIPS IRAP [Australia] ISO 9001 ISO 27001 ISO 27017 ISO 27018 MLPS Level 3 [China] MTCS [Singapore] PCI DSS Level 1 SEC Rule 17-a-4(f) SOC 1 SOC 2 SOC 3 DNB [Netherlands] EAR EU Model Clauses FERPA GLBA HIPAA HITECH IRS 1075 ITAR My Number Act [Japan] U.K. DPA - 1988 VPAT / Section 508 EU Data Protection Directive Privacy Act [Australia] Privacy Act [New Zealand] PDPA - 2010 [Malaysia] PDPA - 2012 [Singapore] PIPEDA [Canada] Spanish DPA Authorization CIS CJIS CLIA CMS EDGE CMSR CSA EU-US Privacy Shield FISC FISMA G-Cloud [UK] GxP (FDA CFR 21 Part 11) ICREA IT Grundschutz [Germany] MITA 3.0 MPAA NIST PHR Uptime Institute Tiers UK Cloud Security Principles Certifications/ attestations Laws, regulations, and, privacy Alignments/ frameworks AWS assurance programs
  65. 65. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Corporate data center Compliance enabled failover Server users disk database tape storage Primary Government
  66. 66. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  67. 67. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Corporate data center Compliance enabled failover Server users disk database tape storage Primary Government us-west-2 Server Availability Zone Disk Database Backup Users AWS Artifact
  68. 68. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cloud lightning round!!!
  69. 69. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 7a All in on AWS: Amazon EC2 snapshot trick
  70. 70. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ”I want to copy my EC2 instance data via EBS snapshot...”
  71. 71. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ..but not lose data.
  72. 72. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. amzn.to/2nAz7n6
  73. 73. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Leverage the power of Amazon EC2 Systems Manager #!/bin/bash mysql -u backup -h localhost -e 'FLUSH TABLES WITH READ LOCK;’ sync for target in $(findmnt -nlo TARGET -t ext4); do fsfreeze -f $target; done instance=`curl -s http://169.254.169.254/latest/meta-data/instance-id` region=`curl -s 169.254.169.254/latest/meta-data/placement/availability-zone` region=${region::-1} volumes=`aws ec2 describe-instance-attribute --instance-id $instance --attribute blockDeviceMapping --output text --query BlockDeviceMappings[*].Ebs.VolumeId --region $region` for volume in $(echo $volumes | tr " " "n") do aws ec2 create-snapshot --volume-id $volume -- description 'Consistent snapshot of MySQL on Amazon Linux' --region $region > /dev/null 2>&1 done for target in $(findmnt -nlo TARGET -t ext4); do fsfreeze -u $target; done mysql -u backup -h localhost -e 'UNLOCK TABLES;' Amazon EC2 Systems Manager
  74. 74. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 7b All in on AWS: EC2 instance crashed!
  75. 75. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 Auto Recovery Set your failed check threshold Choose 1-minute period and statistic minimum Choose recover action Metric = StatusCheckFailed_System
  76. 76. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 Auto Reboot Choose reboot action Metric = StatusCheckFailed_Instance
  77. 77. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 7c All in on AWS: Amazon S3 data loss!
  78. 78. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “I’m worried about losing data from S3!” • Amazon S3 is built for 11 9’s of durability • If you store 10,000 objects, you can on average expect to incur a loss of a single object once every 10,000,000 years. • Amazon S3 supports cross region replication • Amazon S3 supports versioning • Amazon S3 supports MFA delete • IAM roles can also be used to limit access to S3 Amazon S3
  79. 79. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 7d All in on AWS: RDS replication – Failover
  80. 80. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RDS Database • RDS automatic backup/snapshots • RDS supports cross region read replicas for MySQL, PostgreSQL, Aurora DB, or MariaDB Amazon RDS
  81. 81. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use case 7e All in on AWS: AWS Database Migration Service
  82. 82. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DBMS: • Continuous or one time DB replication to EC2 or RDS • Leverage DBMS to replicate your database to AWS or even change your schema from one engine to another AWS DMS
  83. 83. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What about third party support?
  84. 84. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon BC/DR partner ecosystem (sample) • Solutions that utilize AWS to enable recovery strategies • Focused on RTO and RPO requirements • Full suite of both cold and warm BC/DR solutions
  85. 85. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Malibu Boats/CloudEndure case study Challenges • Prevent downtime, which would shut down factories and be very costly • Achieve near-zero RPO and RTO • Ability to recover to previous points in time • Multi-regional resilience in order to prevent weather-related outages • Failback to primary data center without disruption or data loss “[We] quickly noticed that the performance of the server on the AWS environment was at least twice as fast as it was on our current data center environment, using the same hardware specifications, the same memory, and CPU, which was quite eye-opening, and helped us to move forward our plans to a fuller presence in AWS and the cloud.” -Greg Ward, VP of IS & Technology Why AWS, CloudEndure, and Rackspace • Fast recovery, near-zero RPO and RTO • Cost of cold-standby with performance of warm-standby • Multiple checkpoints for point-in-time recovery • Automated failback to source machines • Unlimited, non-disruptive DR testing
  86. 86. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Putting it all together
  87. 87. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Lessons from history Plan for more than just what you expect to happen
  88. 88. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Lessons from history Test your execution plan before you think you can implement it
  89. 89. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Lessons from history Knowledge is critical. Know how to interpret an alarm on events.
  90. 90. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Words of advice People generally don’t do well under pressure • Automate as much as you can • Table top exercises can really help you understand roles and responsibility • Not all services have to require the same RTO/RPO • Seriously, automate as much as you can ahead of time • If you don’t have a run book, it’s time to make one • If you have one, have you tested it?
  91. 91. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. So, one more thing…
  92. 92. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  93. 93. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  94. 94. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  95. 95. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. #alexa-failover When automation automated itself
  96. 96. Remember to complete your evaluations! © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  97. 97. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you!

×