In the event of a disaster, you need to be able to recover lost data quickly to ensure business continuity. For critical applications, keeping your time to recover and data loss to a minimum as well as optimizing your overall capital expense can be challenging. This session presents AWS features and services along with Disaster Recovery architectures that you can leverage when building highly available and disaster resilient applications. We will provide recommendations on how to improve your Disaster Recovery plan and discuss example scenarios showing how to recover from a disaster.
2. What do I expect you know?
• 300 level talk
• Have some prior experience with AWS
• Understand/know basic terms like Amazon EBS, Amazon S3, and
Amazon EC2
"I get it and want to learn more."
• Sessions will dive deeper into the topic. Presenters assume the
audience is familiar with the topic but may or may not have direct
experience implementing a similar solution. Code may be shared but
will not be the primary focus of the session.
18. AWS cloud
Corporate data center
AWS
CloudFormation
Amazon
Route 53
Auto Scaling group
Availability Zone #1
security group
security group
root volume
data volume
Amazon
EC2 instance
web app
server
19. What did it cost?
MQ-7 R-PI 2 Amazon Route53 Amazon S3
$10 / sensor $ 42 $ 0.53 / zone $ 0.03 / GB
Service Cost
Amazon S3 bootstrap
script repo
$.03
Hardware $52
Amazon Route53 DNS $0.53
Total $ 52.56
20. How can I do this?
Techniques for disaster recovery
21.
22.
23.
24.
25. Subordinate
database
server
Pilot light - prep
www.example.com
Data mirroring
replication
Not running
Pilot light system
Reverse
proxy/
caching
server
Data
volume
Application
server
Corporate data center
Reverse
proxy/
caching
server
Application
server
Master
Database
server
26. Database
server
Pilot light - recovery
www.example.com
Start in minutes
Add additional
capacity,
if needed
Reverse
proxy/
caching
server
Data
volume
Application
server
Corporate data center
Reverse
proxy/
caching
server
Application
server
Master
Database
server
27.
28. Warm standby - prep
Mirroring / Replication
Application
data source
cut over
Elastic
Load
BalancerActive
Not active for
production traffic
Amazon
Route 53
www.example.com
Scaled down
standbyCorporate data center
Data
volume
Application
server
Subordinate
database
server
Reverse
proxy/
caching
server
AWS region
Reverse
proxy/
caching
server
Application
server
Master
Database
server
29. Warm standby - recover
Elastic
Load
Balancer
Active
Amazon
Route 53
www.example.com
Scaled up
production
Corporate data center
Data
volume
Application
server
Database
server
Reverse
proxy/
caching
server
AWS region
Reverse
proxy/
caching
server
Application
Server
Master
Database
server
30.
31. Hot-site - prep
Mirroring / Replication
Application
data source
cut over
Elastic
Load
BalancerActive
Amazon
Route 53
www.example.com
Corporate data center
Data
volume
Application
server
Subordinate
database
server
Reverse
proxy/
caching
server
AWS region
Reverse
proxy/
caching
server
Application
server
Master
Database
server
Active
32. Hot-site - recovery
Elastic
Load
Balancer
Amazon
Route 53
www.example.com
Corporate data center
Data
volume
Application
server
Database
server
Reverse
proxy/
caching
server
AWS region
Reverse
proxy/
caching
server
Application
server
Master
Database
server
Active
Scaled up
for production
use
38. Large data set
AWS cloud
AWS Import/Export
Corporate data center
NGS
On-premises
Compute / cluster
Sequence dataPhysical media
Flowcell-ID
AWS CLI
Amazon Glacier
1 3
AWS
Import/Export
Snowball
or
2
39. Large data set
AWS cloud
Corporate data center
NGS
On-premises
Compute / cluster
AWS
Storage Gateway
Virtual server
Amazon S3
ISCI
Cached
volume
1
2
40. Large data set - Recovery
AWS cloud
AWS Import/Export
Corporate data center
NGS
On-premises
Compute / cluster
Sequence data
Flowcell-ID
Amazon Glacier
1
Physical media
AWS
Import/Export
Snowball
or
41. Large data set - Recovery
AWS cloud
Corporate data center
NGS
On-premises
Compute / cluster
AWS
Storage Gateway
Virtual server
Amazon S3
ISCI
Cached
volume
2
1
42. What did it cost?
Amazon S3 AWS Import/Export Amazon Glacier
$ 0.03 /GB $2.49 per data-loading-hour +
$80 per storage device
$ 0.007 / GB
Service Cost
Amazon S3 10TB $ 300
AWS Import/Export 1PB** - Variable
Amazon Glacier Archive 1PB $ 7,000
Total $ 7,300/ Mo
**Factors include drive type, amount of drive.
44. Corporate data center AWS cloud
AWS Storage
Gateway
Amazon
S3
iSCSI from
AWS Storage
Gateway to
ESX Hosts
AWS Storage
Gateway
cached volume
to Amazon S3
VMFS
VMware ESX VMware ESXi
Replication
Appliance
Onsite VM replication / convert
45. Corporate data center AWS cloud
AWS Storage
Gateway
Amazon
S3
iSCSI from
AWS Storage
Gateway to
ESX Hosts
AWS Storage
Gateway
cached volume
to Amazon S3
VMFS
VMware ESX VMware ESXi
Replication
Appliance
AMI
Amazon
EBS
VM
Import
Onsite VM replication / convert
46. What did it cost?
Amazon S3 AWS Storage Gateway
$ 0.03 / GB $ 125.00
Service Cost
AWS Storage Gateway archive (32TB) $960
AWS Storage Gateway VM cost $125
Total $ 1,085 / Mo
48. Corporate data center
AWS
Direct Connect
VPN
US-East-1
US-West-2
Server
Server
Availability Zone Availability Zone
Fail back
Server
Multi-site failover
49. Corporate data center
AWS
Direct Connect
VPN
US-East-1
US-West-2
Server
Failback
AWS
CloudFormation
Server
Availability Zone Availability Zone
Server
Multi-site failover
50. AWS cloud
Corporate data center
Amazon
Route 53
Docker servers
www.example.com
Database
Amazon RDS
Data
Mirroring
Replication
AWS
Storage
Gateway
Container failover
Snapshot
Amazon S3
51. Amazon ECS
AWS cloud
Corporate data center
Amazon
Route 53
www.example.com
Amazon RDS
Amazon
ECS
cluster
Container failover
Amazon
EBS
Data /
code
repo
Amazon S3
52. What did it cost? (30 days) – Remote site
VPC VPN Amazon EC2 *
(m4.xlarge)
1Gb AWS
Direct Connect
Amazon EBS Region data
transfer fee
$ 0.05
/Hour
$ 0.252 $ 0.30 / Hour $ 0.10 / GB $ 0.02 / GB
Service Cost
1Gb AWS Direct Connect $216
VPN Fallback Connection $36
(2) Amazon EC2 instances $362.88
(2) Amazon EBS 60GB volumes $12
(1) AMI copy to US-West-2 $1.20
Total $ 628.08*us-west-2, Amazon Linux AMI
53. What did it cost? (30 days) - Docker
AWS Storage
Gateway
Amazon
EC2
Amazon
Route53
Amazon
RDS
Amazon
EBS
Elastic Load
Balancing
$ 125.00 $ 0.252 /
Hour
$ 0.53 /
Zone
$ 0.185 /
Hour
$ 0.10 / GB $0.025 / Hour
Service Cost
AWS Storage Gateway $125
Amazon Route53 DNS $ 0.53
Elastic Load Balancing $18
Amazon RDS (MySQL) db.m3.large $133.20
(3) Amazon ECS cluster nodes m4.xlarge + (3) 30GB EBS $553.32
Total $ 821.05 / Mo