Amazon Relational Database Service (RDS) makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient, resizable capacity while automating time-consuming tasks such as hardware provisioning, database setup, patching, and backups. There are multiple database engines to choose from, including Amazon Aurora, PostgreSQL, MySQL, MariaDB, Oracle, and Microsoft SQL Server. Amazon Aurora is a relational database engine that combines the speed and reliability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. It is designed to be compatible with MySQL and PostgreSQL so that existing applications and tools can run without modification.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shafreen Sayyed
Solutions Architect, Amazon Web Services
Managed Relational Databases
Follow me @ShafreenSayyed

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Amazon RDS Overview
• Security and Compliance
• Metrics and Monitoring
• Scaling on RDS
• Backups and Snapshots
• High availability
• Amazon Aurora
• Customer story
• AWS Database Migration Service (DMS)
Agenda

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Relational Databases are Complex
Our experience running
Amazon.com taught us that
relational databases can be a
pain to manage and operate
with high availability

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS
Managed relational database service with a choice of popular database engines

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We Made Things Cheaper, Easier, and Better

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lets dive deep!

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone A
Availability Zone B
High Availability Multi-AZ Deployments
Enterprise-grade fault
tolerance solution for
production databases
Standby

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Flexible Scaling

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Read Replicas
Asynchronous
replication
Primary
Read replica

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automated Backups
Amazon RDS for MySQL, PostgreSQL,
MariaDB,
Oracle, and SQL Server
Amazon Aurora

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security and Compliance

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security Groups
Specify network access rules for your database
Protocol
Port
range
Source
TCP 3306 172.31.0.0/16
TCP 3306
“Application
security group”
Corporate address admins
Application tier

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Identity and Access Management (IAM)
Governed access:
use IAM to control who
can perform actions with
Aurora MySQL
and Amazon RDS for
MySQL

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
At Rest Encryption for All Amazon RDS Engines
Two-tiered key hierarchy using envelope encryption
Benefits

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Compliance
Aurora MySQL Oracle MariaDBPostgreSQL SQL Server

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Simplify Monitoring with Performance Insights

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Monitoring Your RDS DB Instance
Amazon CloudWatch metrics
Integration with third-party
monitoring tools
Amazon CloudWatch Alarms
Upload DB logs directly to
CloudWatch Logs
Enhanced Monitoring for
Amazon RDS

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora
MySQL and PostgreSQL-compatible relational database built for the cloud
Performance and availability of commercial-grade databases at 1/10th the cost

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Scale-out, distributed, multi-tenant architecture
Master Replica Replica Replica
Availability
Zone 1
Shared storage volume
Availability
Zone 2
Availability
Zone 3
Storage nodes with SSDs
§ Purpose-built log-structured
distributed storage system designed
for databases
§ Storage volume is striped across
hundreds of storage nodes distributed
over 3 different Availability Zones
§ Six copies of data, two copies in each
Availability Zone to protect against
AZ+1 failures
§ Plan to apply same principles to other
layers of the stack
SQL
Transactions
Caching
SQL
Transactions
Caching
SQL
Transactions
Caching

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Leveraging cloud ecosystem
Lambda
S3
IAM
CloudWatch
Invoke Lambda events from stored procedures/triggers.
Load data from S3, store snapshots and backups in S3.
Use IAM roles to manage database access control.
Upload systems metrics and audit logs to CloudWatch.

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automate administrative tasks
Schema design
Query construction
Query optimization
Automatic failover
Backup & recovery
Isolation & security
Industry compliance
Push-button scaling
Automated patching
Advanced monitoring
Routine maintenance
Takes care of your time-consuming database management tasks,
freeing you to focus on your applications and business
You
AWS

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Databases reimagined for the cloud
R Speed and availability of high-end commercial databases
R Simplicity and cost-effectiveness of open source databases
R Drop-in compatibility with MySQL
R Simple pay-as-you-go pricing
Delivered as a managed service

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora is used by:
2/3 of top 100 AWS customers
8 of top 10 gaming customers
Aurora customer adoption
Fastest growing service in AWS history

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customers using Commercial
engines
Who are moving to Aurora and why?
Customers using
MySQL engines
§ Higher performance – up to 5x
§ Better availability and durability
§ Reduces cost – up to 60%
§ Easy migration; no application change
§ One tenth of the cost; no licenses
§ Integration with cloud eco-system
§ Comparable performance and availability
§ Migration tooling and services

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora is fast …
5x faster than MySQL

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
WRITE PERFORMANCE READ PERFORMANCE
MySQL SysBench results
R3.8XL: 32 cores / 244 GB RAM
5X faster than RDS MySQL 5.6 & 5.7
Five times higher throughput than stock MySQL
based on industry standard benchmarks.
0
25,000
50,000
75,000
100,000
125,000
150,000
0
100,000
200,000
300,000
400,000
500,000
600,000
700,000
Aurora MySQL 5.6 MySQL 5.7

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora scaling
With user connection With number of tables
With database size - SYSBENCH With database size - TPCC
Connections
Amazon
Aurora
RDS MySQL
w/ 30K IOPS
50 40,000 10,000
500 71,000 21,000
5,000 110,000 13,000
Tables
Amazon
Aurora
MySQL
I2.8XL
local SSD
RDS MySQL
w/ 30K IOPS
(single AZ)
10 60,000 18,000 25,000
100 66,000 19,000 23,000
1,000 64,000 7,000 8,000
10,000 54,000 4,000 5,000
8x
U P T O
F A S T E R
11x
U P T O
F A S T E R
DB Size
Amazon
Aurora
RDS MySQL
w/ 30K IOPS
1GB 107,000 8,400
10GB 107,000 2,400
100GB 101,000 1,500
1TB 26,000 1,200
DB Size Amazon Aurora
RDS MySQL
w/ 30K IOPS
80GB 12,582 585
800GB 9,406 69
21
U P T O
F A S T E R
136x
U P T O
F A S T E R

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Six copies across three Availability Zones
4 out 6 write quorum; 3 out of 6 read quorum
Peer-to-peer replication for repairs
Volume striped across hundreds of storage nodes
SQL
Transaction
AZ 1 AZ 2 AZ 3
Caching
SQL
Transaction
AZ 1 AZ 2 AZ 3
Caching
Read and write availabilityRead availability
6-way replicated storage
Survives catastrophic failures

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Up to 15 promotable read replicas
Master
Read
Replica
Read
Replica
Read
Replica
Shared distributed storage volume
Reader end-point
► Up to 15 promotable read replicas across multiple availability zones
► Re-do log based replication leads to low replica lag – typically < 10ms
► Reader end-point with load balancing; customer specifiable failover order

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automated failover in 15 secs
App
RunningFailure Detection DNS Propagation
Recovery Recovery
DB
Failure
MYSQL
App
Running
Failure Detection DNS Propagation
Recovery
DB
Failure
AURORA WITH MARIADB DRIVER
5 - 6 s e c
5 - 1 0 s e c

33. Cross-region read replicas
Faster disaster recovery and enhanced data locality
Promote read replica to a
master for faster recovery in the
event of disaster
Bring data close to your
customer’s applications in
different regions
Promote to a master for easy
migration

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous backup
Segment snapshot Log records
Recovery point
Segment 1
Segment 2
Segment 3
Time
• Take periodic snapshot of each segment in parallel; stream the redo logs to Amazon S3
• Backup happens continuously without performance or availability impact
• At restore, retrieve the appropriate segment snapshots and log streams to storage nodes
• Apply log streams to segment snapshots in parallel and asynchronously

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Traditional databases
Have to replay logs since the last
checkpoint
Typically 5 minutes between checkpoints
Single-threaded in MySQL; requires a
large number of disk accesses
Amazon Aurora
Underlying storage replays redo records
on demand as part of a disk read
Parallel, distributed, asynchronous
No replay for startup
Checkpointed Data Redo Log
Crash at T0 requires
a re-application of the
SQL in the redo log since
last checkpoint
T0 T0
Crash at T0 will result in redo logs being
applied to each segment on demand, in
parallel, asynchronously
Instant crash recovery

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security and compliance
R Encryption to secure data at rest using
customer managed keys
• AES-256; hardware accelerated
• All blocks on disk and in Amazon S3 are encrypted
• Key management via AWS KMS
R Encrypted cross-region replication,
snapshot copy - SSL to secure data in
transit
R Advanced auditing and logging without
any performance impact *NEW*
R Industry standard security and data
protection certifications – SOC, ISO,
PCI/DSS, HIPPA/BAA *NEW*
Data Key 1 Data Key 2 Data Key 3 Data Key 4
Customer Master
Key(s)
Storage
Node
Storage
Node
Storage
Node
Storage
Node
Database
Engine

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Higher performance, lower cost
§ Fewer instances needed
§ Smaller instances can be used
Safe.com lowered their bill by 40% by switching from sharded
MySQL to a single Aurora instance.
Double Down Interactive (gaming) lowered their bill by 67%
while also achieving better latencies (most queries ran faster)
and lower CPU utilization.
§ No need to pre-provision storage
§ No additional storage for read replicas

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Advanced monitoring
50+ system/OS metrics | sorted process list view | 1-60 sec granularity
alarms on specific metrics | egress to CloudWatch Logs | integration with third-party tools
ALARM

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customers

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
MySQL to Aurora migration
MySQL
shards
AuroraDMSMySQL
shards
MySQL
shards
EC2
MySQL
Take snapshot;
Load to S3
Ingest snapshot
into Aurora
RDS
MySQL Aurora
Ingest snapshot
Catchup using
binlog replication
Aurora
RDS MYSQL to Aurora EC2/on-premises
MYSQL to Aurora
Many-to-one migration
Console based automated
snapshot ingestion and catch
up via binlog replication.
Binary snapshot ingestion
through S3 and catch up via
binlog replication.
Consolidate multiple MySQL
shards into a single Aurora
instance using Database
Migration Service.
Amazon S3

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data copy: Existing data is copied from source tables to tables on the target.
Chance data capture and apply: Changes to data on source are captured
while the tables are loaded. Once load is complete, buffered changes are
applied to the target.
§ Additional changes captured on the source are applied to the target until the task
stopped or terminatedAWS Database
Migration Service
AWS Schema
Conversion Tool
Oracle, SQL Server to Aurora migration
Assessment report: SCT analyses the source database and provides a
report with a recommended target engine and information on automatic
and manual conversions
Code Browser and recommendation engine: Highlights places that require
manual edits and provides architectural and design guidelines.

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Resources
• https://aws.amazon.com/rds/aurora/
• https://aws.amazon.com/rds/aurora/details/
• https://aws.amazon.com/rds/aurora/faqs/
• https://d0.awsstatic.com/product-
marketing/Aurora/RDS_Aurora_Performance_Assessment_Benchmarking_v1-2.pdf
• https://aws.amazon.com/vpc/
• https://aws.amazon.com/kms/
• https://aws.amazon.com/rds/aurora/pricing/
• https://aws.amazon.com/cloudwatch/
• https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Aurora.Monitoring.html#A
urora.Monitoring.Metrics
• https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Aurora.Replication.html#A
urora.Overview.Replication.MySQLReplication
• https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Aurora.Migrate.html
• https://aws.amazon.com/dms/

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you