SlideShare a Scribd company logo
1 of 197
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deep dive into Amazon Aurora
and its innovations
D A T 3 2 6
Grant McAlister
Senior Principal Engineer
AWS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora
Designed for unparalleled high performance and availability at global scale with full MySQL and
PostgreSQL compatibility at 1/10th the cost of commercial databases
 5x throughput of standard
MySQL and 3x of standard
PostgreSQL
 Scale out up to 15 read replicas
 Decoupled storage and compute
enabling cost optimization
 Fast database cloning
 Distributed, dynamically scaling
storage subsystem
Performance &
scalability
 6 copies of data across 3 AZs
(customers pays for 1)
 Automatic, continuous,
incremental backups with point-
in-time recovery (PITR)
 Fault-tolerant, self-healing, auto-
scaling storage
 Global Database for disaster
recovery
Availability &
durability
 Network isolation
 Encryption at rest/in transit
 Supports multiple secure
authentication mechanisms and
audit controls
Highly secure
 Automates time-consuming
management of administration
tasks like hardware provisioning,
database setup, patching, and
backups
 Serverless configuration options
Fully managed
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Architecture
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora storage and replicas
RW
Application Application
Write log
records
Aurora
storage
Availability Zone 3
Availability Zone 2
Availability Zone 1
6
5
4
3
2
1
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora storage and replicas
RW
Application Application
Write log
records
Read
blocks
Aurora
storage
Availability Zone 3
Availability Zone 2
Availability Zone 1
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora storage and replicas
RW
Application Application
Write log
records
Read
blocks
Aurora
storage
Availability Zone 3
Availability Zone 2
Availability Zone 1
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora storage and replicas
RW
Application Application
Write log
records
Read
blocks
Aurora
storage
Availability Zone 3
Availability Zone 2
Availability Zone 1
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora storage and replicas
RW
Application Application
Write log
records
Read
blocks
Aurora
storage
Availability Zone 3
Availability Zone 2
Availability Zone 1
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora storage and replicas
RW
Application Application
Write log
records
Read
blocks
Aurora
storage
Availability Zone 3
Availability Zone 2
Availability Zone 1
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
RO
Application
Aurora storage and replicas
RW
Application
RO
Application
Async
Invalidation
& Update
Async
invalidation
& update
Write log
records
Read
blocks
Aurora
storage
RO
RO
RO
RO
Availability Zone 3
Availability Zone 2
Availability Zone 1
db.r6i.4xlarge db.serverless
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
RO
Application
Aurora storage and replicas
RW
Application
RO
Application
Async
Invalidation
& Update
Async
invalidation
& update
Write log
records
Read
blocks
Aurora
storage
RO
RO
RO
RO
Availability Zone 3
Availability Zone 2
Availability Zone 1
db.r6i.4xlarge db.serverless
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
RO
Application
Aurora storage and replicas
RW
Application
RO
Application
Async
Invalidation
& Update
Async
invalidation
& update
Write log
records
Read
blocks
Aurora
storage
RO
RO
RO
RO
Availability Zone 3
Availability Zone 2
Availability Zone 1
db.r6i.4xlarge db.serverless
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
RO
Application
Aurora storage and replicas
RW
Application
RO
Application
Async
Invalidation
& Update Write log
records
Read
blocks
RW
Aurora
storage
RO
RO
RO
RO
Availability Zone 3
Availability Zone 2
Availability Zone 1
db.r6i.4xlarge db.serverless
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
RO
Application
Aurora storage and replicas
RW
Application
RO
Application
Async
Invalidation
& Update Write log
records
Read
blocks
RW
Aurora
storage
RO
RO
RO
RO
Availability Zone 3
Availability Zone 2
Availability Zone 1
db.r6i.4xlarge db.serverless
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
RO
Application
Aurora storage and replicas
RW
Application
RO
Application
Async
Invalidation
& Update Write log
records
Read
blocks
RW
Aurora
storage
RO
RO
RO
RO
Availability Zone 3
Availability Zone 2
Availability Zone 1
db.r6i.4xlarge db.serverless
db.r6g.4xlarge
AWS JDBC
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
DR
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Aurora storage
RO
Application
RW
Application
RO
Application
Aurora storage
RO
Application Application
RO
Application
RO
RW
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Managed planned failover
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Managed planned failover
Aurora storage
RO
Application Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
RO
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Managed planned failover
Aurora storage
RO
Application Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
primary DB cluster secondary DB cluster
RO
verify
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Managed planned failover
Aurora storage
RO
Application Application
RO
Application
Aurora storage
RO
Application Application
RO
Application
RO
RW
RO
primary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Managed planned failover
Aurora storage
RO
Application Application
RO
Application
Aurora storage
RO
Application Application
RO
Application
RO
RW
RO
Replication
servers
Replication
agents
primary DB cluster
secondary DB cluster
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Global Database
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers
Region B
Availability Zone 3
Availability Zone 1 Availability Zone 2
Replication
agents Aurora storage
R
O
Applicatio
n
Applicatio
n
R
O
Applicatio
n
R
O
Region C
Availability Zone 3
Availability Zone 1 Availability Zone 2
Replication
agents Aurora storage
R
O
Applicatio
n
Applicatio
n
R
O
Region D
Availability Zone 3
Availability Zone 1 Availability Zone 2
Replication
agents Aurora storage
db.serverless
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
TUNNEL
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
--enable-global-write-forwarding
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
--enable-global-write-forwarding
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
--enable-global-write-forwarding
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Replication
agents
Region B
Region A
Availability Zone 3
Availability Zone 1 Availability Zone 2
Availability Zone 3
Availability Zone 1 Availability Zone 2
Amazon Aurora Global Database
Write Forwarding
Aurora storage
RO
Application
RW
Application
RO
Application
Replication
servers Aurora storage
RO
Application Application
RO
Application
RO
Application
--enable-global-write-forwarding
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Storage Internals
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v2
Full
block
WAL
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
t-v2
Full
block
WAL
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
t-v2
Full
block
t-v3
WAL
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
update t set y = 6
Block in
memory
t-v1
Aurora
storage
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
update t set y = 6
Block in
memory
t-v1
t-v2
Aurora
storage
t-v2
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
update t set y = 6
Block in
memory
t-v1
t-v2
t-v3
Aurora
storage
t-v2
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
update t set y = 6
Block in
memory
t-v1
t-v2
t-v3
Aurora
storage
t-v2
t-v3
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL: Writing less
Aurora
update t set y = 6
Block in
memory
t-v1
t-v2
t-v3
Aurora
storage
t-v2
t-v3
No engine
checkpoint
=
no FPW
Block in
memory
PostgreSQL
t-v1
t-v2
t-v3
Checkpoint
Datafile
t-v2
Full
block
t-v3
WAL
Archive
4K
4K
8K
update t set y = 6
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes continuous
& parallel
coalesce
recovery in
seconds
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
row2
log
insert
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
Checkpoint
row2
log
insert
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
Checkpoint
row2
Full
block
log
insert
Amazon Simple Storage
Service (Amazon S3)
doublewrite
buffer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
Checkpoint
Datafile
row2
Full
block
log
Archive
insert
Amazon Simple Storage
Service (Amazon S3)
doublewrite
buffer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
Checkpoint
Datafile
row2
Full
block
log
Archive
4K
4K
16K
insert
Amazon Simple Storage
Service (Amazon S3)
4K
4K
doublewrite
buffer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
Checkpoint
Datafile
row2
Full
block
log
Archive
4K
4K
16K
insert
Amazon Simple Storage
Service (Amazon S3)
4K
4K
doublewrite
buffer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
Checkpoint
Datafile
row2
Full
block
log
Archive
4K
4K
16K
insert
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes
4K
4K
doublewrite
buffer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
insert
Block in
memory
row1
Aurora
storage
Block in
memory
MySQL
row1
row2
Checkpoint
Datafile
row2
Full
block
log
Archive
4K
4K
16K
insert
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes
4K
4K
doublewrite
buffer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL: Writing less
Aurora
insert
Block in
memory
row1
row2
Aurora
storage
row2
No engine
checkpoint
=
no
doublewrite
buffer
Block in
memory
MySQL
row1
row2
Checkpoint
Datafile
row2
Full
block
log
Archive
4K
4K
16K
insert
Amazon Simple Storage
Service (Amazon S3)
recovery
in minutes continuous
& parallel
coalesce
recovery in
seconds
4K
4K
doublewrite
buffer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
A
C
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
A
C
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Amazon S3
A C
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Peer storage
nodes
Amazon S3
A C
B
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Peer storage
nodes
Amazon S3
A C
B
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Peer storage
nodes
Amazon S3
A C
B
B C
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Peer storage
nodes
Coalesce
Amazon S3
A C
B
A B C
B C
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Peer storage
nodes
Coalesce
Amazon S3
A C
B
A B C
B C
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora
RW
Storage Node
Incoming queue Data
blocks
Update
queue
Hot log
Peer storage
nodes
Coalesce
Amazon S3
A C
B
A B C
B C
A
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Management – Dynamic resizing
new partitions
every hour
drop
existing
create
new
2 hour
spike
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Management – Dynamic resizing
new partitions
every hour
drop
existing
create
new
2 hour
spike drop
existing
create
new
drop
the
spike
used space
inside the db
used storage
space
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Management – Dynamic resizing
new partitions
every hour
drop
existing
create
new
2 hour
spike drop
existing
create
new
drop
the
spike
used space
inside the db
used storage
space
2X extra
storage
costs
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Management – Dynamic resizing
new partitions
every hour
drop
existing
create
new
2 hour
spike drop
existing
create
new
drop
the
spike
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Storage Management – Dynamic resizing
new partitions
every hour
drop
existing
create
new
2 hour
spike drop
existing
create
new
drop
the
spike
used space
inside the db
used storage
space
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
Reporting
application
Read
blocks
Aurora
storage
Primary storage
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Write log
records
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Write log
records
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Write log
records
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability Zone 2
Availability Zone 1 Availability Zone 3
RO
Application
Fast clones
RW
Application
RW
Reporting
application
Write log
records
Read
blocks
Aurora
storage
Primary storage
Clone storage
Clone
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fast clone example
0
5000
10000
15000
20000
25000
0 3 6 9 12 15 18 21 24 27 30 33 36 39 42 45 48 51 54 57 60 63 66 69 72 75 78
Transactions
per
second
(TPS)
Minutes
PGBench RW Scale 10K - Target Rate 20K TPS
Main Database Clone Database
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Aurora storage
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Snapshot
Aurora storage
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Snapshot
Aurora storage Aurora storage
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Snapshot
Aurora storage Aurora storage
Amazon Aurora
Primary Snapshot
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Snapshot
Aurora storage
Amazon Simple Storage
Service (Amazon S3)
Aurora storage
Amazon Aurora
Primary Snapshot
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Aurora storage
Amazon Simple Storage
Service (Amazon S3)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Aurora storage
Amazon Simple Storage
Service (Amazon S3)
Amazon Aurora
CLONE
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Aurora storage
Amazon Simple Storage
Service (Amazon S3)
Amazon Aurora
CLONE
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Export to S3 via clone
Amazon Aurora
Primary(R/W)
Aurora storage
Amazon Simple Storage
Service (Amazon S3)
Amazon Aurora
CLONE
parallel export – Aurora MySQL
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
MySQL Updates
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora MySQL Updates
• Support for major version upgrade to MySQL 3 with MySQL 8.0 Compatibility
• IPv6 support
• Active Directory support
• Parallel Export to S3
• Enhanced binlog
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
enhanced binlog
Binlog
Enhanced
Binlog
• greatly reduced
overhead for enabling
binlog
• reduced cost to read
binlogs for cdc
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PostgreSQL Updates
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL Updates
• Support for PostgreSQL14 – new extensions tds_fdw & lo
• Multi Major Version Upgrade
• SCRAM auth enforcement
• IPv6 support
• Improved consistency of minor version & patch upgrade times
• Improved availability of read replicas
• Logical Replication cache
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT
AWS Database Migration
Service (AWS DMS)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
write wal log
(needed for logical decoding)
write transaction
log
Users /
Applications
INSERT
AWS Database Migration
Service (AWS DMS)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT
AWS Database Migration
Service (AWS DMS)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT logical
decoding
AWS Database Migration
Service (AWS DMS)
read wal log
(needed for logical decoding)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT logical
decoding
AWS Database Migration
Service (AWS DMS)
INSERT
read wal log
(needed for logical decoding)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT logical
decoding
AWS Database Migration
Service (AWS DMS)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT logical
decoding
AWS Database Migration
Service (AWS DMS)
wal log
cache
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT logical
decoding
AWS Database Migration
Service (AWS DMS)
wal log
cache
cache read
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora PostgreSQL – Logical replication cache
Aurora storage
Amazon
Aurora
Users /
Applications
INSERT logical
decoding
AWS Database Migration
Service (AWS DMS)
INSERT
wal log
cache
cache read
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PostgreSQL
Trusted Language Extensions
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Trusted Language Extensions (TLE)
Builders create new libraries
using TLE framework
Customers choose TLE
extensions for their apps
DBAs control who can install and
manage TLE extensions
Available on Aurora and RDS
PostgreSQL 14.5 and higher
Application
Extension code is installed by TLE
A M A Z O N A U R O R A W I T H P O S T G R E S Q L C O M P A T I B I L I T Y , A M A Z O N R D S F O R P O S T G R E S Q L
DBA
C U S T O M E R
B U I L D E R
TLE
Code
PostgreSQL
Open Source Project - Source code: https://github.com/aws/pg_tle - Apache 2.0 licensed
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Safely extend PostgreSQL capabilities
T L E P R O V I D E S S A F E O P E R A T I O N O F P O S T G R E S Q L E X T E N S I O N S I N P R O D U C T I O N
Enforces use of PostgreSQL
trusted languages
TLE API provides safe access
to PostgreSQL internals
Supports languages that have
C-like performance
Removes need for C expertise
to create a safe extension
Build and use extensions on
your timeline
Reduces DBA
certification burden
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How it works
Build functions
using a trusted
PostgreSQL
language
Install
functions
using TLE
PostgreSQL
users can start
using the
extension
using "CREATE
EXTENSION"
Collect
feedback for
making new
versions of
software
Any "trusted” PostgreSQL procedural
language can be used in a TLE
JavaScript
Perl
Tcl
PL/pgSQL
Coming soon: Rust
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Manageability – Aurora Serverless
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Serverless
On-demand and automatically scaling configuration
Automatically scales capacity based on application needs
Simple pay-per-use pricing per second
Scales instantly to support demanding applications
Worry-free database capacity management
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instant, in-place scaling
• Scales in place in under a second by adding
more CPU and memory resources and billed
by the second
• No impact due to scaling even when running
hundreds of thousands of transactions
AWS Lambda
Amazon Aurora
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instant, in-place scaling
• Scales in place in under a second by adding
more CPU and memory resources and billed
by the second
• No impact due to scaling even when running
hundreds of thousands of transactions
AWS Lambda
Amazon Aurora
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instant, in-place scaling
• Scales in place in under a second by adding
more CPU and memory resources and billed
by the second
• No impact due to scaling even when running
hundreds of thousands of transactions
AWS Lambda
Amazon Aurora
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instant, in-place scaling
• Scales in place in under a second by adding
more CPU and memory resources and billed
by the second
• No impact due to scaling even when running
hundreds of thousands of transactions
AWS Lambda
Amazon Aurora
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instant, in-place scaling
• Scales in place in under a second by adding
more CPU and memory resources and billed
by the second
• No impact due to scaling even when running
hundreds of thousands of transactions
AWS Lambda
Amazon Aurora
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora – challenging workload example
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora - challenging workload example
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless – CPU scaling
db.serverless
per second scale
up by 8% of max
ACU configured
(128)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora - challenging workload example
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora - challenging workload example
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora - challenging workload example
db.r6g.4xlarge
point select canary query
10X increase in average latency
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora - challenging workload example
db.r6g.4xlarge
point select canary query
10X increase in average latency
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora - challenging workload example
db.r6g.4xlarge
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless – memory and CPU scaling
serverless scales up
providing additional
memory and CPU
db.serverless
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless – memory scaling
8X reduction in latency
point select canary query
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Reads
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Page
read
Page
read
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Page
read
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Evict cold pages
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Shrink memory
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Buffer pool resizing
Buffer pool
Access frequency
Storage volume
Shrink memory
Default memory allocation: 75% for buffer
pool and 25% for heap
Buffer pool size scaled along with capacity
Parameters automatically adjusted:
MySQL: innodb_buffer_pool_size
PostgreSQL: shared_buffers
Buffer pool scaled down through a
combination of least frequently used (LFU) and
least recently used (LRU) algorithms
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Manageability – Amazon DevOps
Guru for RDS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DevOps Guru for RDS
A new Machine Learning (ML)-powered capability for Amazon RDS that
automatically detects and diagnoses database performance and operational
issues, enabling you to resolve bottlenecks in minutes
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DevOps Guru for RDS
• Finds DB performance anomalies
• Analyzes the anomaly
• Highlights:
• Prevalent wait events
• Prevalent SQL statements
• Other anomalous metrics
• Recommends next steps
LOCKS
78%
SELECT NAME FROM CUSTOMERS;
SELECT ITEM FROM F;
MEMORY
What to do
about locking
issues…
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DevOps Guru for RDS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Introducing Amazon GuardDuty RDS Protection
Protect your data stored in Amazon RDS databases (starting
with Amazon Aurora) by identifying suspicious login
attempts to mitigate threats before they escalate
Continuously monitor all Aurora databases across your
organization with a single click
Use machine learning to reduce noise and avoid alert fatigue
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon GuardDuty RDS Protection:
How does it work?
Aurora
Metrics
ingestion
Detect
suspicious
activity
GuardDuty Amazon
GuardDuty
RDS Protection
Explain
+
understand
Remediate
+
GuardDuty
RDS Protection
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon GuardDuty RDS Protection:
Anomaly detection deep dive
Detects
suspicious
activity
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon GuardDuty RDS Protection:
Anomaly detection deep dive
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What GuardDuty RDS Protection can detect
Amazon Aurora
Brute Force
Password Spraying/Guessing
pgAdmin
Stolen
Credentials
Virtual Private Cloud (VPC)
?
Scanning
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When GuardDuty RDS Protection detects a threat
you can quickly take action
Amazon Aurora
Virtual Private Cloud (VPC)
Security group
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When GuardDuty RDS Protection detects a threat
you can quickly take action
Amazon Aurora
Virtual Private Cloud (VPC)
Security group
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When GuardDuty RDS Protection detects a threat
you can quickly take action
Amazon Aurora
Virtual Private Cloud (VPC)
Security group
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When GuardDuty RDS Protection detects a threat
you can quickly take action
Amazon Aurora
Virtual Private Cloud (VPC)
Security group
X
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When GuardDuty RDS Protection detects a threat
you can quickly take action
Amazon Aurora
Virtual Private Cloud (VPC)
Security group
X
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When GuardDuty RDS Protection detects a threat
you can quickly take action
Amazon Aurora
Virtual Private Cloud (VPC)
Security group
X
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When GuardDuty RDS Protection detects a threat
you can quickly take action
Amazon Aurora
Virtual Private Cloud (VPC)
Security group
X
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Manageability – Blue/Green
Deployments
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
create-blue-green-deployment
RO RO
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
Target
mycluster-green-x1234
Aurora MySQL 2.10.2 (5.7)
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
AVAILABLE
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
AVAILABLE
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
SWITCHOVER_IN_PROGRESS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
SWITCHOVER_IN_PROGRESS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
SWITCHOVER_IN_PROGRESS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
SWITCHOVER_IN_PROGRESS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster-green-x1234
Aurora MySQL 3.02.2 (8.0)
SWITCHOVER_IN_PROGRESS
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
SWITCHOVER_COMPLETED
Target
mycluster
Aurora MySQL 3.02.2 (8.0)
Source
mycluster-old1
Aurora MySQL 2.10.2 (5.7)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster
Aurora MySQL 3.02.2 (8.0)
Source
mycluster-old1
Aurora MySQL 2.10.2 (5.7)
delete-blue-green-deployment
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Aurora storage
RW
Users /
Applications
db cluster
endpoint
RO
Source
mycluster
Aurora MySQL 2.10.2 (5.7)
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO RO
RO
RO
switchover-blue-green-deployment
Target
mycluster
Aurora MySQL 3.02.2 (8.0)
Source
mycluster-old1
Aurora MySQL 2.10.2 (5.7)
delete-blue-green-deployment
customer verification
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora Blue/Green Deployments
Region
Availability Zone
3
Availability Zone
1
Availability Zone
2
Users /
Applications
db cluster
endpoint
Aurora storage
RO
RW RO
• Major/Minor Upgrades
• Schema Changes
• Static Parameter Changes
• Maintenance Updates
create-blue-green-deployment
RO
RO
switchover-blue-green-deployment
delete-blue-green-deployment
Target
mycluster
Aurora MySQL 3.02.2 (8.0)
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Manageability – Redshift Integration
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transaction analytics at scale
Requires building and managing complex data pipelines
Amazon Aurora Amazon Redshift
Transactional
Applications
Analytics
Applications
DMS AWS Glue
Amazon S3 Analytics
Analyst
Amazon EMR
Amazon S3 Analyst
Data Engineer
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Introducing: Amazon Aurora zero-ETL
integration with Amazon Redshift
An easy and secure way to enable near real-time analytics
on petabytes of transactional data
Amazon Aurora Amazon Redshift
Transactional
Applications
Analytics
Applications
Analytics
Analyst
Analyst
Data Engineer
Zero-ETL
integration
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Designed for simplicity and performance
Aurora storage
Amazon Redshift
Amazon Aurora
Redshift storage
• Easy creation of Redshift
integration target
• Automated data seeding and
continuous replication at
storage layer
• Run analytics along
side ingestion
• Monitor progress, lag,
and performance from
Redshift system tables
and CloudWatch
Client Application
Zero-ETL
Integration
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Operational analytics across many databases
Amazon Aurora
Amazon Aurora
Amazon Aurora
Amazon Redshift
Zero-ETL
Recommendation
Engine
74 Amazon Aurora databases
200K-300K daily transaction
<10 seconds lag
200TB
30B rows on largest table
70+ columns
ML and analytics
services
Amazon
Redshift ML
BI and analytics apps
Connect apps to analyze and visualize your data
SQL
Amazon
Redshift ML
ML and
analytics services
Analyze open standards-
based data formats
Amazon Redshift
integration for
Apache Spark
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Integration at the storage layer
Aurora storage
Amazon Redshift
Amazon Aurora MySQL
Redshift storage
Transaction
log
Change data
capture (CDC) log
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Integration at the storage layer
Aurora storage
Amazon Redshift
Amazon Aurora MySQL
Redshift storage
Transaction
log
Change data
capture (CDC) log
Seed data
parallel direct export
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Integration at the storage layer
Aurora storage
Amazon Redshift
Amazon Aurora MySQL
Redshift storage
CDC Streaming
Change data
capture (CDC) log
CDC from storage Replicate to Redshift
Transaction
log
enhanced binlog
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related sessions
DAT221 Breakout PostgreSQL Trusted Language Extensions
DAT222 Breakout Blue/Green Deployments
DAT328 Breakout Amazon Aurora Zero-ETL to Amazon Redshift
SEC218 Breakout Amazon GuardDuty RDS Protection
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!
Please complete the session
survey in the mobile app

More Related Content

What's hot

Oracle to Postgres Migration - part 1
Oracle to Postgres Migration - part 1Oracle to Postgres Migration - part 1
Oracle to Postgres Migration - part 1PgTraining
 
SRV308 Deep Dive on Amazon Aurora
SRV308 Deep Dive on Amazon AuroraSRV308 Deep Dive on Amazon Aurora
SRV308 Deep Dive on Amazon AuroraAmazon Web Services
 
RocksDB Performance and Reliability Practices
RocksDB Performance and Reliability PracticesRocksDB Performance and Reliability Practices
RocksDB Performance and Reliability PracticesYoshinori Matsunobu
 
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Amazon Web Services
 
New Generation Oracle RAC Performance
New Generation Oracle RAC PerformanceNew Generation Oracle RAC Performance
New Generation Oracle RAC PerformanceAnil Nair
 
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...Severalnines
 
Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인
Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인
Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인Amazon Web Services Korea
 
Oracle RAC features on Exadata
Oracle RAC features on ExadataOracle RAC features on Exadata
Oracle RAC features on ExadataAnil Nair
 
Migrating Your Oracle Database to PostgreSQL - AWS Online Tech Talks
Migrating Your Oracle Database to PostgreSQL - AWS Online Tech TalksMigrating Your Oracle Database to PostgreSQL - AWS Online Tech Talks
Migrating Your Oracle Database to PostgreSQL - AWS Online Tech TalksAmazon Web Services
 
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...Amazon Web Services
 
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018Amazon Web Services
 
Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身Amazon Web Services Japan
 
Amazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS SummitAmazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS SummitAmazon Web Services
 
Distributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DB
Distributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DBDistributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DB
Distributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DBYugabyteDB
 

What's hot (20)

Oracle to Postgres Migration - part 1
Oracle to Postgres Migration - part 1Oracle to Postgres Migration - part 1
Oracle to Postgres Migration - part 1
 
Deep Dive on Amazon Aurora
Deep Dive on Amazon AuroraDeep Dive on Amazon Aurora
Deep Dive on Amazon Aurora
 
Migrating Oracle to PostgreSQL
Migrating Oracle to PostgreSQLMigrating Oracle to PostgreSQL
Migrating Oracle to PostgreSQL
 
SRV308 Deep Dive on Amazon Aurora
SRV308 Deep Dive on Amazon AuroraSRV308 Deep Dive on Amazon Aurora
SRV308 Deep Dive on Amazon Aurora
 
Amazon Aurora: Under the Hood
Amazon Aurora: Under the HoodAmazon Aurora: Under the Hood
Amazon Aurora: Under the Hood
 
Azure CosmosDb
Azure CosmosDbAzure CosmosDb
Azure CosmosDb
 
RocksDB Performance and Reliability Practices
RocksDB Performance and Reliability PracticesRocksDB Performance and Reliability Practices
RocksDB Performance and Reliability Practices
 
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
 
New Generation Oracle RAC Performance
New Generation Oracle RAC PerformanceNew Generation Oracle RAC Performance
New Generation Oracle RAC Performance
 
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
MySQL Load Balancers - Maxscale, ProxySQL, HAProxy, MySQL Router & nginx - A ...
 
Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인
Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인
Aurora MySQL Backtrack을 이용한 빠른 복구 방법 - 진교선 :: AWS Database Modernization Day 온라인
 
AWSのNoSQL入門
AWSのNoSQL入門AWSのNoSQL入門
AWSのNoSQL入門
 
Oracle RAC features on Exadata
Oracle RAC features on ExadataOracle RAC features on Exadata
Oracle RAC features on Exadata
 
Amazon Aurora
Amazon AuroraAmazon Aurora
Amazon Aurora
 
Migrating Your Oracle Database to PostgreSQL - AWS Online Tech Talks
Migrating Your Oracle Database to PostgreSQL - AWS Online Tech TalksMigrating Your Oracle Database to PostgreSQL - AWS Online Tech Talks
Migrating Your Oracle Database to PostgreSQL - AWS Online Tech Talks
 
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
Amazon RDS & Amazon Aurora: Relational Databases on AWS - SRV206 - Atlanta AW...
 
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
Deep Dive on PostgreSQL Databases on Amazon RDS (DAT324) - AWS re:Invent 2018
 
Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身Amazon Aurora - Auroraの止まらない進化とその中身
Amazon Aurora - Auroraの止まらない進化とその中身
 
Amazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS SummitAmazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
Amazon RDS: Deep Dive - SRV310 - Chicago AWS Summit
 
Distributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DB
Distributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DBDistributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DB
Distributed Databases Deconstructed: CockroachDB, TiDB and YugaByte DB
 

Similar to re:Invent 2022 DAT326 Deep dive into Amazon Aurora and its innovations

Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...Amazon Web Services Korea
 
re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...
re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...
re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...Grant McAlister
 
2021_0825-DAT_Slide-Deck.pdf
2021_0825-DAT_Slide-Deck.pdf2021_0825-DAT_Slide-Deck.pdf
2021_0825-DAT_Slide-Deck.pdfRais Charipov
 
Dat305 Deep Dive on Amazon Aurora PostgreSQL
Dat305 Deep Dive on Amazon Aurora PostgreSQLDat305 Deep Dive on Amazon Aurora PostgreSQL
Dat305 Deep Dive on Amazon Aurora PostgreSQLGrant McAlister
 
Understanding High Availability on Amazon Aurora
Understanding High Availability on Amazon Aurora Understanding High Availability on Amazon Aurora
Understanding High Availability on Amazon Aurora Amazon Web Services
 
Managed Relational Databases - Amazon RDS
Managed Relational Databases - Amazon RDSManaged Relational Databases - Amazon RDS
Managed Relational Databases - Amazon RDSAmazon Web Services
 
AWS DevDay Vienna - Resiliency and availability design patterns for the cloud
AWS DevDay Vienna - Resiliency and availability design patterns for the cloudAWS DevDay Vienna - Resiliency and availability design patterns for the cloud
AWS DevDay Vienna - Resiliency and availability design patterns for the cloudCobus Bernard
 
AWS DevDay Cologne - Resiliency and availability design patterns for the cloud
AWS DevDay Cologne - Resiliency and availability design patterns for the cloudAWS DevDay Cologne - Resiliency and availability design patterns for the cloud
AWS DevDay Cologne - Resiliency and availability design patterns for the cloudCobus Bernard
 
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ..."How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...Provectus
 
DevConf 2020: Resiliency and availability design patterns for the cloud
DevConf 2020: Resiliency and availability design patterns for the cloudDevConf 2020: Resiliency and availability design patterns for the cloud
DevConf 2020: Resiliency and availability design patterns for the cloudCobus Bernard
 
Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...
Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...
Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...Amazon Web Services
 
Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...Amazon Web Services
 
Databases in the Cloud em Amazon Web Services
Databases in the Cloud em Amazon Web Services Databases in the Cloud em Amazon Web Services
Databases in the Cloud em Amazon Web Services Amazon Web Services LATAM
 
AWS DevDay Berlin - Resiliency and availability design patterns for the cloud
AWS DevDay Berlin - Resiliency and availability design patterns for the cloudAWS DevDay Berlin - Resiliency and availability design patterns for the cloud
AWS DevDay Berlin - Resiliency and availability design patterns for the cloudCobus Bernard
 
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018Amazon Web Services
 
Migrate and Modernize Your Database
Migrate and Modernize Your DatabaseMigrate and Modernize Your Database
Migrate and Modernize Your DatabaseAmazon Web Services
 
Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Amazon Web Services
 
Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018
Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018
Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018Amazon Web Services
 

Similar to re:Invent 2022 DAT326 Deep dive into Amazon Aurora and its innovations (20)

Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
 
re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...
re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...
re:Invent 2022 DAT316 Build resilient applications using Amazon RDS and Auror...
 
2021_0825-DAT_Slide-Deck.pdf
2021_0825-DAT_Slide-Deck.pdf2021_0825-DAT_Slide-Deck.pdf
2021_0825-DAT_Slide-Deck.pdf
 
Dat305 Deep Dive on Amazon Aurora PostgreSQL
Dat305 Deep Dive on Amazon Aurora PostgreSQLDat305 Deep Dive on Amazon Aurora PostgreSQL
Dat305 Deep Dive on Amazon Aurora PostgreSQL
 
Understanding High Availability on Amazon Aurora
Understanding High Availability on Amazon Aurora Understanding High Availability on Amazon Aurora
Understanding High Availability on Amazon Aurora
 
Managed Relational Databases - Amazon RDS
Managed Relational Databases - Amazon RDSManaged Relational Databases - Amazon RDS
Managed Relational Databases - Amazon RDS
 
AWS DevDay Vienna - Resiliency and availability design patterns for the cloud
AWS DevDay Vienna - Resiliency and availability design patterns for the cloudAWS DevDay Vienna - Resiliency and availability design patterns for the cloud
AWS DevDay Vienna - Resiliency and availability design patterns for the cloud
 
AWS DevDay Cologne - Resiliency and availability design patterns for the cloud
AWS DevDay Cologne - Resiliency and availability design patterns for the cloudAWS DevDay Cologne - Resiliency and availability design patterns for the cloud
AWS DevDay Cologne - Resiliency and availability design patterns for the cloud
 
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ..."How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...
"How to build a global serverless service", Alex Casalboni, AWS Dev Day Kyiv ...
 
DevConf 2020: Resiliency and availability design patterns for the cloud
DevConf 2020: Resiliency and availability design patterns for the cloudDevConf 2020: Resiliency and availability design patterns for the cloud
DevConf 2020: Resiliency and availability design patterns for the cloud
 
Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...
Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...
Architecture Patterns for Multi-Region Active-Active Applications (ARC209-R2)...
 
Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...
 
Databases in the Cloud em Amazon Web Services
Databases in the Cloud em Amazon Web Services Databases in the Cloud em Amazon Web Services
Databases in the Cloud em Amazon Web Services
 
AWS DevDay Berlin - Resiliency and availability design patterns for the cloud
AWS DevDay Berlin - Resiliency and availability design patterns for the cloudAWS DevDay Berlin - Resiliency and availability design patterns for the cloud
AWS DevDay Berlin - Resiliency and availability design patterns for the cloud
 
Managed Relational Databases
Managed Relational DatabasesManaged Relational Databases
Managed Relational Databases
 
Amazon Aurora 深度探討
Amazon Aurora 深度探討Amazon Aurora 深度探討
Amazon Aurora 深度探討
 
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
 
Migrate and Modernize Your Database
Migrate and Modernize Your DatabaseMigrate and Modernize Your Database
Migrate and Modernize Your Database
 
Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]
 
Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018
Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018
Ask Me Anything about Amazon Aurora (DAT369-R1) - AWS re:Invent 2018
 

More from Grant McAlister

Practical Memory Tuning for PostgreSQL
Practical Memory Tuning for PostgreSQLPractical Memory Tuning for PostgreSQL
Practical Memory Tuning for PostgreSQLGrant McAlister
 
Full Page Writes in PostgreSQL PGCONFEU 2022
Full Page Writes in PostgreSQL PGCONFEU 2022Full Page Writes in PostgreSQL PGCONFEU 2022
Full Page Writes in PostgreSQL PGCONFEU 2022Grant McAlister
 
re:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL Compatibility
re:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL Compatibilityre:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL Compatibility
re:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL CompatibilityGrant McAlister
 
AWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQL
AWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQLAWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQL
AWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQLGrant McAlister
 
HOT Understanding this important update optimization
HOT Understanding this important update optimizationHOT Understanding this important update optimization
HOT Understanding this important update optimizationGrant McAlister
 
DAT402 - Deep Dive on Amazon Aurora PostgreSQL
DAT402 - Deep Dive on Amazon Aurora PostgreSQL DAT402 - Deep Dive on Amazon Aurora PostgreSQL
DAT402 - Deep Dive on Amazon Aurora PostgreSQL Grant McAlister
 
Deep dive into the Rds PostgreSQL Universe Austin 2017
Deep dive into the Rds PostgreSQL Universe Austin 2017Deep dive into the Rds PostgreSQL Universe Austin 2017
Deep dive into the Rds PostgreSQL Universe Austin 2017Grant McAlister
 
Tuning PostgreSQL for High Write Throughput
Tuning PostgreSQL for High Write Throughput Tuning PostgreSQL for High Write Throughput
Tuning PostgreSQL for High Write Throughput Grant McAlister
 
Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017
Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017
Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017Grant McAlister
 
Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...
Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...
Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...Grant McAlister
 
Amazon RDS for PostgreSQL - PGConf 2016
Amazon RDS for PostgreSQL - PGConf 2016 Amazon RDS for PostgreSQL - PGConf 2016
Amazon RDS for PostgreSQL - PGConf 2016 Grant McAlister
 

More from Grant McAlister (11)

Practical Memory Tuning for PostgreSQL
Practical Memory Tuning for PostgreSQLPractical Memory Tuning for PostgreSQL
Practical Memory Tuning for PostgreSQL
 
Full Page Writes in PostgreSQL PGCONFEU 2022
Full Page Writes in PostgreSQL PGCONFEU 2022Full Page Writes in PostgreSQL PGCONFEU 2022
Full Page Writes in PostgreSQL PGCONFEU 2022
 
re:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL Compatibility
re:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL Compatibilityre:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL Compatibility
re:Invent 2020 DAT301 Deep Dive on Amazon Aurora with PostgreSQL Compatibility
 
AWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQL
AWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQLAWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQL
AWS re:Invent 2019 - DAT328 Deep Dive on Amazon Aurora PostgreSQL
 
HOT Understanding this important update optimization
HOT Understanding this important update optimizationHOT Understanding this important update optimization
HOT Understanding this important update optimization
 
DAT402 - Deep Dive on Amazon Aurora PostgreSQL
DAT402 - Deep Dive on Amazon Aurora PostgreSQL DAT402 - Deep Dive on Amazon Aurora PostgreSQL
DAT402 - Deep Dive on Amazon Aurora PostgreSQL
 
Deep dive into the Rds PostgreSQL Universe Austin 2017
Deep dive into the Rds PostgreSQL Universe Austin 2017Deep dive into the Rds PostgreSQL Universe Austin 2017
Deep dive into the Rds PostgreSQL Universe Austin 2017
 
Tuning PostgreSQL for High Write Throughput
Tuning PostgreSQL for High Write Throughput Tuning PostgreSQL for High Write Throughput
Tuning PostgreSQL for High Write Throughput
 
Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017
Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017
Amazon RDS for PostgreSQL: What's New and Lessons Learned - NY 2017
 
Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...
Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...
Amazon RDS for PostgreSQL - Postgres Open 2016 - New Features and Lessons Lea...
 
Amazon RDS for PostgreSQL - PGConf 2016
Amazon RDS for PostgreSQL - PGConf 2016 Amazon RDS for PostgreSQL - PGConf 2016
Amazon RDS for PostgreSQL - PGConf 2016
 

Recently uploaded

Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...
Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...
Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...Klinik Aborsi
 
sourabh vyas1222222222222222222244444444
sourabh vyas1222222222222222222244444444sourabh vyas1222222222222222222244444444
sourabh vyas1222222222222222222244444444saurabvyas476
 
obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...
obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...
obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...yulianti213969
 
Case Study 4 Where the cry of rebellion happen?
Case Study 4 Where the cry of rebellion happen?Case Study 4 Where the cry of rebellion happen?
Case Study 4 Where the cry of rebellion happen?RemarkSemacio
 
一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单
一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单
一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单aqpto5bt
 
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...ThinkInnovation
 
Seven tools of quality control.slideshare
Seven tools of quality control.slideshareSeven tools of quality control.slideshare
Seven tools of quality control.slideshareraiaryan448
 
Credit Card Fraud Detection: Safeguarding Transactions in the Digital Age
Credit Card Fraud Detection: Safeguarding Transactions in the Digital AgeCredit Card Fraud Detection: Safeguarding Transactions in the Digital Age
Credit Card Fraud Detection: Safeguarding Transactions in the Digital AgeBoston Institute of Analytics
 
bams-3rd-case-presentation-scabies-12-05-2020.pptx
bams-3rd-case-presentation-scabies-12-05-2020.pptxbams-3rd-case-presentation-scabies-12-05-2020.pptx
bams-3rd-case-presentation-scabies-12-05-2020.pptxJocylDuran
 
Northern New England Tableau User Group (TUG) May 2024
Northern New England Tableau User Group (TUG) May 2024Northern New England Tableau User Group (TUG) May 2024
Northern New England Tableau User Group (TUG) May 2024patrickdtherriault
 
如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样
如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样
如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样wsppdmt
 
如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证acoha1
 
Audience Researchndfhcvnfgvgbhujhgfv.pptx
Audience Researchndfhcvnfgvgbhujhgfv.pptxAudience Researchndfhcvnfgvgbhujhgfv.pptx
Audience Researchndfhcvnfgvgbhujhgfv.pptxStephen266013
 
如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样
如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样
如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样jk0tkvfv
 
Displacement, Velocity, Acceleration, and Second Derivatives
Displacement, Velocity, Acceleration, and Second DerivativesDisplacement, Velocity, Acceleration, and Second Derivatives
Displacement, Velocity, Acceleration, and Second Derivatives23050636
 
Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...
Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...
Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...Payal Garg #K09
 
obat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di Bontang
obat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di  Bontangobat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di  Bontang
obat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di Bontangsiskavia95
 
如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证
如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证
如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证zifhagzkk
 
Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...
Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...
Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...Obat Aborsi 088980685493 Jual Obat Aborsi
 
社内勉強会資料_Object Recognition as Next Token Prediction
社内勉強会資料_Object Recognition as Next Token Prediction社内勉強会資料_Object Recognition as Next Token Prediction
社内勉強会資料_Object Recognition as Next Token PredictionNABLAS株式会社
 

Recently uploaded (20)

Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...
Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...
Jual Obat Aborsi Bandung (Asli No.1) Wa 082134680322 Klinik Obat Penggugur Ka...
 
sourabh vyas1222222222222222222244444444
sourabh vyas1222222222222222222244444444sourabh vyas1222222222222222222244444444
sourabh vyas1222222222222222222244444444
 
obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...
obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...
obat aborsi Tarakan wa 081336238223 jual obat aborsi cytotec asli di Tarakan9...
 
Case Study 4 Where the cry of rebellion happen?
Case Study 4 Where the cry of rebellion happen?Case Study 4 Where the cry of rebellion happen?
Case Study 4 Where the cry of rebellion happen?
 
一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单
一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单
一比一原版(ucla文凭证书)加州大学洛杉矶分校毕业证学历认证官方成绩单
 
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
Identify Customer Segments to Create Customer Offers for Each Segment - Appli...
 
Seven tools of quality control.slideshare
Seven tools of quality control.slideshareSeven tools of quality control.slideshare
Seven tools of quality control.slideshare
 
Credit Card Fraud Detection: Safeguarding Transactions in the Digital Age
Credit Card Fraud Detection: Safeguarding Transactions in the Digital AgeCredit Card Fraud Detection: Safeguarding Transactions in the Digital Age
Credit Card Fraud Detection: Safeguarding Transactions in the Digital Age
 
bams-3rd-case-presentation-scabies-12-05-2020.pptx
bams-3rd-case-presentation-scabies-12-05-2020.pptxbams-3rd-case-presentation-scabies-12-05-2020.pptx
bams-3rd-case-presentation-scabies-12-05-2020.pptx
 
Northern New England Tableau User Group (TUG) May 2024
Northern New England Tableau User Group (TUG) May 2024Northern New England Tableau User Group (TUG) May 2024
Northern New England Tableau User Group (TUG) May 2024
 
如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样
如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样
如何办理澳洲拉筹伯大学毕业证(LaTrobe毕业证书)成绩单原件一模一样
 
如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(WashU毕业证书)圣路易斯华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
 
Audience Researchndfhcvnfgvgbhujhgfv.pptx
Audience Researchndfhcvnfgvgbhujhgfv.pptxAudience Researchndfhcvnfgvgbhujhgfv.pptx
Audience Researchndfhcvnfgvgbhujhgfv.pptx
 
如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样
如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样
如何办理(UCLA毕业证书)加州大学洛杉矶分校毕业证成绩单学位证留信学历认证原件一样
 
Displacement, Velocity, Acceleration, and Second Derivatives
Displacement, Velocity, Acceleration, and Second DerivativesDisplacement, Velocity, Acceleration, and Second Derivatives
Displacement, Velocity, Acceleration, and Second Derivatives
 
Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...
Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...
Unsatisfied Bhabhi ℂall Girls Vadodara Book Esha 7427069034 Top Class ℂall Gi...
 
obat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di Bontang
obat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di  Bontangobat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di  Bontang
obat aborsi Bontang wa 082135199655 jual obat aborsi cytotec asli di Bontang
 
如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证
如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证
如何办理(Dalhousie毕业证书)达尔豪斯大学毕业证成绩单留信学历认证
 
Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...
Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...
Jual Obat Aborsi Lhokseumawe ( Asli No.1 ) 088980685493 Obat Penggugur Kandun...
 
社内勉強会資料_Object Recognition as Next Token Prediction
社内勉強会資料_Object Recognition as Next Token Prediction社内勉強会資料_Object Recognition as Next Token Prediction
社内勉強会資料_Object Recognition as Next Token Prediction
 

re:Invent 2022 DAT326 Deep dive into Amazon Aurora and its innovations

  • 1. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 2. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Deep dive into Amazon Aurora and its innovations D A T 3 2 6 Grant McAlister Senior Principal Engineer AWS
  • 3. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Designed for unparalleled high performance and availability at global scale with full MySQL and PostgreSQL compatibility at 1/10th the cost of commercial databases  5x throughput of standard MySQL and 3x of standard PostgreSQL  Scale out up to 15 read replicas  Decoupled storage and compute enabling cost optimization  Fast database cloning  Distributed, dynamically scaling storage subsystem Performance & scalability  6 copies of data across 3 AZs (customers pays for 1)  Automatic, continuous, incremental backups with point- in-time recovery (PITR)  Fault-tolerant, self-healing, auto- scaling storage  Global Database for disaster recovery Availability & durability  Network isolation  Encryption at rest/in transit  Supports multiple secure authentication mechanisms and audit controls Highly secure  Automates time-consuming management of administration tasks like hardware provisioning, database setup, patching, and backups  Serverless configuration options Fully managed
  • 4. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Architecture
  • 5. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora storage and replicas RW Application Application Write log records Aurora storage Availability Zone 3 Availability Zone 2 Availability Zone 1 6 5 4 3 2 1
  • 6. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora storage and replicas RW Application Application Write log records Read blocks Aurora storage Availability Zone 3 Availability Zone 2 Availability Zone 1
  • 7. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora storage and replicas RW Application Application Write log records Read blocks Aurora storage Availability Zone 3 Availability Zone 2 Availability Zone 1
  • 8. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora storage and replicas RW Application Application Write log records Read blocks Aurora storage Availability Zone 3 Availability Zone 2 Availability Zone 1
  • 9. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora storage and replicas RW Application Application Write log records Read blocks Aurora storage Availability Zone 3 Availability Zone 2 Availability Zone 1
  • 10. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora storage and replicas RW Application Application Write log records Read blocks Aurora storage Availability Zone 3 Availability Zone 2 Availability Zone 1
  • 11. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. RO Application Aurora storage and replicas RW Application RO Application Async Invalidation & Update Async invalidation & update Write log records Read blocks Aurora storage RO RO RO RO Availability Zone 3 Availability Zone 2 Availability Zone 1 db.r6i.4xlarge db.serverless db.r6g.4xlarge
  • 12. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. RO Application Aurora storage and replicas RW Application RO Application Async Invalidation & Update Async invalidation & update Write log records Read blocks Aurora storage RO RO RO RO Availability Zone 3 Availability Zone 2 Availability Zone 1 db.r6i.4xlarge db.serverless db.r6g.4xlarge
  • 13. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. RO Application Aurora storage and replicas RW Application RO Application Async Invalidation & Update Async invalidation & update Write log records Read blocks Aurora storage RO RO RO RO Availability Zone 3 Availability Zone 2 Availability Zone 1 db.r6i.4xlarge db.serverless db.r6g.4xlarge
  • 14. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. RO Application Aurora storage and replicas RW Application RO Application Async Invalidation & Update Write log records Read blocks RW Aurora storage RO RO RO RO Availability Zone 3 Availability Zone 2 Availability Zone 1 db.r6i.4xlarge db.serverless db.r6g.4xlarge
  • 15. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. RO Application Aurora storage and replicas RW Application RO Application Async Invalidation & Update Write log records Read blocks RW Aurora storage RO RO RO RO Availability Zone 3 Availability Zone 2 Availability Zone 1 db.r6i.4xlarge db.serverless db.r6g.4xlarge
  • 16. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. RO Application Aurora storage and replicas RW Application RO Application Async Invalidation & Update Write log records Read blocks RW Aurora storage RO RO RO RO Availability Zone 3 Availability Zone 2 Availability Zone 1 db.r6i.4xlarge db.serverless db.r6g.4xlarge AWS JDBC
  • 17. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application primary DB cluster secondary DB cluster
  • 18. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage primary DB cluster secondary DB cluster
  • 19. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage primary DB cluster secondary DB cluster
  • 20. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage primary DB cluster secondary DB cluster
  • 21. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage primary DB cluster secondary DB cluster
  • 22. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage primary DB cluster secondary DB cluster
  • 23. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage DR primary DB cluster secondary DB cluster
  • 24. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO primary DB cluster secondary DB cluster
  • 25. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO primary DB cluster secondary DB cluster
  • 26. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster
  • 27. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster
  • 28. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster
  • 29. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster
  • 30. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster
  • 31. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster
  • 32. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Aurora storage RO Application RW Application RO Application Aurora storage RO Application Application RO Application RO RW primary DB cluster secondary DB cluster
  • 33. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Managed planned failover Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster
  • 34. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Managed planned failover Aurora storage RO Application Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster RO
  • 35. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Managed planned failover Aurora storage RO Application Application RO Application Replication servers Aurora storage RO Application Application RO Application RO primary DB cluster secondary DB cluster RO verify
  • 36. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Managed planned failover Aurora storage RO Application Application RO Application Aurora storage RO Application Application RO Application RO RW RO primary DB cluster
  • 37. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Managed planned failover Aurora storage RO Application Application RO Application Aurora storage RO Application Application RO Application RO RW RO Replication servers Replication agents primary DB cluster secondary DB cluster
  • 38. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Global Database Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RO Application RW Application RO Application Replication servers Region B Availability Zone 3 Availability Zone 1 Availability Zone 2 Replication agents Aurora storage R O Applicatio n Applicatio n R O Applicatio n R O Region C Availability Zone 3 Availability Zone 1 Availability Zone 2 Replication agents Aurora storage R O Applicatio n Applicatio n R O Region D Availability Zone 3 Availability Zone 1 Availability Zone 2 Replication agents Aurora storage db.serverless
  • 39. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO
  • 40. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application
  • 41. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application
  • 42. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application TUNNEL
  • 43. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application
  • 44. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application --enable-global-write-forwarding
  • 45. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application --enable-global-write-forwarding
  • 46. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application --enable-global-write-forwarding
  • 47. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Replication agents Region B Region A Availability Zone 3 Availability Zone 1 Availability Zone 2 Availability Zone 3 Availability Zone 1 Availability Zone 2 Amazon Aurora Global Database Write Forwarding Aurora storage RO Application RW Application RO Application Replication servers Aurora storage RO Application Application RO Application RO Application --enable-global-write-forwarding
  • 48. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Storage Internals
  • 49. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v2 Full block WAL update t set y = 6 Amazon Simple Storage Service (Amazon S3)
  • 50. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 t-v2 Full block WAL update t set y = 6 Amazon Simple Storage Service (Amazon S3)
  • 51. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 t-v2 Full block t-v3 WAL update t set y = 6 Amazon Simple Storage Service (Amazon S3)
  • 52. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive update t set y = 6 Amazon Simple Storage Service (Amazon S3)
  • 53. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3)
  • 54. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3)
  • 55. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3)
  • 56. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3) recovery in minutes
  • 57. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora update t set y = 6 Block in memory t-v1 Aurora storage Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3) recovery in minutes
  • 58. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora update t set y = 6 Block in memory t-v1 t-v2 Aurora storage t-v2 Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3) recovery in minutes
  • 59. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora update t set y = 6 Block in memory t-v1 t-v2 t-v3 Aurora storage t-v2 Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3) recovery in minutes
  • 60. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora update t set y = 6 Block in memory t-v1 t-v2 t-v3 Aurora storage t-v2 t-v3 Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3) recovery in minutes
  • 61. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL: Writing less Aurora update t set y = 6 Block in memory t-v1 t-v2 t-v3 Aurora storage t-v2 t-v3 No engine checkpoint = no FPW Block in memory PostgreSQL t-v1 t-v2 t-v3 Checkpoint Datafile t-v2 Full block t-v3 WAL Archive 4K 4K 8K update t set y = 6 Amazon Simple Storage Service (Amazon S3) recovery in minutes continuous & parallel coalesce recovery in seconds
  • 62. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora Block in memory row1 Aurora storage Block in memory MySQL row1 row2 row2 log insert Amazon Simple Storage Service (Amazon S3)
  • 63. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora Block in memory row1 Aurora storage Block in memory MySQL row1 row2 Checkpoint row2 log insert Amazon Simple Storage Service (Amazon S3)
  • 64. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora Block in memory row1 Aurora storage Block in memory MySQL row1 row2 Checkpoint row2 Full block log insert Amazon Simple Storage Service (Amazon S3) doublewrite buffer
  • 65. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora Block in memory row1 Aurora storage Block in memory MySQL row1 row2 Checkpoint Datafile row2 Full block log Archive insert Amazon Simple Storage Service (Amazon S3) doublewrite buffer
  • 66. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora Block in memory row1 Aurora storage Block in memory MySQL row1 row2 Checkpoint Datafile row2 Full block log Archive 4K 4K 16K insert Amazon Simple Storage Service (Amazon S3) 4K 4K doublewrite buffer
  • 67. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora Block in memory row1 Aurora storage Block in memory MySQL row1 row2 Checkpoint Datafile row2 Full block log Archive 4K 4K 16K insert Amazon Simple Storage Service (Amazon S3) 4K 4K doublewrite buffer
  • 68. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora Block in memory row1 Aurora storage Block in memory MySQL row1 row2 Checkpoint Datafile row2 Full block log Archive 4K 4K 16K insert Amazon Simple Storage Service (Amazon S3) recovery in minutes 4K 4K doublewrite buffer
  • 69. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora insert Block in memory row1 Aurora storage Block in memory MySQL row1 row2 Checkpoint Datafile row2 Full block log Archive 4K 4K 16K insert Amazon Simple Storage Service (Amazon S3) recovery in minutes 4K 4K doublewrite buffer
  • 70. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL: Writing less Aurora insert Block in memory row1 row2 Aurora storage row2 No engine checkpoint = no doublewrite buffer Block in memory MySQL row1 row2 Checkpoint Datafile row2 Full block log Archive 4K 4K 16K insert Amazon Simple Storage Service (Amazon S3) recovery in minutes continuous & parallel coalesce recovery in seconds 4K 4K doublewrite buffer
  • 71. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3
  • 72. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3 A
  • 73. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3 A
  • 74. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3 A
  • 75. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3 A
  • 76. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3 A C
  • 77. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3 A C
  • 78. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Amazon S3 A C
  • 79. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Peer storage nodes Amazon S3 A C B
  • 80. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Peer storage nodes Amazon S3 A C B
  • 81. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Peer storage nodes Amazon S3 A C B B C A
  • 82. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Peer storage nodes Coalesce Amazon S3 A C B A B C B C A
  • 83. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Peer storage nodes Coalesce Amazon S3 A C B A B C B C A
  • 84. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora RW Storage Node Incoming queue Data blocks Update queue Hot log Peer storage nodes Coalesce Amazon S3 A C B A B C B C A
  • 85. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Storage Management – Dynamic resizing new partitions every hour drop existing create new 2 hour spike
  • 86. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Storage Management – Dynamic resizing new partitions every hour drop existing create new 2 hour spike drop existing create new drop the spike used space inside the db used storage space
  • 87. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Storage Management – Dynamic resizing new partitions every hour drop existing create new 2 hour spike drop existing create new drop the spike used space inside the db used storage space 2X extra storage costs
  • 88. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Storage Management – Dynamic resizing new partitions every hour drop existing create new 2 hour spike drop existing create new drop the spike
  • 89. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Storage Management – Dynamic resizing new partitions every hour drop existing create new 2 hour spike drop existing create new drop the spike used space inside the db used storage space
  • 90. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application Reporting application Read blocks Aurora storage Primary storage
  • 91. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Read blocks Aurora storage Primary storage Clone storage Clone
  • 92. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Read blocks Aurora storage Primary storage Clone storage Clone
  • 93. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Read blocks Aurora storage Primary storage Clone storage Clone
  • 94. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Read blocks Aurora storage Primary storage Clone storage Clone
  • 95. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Read blocks Aurora storage Primary storage Clone storage Clone
  • 96. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Read blocks Aurora storage Primary storage Clone storage Clone
  • 97. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Read blocks Aurora storage Primary storage Clone storage Clone
  • 98. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Write log records Read blocks Aurora storage Primary storage Clone storage Clone
  • 99. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Write log records Read blocks Aurora storage Primary storage Clone storage Clone
  • 100. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Write log records Read blocks Aurora storage Primary storage Clone storage Clone
  • 101. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Availability Zone 2 Availability Zone 1 Availability Zone 3 RO Application Fast clones RW Application RW Reporting application Write log records Read blocks Aurora storage Primary storage Clone storage Clone
  • 102. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Fast clone example 0 5000 10000 15000 20000 25000 0 3 6 9 12 15 18 21 24 27 30 33 36 39 42 45 48 51 54 57 60 63 66 69 72 75 78 Transactions per second (TPS) Minutes PGBench RW Scale 10K - Target Rate 20K TPS Main Database Clone Database
  • 103. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Aurora storage
  • 104. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Snapshot Aurora storage
  • 105. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Snapshot Aurora storage Aurora storage
  • 106. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Snapshot Aurora storage Aurora storage Amazon Aurora Primary Snapshot
  • 107. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Snapshot Aurora storage Amazon Simple Storage Service (Amazon S3) Aurora storage Amazon Aurora Primary Snapshot
  • 108. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Aurora storage Amazon Simple Storage Service (Amazon S3)
  • 109. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Aurora storage Amazon Simple Storage Service (Amazon S3) Amazon Aurora CLONE
  • 110. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Aurora storage Amazon Simple Storage Service (Amazon S3) Amazon Aurora CLONE
  • 111. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Export to S3 via clone Amazon Aurora Primary(R/W) Aurora storage Amazon Simple Storage Service (Amazon S3) Amazon Aurora CLONE parallel export – Aurora MySQL
  • 112. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. MySQL Updates
  • 113. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora MySQL Updates • Support for major version upgrade to MySQL 3 with MySQL 8.0 Compatibility • IPv6 support • Active Directory support • Parallel Export to S3 • Enhanced binlog
  • 114. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. enhanced binlog Binlog Enhanced Binlog • greatly reduced overhead for enabling binlog • reduced cost to read binlogs for cdc
  • 115. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. PostgreSQL Updates
  • 116. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL Updates • Support for PostgreSQL14 – new extensions tds_fdw & lo • Multi Major Version Upgrade • SCRAM auth enforcement • IPv6 support • Improved consistency of minor version & patch upgrade times • Improved availability of read replicas • Logical Replication cache
  • 117. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT AWS Database Migration Service (AWS DMS)
  • 118. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora write wal log (needed for logical decoding) write transaction log Users / Applications INSERT AWS Database Migration Service (AWS DMS)
  • 119. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT AWS Database Migration Service (AWS DMS)
  • 120. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT logical decoding AWS Database Migration Service (AWS DMS) read wal log (needed for logical decoding)
  • 121. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT logical decoding AWS Database Migration Service (AWS DMS) INSERT read wal log (needed for logical decoding)
  • 122. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT logical decoding AWS Database Migration Service (AWS DMS)
  • 123. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT logical decoding AWS Database Migration Service (AWS DMS) wal log cache
  • 124. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT logical decoding AWS Database Migration Service (AWS DMS) wal log cache cache read
  • 125. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora PostgreSQL – Logical replication cache Aurora storage Amazon Aurora Users / Applications INSERT logical decoding AWS Database Migration Service (AWS DMS) INSERT wal log cache cache read
  • 126. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. PostgreSQL Trusted Language Extensions
  • 127. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Trusted Language Extensions (TLE) Builders create new libraries using TLE framework Customers choose TLE extensions for their apps DBAs control who can install and manage TLE extensions Available on Aurora and RDS PostgreSQL 14.5 and higher Application Extension code is installed by TLE A M A Z O N A U R O R A W I T H P O S T G R E S Q L C O M P A T I B I L I T Y , A M A Z O N R D S F O R P O S T G R E S Q L DBA C U S T O M E R B U I L D E R TLE Code PostgreSQL Open Source Project - Source code: https://github.com/aws/pg_tle - Apache 2.0 licensed
  • 128. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Safely extend PostgreSQL capabilities T L E P R O V I D E S S A F E O P E R A T I O N O F P O S T G R E S Q L E X T E N S I O N S I N P R O D U C T I O N Enforces use of PostgreSQL trusted languages TLE API provides safe access to PostgreSQL internals Supports languages that have C-like performance Removes need for C expertise to create a safe extension Build and use extensions on your timeline Reduces DBA certification burden
  • 129. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. How it works Build functions using a trusted PostgreSQL language Install functions using TLE PostgreSQL users can start using the extension using "CREATE EXTENSION" Collect feedback for making new versions of software Any "trusted” PostgreSQL procedural language can be used in a TLE JavaScript Perl Tcl PL/pgSQL Coming soon: Rust
  • 130. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Manageability – Aurora Serverless
  • 131. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Serverless On-demand and automatically scaling configuration Automatically scales capacity based on application needs Simple pay-per-use pricing per second Scales instantly to support demanding applications Worry-free database capacity management
  • 132. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Instant, in-place scaling • Scales in place in under a second by adding more CPU and memory resources and billed by the second • No impact due to scaling even when running hundreds of thousands of transactions AWS Lambda Amazon Aurora
  • 133. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Instant, in-place scaling • Scales in place in under a second by adding more CPU and memory resources and billed by the second • No impact due to scaling even when running hundreds of thousands of transactions AWS Lambda Amazon Aurora
  • 134. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Instant, in-place scaling • Scales in place in under a second by adding more CPU and memory resources and billed by the second • No impact due to scaling even when running hundreds of thousands of transactions AWS Lambda Amazon Aurora
  • 135. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Instant, in-place scaling • Scales in place in under a second by adding more CPU and memory resources and billed by the second • No impact due to scaling even when running hundreds of thousands of transactions AWS Lambda Amazon Aurora
  • 136. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Instant, in-place scaling • Scales in place in under a second by adding more CPU and memory resources and billed by the second • No impact due to scaling even when running hundreds of thousands of transactions AWS Lambda Amazon Aurora
  • 137. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora – challenging workload example db.r6g.4xlarge
  • 138. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora - challenging workload example db.r6g.4xlarge
  • 139. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless – CPU scaling db.serverless per second scale up by 8% of max ACU configured (128)
  • 140. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora - challenging workload example db.r6g.4xlarge
  • 141. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora - challenging workload example db.r6g.4xlarge
  • 142. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora - challenging workload example db.r6g.4xlarge point select canary query 10X increase in average latency
  • 143. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora - challenging workload example db.r6g.4xlarge point select canary query 10X increase in average latency
  • 144. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora - challenging workload example db.r6g.4xlarge
  • 145. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless – memory and CPU scaling serverless scales up providing additional memory and CPU db.serverless
  • 146. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless – memory scaling 8X reduction in latency point select canary query
  • 147. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Reads Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 148. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 149. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Page read Page read Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 150. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Page read Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 151. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Evict cold pages Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 152. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 153. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 154. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Shrink memory Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 155. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Buffer pool resizing Buffer pool Access frequency Storage volume Shrink memory Default memory allocation: 75% for buffer pool and 25% for heap Buffer pool size scaled along with capacity Parameters automatically adjusted: MySQL: innodb_buffer_pool_size PostgreSQL: shared_buffers Buffer pool scaled down through a combination of least frequently used (LFU) and least recently used (LRU) algorithms
  • 156. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Manageability – Amazon DevOps Guru for RDS
  • 157. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DevOps Guru for RDS A new Machine Learning (ML)-powered capability for Amazon RDS that automatically detects and diagnoses database performance and operational issues, enabling you to resolve bottlenecks in minutes
  • 158. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. DevOps Guru for RDS • Finds DB performance anomalies • Analyzes the anomaly • Highlights: • Prevalent wait events • Prevalent SQL statements • Other anomalous metrics • Recommends next steps LOCKS 78% SELECT NAME FROM CUSTOMERS; SELECT ITEM FROM F; MEMORY What to do about locking issues…
  • 159. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. DevOps Guru for RDS
  • 160. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Introducing Amazon GuardDuty RDS Protection Protect your data stored in Amazon RDS databases (starting with Amazon Aurora) by identifying suspicious login attempts to mitigate threats before they escalate Continuously monitor all Aurora databases across your organization with a single click Use machine learning to reduce noise and avoid alert fatigue
  • 161. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon GuardDuty RDS Protection: How does it work? Aurora Metrics ingestion Detect suspicious activity GuardDuty Amazon GuardDuty RDS Protection Explain + understand Remediate + GuardDuty RDS Protection
  • 162. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon GuardDuty RDS Protection: Anomaly detection deep dive Detects suspicious activity
  • 163. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon GuardDuty RDS Protection: Anomaly detection deep dive
  • 164. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. What GuardDuty RDS Protection can detect Amazon Aurora Brute Force Password Spraying/Guessing pgAdmin Stolen Credentials Virtual Private Cloud (VPC) ? Scanning
  • 165. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. When GuardDuty RDS Protection detects a threat you can quickly take action Amazon Aurora Virtual Private Cloud (VPC) Security group
  • 166. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. When GuardDuty RDS Protection detects a threat you can quickly take action Amazon Aurora Virtual Private Cloud (VPC) Security group
  • 167. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. When GuardDuty RDS Protection detects a threat you can quickly take action Amazon Aurora Virtual Private Cloud (VPC) Security group
  • 168. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. When GuardDuty RDS Protection detects a threat you can quickly take action Amazon Aurora Virtual Private Cloud (VPC) Security group X
  • 169. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. When GuardDuty RDS Protection detects a threat you can quickly take action Amazon Aurora Virtual Private Cloud (VPC) Security group X
  • 170. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. When GuardDuty RDS Protection detects a threat you can quickly take action Amazon Aurora Virtual Private Cloud (VPC) Security group X
  • 171. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. When GuardDuty RDS Protection detects a threat you can quickly take action Amazon Aurora Virtual Private Cloud (VPC) Security group X
  • 172. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Manageability – Blue/Green Deployments
  • 173. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) create-blue-green-deployment RO RO
  • 174. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO Target mycluster-green-x1234 Aurora MySQL 2.10.2 (5.7) • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO
  • 175. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0)
  • 176. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0)
  • 177. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0) AVAILABLE
  • 178. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0) AVAILABLE
  • 179. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0) SWITCHOVER_IN_PROGRESS
  • 180. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0) SWITCHOVER_IN_PROGRESS
  • 181. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0) SWITCHOVER_IN_PROGRESS
  • 182. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0) SWITCHOVER_IN_PROGRESS
  • 183. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster-green-x1234 Aurora MySQL 3.02.2 (8.0) SWITCHOVER_IN_PROGRESS
  • 184. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment SWITCHOVER_COMPLETED Target mycluster Aurora MySQL 3.02.2 (8.0) Source mycluster-old1 Aurora MySQL 2.10.2 (5.7)
  • 185. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster Aurora MySQL 3.02.2 (8.0) Source mycluster-old1 Aurora MySQL 2.10.2 (5.7) delete-blue-green-deployment
  • 186. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Aurora storage RW Users / Applications db cluster endpoint RO Source mycluster Aurora MySQL 2.10.2 (5.7) Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO RO RO switchover-blue-green-deployment Target mycluster Aurora MySQL 3.02.2 (8.0) Source mycluster-old1 Aurora MySQL 2.10.2 (5.7) delete-blue-green-deployment customer verification
  • 187. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora Blue/Green Deployments Region Availability Zone 3 Availability Zone 1 Availability Zone 2 Users / Applications db cluster endpoint Aurora storage RO RW RO • Major/Minor Upgrades • Schema Changes • Static Parameter Changes • Maintenance Updates create-blue-green-deployment RO RO switchover-blue-green-deployment delete-blue-green-deployment Target mycluster Aurora MySQL 3.02.2 (8.0)
  • 188. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Manageability – Redshift Integration
  • 189. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Transaction analytics at scale Requires building and managing complex data pipelines Amazon Aurora Amazon Redshift Transactional Applications Analytics Applications DMS AWS Glue Amazon S3 Analytics Analyst Amazon EMR Amazon S3 Analyst Data Engineer
  • 190. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Introducing: Amazon Aurora zero-ETL integration with Amazon Redshift An easy and secure way to enable near real-time analytics on petabytes of transactional data Amazon Aurora Amazon Redshift Transactional Applications Analytics Applications Analytics Analyst Analyst Data Engineer Zero-ETL integration
  • 191. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Designed for simplicity and performance Aurora storage Amazon Redshift Amazon Aurora Redshift storage • Easy creation of Redshift integration target • Automated data seeding and continuous replication at storage layer • Run analytics along side ingestion • Monitor progress, lag, and performance from Redshift system tables and CloudWatch Client Application Zero-ETL Integration
  • 192. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Operational analytics across many databases Amazon Aurora Amazon Aurora Amazon Aurora Amazon Redshift Zero-ETL Recommendation Engine 74 Amazon Aurora databases 200K-300K daily transaction <10 seconds lag 200TB 30B rows on largest table 70+ columns ML and analytics services Amazon Redshift ML BI and analytics apps Connect apps to analyze and visualize your data SQL Amazon Redshift ML ML and analytics services Analyze open standards- based data formats Amazon Redshift integration for Apache Spark
  • 193. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Integration at the storage layer Aurora storage Amazon Redshift Amazon Aurora MySQL Redshift storage Transaction log Change data capture (CDC) log
  • 194. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Integration at the storage layer Aurora storage Amazon Redshift Amazon Aurora MySQL Redshift storage Transaction log Change data capture (CDC) log Seed data parallel direct export
  • 195. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Integration at the storage layer Aurora storage Amazon Redshift Amazon Aurora MySQL Redshift storage CDC Streaming Change data capture (CDC) log CDC from storage Replicate to Redshift Transaction log enhanced binlog
  • 196. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Related sessions DAT221 Breakout PostgreSQL Trusted Language Extensions DAT222 Breakout Blue/Green Deployments DAT328 Breakout Amazon Aurora Zero-ETL to Amazon Redshift SEC218 Breakout Amazon GuardDuty RDS Protection
  • 197. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you! Please complete the session survey in the mobile app

Editor's Notes

  1. Aurora is a cloud-native database engine. We designed it to meet the needs of enterprise with demanding requirements in terms of features, scaling and performance. We're talking about customers who need powerful and full-featured databases, but are getting tired of the legacy databases’ punitive licensing, their significant expense, their lack of cloud-native capabilities, etc. So Aurora is our answer to that need. At the SQL prompt, Aurora looks and feels just like Postgres or MySQL. But behind the scenes, it features a distributed, fault-tolerant, self-healing storage system that auto-scales up to 128TB per database. Each Aurora cluster replicates automatically across three Availability Zones, while at the same time, delivering high performance and availability with up to 15 low-latency read replicas. So in essence, Aurora is cloud-native, massively scalable and available database. It aims to address high-end enterprise use cases in a way that MySQL and Postgres can’t do by themselves. And Aurora aims to do it at a lower cost to customers than the legacy commercial databases.
  2. DAT221- Thurs
  3. Until today, RDS and Aurora supported solely a curated set of 85 plus PostgreSQL extensions. However, we heard from developers that they want access to the broader library of PostgreSQL extensions to use in production. TLE allows you to improve the time to market by allowing you to deploy extensions on Amazon Aurora on RDS as soon as you determine that an extension meets your needs. This is possible through AWS’ Shared Responsibility model. You no longer need to wait for AWS to support an extension to begin implementation because TLE extensions are considered part of your application. Previously, building a successful PostgreSQL extension required expert orchestration with C language. TLE uses popular PostgreSQL trusted languages, including JavaScript, PLpgSQL, and Perl, to improve extension builders’ productivity, letting developers efficiently create extensions. DBAs have control over who can install TLE extensions, making it possible for select application developers to test an extension prior to production use. Furthermore, all can rest assured that any defects in an extension’s code is limited to a single database connection.
  4. TLE raises the bar on PostgreSQL extension creation and use. TLE is designed to provide you better safety, support for high performance programming languages, and removes AWS certification from your project. TLE is open source, so you can see what it does, and you can make it better. As we like to say at Amazon, it is still day one for this project. We would like this open-source project to become the standard for creating extensions for PostgreSQL, making it easier for developers to innovate. We recognize that an open-source project cannot be successful without the community. With this project, we can enable developers with tools to innovate faster and create a better experience for all PostgreSQL lovers.
  5. For a long time, customers have been telling us that they like a lot of things about Performance Insights and CloudWatch, which let them explore all kinds of issues around database performance and troubleshooting. But you’ve also told us loud and clear that you’d like a little more help tracking down potential problems and even more importantly, figuring out what to do about them. That’s where DevOps Guru comes in. Since being released DevOps Guru has been helping customers by telling them about unusual and problematic performance behavior throughout their application stacks. This week we’re raising the bar for database diagnostics in DevOps Guru, bringing detailed database-specific capabilities to DevOps Guru. DevOps Guru for RDS goes several steps further than Performance Insights, by using machine learning to detect and diagnose performance problems in your databases, in order to help you fix those problems quickly.
  6. Customers feedback has been consistent that they, that you, want to see the unique value GuardDuty provides expand to protect more of your AWS resources, and as we mentioned, perhaps most importantly your data. Protect your data in RDS, starting with Aurora – suspicious logins that we identified as a critical level of visibility to identify an early stage of threats to DBs that allows you to mitigate threats before the escalate, and further put your data at risk. Single click – org wide. With machine learning models that accurately detect suspicious logins to your RDS DBs.
  7. Now I’d like to give you a look inside this new feature so you can understand how it detects threats. Perhaps you feel we glossed over the important part, where we detect suspicious activity. What is suspicious? How do we know?
  8. Well what can you do if Guard Duty RDS Protection detects an issue? If Guard Duty RDS Protection tells you that connection attempts are coming from an atypical IP address range, you can tighten your security group posture to prevent unauthorized hosts from connecting, especially those outside your VPC. If Guard Duty RDS Protection tells you that a user you don’t recognize has connected to the system database, you can terminate that connection at the database, and rotate the credential that was used, preventing further connections. Any whenever Guard Duty RDS Protection detects unusual activity, it’s a great opportunity for your security team to review database audit records to determine if the issue is part of a larger pattern of misuse or abuse.
  9. Fastest way to go from transaction to insights Fastest way to go from transaction to ML driven insights Easy and reliable Unify multiple sources
  10. Automated data seeding Single-digit second replication lag Monitoring and recovery Low Latency Let’s take a closer looks at some other aspects of this integration. Creating a Redshift integration target, whether it’s a new of existing endpoint, is easy with zero-etl. Each Aurora database cluster is mapped into a Redshift database. A Redshift endpoint can support multiple integrations. Data can be ingested into Redshift in parallel, even as multiple concurrent queries are running in Redshift. Once the data is in Redshift, you can transform data with materialized views for improving performance. You can also further share data between Redshift clusters using Data Sharing.    We have designed this integration for easy maintenance. This integration adapts to Aurora side schema changes. Database or table additions and deletions are handled transparently. If a transient error is encountered, the integration automatically re-synchs after the recovery from the error. There is often a need for other permutations of data movement from one purpose built database to another, and we’ll turn to this topic next.