SlideShare a Scribd company logo
1 of 34
Download to read offline
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Accelerate database development and
testing with Amazon Aurora
Vlad Vlasceanu
Principal Database Specialist SA
AWS
A D B 2 0 8
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Database development and testing perspective
Responsibilities of today’s developers, DevOps, and database admins:
• Database architecture
• Deployment & automation
• Improve dev/test outcomes
• Performance and availability focused development
• Cost effective development
Aurora provides native capabilities to meet these goals
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Aurora: Reimaging the relational database
Scale-out, distributed architecture using purpose-built storage
system
Service-oriented architecture leveraging AWS services
Fully managed service, automating administrative tasks
1
2
3
Cloud-native capabilities simplify use4
Aurora is fast…
5x more throughput than MySQL; 3x more throughput than PostgreSQL
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Aurora – key characteristics
1 Log-structured storage volume shared
between all cluster nodes
2
Optimized for high throughput3
Readers strictly read-only
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Core use cases: Read scaling architecture
Automatic scaling optional
All readers treated the same
Any reader can be a failover
target
Application should use cluster
and reader endpoints
Dev. tip: Monitor cluster
topology for faster failover
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Core use cases: Separated workloads architecture
Each reader used for a specific
purpose
Ordered failover targeting
Application uses cluster, custom
or even database instance
endpoints
Caveat: Readers share the same
storage and undo log
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Automating deployments for Aurora
Why?
• Reduce the risk of human errors
• Repeatable deployments
• Accountability and management of change
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Automating deployments for Aurora
Why?
• Reduce the risk of human errors
• Repeatable deployments
• Accountability and management of change
How?
+
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deployment automation using AWS CloudFormation
AWS CloudFormation:
Outcome-driven deployment automation, templates define desired state
… but how do you define the state of an Aurora database cluster?
Supplement capabilities to match desired processes:
Check capability gaps in AWS CloudFormation versus API1
Use AWS CloudFormation custom resources or a master snapshot to bootstrap
database (initial users, permissions, schemas)
2
Create alternative automation for workflows that need to be completed with
minimal disruption
3
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Risk free dev/test, data extracts, and analytics
Bad practices we’ve seen
• App development and testing on tiny subsets of non-production data
• Bulk data exports from live production instances
• Running long, unoptimized queries on cluster readers
• Lack of outcome focus
The right way
• Know your features: Point-in-Time Restore, Database Cloning, Backtrack
• Proper workload isolation
• Test; don’t hope for the best
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Database cloning
Get faster access to copies of your data so you can:
Test changes in pre-production on relevant
datasets
Reorganize a database with minimal
production impact
Save a point-in-time snapshot for data
analysis without impacting production
systems
1
2
3
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Fast database cloning with Aurora
Available for both MySQL and PostgreSQL compatible versions
of Aurora
Creation of clone takes a few minutes
Data copy happens only on write, when the original and
cloned volume start to differ
Operations on clone do not affect the source cluster
Up to 15 clones from the same source
Pay only for the data storage difference on the clone PRODUCTION DATABASE
CLONE CLONE
CLONE
DEV/TEST
APPLICATIONS
BENCHMARKS
PRODUCTION
APPLICATIONS
PRODUCTION
APPLICATIONS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Backtracking databases
Easily undo changes to your data:
Reduce the risk of database changes at
scale
Undo unintentional DML and DDL
changes
Mitigate risk of malicious changes to your
data
1
2
3
Avoid time consuming data restore from
backups
4
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
How does Backtrack work?
• We keep periodic snapshots of each segment; we also preserve the logs
• For Backtrack, we identify the appropriate segment snapshots
• Apply log streams to segment snapshots in parallel and asynchronously
SEGMENT SNAPSHOT
CHANGE RECORDS
RECOVERY POINT
SEGMENT 1
SEGMENT 2
SEGMENT 3
TIME
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Going back in time with Backtrack
t0 t1 t2
t0 t1
t2
t3 t4
t3
t4
Rewind to t1
Rewind to t3
Invisible Invisible
• Backtrack is not destructive
• You can backtrack multiple times to find the right point in time
• Pay for the volume of change records retained for the desired duration (up to 72 hours)
• Available for Aurora MySQL 5.6 compatible
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Development focused on production scale
Bad practices we’ve seen:
• App development and testing on tiny subsets of non-production data
• My database is always there for me and never fails me
• Running long, unoptimized queries on cluster readers
• Lack of outcome focus
The right way:
• Be aware of architectural differences between Aurora and equivalent engines
• Know Aurora capabilities and operational procedures: automated failovers, upgrades
• Extend Aurora features with application side cluster awareness
• Test, don’t hope for the best: failure injection
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Connection management and availability
Minimize failure downtime, and connection management overhead
Common MySQL and PostgreSQL drivers are not aware
of the cluster or topology
Use a client-side connection pool; recycle connections
periodically; avoid connection storms
Use a smart driver, or build topology awareness in your
client data layer, validate connections
1
2
3
Understand the behavior of the Aurora DNS endpoints,
manage DNS caching
4
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Monitor the performance of your queries
Establish a baseline of acceptable or
preferred query performance
Assess performance impact of workload
changes
Troubleshoot poor performance, identify
bottlenecks
1
2
3
Effective capacity planning4
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Database health at a glance
Aurora comes with comprehensive monitoring built-in:
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Database health at a glance
Amazon Aurora comes with comprehensive monitoring built-in:
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Performance Insights
Available for both MySQL and PostgreSQL compatible versions
of Aurora
Easy and powerful dashboard showing load on your database
Helps you identify source of bottlenecks: top SQL queries, wait
statistics
Adjustable time frame (hour, day week, month)
Seven days of performance data history free. Perfect for
developers; up to two years of long-term retention for
production use cases
Max CPU
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Cost optimized development and testing
Use database resources at appropriate scale only when they are needed
1 Development and test activities are rarely continuous
2
Development and test environment isolation3
Scale of development and test activities vary
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Aurora features helping with cost optimization
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Aurora features helping with cost optimization
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Aurora Serverless use cases
Development and test databases:
• Easily provisioned
• Cost savings when databases are not in use
• Simplify development and test pipelines
Infrequently used applications
(e.g., low-volume blog site)
Applications with variable load; peaks of activity that are
hard to predict (e.g., news site)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Aurora Serverless architecture
• Application talks to MySQL-compatible endpoint
• Fleet of routers manage queue, client connections, and
route DB traffic
• Instance handles database operations
• Data kept durable and highly available on Aurora storage
volume
• When scaling thresholds are reached, we scale the
instance substituting with capacity from warm pool
• Scaling operations are transparent to applications
• You configure min. and max. capacity, whether and when
to pause database if there’s no activity
INSTANCE
DATABASE
STORAGE
APPLICATION
WARM POOL
DATABASE TRAFFIC ROUTERS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Aurora Serverless pricing
• You pay for the capacity your database consumes while it
is active
• Database capacity is measured in Aurora Capacity Units
(ACUs): 1 ACU ~ 2 Gb of memory with corresponding CPU
and network capacity
• Flat rate per second of ACU usage, with a minimum of 5
minutes of usage each time the database is activated
• Storage and I/O are billed the same as Aurora instances
Duration ACUs ACU-Hours Rate Charges
1 hour, 10 minutes, and 15
seconds (1.020 hours)
4 4.08 $0.06 $0.25
40 minutes and 34 seconds
(0.676 hours)
8 5.41 $0.06 $0.32
Usage total for 24 hours 9.49 $0.06 $0.57
Usage Rate Charges
9.49 ACU-hours $0.06 per ACU-hour $0.57
80 GB of storage for 24 hours $0.10 per GB-month $0.26
90,000 I/O requests $0.20 per 1 million requests $0.02
Total charges for 24 hours $0.85
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Introducing the RDS Data API
• Public HTTP API endpoint, integrated with AWS authentication
• Automated server-side connection pooling
• Ideal for AWS Lambda or serverless apps reusing connections
across multiple invocations
• Fully integrated with AWS Secrets Manager and
AWS AppSync
• Optional session construct for efficient prepared statement
executions
• Interactive query editor in the console for
ad-hoc queries
• Available for Aurora Serverless (MySQL)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Parting thoughts
Use automation wisely and map out your
operational processes in detail
Know Aurora’s features and how they can
improve on your development and testing
process
Develop and test with performance in
mind
1
2
3
Quantify the expected baseline
performance of your workload
4
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Vlad Vlasceanu
vladv@amazon.com

More Related Content

What's hot

Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...
Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...
Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...Amazon Web Services
 
Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...
Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...
Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...Amazon Web Services
 
Monitoring with container insights & anomaly detection - SVC308 - New York AW...
Monitoring with container insights & anomaly detection - SVC308 - New York AW...Monitoring with container insights & anomaly detection - SVC308 - New York AW...
Monitoring with container insights & anomaly detection - SVC308 - New York AW...Amazon Web Services
 
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...Amazon Web Services
 
Building system-of-record applications with Amazon QLDB - SVC218 - New York A...
Building system-of-record applications with Amazon QLDB - SVC218 - New York A...Building system-of-record applications with Amazon QLDB - SVC218 - New York A...
Building system-of-record applications with Amazon QLDB - SVC218 - New York A...Amazon Web Services
 
Making CI/CD pipelines safer with application monitoring and tracing - MAD202...
Making CI/CD pipelines safer with application monitoring and tracing - MAD202...Making CI/CD pipelines safer with application monitoring and tracing - MAD202...
Making CI/CD pipelines safer with application monitoring and tracing - MAD202...Amazon Web Services
 
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...Amazon Web Services
 
AWS CloudFormation macros: Coding best practices - MAD201 - New York AWS Summit
AWS CloudFormation macros: Coding best practices - MAD201 - New York AWS SummitAWS CloudFormation macros: Coding best practices - MAD201 - New York AWS Summit
AWS CloudFormation macros: Coding best practices - MAD201 - New York AWS SummitAmazon Web Services
 
Threat detection and mitigation at AWS - SEC201 - New York AWS Summit
Threat detection and mitigation at AWS - SEC201 - New York AWS SummitThreat detection and mitigation at AWS - SEC201 - New York AWS Summit
Threat detection and mitigation at AWS - SEC201 - New York AWS SummitAmazon Web Services
 
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...Amazon Web Services
 
Optimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS SummitOptimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS SummitAmazon Web Services
 
Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...
Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...
Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...Amazon Web Services
 
Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...Amazon Web Services
 
Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...
Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...
Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...Amazon Web Services
 
Best practices for queue processing in serverless applications - MAD313 - Chi...
Best practices for queue processing in serverless applications - MAD313 - Chi...Best practices for queue processing in serverless applications - MAD313 - Chi...
Best practices for queue processing in serverless applications - MAD313 - Chi...Amazon Web Services
 
Safeguarding the integrity of your code for fast, secure deployments - SVC301...
Safeguarding the integrity of your code for fast, secure deployments - SVC301...Safeguarding the integrity of your code for fast, secure deployments - SVC301...
Safeguarding the integrity of your code for fast, secure deployments - SVC301...Amazon Web Services
 
Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...
Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...
Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...Amazon Web Services
 
Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...
Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...
Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...Amazon Web Services
 
Increasing the value of video with machine learning & AWS Media Services - SV...
Increasing the value of video with machine learning & AWS Media Services - SV...Increasing the value of video with machine learning & AWS Media Services - SV...
Increasing the value of video with machine learning & AWS Media Services - SV...Amazon Web Services
 

What's hot (20)

Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...
Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...
Improve operations with AWS Systems Manager OpsCenter - SVC310 - New York AWS...
 
Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...
Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...
Mythical Mysfits: Build & collaborate on a modern web application on AWS - MA...
 
Monitoring with container insights & anomaly detection - SVC308 - New York AW...
Monitoring with container insights & anomaly detection - SVC308 - New York AW...Monitoring with container insights & anomaly detection - SVC308 - New York AW...
Monitoring with container insights & anomaly detection - SVC308 - New York AW...
 
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
 
Building system-of-record applications with Amazon QLDB - SVC218 - New York A...
Building system-of-record applications with Amazon QLDB - SVC218 - New York A...Building system-of-record applications with Amazon QLDB - SVC218 - New York A...
Building system-of-record applications with Amazon QLDB - SVC218 - New York A...
 
Making CI/CD pipelines safer with application monitoring and tracing - MAD202...
Making CI/CD pipelines safer with application monitoring and tracing - MAD202...Making CI/CD pipelines safer with application monitoring and tracing - MAD202...
Making CI/CD pipelines safer with application monitoring and tracing - MAD202...
 
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What’s new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
 
AWS CloudFormation macros: Coding best practices - MAD201 - New York AWS Summit
AWS CloudFormation macros: Coding best practices - MAD201 - New York AWS SummitAWS CloudFormation macros: Coding best practices - MAD201 - New York AWS Summit
AWS CloudFormation macros: Coding best practices - MAD201 - New York AWS Summit
 
Threat detection and mitigation at AWS - SEC201 - New York AWS Summit
Threat detection and mitigation at AWS - SEC201 - New York AWS SummitThreat detection and mitigation at AWS - SEC201 - New York AWS Summit
Threat detection and mitigation at AWS - SEC201 - New York AWS Summit
 
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...
 
Optimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS SummitOptimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
 
Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...
Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...
Analyzing and processing streaming data with Amazon EMR - ADB204 - New York A...
 
Data_Analytics_and_AI_ML
Data_Analytics_and_AI_MLData_Analytics_and_AI_ML
Data_Analytics_and_AI_ML
 
Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...Manage your database in the cloud like a pro with Cloud Volumes Service for A...
Manage your database in the cloud like a pro with Cloud Volumes Service for A...
 
Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...
Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...
Technical deep dive: Cloud data management with Veeam and AWS - SVC202-S - Ch...
 
Best practices for queue processing in serverless applications - MAD313 - Chi...
Best practices for queue processing in serverless applications - MAD313 - Chi...Best practices for queue processing in serverless applications - MAD313 - Chi...
Best practices for queue processing in serverless applications - MAD313 - Chi...
 
Safeguarding the integrity of your code for fast, secure deployments - SVC301...
Safeguarding the integrity of your code for fast, secure deployments - SVC301...Safeguarding the integrity of your code for fast, secure deployments - SVC301...
Safeguarding the integrity of your code for fast, secure deployments - SVC301...
 
Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...
Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...
Deep dive on storage offerings: What to use, where, and why - STG303 - New Yo...
 
Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...
Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...
Storing data long term with Amazon S3 Glacier Deep Archive - STG302 - Chicago...
 
Increasing the value of video with machine learning & AWS Media Services - SV...
Increasing the value of video with machine learning & AWS Media Services - SV...Increasing the value of video with machine learning & AWS Media Services - SV...
Increasing the value of video with machine learning & AWS Media Services - SV...
 

Similar to Accelerate database development and testing with Amazon Aurora - ADB208 - New York AWS Summit

Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...Amazon Web Services
 
Migrate and Modernize Your Database
Migrate and Modernize Your DatabaseMigrate and Modernize Your Database
Migrate and Modernize Your DatabaseAmazon Web Services
 
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWS
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWSAmazon Aurora, funzionalità e best practice per la migrazione di database su AWS
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWSAmazon Web Services
 
What's new in Amazon Aurora - ADB203 - Atlanta AWS Summit
What's new in Amazon Aurora - ADB203 - Atlanta AWS SummitWhat's new in Amazon Aurora - ADB203 - Atlanta AWS Summit
What's new in Amazon Aurora - ADB203 - Atlanta AWS SummitAmazon Web Services
 
Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019
Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019
Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019javier ramirez
 
What's New in Amazon Aurora - ADB203 - Anaheim AWS Summit
What's New in Amazon Aurora - ADB203 - Anaheim AWS SummitWhat's New in Amazon Aurora - ADB203 - Anaheim AWS Summit
What's New in Amazon Aurora - ADB203 - Anaheim AWS SummitAmazon Web Services
 
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &MLAWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &MLAmazon Web Services
 
Re:cap día 1 del Aws Re:Invent 2023 - AWS UG Chile
Re:cap día 1 del Aws Re:Invent 2023 - AWS UG ChileRe:cap día 1 del Aws Re:Invent 2023 - AWS UG Chile
Re:cap día 1 del Aws Re:Invent 2023 - AWS UG ChileAlvaro Garcia
 
Data Warehousing in the Cloud - AWS Summit Sydney
Data Warehousing in the Cloud - AWS Summit SydneyData Warehousing in the Cloud - AWS Summit Sydney
Data Warehousing in the Cloud - AWS Summit SydneyAmazon Web Services
 
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018Amazon Web Services
 
Deep dive session - how to achieve database freedom
Deep dive session - how to achieve database freedomDeep dive session - how to achieve database freedom
Deep dive session - how to achieve database freedomRitesh Toshniwal
 
What's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdf
What's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdfWhat's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdf
What's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdfAmazon Web Services
 
What's new in Amazon Aurora - ADB203 - Chicago AWS Summit
What's new in Amazon Aurora - ADB203 - Chicago AWS SummitWhat's new in Amazon Aurora - ADB203 - Chicago AWS Summit
What's new in Amazon Aurora - ADB203 - Chicago AWS SummitAmazon Web Services
 
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Amazon Web Services
 
Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...Amazon Web Services
 
How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...
How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...
How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...Amazon Web Services
 
AWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best PracticesAWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best PracticesAmazon Web Services
 
Building a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay NordicsBuilding a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay Nordicsjavier ramirez
 

Similar to Accelerate database development and testing with Amazon Aurora - ADB208 - New York AWS Summit (20)

Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
Accelerate Database Development and Testing with Amazon Aurora (DAT313) - AWS...
 
Migrate and Modernize Your Database
Migrate and Modernize Your DatabaseMigrate and Modernize Your Database
Migrate and Modernize Your Database
 
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWS
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWSAmazon Aurora, funzionalità e best practice per la migrazione di database su AWS
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWS
 
What's new in Amazon Aurora - ADB203 - Atlanta AWS Summit
What's new in Amazon Aurora - ADB203 - Atlanta AWS SummitWhat's new in Amazon Aurora - ADB203 - Atlanta AWS Summit
What's new in Amazon Aurora - ADB203 - Atlanta AWS Summit
 
Amazon Aurora: Database Week SF
Amazon Aurora: Database Week SFAmazon Aurora: Database Week SF
Amazon Aurora: Database Week SF
 
Amazon Aurora
Amazon AuroraAmazon Aurora
Amazon Aurora
 
Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019
Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019
Scalable Relational Databases with Amazon Aurora. Madrid Summit 2019
 
What's New in Amazon Aurora - ADB203 - Anaheim AWS Summit
What's New in Amazon Aurora - ADB203 - Anaheim AWS SummitWhat's New in Amazon Aurora - ADB203 - Anaheim AWS Summit
What's New in Amazon Aurora - ADB203 - Anaheim AWS Summit
 
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &MLAWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
AWS re:Invent Comes to London 2019 - Database, Analytics, AI &ML
 
Re:cap día 1 del Aws Re:Invent 2023 - AWS UG Chile
Re:cap día 1 del Aws Re:Invent 2023 - AWS UG ChileRe:cap día 1 del Aws Re:Invent 2023 - AWS UG Chile
Re:cap día 1 del Aws Re:Invent 2023 - AWS UG Chile
 
Data Warehousing in the Cloud - AWS Summit Sydney
Data Warehousing in the Cloud - AWS Summit SydneyData Warehousing in the Cloud - AWS Summit Sydney
Data Warehousing in the Cloud - AWS Summit Sydney
 
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018
 
Deep dive session - how to achieve database freedom
Deep dive session - how to achieve database freedomDeep dive session - how to achieve database freedom
Deep dive session - how to achieve database freedom
 
What's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdf
What's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdfWhat's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdf
What's new in Amazon Aurora - ADB204 - Santa Clara AWS Summit.pdf
 
What's new in Amazon Aurora - ADB203 - Chicago AWS Summit
What's new in Amazon Aurora - ADB203 - Chicago AWS SummitWhat's new in Amazon Aurora - ADB203 - Chicago AWS Summit
What's new in Amazon Aurora - ADB203 - Chicago AWS Summit
 
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
Aurora Serverless: Scalable, Cost-Effective Application Deployment (DAT336) -...
 
Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...Scale Up and Modernize Your Database with Amazon Relational Database Service ...
Scale Up and Modernize Your Database with Amazon Relational Database Service ...
 
How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...
How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...
How-to-Choose-the-Right-Database-to-Build-High-Performance-Internet-Scale-App...
 
AWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best PracticesAWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best Practices
 
Building a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay NordicsBuilding a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay Nordics
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Accelerate database development and testing with Amazon Aurora - ADB208 - New York AWS Summit

  • 1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Accelerate database development and testing with Amazon Aurora Vlad Vlasceanu Principal Database Specialist SA AWS A D B 2 0 8
  • 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Database development and testing perspective Responsibilities of today’s developers, DevOps, and database admins: • Database architecture • Deployment & automation • Improve dev/test outcomes • Performance and availability focused development • Cost effective development Aurora provides native capabilities to meet these goals
  • 3. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Aurora: Reimaging the relational database Scale-out, distributed architecture using purpose-built storage system Service-oriented architecture leveraging AWS services Fully managed service, automating administrative tasks 1 2 3 Cloud-native capabilities simplify use4 Aurora is fast… 5x more throughput than MySQL; 3x more throughput than PostgreSQL
  • 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon Aurora – key characteristics 1 Log-structured storage volume shared between all cluster nodes 2 Optimized for high throughput3 Readers strictly read-only
  • 6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Core use cases: Read scaling architecture Automatic scaling optional All readers treated the same Any reader can be a failover target Application should use cluster and reader endpoints Dev. tip: Monitor cluster topology for faster failover
  • 7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Core use cases: Separated workloads architecture Each reader used for a specific purpose Ordered failover targeting Application uses cluster, custom or even database instance endpoints Caveat: Readers share the same storage and undo log
  • 8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Automating deployments for Aurora Why? • Reduce the risk of human errors • Repeatable deployments • Accountability and management of change
  • 9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Automating deployments for Aurora Why? • Reduce the risk of human errors • Repeatable deployments • Accountability and management of change How? +
  • 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Deployment automation using AWS CloudFormation AWS CloudFormation: Outcome-driven deployment automation, templates define desired state … but how do you define the state of an Aurora database cluster? Supplement capabilities to match desired processes: Check capability gaps in AWS CloudFormation versus API1 Use AWS CloudFormation custom resources or a master snapshot to bootstrap database (initial users, permissions, schemas) 2 Create alternative automation for workflows that need to be completed with minimal disruption 3
  • 11. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Risk free dev/test, data extracts, and analytics Bad practices we’ve seen • App development and testing on tiny subsets of non-production data • Bulk data exports from live production instances • Running long, unoptimized queries on cluster readers • Lack of outcome focus The right way • Know your features: Point-in-Time Restore, Database Cloning, Backtrack • Proper workload isolation • Test; don’t hope for the best
  • 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Database cloning Get faster access to copies of your data so you can: Test changes in pre-production on relevant datasets Reorganize a database with minimal production impact Save a point-in-time snapshot for data analysis without impacting production systems 1 2 3
  • 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fast database cloning with Aurora Available for both MySQL and PostgreSQL compatible versions of Aurora Creation of clone takes a few minutes Data copy happens only on write, when the original and cloned volume start to differ Operations on clone do not affect the source cluster Up to 15 clones from the same source Pay only for the data storage difference on the clone PRODUCTION DATABASE CLONE CLONE CLONE DEV/TEST APPLICATIONS BENCHMARKS PRODUCTION APPLICATIONS PRODUCTION APPLICATIONS
  • 15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Backtracking databases Easily undo changes to your data: Reduce the risk of database changes at scale Undo unintentional DML and DDL changes Mitigate risk of malicious changes to your data 1 2 3 Avoid time consuming data restore from backups 4
  • 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T How does Backtrack work? • We keep periodic snapshots of each segment; we also preserve the logs • For Backtrack, we identify the appropriate segment snapshots • Apply log streams to segment snapshots in parallel and asynchronously SEGMENT SNAPSHOT CHANGE RECORDS RECOVERY POINT SEGMENT 1 SEGMENT 2 SEGMENT 3 TIME
  • 17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Going back in time with Backtrack t0 t1 t2 t0 t1 t2 t3 t4 t3 t4 Rewind to t1 Rewind to t3 Invisible Invisible • Backtrack is not destructive • You can backtrack multiple times to find the right point in time • Pay for the volume of change records retained for the desired duration (up to 72 hours) • Available for Aurora MySQL 5.6 compatible
  • 18. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Development focused on production scale Bad practices we’ve seen: • App development and testing on tiny subsets of non-production data • My database is always there for me and never fails me • Running long, unoptimized queries on cluster readers • Lack of outcome focus The right way: • Be aware of architectural differences between Aurora and equivalent engines • Know Aurora capabilities and operational procedures: automated failovers, upgrades • Extend Aurora features with application side cluster awareness • Test, don’t hope for the best: failure injection
  • 20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Connection management and availability Minimize failure downtime, and connection management overhead Common MySQL and PostgreSQL drivers are not aware of the cluster or topology Use a client-side connection pool; recycle connections periodically; avoid connection storms Use a smart driver, or build topology awareness in your client data layer, validate connections 1 2 3 Understand the behavior of the Aurora DNS endpoints, manage DNS caching 4
  • 21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Monitor the performance of your queries Establish a baseline of acceptable or preferred query performance Assess performance impact of workload changes Troubleshoot poor performance, identify bottlenecks 1 2 3 Effective capacity planning4
  • 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Database health at a glance Aurora comes with comprehensive monitoring built-in:
  • 23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Database health at a glance Amazon Aurora comes with comprehensive monitoring built-in:
  • 24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Performance Insights Available for both MySQL and PostgreSQL compatible versions of Aurora Easy and powerful dashboard showing load on your database Helps you identify source of bottlenecks: top SQL queries, wait statistics Adjustable time frame (hour, day week, month) Seven days of performance data history free. Perfect for developers; up to two years of long-term retention for production use cases Max CPU
  • 25. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Cost optimized development and testing Use database resources at appropriate scale only when they are needed 1 Development and test activities are rarely continuous 2 Development and test environment isolation3 Scale of development and test activities vary
  • 27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Aurora features helping with cost optimization
  • 28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Aurora features helping with cost optimization
  • 29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Aurora Serverless use cases Development and test databases: • Easily provisioned • Cost savings when databases are not in use • Simplify development and test pipelines Infrequently used applications (e.g., low-volume blog site) Applications with variable load; peaks of activity that are hard to predict (e.g., news site)
  • 30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Aurora Serverless architecture • Application talks to MySQL-compatible endpoint • Fleet of routers manage queue, client connections, and route DB traffic • Instance handles database operations • Data kept durable and highly available on Aurora storage volume • When scaling thresholds are reached, we scale the instance substituting with capacity from warm pool • Scaling operations are transparent to applications • You configure min. and max. capacity, whether and when to pause database if there’s no activity INSTANCE DATABASE STORAGE APPLICATION WARM POOL DATABASE TRAFFIC ROUTERS
  • 31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Aurora Serverless pricing • You pay for the capacity your database consumes while it is active • Database capacity is measured in Aurora Capacity Units (ACUs): 1 ACU ~ 2 Gb of memory with corresponding CPU and network capacity • Flat rate per second of ACU usage, with a minimum of 5 minutes of usage each time the database is activated • Storage and I/O are billed the same as Aurora instances Duration ACUs ACU-Hours Rate Charges 1 hour, 10 minutes, and 15 seconds (1.020 hours) 4 4.08 $0.06 $0.25 40 minutes and 34 seconds (0.676 hours) 8 5.41 $0.06 $0.32 Usage total for 24 hours 9.49 $0.06 $0.57 Usage Rate Charges 9.49 ACU-hours $0.06 per ACU-hour $0.57 80 GB of storage for 24 hours $0.10 per GB-month $0.26 90,000 I/O requests $0.20 per 1 million requests $0.02 Total charges for 24 hours $0.85
  • 32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Introducing the RDS Data API • Public HTTP API endpoint, integrated with AWS authentication • Automated server-side connection pooling • Ideal for AWS Lambda or serverless apps reusing connections across multiple invocations • Fully integrated with AWS Secrets Manager and AWS AppSync • Optional session construct for efficient prepared statement executions • Interactive query editor in the console for ad-hoc queries • Available for Aurora Serverless (MySQL)
  • 33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Parting thoughts Use automation wisely and map out your operational processes in detail Know Aurora’s features and how they can improve on your development and testing process Develop and test with performance in mind 1 2 3 Quantify the expected baseline performance of your workload 4
  • 34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Thank you! S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Vlad Vlasceanu vladv@amazon.com