Database Week at the San Francisco Loft Open Source Databases on the Cloud Amazon Relational Database Service (Amazon RDS) makes it easy to set up, operate, and scale a relational database in the cloud. In this session we'll look at open source databases supported by Amazon RDS. Level: 200 Speakers: Amy Che - Sr. Solutions Delivery Manager, AWS Ben Romano - Associate Solutions Architect, AWS

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Pop-up Loft
Open Source Managed Databases
Amy Che
Principal Solutions Delivery Manager
Ben Romano
Solutions Architect

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Agenda
• Why Use Open Source Databases on RDS?
• Review of RDS Open Source Databases Best Practices
• MySQL/MariaDB
§ Fast Facts
§ Engine Specific Best Practices
• PostgreSQL
• Fast Facts
• Engine Specific Best Practices
• Summary

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Why Use Open Source Databases on RDS?
• All the great features of RDS
§ Managed high availability and disaster recovery
§ Push button provisioning and scaling
§ Lower TCO because we manage the muck (patching, upgrades)
• No licenses necessary!
• Power enterprise applications with Amazon Aurora
• Built to meet your compliance needs (HIPAA, PCI, plus many more)
• No licenses necessary!

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
RDS Best Practices - Replication
• Multi-AZ Configurations
§ High availability for planned and unplanned events
§ Synchronous replication to standby in another Availability Zone
§ Automated failover if primary is unavailable
• Read Replicas
§ Scale read capacity or reduce geographic latency
§ Support for managed replication chaining (source > target > target)
• Replica in one region and then a cross-region replica in another region
§ Replicas can be made writeable
§ RDS instances support non-managed replication
• Useful for on-premises to RDS, EC2 to RDS scenarios
• Uses stored procedures rather than service API for management

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
RDS Best Practices - Storage
• Storage Types
§ Magnetic, General Purpose (GP2), Provisioned IOPS (PIOPS)
• Generally recommend an SSD-based storage type (GP2, PIOPS)
• Proper type of storage can be crucial for I/O intensive operations
§ Crash recovery
§ Engine Upgrades
§ DDL

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
RDS Best Practices - Monitoring
• Amazon CloudWatch
• Database Log Files
§ Available to view/download in the console
• RDS Enhanced Monitoring
§ Additional information for tuning and troubleshooting

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
RDS Performance Insights (New!)
• Provides monitoring and tuning guidance for queries
• Useful for both IT generalists and DB experts
• Lightweight collection methods don’t impact application performance

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
MySQL/MariaDB

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Managed MySQL Compatible Engines on AWS
The popular open
source MySQL
The popular
community choice
Amazon Aurora
MySQL
The fastest MySQL
compatible engine

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• World’s most commonly used open-source relational database
§ Used in many open source applications such as WordPress, Joomla, and
Drupal
• History
§ First released in 1995 in Sweden by MySQL AB
§ Acquired by Sun in 2008
§ Launched as first Amazon RDS engine in 2009
§ Acquired by Oracle in 2010
• Popular Branches
§ MySQL Community Edition
§ MySQL Enterprise Edition
§ MariaDB Server
§ Amazon Aurora MySQL
MySQL Fast Facts

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
MySQL Is the ‘M’ in the LAMP Stack

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• History
§ Forked from MySQL at version 5.1
§ Actively maintained by “MariaDB Foundation”
• Differences from MySQL
§ Generally considered a drop-in replacement, but some divergences
§ Broader selection of storage engines
§ GTID implementation (affects replication compatibility)
§ Faster incorporation of patches, updates and features
MariaDB Fast Facts

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
RDS MySQL
• Support for MySQL Community Edition
§ Current versions are 5.5.61, 5.6.41, and 5.7.23
• InnoDB and MyISAM storage engines
• Version 5.7 - New Features
§ JSON support
§ Query optimizer improvements
§ GIS extensions
§ Improved parallel replication
§ Dynamic buffer pool resizing
• Version 8.0 coming soon
Amazon RDS

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
RDS MariaDB
• Support for MariaDB Server
§ Current versions are 10.0.35, 10.1.34, and 10.2.15
• Same instance, regions, pricing as RDS MySQL (including free tier)
• InnoDB, XtraDB and Aria storage engines
• Version 10.2 - New Features
§ InnoDB now default storage engine
§ Multiple triggers on the same event
§ Auto-partition of table cache
Amazon RDS

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
MySQL & MariaDB Best Practices – Data Loading
• Turn off backup retention (disables binlog)
• Turn off autocommit mode
• Drop indexes and disable foreign keys
• For EBS-based engines
§ Use EBS-optimized instance types
§ Maximize storage IOPS
• Optimize parameter settings
§ innodb_flush_log_at_trx_commit, innodb_io_capacity,
innodb_io_read_threads, innodb_io_write_threads, sync_binlog
• Remember to reset settings after load completes!

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
MySQL & MariaDB Best Practices – Migration
• Bulk Load
§ Create full or incremental backup
with Percona XtraBackup 2.3, mysqldump
§ Upload backup to Amazon S3
§ Import backup From Amazon S3
• New for RDS MySQL
• Use AWS IAM role to access S3 bucket
§ Use replication to catch up to changes in the
source database (if necessary)
• Replication
§ Native replication tools
§ AWS Database Migration Service

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
MySQL & MariaDB Best Practices - Monitoring
• Enable MySQL general and slow query logs for troubleshooting
§ Logs can be written to a CSV table or file
§ Use stored procedures to rotate logs
• mysql.rds_rotate_general_log, mysql.rds_rotate_slow_log
§ Consider also using Performance Insights
• MariaDB Audit Plug-in for MariaDB and MySQL
§ Available via RDS option group
§ Provides customer configurable event logging for database activity
• Auditable events include logins, queries, and tables accessed
• Individual users can be included or excluded from the audit
§ Can impact server performance up to 10% for full logs

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Amazon RDS allowed us to focus
a little less on MySQL
administration and a little more
scaling out the rest of our service."
- Joey Parsons
Head of Operations at Flipboard
”
“
Flipboard is one of the world's first social magazines. Inspired
by the beauty and ease of print media, the company’s mission
is to fundamentally improve how people discover, view, and
share content across their social networks.
• From the beginning, Flipboard has
run its infrastructure on Amazon Web
Services
• One key decision was to use MySQL,
and in turn, Amazon RDS
• Flipboard uses Amazon RDS for
MySQL and its Multi-AZ capabilities
to store mission critical user data
• Key features are auto minor version
upgrade, automatic backups, easy
restores, and the ability to spin up
read replicas to add capacity
Customer Story: Flipboard

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
PostgreSQL

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• Object-Relational DBMS
• History
§ Born out of Ingres Project at Cal Berkeley
§ Actively maintained by “The PostgreSQL Global Development Group”
• Popular Features
§ Broad language support (Java, Perl, Python, Ruby and more)
§ Most geospatial features of any open-source database
§ Available on Amazon Aurora PostgreSQL
• Oracle Migration Compatibility
§ Most Oracle-compatible open-source database
§ Highest AWS Schema Conversion Tool auto-conversion rates
PostgreSQL Fast Facts

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
RDS PostgreSQL
• Current versions are 9.3.23, 9.4.18, 9.5.13, 9.6.9, and 10.4.1
• Version 11.0
§ Available in Preview
• Dev/Test Environments
§ New Features
• Embedded transactions in SQL stored procedures
• Improvements to parallelism
• Improvements to partitioning
• Supports many PostgreSQL extensions and modules
Amazon RDS

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PostgreSQL Best Practices – Data Loading
• Increase maintenance_work_mem
• Turn off auto-vacuum
• Turn off synchronous_commit
• Increase checkpoint_segments, checkpoint_timeout
• For EBS-based engines
§ Use EBS-optimized instance types
§ Maximize storage IOPS
• Remember to reset settings after load completes!

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PostgreSQL Best Practices – Migration
• Bulk Load
§ Create backup with pg_dump
§ Restore with pg_restore
§ Use replication to catch up to changes in the
source database (if necessary)
• Replication
§ Native replication tools for minimizing downtime
§ AWS Database Migration Services

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
PostgresSQL Best Practices - Monitoring
• pg_audit
• Detailed session and object audit logging
• pg_stat_statements
• Monitor query usage and performance
SELECT * from pg_stat_statements order by total_time DESC;
-[ RECORD 2 ]-------+--------
userid | 16388
dbid | 16464
queryid | 4286627671
query | UPDATE pgbench_accounts SET abalance = abalance + ? WHERE aid = ?;
calls | 165125
total_time | 5251.54200000001
min_time | 0.015
max_time | 5.558
mean_time | 0.0318034337623008
stddev_time | 0.0369181019548524
rows | 165125

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Pop-up Loft
aws.amazon.com/activate
Everything and Anything Startups
Need to Get Started on AWS