In this introductory session, we cover how to convert and migrate your relational databases, non-relational databases, and data warehouses to the cloud. AWS Database Migration Service (AWS DMS) and AWS Schema Conversion Tool (AWS SCT) have been used to migrate tens of thousands of databases across the world. This includes homogeneous migrations, such as PostgreSQL to PostgreSQL, and heterogeneous migrations between different database engines, such as Oracle or SQL Server to Amazon Aurora, Amazon DynamoDB, and Amazon Redshift. Learn how to quickly and securely migrate your data and procedural code, enjoy flexibility and cost savings, and minimize the downtime of your applications.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kwesi Edwards
Sr. Business Development Manager, Database Migrations
SRV215
Migrating Databases to the Cloud:
Introduction to AWS DMS

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Cloud migrations and customers
AWS SCT overview
AWS DMS overview
AWS DMS advanced features
Resources
Wrap and Q&A

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Database Migration Service

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Our Customers

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What are AWS DMS and AWS SCT?
AWS Database Migration Service (AWS DMS) easily and securely
migrates and/or replicate your databases and data warehouses to
AWS.
AWS Schema Conversion Tool (AWS SCT) converts your commercial
database and data warehouse schemas to open-source engines or AWS-
native services, such as Amazon Aurora and Amazon Redshift.

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS SCT – Overview
Introduction

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When to use AWS SCT?
Modernize
Modernize your database tier
Modernize and migrate your
Data Warehouse to Amazon
Redshift
Amazon Aurora
Amazon Redshift

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SCT helps with converting tables, views, & code
Sequences
User-defined types
Synonyms
Packages
Stored procedures
Functions
Triggers
Schemas
Tables
Indexes
Views
Sort and distribution keys

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Components of AWS SCT Console
1. Source Schema
2. Action Items
3. Target Schema
4. Schema Element Details
5. Edit Window

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS SCT Migration Assessment Report
• Assessment of migration
compatibility of source databases
with open-source database
engines – Amazon RDS MySQL,
Amazon RDS PostgreSQL and
Amazon Aurora
• Recommends best target engine
• Provides details level of efforts to
complete migration

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS SCT Assessment Report
The migration assessment report includes the following:
Executive summary
License evaluation
Cloud support, indicating any features in the source database not available on
the target.
Current source hardware configuration
Recommendations, including conversion of server objects, backup suggestions,
and linked server changes

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Example:
In this example, this issue occurs 71 times. This doesn’t mean you have to fix
71 issues. Once you figure out the solution, it just needs to be applied to all the
objects.

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS SCT Data Extractors
Extract Data from your data warehouse and migrate to Amazon Redshift
• Extracts data through local migration agents
• Data is optimized for Amazon Redshift and saved in local files
• Files are loaded to an Amazon S3 bucket (through network or AWS Snowball) and then to
Amazon Redshift
Amazon RedshiftAWS SCT S3 Bucket

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS − Overview
Introduction

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When to use AWS DMS*?
Migrate
• Migrate business-critical applications
• Migrate from Classic to VPC
• Migrate data warehouse to Amazon
Redshift
• Upgrade to a minor version
• Consolidate shards into Amazon Aurora
• Archive old data
• Migrate from NoSQL to SQL, SQL to
NoSQL, or NoSQL to NoSQL
Targets:
Amazon Dynamo
DB
Amazon Redshift
Amazon S3
Amazon Aurora
*AWS DMS is a HIPAA-certified service
Amazon S3
Sources:

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
When to use AWS DMS?
Replicate • Create cross-region Read Replicas
• Run your analytics in the cloud
• Keep your dev / test and production
environment sync

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS + AWS Snowball
Common use cases –
• Migrate large databases (over 5 TB)
• Migrate many databases at once
• Migrate over slow network
• Push vs. pull

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer
premises
Application users
AWS
Internet
VPN
Keep your apps running during the migration
Start a replication instance
Connect to source and target
databases
Select tables, schemas, or databases
 Let AWS DMS create tables, load
data, and keep them in sync
 Switch applications over to the
target at your convenience
AWS
DMS

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multi-AZ option for high availability
Customer
premises
or AWS
AWS
Internet
VPN
AWS DMS
AWS DMS

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Change data capture (CDC) and apply
Replication instanceSource Target
Update
t1 t2
t1
t2
Transactions Change
apply after
bulk load

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Source
Take it all − or not
Target
Replication instance

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Homogenous or heterogeneous
SQL Server MySQL
Oracle Oracle
Oracle Amazon S3

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database migration process
Step 1: Convert or copy your schema
Source DB or DW
AWS SCT
Native tool
Destination DB or DW
Step 2: Move your data
Source DB or DW
AWS SCT
Destination DB or DW
AWS DMS

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DMS Advanced Features

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS preflight check

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS preflight check, sample report

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS data validation
• Data validation is optional.
• AWS DMS compares each row in the source with its corresponding row at
the target.
• To enable data validation, set the EnableValidation setting to true.
• ThreadCount : The number of execution threads that AWS DMS uses
during validation.
• The default value for ThreadCount is 5.

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS validation

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS log management

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Native start points

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Resources

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Oracle to Amazon Aurora Migration Playbook
• Topic-by-topic overview of Oracle to Aurora
PostgreSQL migrations and “hand-on” best practices.
• How to migrate from proprietary features and
different database objects.
• Migration best practices.
AWS SCT AWS DMS Playbook
Schema Data Best practices

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Resources available to customers − AWS DMS
Getting Started Guide: Review technical
documentation.
Features and benefits: Highlights DMS
features.
Pricing: Prices for replication instances,
storage, and data transfer.
Support: Post your questions to our Support
forum.
AWS SDK: Java-based API for creating and
managing data migration tasks.
AWS Command Line Interface (AWS CLI): Start
and stop replication tasks with simple
commands.

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Resources available to customers − AWS SCT
User Guide: Review technical docs at
aws.amazon.com/documentation/SchemaConversionTool/
or choose the Download button.
Download area: Get installation files
for the Schema Conversion Tool.
Support forums: Ask questions and review
how-to guides.
https://forums.aws.amazon.com/forum.jspa?forumID=208.

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pointers for AWS DMS
Blogs
• How to Migrate Your Oracle Database to PostgreSQL
• DMS Best Practices
• How to Migrate from Oracle ASM to AWS using AWS DMS
• Debugging Your AWS DMS Migrations: What to Do When Things Go Wrong (Part 1)
• Debugging Your AWS DMS Migrations: What to Do When Things Go Wrong (Part 2)
• Debugging Your AWS DMS Migrations: What to Do When Things Go Wrong (Part 3)
Webinars
• “Consolidate MySQL Shards Into Amazon Aurora Using AWS Database Migration Service”
• “Migrate from SQL Server or Oracle into Amazon Aurora using AWS Database Migration Service”
Github repository: https://github.com/awslabs/aws-database-migration-tools
https://github.com/awslabs/aws-database-migration-samples

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Learn more
aws.amazon.com/dms
Thank you!

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Submit session feedback
1. Tap the Schedule icon.
2. Select the session you
attended.
3. Tap Session Evaluation to
submit your feedback.