Changing database engines is often daunting to customers. However, the value of a highly scalable, cost-effective, and fully managed service, such as Amazon Aurora, can make the challenge worth it. In this hand-on lab, we demonstrate how to take advantage of the AWS Schema Conversion Tool (SCT) and AWS Database Migration Service (DMS) to facilitate and simplify migrating an Oracle database to the Amazon Aurora PostgreSQL-compatible Edition. We connect to an Oracle (source) and a PostgreSQL (target) instance, and convert the Oracle database schema and code objects to PostgreSQL using AWS SCT. Then, we migrate and replicate the data using AWS DMS. AWS credits are provided. Bring your laptop, and have an active AWS account.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENTU s e A W S D M S t o S e c u r e l y M i g r a t e Y o u r O r a c l e D a t a b a s e t o
A m a z o n A u r o r a w i t h M i n i m a l D o w n t i m e
Ramya Kaushik
Arun Thiagarajan
N o v e m b e r 3 0 , 2 0 1 7
DAT343

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What to Expect from This Session
• Learn about AWS Schema Conversion Tool (AWS SCT)
• Learn about AWS Database Migration Service (AWS DMS)
• General Workflow of a Typical Database Migration
• AWS Migration Hub
• Hands on Lab—Oracle RDS  Amazon Aurora PostgreSQL

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Database Migration Process

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Database Migration Process
Step 1: Convert or copy your schema
Source DB or DW
AWS SCT
Native Tool
Destination DB or DW
Step 2: Move your data
Source DB or DW
AWS SCT
Destination DB or DW
AWS DMS

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Schema Conversion Tool

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Schema Conversion Tool (AWS SCT)
• Client-side tool
• Database schema and code conversion service
• OLTP schema or data warehouse schema
• Converts embedded SQL statements too
• Creates a conversion report
• Helps choose the best target engine

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS SCT—OLTP Sources and Targets
Source Database Target Database
Microsoft SQL Server (version 2008 and
later)
Amazon Aurora (MySQL or PostgreSQL),
Microsoft SQL Server, MySQL, PostgreSQL
MySQL (version 5.6 and later)
Amazon Aurora PostgreSQL, MySQL,
PostgreSQL
Oracle (version 10.2 and later)
Amazon Aurora (MySQL or PostgreSQL),
MySQL, Oracle, PostgreSQL
PostgreSQL (version 9.1 and later)
Amazon Aurora MySQL, MySQL,
PostgreSQL

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS SCT—DW Sources and Targets
Source Database Target Database
Greenplum Database (version 4.3 and later) Amazon Redshift
Microsoft SQL Server (version 2008 and
later)
Amazon Redshift
Netezza (version 7.2 and later) Amazon Redshift
Oracle (version 11 and later) Amazon Redshift
Teradata (version 14 and later) Amazon Redshift
Vertica (version 7.2.2 and later) Amazon Redshift

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS SCT Assessment Report
• Assessment of migration
compatibility of source databases
with open-source database
engines – RDS MySQL, RDS
PostgreSQL and Aurora
• Recommends best target engine
• Provides details level of efforts to
complete migration

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS SCT Helps with Converting Tables, Views, and
Code
Sequences
User-defined types
Synonyms
Packages
Stored procedures
Functions
Triggers
Schemas
Tables
Indexes
Views
Sort and distribution keys

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Database Migration Service

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Database Migration Service (DMS)
Modernize Migrate Replicate
Modernize your database tier –
• Commercial to open-source
• Commercial to Amazon Aurora
Modernize your data warehouse –
• Commercial to Amazon Redshift
• Migrate business-critical apps
• Migrate from Classic to VPC
• Migrate data warehouse to
Amazon Redshift
• Upgrade to a minor version
• Consolidate shards into Amazon
Aurora
• Create cross-regions read replicas
• Run your analytics in the cloud
• Keep your dev/test and production
environment in sync

13. Why use DMS and SCT?
Secure
Cost Effective
Remove Barriers
to Entry
Allow DB
Freedom
Keep a Leg in
the Cloud
Easy to Use, but
Sophisticated…
Near-Zero
Downtime

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DMS—Sources and Targets
Sources Targets
Oracle Oracle
MS SQL Server MS SQL Server
MySQL MySQL
MariaDB MariaDB
MongoDB PostgreSQL
Amazon Aurora Amazon Aurora
SAP ASE SAP ASE
PostgreSQL Amazon S3
Azure SQL Amazon Redshift
Amazon S3 Amazon DynamoDB

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How does AWS DMS work?
Customer
premises
Application users
AWS
Internet
VPN
Start a replication instance
Connect to source and target
databases
Create tasks
 Let AWS DMS create tables,
load data, and keep them in
sync
 Switch applications over to
the target at your convenience
AWS
DMS

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Multi-AZ Option for High Availability
Customer
premises
or AWS
AWS
Internet
VPN
AWS DMS
AWS DMS

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DMS Phases during Full Load + CDC
• Bulk load
• Application of cached changes
• Transactional apply

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How Full Load Works
Replication instance
Source Target
Load is table by table

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Change Data Capture(CDC) and Apply
Replication instanceSource Target
Update
t1 t2
t1
t2
Transactions Change
apply
after bulk
load

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS DMS Components
• Replication instance
• Tasks
• Endpoints
• Source
• Target

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What else I can do? – Fan In
Source Target
Source
Source

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What else I can do? – Fan Out
Source Target
Target
Target

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What else I can do? – Take it all or not
Source Target

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What else I can do?
SQL Server MySQL
Oracle Oracle
Oracle Aurora

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Important Things to Remember
• Enable supplemental logging on the Oracle database
• Disable foreign keys, triggers during full load
• Name notations
• Create secondary indexes during applied cached changes and replicating
ongoing changes
• Data type mismatches

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
General Workflow—Full Load + CDC
• Migrate schema with SCT
• Drop all FK constraints/indexes on target
• Initiate full load using DMS
• Stop task (can do this automatically with task settings)
• Create secondary indexes
• Resume task to apply cached changes
• Enable foreign keys
• Start change data capture

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Migration Hu b
Simp lify and Acce le rate Mig ration Ex e cu tion
A single location to track the progress of application migrations across AWS and partner solutions
AWS Database
Migration Service

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Further Reading
Blogs
• How to Migrate Your Oracle Database to PostgreSQL
• Migrating Oracle Database from On-Premises or Amazon EC2 Instances to Amazon Redshift
• Using the AWS Database Migration Service, Amazon S3, and AWS Lambda for Database Analytics
• How to Migrate Your Oracle Data Warehouse to Amazon Redshift Using AWS SCT and AWS DMS
• Reduce Resource Consumption by Consolidating Your Sharded System into Aurora
• Set Up AWS DMS for Cross-Account Migration
Webinars
• “Consolidate MySQL Shards into Amazon Aurora Using AWS Database Migration Service”
• “Migrate from SQL Server or Oracle into Amazon Aurora using AWS Database Migration Service”
Cookbook (Q4): step-by-step guide how to migrate Oracle to Aurora PostgreSQL

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Oracle to PostgreSQL Replication
Oracle private DC to RDS PostgreSQL migration
Used the AWS Schema Conversion Tool to
convert their database schema
Used on-going replication (CDC) to keep
databases in sync until they reached the cutover
window
Benefits:
• Improved reliability of the cloud environment
• Savings on Oracle licensing costs
• SCT Assessment Report let them understand
the scope of the migration

30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Oracle RAC to PostgreSQL Replication
Our goal is to improve lives one smile at a time…
Replicate Oracle RAC to RDS for PostgreSQL
Replicate PostgreSQL to Amazon Redshift
• Higher performance without the Oracle cost
• Ability to split the data and keep master tables in
sync
• Use SCT to begin the modernization journey
“DMS is a great product. From looking at the product to getting it in production takes no time
at all. Its simple to use and reliable. The flexibility of creating new tasks is not very time
consuming and just works.”

31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hands-on Lab
Oracle to Amazon Aurora PostgreSQL

32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hands on Lab Instructions
Today’s lab http://bit.ly/2i1lAUc
Lab with CloudFormation template http://bit.ly/2zQkiXm

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!