1© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved | 1© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Digital Transformation Day
Kuwait
Application and Database Migration
Workshop
Aneesh Mohan
AWS Solutions Architect
16-Dec-19
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migrate existing
apps to the cloud
Quickly build new
apps in the cloud
Gain new
insights
Three type of projects
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migrate existing apps to the cloud
Migrate existing
apps to the cloud
Quickly build new
apps in the cloud
Gain new
insights
4© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved | 4© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Digital Transformation Day
Kuwait
Using CloudEndure
Application Migration
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Simplify and Accelerate Migration With CloudEndure
• Designed for rapid, large-scale migrations
• Simple setup lets you get started in minutes
• Same highly automated process for any workload
• Common workloads include databases such as
Microsoft SQL Server, Oracle, and MySQL, and
enterprise applications such as SAP
• Eliminates complexity and reduces risk
• Migrate with minimal business disruption
Highly Automated
Short Cutover
Windows With
Minimal Downtime
Minimal Skill Set
Required to Operate
Easily Plugs Into
Migration Factories
and Cloud COEs
Easy, Non-
Disruptive Tests
Prior to Cutover
Reliable
Robust, Predictable,
Non-Disruptive
Continuous Replication
Highly Secure
for Regulated
Environments
Migrate From
Any Source
Flexible
Option to
Migrate Back
Wide Range of OS,
Application, and
Database Support
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
How CloudEndure Migration Works
• Continuously replicates any application or database from any source into AWS
• Business outcome: self-service, rapid, reliable migrations with minimal business disruption
7© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
C l o u d E n d u r e D E M O
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
Physical
Data Centers
Wide Platform Support*
Any
Application
Any
Database
x86 Operating
Systems
Source
Infrastructure
* See documentation or contact Support for a complete list.
Windows
Workstations
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential
CloudEndure Migration Success Stories
• Continuous replication of large servers, filers, and Oracle-based legacy applications
• Cutover was complete within minutes with no system disruption
• End users were unaware of the migration, and business continued as usual
• Complete self-service migration as part of MAP program; finished on schedule
• Legacy applications running on ~1,000 Windows servers of various versions
• Automated lift-and-shift with no performance disruption
• 100% success in migrating all workloads
• After deploying CloudEndure Disaster Recovery, Malibu Boats experienced an outage
• Failover to AWS in recovery mode resulted in 2x faster performance in the cloud
• Led to a business decision to significantly expedite migration to AWS
• Accelerated migration of ~3,000 servers with COTS applications
• Multiple sources (mix of virtual and physical, different OS types and versions)
• Significant cost savings by retiring legacy infrastructure
• ProServe provided cloud skills training
10© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved | 10© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Digital Transformation Day
Kuwait
Using AWS Database Migration Service
Database Migration
11© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
What are DMS and SCT?
Our goal: Allow customers the freedom to choose the best data platform for
their needs #DBFreedom
AWS Schema Conversion Tool converts your commercial database
and data warehouse schemas to open-source engines or AWS-
native services, such as Amazon Aurora and Amazon Redshift
AWS Database Migration Service easily and securely
migrates and/or replicate your databases and data
warehouses to AWS
12© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Simple to use
No drivers or applications to install
No changes to the source database in most cases
Just a few clicks to start a migration from the console
DMS manages the complexities of migration for you
Automatically replicate changes
Can be used for continuous replication
13© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Fast and easy to setup
Set up a migration task in minutes
Connect to the
source
database
Connect to the
target
database
Create a
replication
instance to run
the migration
Create a task Run the task
You can use different tasks with different settings for different environments.
14© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Homogenous or heterogeneous
Replication
Instance
SQL Server MySQL
Replication
Instance
Oracle Oracle
Replication
Instance
Oracle PostgreSQL
15© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Supports widely used databases
Sources* Targets**
Oracle Oracle
SQL Server SQL Server
Azure SQL PostgreSQL
PostgreSQL MySQL
MySQL Amazon Redshift
SAP ASE SAP ASE
MongoDB Amazon S3
Amazon S3 Amazon DynamoDB
IBM DB2 Amazon Kinesis
Amazon ElasticSearch
On-premises
database
https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.html
https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.html
*
**
On-premises
database
16© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
When to use DMS and SCT?
Modernize Migrate Replicate
17© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
D M S D E M O
Migrating Oracle DB to Aurora PostgreSQL
18© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Possible migration preparation scenarios
Using DMS alone
• DMS creates tables and primary keys using Drop tables on target
• Manually add secondary indexes and foreign key objects after initial load has
completed.
Using SCT and DMS together
• Use Schema Conversion Tool to create all objects
• Disable secondary indexes and foreign key objects
• Load using DMS using Do nothing
• Re-enable secondary indexes and foreign key objects
Using Native Tools and DMS
• Use database scripts to create tables, primary keys, views, and sequences
• Load tables with DMS using Truncate
• Manually add secondary indexes and foreign key objects after initial load has
completed
19© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
General Steps:
Full Load + CDC:
• Migrate schema with SCT
• Drop all FK constraints/indexes on target
• Initiate full load using DMS
• Stop task (can do this automatically via task settings)
• Create secondary indexes
• Resume task to apply cached changes
• Enable Foreign keys
• Start Change Data Capture.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS – Endpoint Support
Amazon
Redshift
Amazon
DynamoDB
Amazon S3
Amazon S3
Amazon
Aurora
Amazon
Aurora
Oracle SQL Server Netezza
Greenplum Vertica Teradata
AWS Snowball
Edge
MongoDB Cassandra
Amazon ES Amazon
Kinesis
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customers are migrating their workloads to AWS
Verizon is migrating over 1,000 business-critical applications and database backend systems to
AWS, several of which also include the migration of production databases to Amazon Aurora.
Wappa migrated from their Oracle database to Amazon Aurora and improved their
reporting time per user by 75 percent.
Trimble migrated their Oracle databases to Amazon RDS and project they will pay about 1/4th
of what they paid when managing their private infrastructure.
Intuit migrated from Microsoft SQL Server to Amazon Redshift to reduce data-processing
timelines and get insights to decision makers faster and more frequently.
Equinox Fitness migrated its Teradata on-premises data warehouse to Amazon Redshift. They went
from static reports to a modern data lake that delivers dynamic reports.
Eventbrite moved from Cloudera to Amazon EMR and were able to cut costs dramatically, spinning
clusters up/down on-demand and using Spot (saving > 80%) and Reserved Instances.
By December 2018, Amazon.com will have migrated 88% of their Oracle DBs (and 97% of
critical system DBs) moved to Amazon Aurora and Amazon DynamoDB. They also migrated
their 50 PB Oracle Data Warehouse to AWS (Amazon S3, Amazon Redshift, and Amazon EMR).
Samsung Electronics migrated their Cassandra clusters to Amazon DynamoDB for their
Samsung Cloud workload with 70% cost savings.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
>110,000 databases migrated with DMS
23© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved |
Thank you!

Application and database migration workshop

  • 1.
    1© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | 1© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved | Digital Transformation Day Kuwait Application and Database Migration Workshop Aneesh Mohan AWS Solutions Architect 16-Dec-19
  • 2.
    © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Migrate existing apps to the cloud Quickly build new apps in the cloud Gain new insights Three type of projects
  • 3.
    © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Migrate existing apps to the cloud Migrate existing apps to the cloud Quickly build new apps in the cloud Gain new insights
  • 4.
    4© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | 4© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved | Digital Transformation Day Kuwait Using CloudEndure Application Migration
  • 5.
    © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Simplify and Accelerate Migration With CloudEndure • Designed for rapid, large-scale migrations • Simple setup lets you get started in minutes • Same highly automated process for any workload • Common workloads include databases such as Microsoft SQL Server, Oracle, and MySQL, and enterprise applications such as SAP • Eliminates complexity and reduces risk • Migrate with minimal business disruption Highly Automated Short Cutover Windows With Minimal Downtime Minimal Skill Set Required to Operate Easily Plugs Into Migration Factories and Cloud COEs Easy, Non- Disruptive Tests Prior to Cutover Reliable Robust, Predictable, Non-Disruptive Continuous Replication Highly Secure for Regulated Environments Migrate From Any Source Flexible Option to Migrate Back Wide Range of OS, Application, and Database Support
  • 6.
    © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential How CloudEndure Migration Works • Continuously replicates any application or database from any source into AWS • Business outcome: self-service, rapid, reliable migrations with minimal business disruption
  • 7.
    7© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | C l o u d E n d u r e D E M O
  • 8.
    © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential Physical Data Centers Wide Platform Support* Any Application Any Database x86 Operating Systems Source Infrastructure * See documentation or contact Support for a complete list. Windows Workstations
  • 9.
    © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential CloudEndure Migration Success Stories • Continuous replication of large servers, filers, and Oracle-based legacy applications • Cutover was complete within minutes with no system disruption • End users were unaware of the migration, and business continued as usual • Complete self-service migration as part of MAP program; finished on schedule • Legacy applications running on ~1,000 Windows servers of various versions • Automated lift-and-shift with no performance disruption • 100% success in migrating all workloads • After deploying CloudEndure Disaster Recovery, Malibu Boats experienced an outage • Failover to AWS in recovery mode resulted in 2x faster performance in the cloud • Led to a business decision to significantly expedite migration to AWS • Accelerated migration of ~3,000 servers with COTS applications • Multiple sources (mix of virtual and physical, different OS types and versions) • Significant cost savings by retiring legacy infrastructure • ProServe provided cloud skills training
  • 10.
    10© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | 10© 2019 Amazon Web Services, Inc. or its affiliates. All rights reserved | Digital Transformation Day Kuwait Using AWS Database Migration Service Database Migration
  • 11.
    11© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | What are DMS and SCT? Our goal: Allow customers the freedom to choose the best data platform for their needs #DBFreedom AWS Schema Conversion Tool converts your commercial database and data warehouse schemas to open-source engines or AWS- native services, such as Amazon Aurora and Amazon Redshift AWS Database Migration Service easily and securely migrates and/or replicate your databases and data warehouses to AWS
  • 12.
    12© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | Simple to use No drivers or applications to install No changes to the source database in most cases Just a few clicks to start a migration from the console DMS manages the complexities of migration for you Automatically replicate changes Can be used for continuous replication
  • 13.
    13© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | Fast and easy to setup Set up a migration task in minutes Connect to the source database Connect to the target database Create a replication instance to run the migration Create a task Run the task You can use different tasks with different settings for different environments.
  • 14.
    14© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | Homogenous or heterogeneous Replication Instance SQL Server MySQL Replication Instance Oracle Oracle Replication Instance Oracle PostgreSQL
  • 15.
    15© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | Supports widely used databases Sources* Targets** Oracle Oracle SQL Server SQL Server Azure SQL PostgreSQL PostgreSQL MySQL MySQL Amazon Redshift SAP ASE SAP ASE MongoDB Amazon S3 Amazon S3 Amazon DynamoDB IBM DB2 Amazon Kinesis Amazon ElasticSearch On-premises database https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Source.html https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.html * ** On-premises database
  • 16.
    16© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | When to use DMS and SCT? Modernize Migrate Replicate
  • 17.
    17© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | D M S D E M O Migrating Oracle DB to Aurora PostgreSQL
  • 18.
    18© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | Possible migration preparation scenarios Using DMS alone • DMS creates tables and primary keys using Drop tables on target • Manually add secondary indexes and foreign key objects after initial load has completed. Using SCT and DMS together • Use Schema Conversion Tool to create all objects • Disable secondary indexes and foreign key objects • Load using DMS using Do nothing • Re-enable secondary indexes and foreign key objects Using Native Tools and DMS • Use database scripts to create tables, primary keys, views, and sequences • Load tables with DMS using Truncate • Manually add secondary indexes and foreign key objects after initial load has completed
  • 19.
    19© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | General Steps: Full Load + CDC: • Migrate schema with SCT • Drop all FK constraints/indexes on target • Initiate full load using DMS • Stop task (can do this automatically via task settings) • Create secondary indexes • Resume task to apply cached changes • Enable Foreign keys • Start Change Data Capture.
  • 20.
    © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS DMS – Endpoint Support Amazon Redshift Amazon DynamoDB Amazon S3 Amazon S3 Amazon Aurora Amazon Aurora Oracle SQL Server Netezza Greenplum Vertica Teradata AWS Snowball Edge MongoDB Cassandra Amazon ES Amazon Kinesis
  • 21.
    © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Customers are migrating their workloads to AWS Verizon is migrating over 1,000 business-critical applications and database backend systems to AWS, several of which also include the migration of production databases to Amazon Aurora. Wappa migrated from their Oracle database to Amazon Aurora and improved their reporting time per user by 75 percent. Trimble migrated their Oracle databases to Amazon RDS and project they will pay about 1/4th of what they paid when managing their private infrastructure. Intuit migrated from Microsoft SQL Server to Amazon Redshift to reduce data-processing timelines and get insights to decision makers faster and more frequently. Equinox Fitness migrated its Teradata on-premises data warehouse to Amazon Redshift. They went from static reports to a modern data lake that delivers dynamic reports. Eventbrite moved from Cloudera to Amazon EMR and were able to cut costs dramatically, spinning clusters up/down on-demand and using Spot (saving > 80%) and Reserved Instances. By December 2018, Amazon.com will have migrated 88% of their Oracle DBs (and 97% of critical system DBs) moved to Amazon Aurora and Amazon DynamoDB. They also migrated their 50 PB Oracle Data Warehouse to AWS (Amazon S3, Amazon Redshift, and Amazon EMR). Samsung Electronics migrated their Cassandra clusters to Amazon DynamoDB for their Samsung Cloud workload with 70% cost savings.
  • 22.
    © 2018, AmazonWeb Services, Inc. or its affiliates. All rights reserved. >110,000 databases migrated with DMS
  • 23.
    23© 2019 AmazonWeb Services, Inc. or its affiliates. All rights reserved | Thank you!