AWS Database Migration Strategies

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Enterprise Database Migration
Strategies and Options on AWS
Ivan Cheng (鄭志帆)
Solutions Architect
AWS

Purpose-built
Purpose-built
databases and
analytic engines.
Right tool for the right
job

Purpose-built databases
Relational Key-value Document In-memory Graph Time-series Ledger
DynamoDB NeptuneAmazon
RDS
Aurora CommercialCommunity
Timestream QLDBElastiCacheDocumentD
B

Our portfolio
Broad and deep portfolio, purpose-built for builders
Redshift
Data warehousing
EMR
Hadoop + Spark
Athena
Interactive analytics
Kinesis Data
Analytics Real time
Elasticsearch Service
Operational Analytics
RDS
MySQL, PostgreSQL,
MariaDB, Oracle, SQL Server
Aurora
MySQL, PostgreSQL
QuickSight SageMaker
DynamoDB
Key value
ElastiCache
Redis, Memcached
Neptune
Graph
Timestream
Time Series
QLDB
Ledger Database
S3/Glacier
Glue
ETL & Data Catalog
Lake Formation
Data Lakes
Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams
Data Movement
Analytics Databases
Business Intelligence & Machine Learning
Data Lake
Managed
Blockchain
Blockchain
Templates
Blockchain
RDS on VMware
DocumentDB
Document

Most enterprise database & analytics cloud
customers

Challenges with on-premises deployments
Large CapEx investments needed in data centers and servers
IT resources needed to rack, stack, power servers
Overbuying and guessing on future capacity needs
Manual maintenance (software upgrades, etc.)

Customers want to migrate to the cloud
Relational
databases
Non-relational
databases
Data
warehouses
Hadoop
and Spark
Redshif
t
EM
R
Operational
analytics
Elasticsearch
ServiceAuror
a
DynamoD
B
Business
Intelligence
QuickSightRDS DocumentDB

Common migration strategies (the Six Rs)

3 Types of database migrations
• Purpose Built
• AWS Cloud native managed database
services
• Migrate to Aurora, RDS Open Source
Databases, Redshift, DynamoDB, etc
• Reduced licensing costs
Refactor
Adopt cloud-native services
• Managed Service
• Auto provisioning, backups,
recovery, patching
• Reduce undifferentiated heavy
lifting
• Proven high availability
Replatform
Amazon RDS
• Familiar administration experience
• Full control over the environment
• Quickest way to onboard workloads
Rehost (Lift and Shift)
Amazon EC2

As a managed service using
Amazon RDS
Self-managed using
Amazon EC2
Relational Databases on AWS

App optimization
Scaling
High availability
Database backups
DB software patching
DB software install
OS patching
OS install
Server maintenance
Hardware lifecycle
Power/network/HVAC
Amazon EC2
App optimization
Scaling
High availability
Database backups
DB software patching
DB software install
OS patching
OS install
Amazon RDS
App optimization
Youmanage

Amazon Relational Database Service (RDS)
Managed relational database service with a choice of six popular database engines
Easy to administer Available and durable Highly scalable Fast and secure
No need for infrastructure
provisioning, installing, and
maintaining DB software
Automatic Multi-AZ data
replication; automated backup,
snapshots, failover
Scale database compute
and storage with a few
clicks with no app
downtime
SSD storage and guaranteed
provisioned I/O; data
encryption at rest and in
transit

Region
Availability zone A Availability zone B
DB Instance DB instance
standby
Volume Volume
RDS monitoring and automation
DB instance
standby
DB Instance

Read Replicas
Read scaling and disaster recovery
RDS for Oracle, MySQL,
PostgreSQL, MariaDB, Aurora
• Relieve pressure on your master node with
additional read capacity
• Bring data close to your applications
in different regions
• Promote a read replica to a master for faster
recovery in the event of disaster
Asynchronous
replication
BI/reporting
application server
Read only
Read/write Primary
Read replica

Amazon EC2 might be a better choice for you if
• You need full control over the database, including SYS/SYSTEM user access, or
you need access at the operating system level.
• Your database size exceeds the 80% of current maximum database size in Amazon
RDS.
• You need to use specific DB engine features or options that are not currently
supported by Amazon RDS. See the documentation for currently supported options
in Amazon RDS.
• Your database IOPS needs are higher than the current IOPS limit. See the
documentation for the current IOPS limit.
• You need a specific Engine Database version that is not supported by Amazon
RDS. For more information, see Amazon RDS Database Editions

Oracle DBA time spent
On-Premises
Platform
Access
Monitoring
Database
App
Amazon RDS

Recent Releases – Amazon RDS for Oracle
• 64TiB Maximum Storage Size
New / existing Amazon RDS for Oracle database instances with up to 64TiB of storage.
• X1/X1e Instance Types
Provides a high ratio of memory to vCPU.
• T3 Instance Types
Burstable general-purpose instance type ideal for database workloads with moderate CPU usage that experience temporary
spikes in use.
• Optimize CPU
Provides ways to enhance the value of your Oracle DB licenses: you can specify a custom number of cores , and you can disable
Intel Hyper-Threading (HT) Technology.
• Support Read Replicas
With Active Data Guard, you can create up to five read replicas allows offload read workload from the primary DB Instance.

Australia Finance Group’s Journey to Cloud
Databases: Migrating from Oracle Exadata to
Amazon RDS
https://aws.amazon.com/blogs/database/australia-finance-groups-journey-to-cloud-databases/
“More than 80 percent of IT expenditure at
AFG was consumed by IT operational costs”

* Self-installed
Versions Supported: 2008 R2, 2012, 2014, 2016, 2017 All
Editions Supported: Express, Web, Standard, Enterprise**
High Availability: Self-managed; AlwaysOn, Mirror, Log ShipAWS-managed
Encrypted Storage using AWS KMS (all editions); TDE SupportEncryption:
Authentication: Windows & SQL authentication
Maintenance plans & 3rd party toolsManaged automated backupsBackups:
Self-managedAutomatic software patchingMaintenance:
Amazon RDS Amazon EC2
SQL Server features at a glance

SQL Server on AWS exhibited 2X+ better
price/ performance than Azure (ZK Research)
SQL Server on Amazon EC2 consistently outperforms Azure across a variety of machine types
0
200
400
600
800
1000
1200
3 5 8 13 21 34 55 89 144 233
AWS versus Azure Large* Configuration (TPM)
AWS Azure
$0
$100
$200
$300
$400
$500
$600
Small Medium Large
Costs per 1 Billion Transactions Per Month
AWS Azure
https://zkresearch.com/blog/2018/11/comparing-sql-server-deployments-on-microsoft-azure-and-amazon-web-services
*Results for Small and Medium configuration available on https://zkresearch.com, a 3rd party research firm

Migrating SQL Server 2008/2008R2
• Support ends July 9, 2019 – must upgrade DB Engine
• Upgrade to SQL Server 2012, 2014, 2016, or 2017 (with SQL Server
2008 SP4/2008R2 SP3)
• Understand Database Compatibility Level Dependencies
• Set your database compatibility level to 100
• Upgrade compatibility level, only if supported and necessary
• New home – Amazon RDS for SQL Server and SQL Server on
Amazon EC2
• Migration options – Mirroring or Log Shipping? AWS DMS or Backup and
Restore?

Sony easily Upgraded SQL Server 2008 Workloads to
AWS & Improved Performance by 30%
• The DR plan was executed
successfully in one real-world
failure event
• Improved availability and added
redundancy to their e-commerce
applications, improving
performance by 30%
• Reduced costs compared to
running on-prem
Challenge Approach Results
About Sony New Media Solutions
Since 2009, Sony New Media Solutions
has been at the forefront of the media
supply chain. Ven.ue takes that
offering a step further, with a service
suite that encompasses a
revolutionary end-to-end digital
media management and distribution
solution.
Company: Sony New Media Solutions
Industry: Hospitality
Website: https://www.sonynms.com/
Datavail provided planning, testing,
and execution throughout the project,
including I/O performance testing that
compared database performance on
AWS to the performance in the NMS
data center.
• Used r3 high-memory Amazon EC2
template and Provisioned IOPS
EBS volumes
• Upgraded SQL Server 2008 R2 to
SQL 2014
• Leveraged SQL Server AlwaysOn
Availability Groups
We concluded that migrating to AWS would be the most
cost-effective strategy, and the agility of the AWS Cloud
model fit our SQL Server workloads perfectly
• Datacenter operating under
capacity for several months out of
the year and contract was up for
renewal.
• 20 PB archive of content ready for
migration and needed a DR
strategy to secure their business-
critical SQL-based workloads
-Mike Gassner, SVP Sony New Media Solutions‘‘

Migration Considerations
• SQL Server version and edition features
• Authentication requirements
• Amount of data being migrated
• Connectivity to AWS
• Migration method
• New home for the databases
• AWS Professional Services or Partner help
• Well Architected Framework
• Optimize after migration

Microsoft Licensing Options on AWS
Microsoft
Licenses on
AWS
License-
Included
Instances
Bring
Licenses to
AWS
Default
Tenancy
Dedicated
Tenancy
Dedicated
Instance
Dedicated
Host

License-Included Options
Windows Server
• 2003, 2008/R2, 2012/R2, 2016
• Includes two administrative
Remote Desktop Services
(RDS) connections
SQL Server for Windows
• 2005, 2008, 2012, 2014, 2016, 2017
• Enterprise, Standard, Web Editions
• No CALs needed
• Amazon Elastic Compute Cloud
(EC2) or Amazon RDS

Default Tenancy Instances
EC2 Instances: Default and Dedicated
Tenancy Dedicated Instances Dedicated Hosts
Customer A
Customer B
Customer C
Customer D
Customer E
Customer E
Multi-tenant servers host instances for
multiple customers
AWS determines which host
instances run on
You pay per-instance
Single-tenant servers host instances
dedicated to one AWS account
AWS determines which host instances
run on
You pay per-instance + hourly fee per
region
Single-tenant servers host instances
dedicated to one AWS account
Launch instances to same physical
server through targeted placement
You pay per-host, per-hour
Customer A Customer A

Bringing Licenses to Default Tenancy
Instances
Amazon EC2
Windows Server AMI
Microsoft Application
with License Mobility
Windows Server, Windows Desktop
and Microsoft Office licenses cannot
be brought to default instances
With License Mobility, you can bring
your own Microsoft application
software to a license-included EC2
instance
Includes SQL Server, Remote
Desktop Services, Exchange,
SharePoint, Dynamics, Systems
Center
Linux AMI
SQL Server 2017 with
License Mobility

Dedicated Instances
Customer A
When to Use Dedicated Instances
BYOL Windows Server not eligible
(except MSDN licenses)
BYOL SQL Server Virtual OSEs
without Software Assurance
User-based BYOL options including
Windows Desktop OS and Microsoft
Office
MSDN deployment—even Windows
Server (bring your own AMI)
Amazon EC2
Windows Server AMI
Microsoft Application
(customer-provided)

Dedicated Host
When to Use Dedicated Hosts
Pay per host—no OS included
Bring any Microsoft application—
regardless of SA or License Mobility
Bring your own Windows Server
license
Maximize licensing benefits of
Windows Datacenter and SQL Server
Enterprise Edition
Option to license by physical core
Customer-provided
Windows Server AMI
Customer A

Amazon Aurora
MySQL and PostgreSQL-compatible relational database built for the cloud
Performance and availability of commercial-grade databases at 1/10th the cost
Performance
and scalability
Availability
and durability
Highly secure Fully managed
5x throughput of standard MySQL
and 3x of standard PostgreSQL;
scale-out up to
15 read replicas
Fault-tolerant, self-healing
storage; six copies of data
across three Availability Zones;
continuous backup to Amazon S3
Network isolation,
encryption at rest/transit
Managed by RDS:
No hardware provisioning,
software patching, setup,
configuration, or backups

Amazon DynamoDB
Fast and flexible key value database service for any scale
Comprehensive
security
Encrypts all data by default
and fully integrates with
AWS Identity and Access
Management for robust
security
Performance at scale
Consistent, single-digit
millisecond response times at any
scale; build applications with
virtually unlimited throughput
Global database for
global users and apps
Build global applications with fast
access to local data by easily
replicating tables across multiple
AWS Regions
Serverless
No server provisioning,
software patching, or upgrades;
scales up or down
automatically; continuously
backs up your data

Amazon Redshift
Highly scalable cloud data warehouse at 10x the performance and 1/10th
the cost of traditional data warehouses
Virtually unlimited
concurrency
Extends your
data lake
Dynamically scales to support
virtually unlimited number of
concurrent users and growing
data volumes
Analyze exabytes of data in the
Amazon S3 data lake together
with petabytes of data loaded
into Amazon Redshift’s high
performance SSDs
10x performance 1/10th the cost
Get faster time-to-insight for all
types of analytics workloads;
powered by machine learning,
columnar storage and MPP
Start at $0.25 per hour,
scale out as low as $1,000
per terabyte per year

Customers are moving to AWS Databases
Verizon is migrating over 1,000 business-critical applications and database backend systems to AWS,
several of which also include the migration of production databases to Amazon Aurora.
Wappa migrated from their Oracle database to Amazon Aurora and improved their reporting
time per user by 75 percent.
Trimble migrated their Oracle databases to Amazon RDS and project they will pay about 1/4th of
what they paid when managing their private infrastructure.
Intuit migrated from Microsoft SQL Server to Amazon Redshift to reduce data-processing timelines
and get insights to decision makers faster and more frequently.
Equinox Fitness migrated its Teradata on-premises data warehouse to Amazon Redshift. They went from
static reports to a modern data lake that delivers dynamic reports.
Eventbrite moved from Cloudera to Amazon EMR and were able to cut costs dramatically, spinning
clusters up/down on-demand and using Spot (saving > 80%) and Reserved Instances.
By December 2018, Amazon.com will have migrated 88% of their Oracle DBs (and 97% of critical
system DBs) moved to Amazon Aurora and Amazon DynamoDB. They also migrated their 50 PB
Oracle Data Warehouse to AWS (Amazon S3, Amazon Redshift, and Amazon EMR).
Samsung Electronics migrated their Cassandra clusters to Amazon DynamoDB for their Samsung
Cloud workload with 70% cost savings.

AWS Database Migration Service (DMS) easily and
securely migrate and/or replicate your databases and
data warehouses to AWS
AWS Schema Conversion Tool (SCT) convert your
commercial database and data warehouse schemas to open-
source engines or AWS-native services, such as Amazon
Aurora and Redshift
AWS Database Migration Service

Database migration process
Source
Oracle Database on premises
in EC2 or RDS
Source
Oracle Database on premises
in EC2 or RDS
AWS Schema Conversion Tool
Target
Amazon Aurora PostgreSQL
Target
Amazon Aurora PostgreSQL
Step 1
Step 2
AWS Database Migration Service

Customer
premises
Application users
AWS
Internet
VPN/DX
 Start a replication instance
 Connect to source and target
databases
 Select tables, schemas, or
databases
 Let AWS DMS load data, and
keep them in sync
 Switch applications over to
the target at your
convenience
Keep your apps running during the migration
AWS
DMS

Database Freedom MAP Provides:
Migration methodology
AWS tools and
specialist teams
AWS partners
AWS investment AWS training AWS Professional
Services

Database Migration Playbooks
• Topic-by-topic overview of how to migrate databases and
data warehouses to AWS services
• Covers all proprietary features and the different database
objects
• Migration best practices
• Oracle to Aurora PostgreSQL – available
• SQL Server to Aurora MySQL – available
• SQL Server to Aurora PostgreSQL – available
SCT DMS Playbook
Schema Data Best Practices

Summary
• Organizations are embracing AWS’s purpose-built cloud database
services (right tool for the right job)
• Managed service (ex. RDS) are preferred
• Embrace modern cloud-based applications with database freedom
• AWS Team (SA, ProServe, and Partner team) to help.

AWS Database Migration Strategies

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to AWS Database Migration Strategies

Similar to AWS Database Migration Strategies (20)

More from Amazon Web Services

More from Amazon Web Services (20)

AWS Database Migration Strategies