AWS는 고객의 기존 데이터베이스를 쉽게 클라우드로 이전할 수 있도록 데이터베이스 전환을 돕는 AWS Database Migration Service와 AWS Schema Conversion Tool을 제공합니다. 이 강연에서는 이 도구들을 활용하여 오라클 데이터베이스를 Amazon Aurora 데이터베이스로 이전하는 방법에 대하여 실습을 통하여 학습할 예정입니다.
연사: John Winford, 아마존 웹서비스 시니어 테크니컬 매니저
김상필, 아마존 웹서비스 솔루션즈 아키텍트
2017 AWS DB Day | Amazon Database Migration Service (DMS) 소개 및 실습
1. AWS Database Migration Service
Database Modernization with Minimal Downtime
John Winford
Sr. Technical Program Manager
Time : 15:30 – 17:20
2. AWS Database Migration Service
Database Modernization with Minimal Downtime
AGENDA
• How does the cloud help?
• How do I get there?
• When should I use it?
• How does it work?
• What else can I do?
• What have others done?
4. • Multi-engine support: Aurora, MySQL, MariaDB,
PostgreSQL, Oracle, SQL Server
• Automated provisioning, patching, scaling,
backup/restore, failover
• High availability with RDS Multi-AZ
– 99.95% SLA for Multi-AZ deployments
Amazon RDS
5. • Lower TCO because we manage the muck
• Get more leverage from your teams
• Focus on the things that differentiate you
• Built-in high availability and cross region replication ac
ross multiple data centers
• Available on all engines, including base/standar
d editions, not just for enterprise editions
• Now even a small startup can leverage multiple data c
enters to design highly available apps with over 99.95
% availability.
The Cloud makes things cheaper, easier, better
7. How can I get to the cloud?
How will my on-premises data migrate to the cloud?
How can I make it transparent to my users?
Afterwards, how will on-premises and cloud data interact?
How can I integrate my data assets within AWS?
Can I get help moving off of commercial databases?
8. Migration used to be cost + complexity + time
Commercial data migration and replication software
Complex to set up and manage
Application downtime
Database-engine-specific application code
9. What are DMS and SCT?
AWS Database Migration Service (DMS) easily and securely
migrates and/or replicate your databases and data warehous
es to AWS
AWS Schema Conversion Tool (SCT) converts your commercial dat
abase and data warehouse schemas to open-source engines, Amaz
on Aurora and Redshift. Converts and loads data warehouse data in
to Amazon Redshift
We have migrated over 25,000 unique databases. And counting…
10. Migration options
If you’re not switching engines and can take downtime:
- SQL Server: bak file import
- MySQL: read replicas
- Oracle SQL Developer, Data Pump, Export/Import
- PostgreSQL: pg_dump
- SAP ASE: bcp
12. When to use DMS and SCT?
Modernise Migrate Replicate
Modernise your database tier –
• Commercial to open-source
• Commercial to Amazon Aurora
Modernise your Data Warehouse –
• Commercial to Redshift
• Migrate business-critical applicat
ions
• Migrate from Classic to VPC
• Migrate data warehouse to Reds
hift
• Upgrade to a minor version
• Consolidate shards into Aurora
• Create cross-regions Read Replicas
• Run your analytics in the cloud
• Keep your dev/test and production
environment sync
13. When to use SCT?
Modernise your Database Tier
• Commercial to open-source
• Commercial to Amazon Aurora
• S3 target
Modernise your Warehouse
• Commercial to Redshift
Amazon Redshift
Amazon Aurora
14. When to use DMS*?
Migrate
• Migrate business-critical applicatio
ns
• Migrate from Classic to VPC
• Migrate data warehouse to Redshif
t
• Upgrade to a minor version
• Consolidate shards into Aurora
• Migrate from NoSQL to SQL, SQL t
o NoSQL or NoSQL to NoSQL
Sources:
Targets:
Amazon Dynamo
DB
Amazon Redshift
Amazon S3
Amazon Aurora
*DMS is a HIPAA certified service
15. Why use DMS and SCT?
Secure
Cost Effective
Remove Barriers
to Entry
Allow DB
Freedom
Keep a Leg in
the Cloud
Easy to Use, but
Sophisticated…
Near-Zero
Downtime
17. Database migration process
Step 1: Convert or Copy your Schema
Source DB or DW
AWS SCT
Native Tool
Destination DB or DW
Step 2: Move your data
Source DB or DW
AWS SCT
Destination DB or DW
AWS DMS
19. Customer
premises
Application users
AWS
Internet
VPN
Start a replication instance
Connect to source and target data
bases
Select tables, schemas, or databas
es
® Let AWS DMS create tables,
load data, and keep them in
sync
® Switch applications over to
the target at your convenience
Keep your apps running during the migration
AWS
DMS
20. Load is table by table
Replication instance
Source Target
21. Change data capture (CDC) and apply
Replication instanceSource Target
Updat
e
t1 t2
t1
t2
Transactions Change a
pply after
bulk load
26. New SCT data extractors
Extract Data from your data warehouse and migrate to Amazon Redshift
• Extracts through local migration agents
• Data is optimized for Redshift and Saved
in local files
• Files are loaded to an Amazon S3 bucket
(through network or Amazon Snowball) a
nd then to Amazon Redshift
Amazon RedshiftAWS SCT S3 Bucket
27. New NoSQL support with DMS
Migrate to AWS
• Move from MongoDB to Amazon DynamoDB
• Move from MongoDB to relational db’s
Move between NoSQL and SQL
• Change technologies
Amazon Aurora
DynamoDB
DynamoDB
RDS
31. Who is saying What about DMS and SCT?
"We migrated hundreds of our clients from our in-house data-center to Amazo
n RDS Oracle 12c using the AWS Data Migration Service (DMS). Due to this ser
vice, we could live-replicate the databases between our data-center and RDS b
efore the migration. That kept the migration down-time to the very minimum
. We are very happy with DMS and are planning to use it for Oracle to MySQ
L migration next”.
”The SCT Assessment Report was the key enabler to allow us to understand t
he scope of effort required to complete an Oracle to PostgreSQL migration.
What was originally thought to be a largely manual task that no one was partic
ularly excited about having to do became a very straight-forward quick and e
asy process."
“We are in the process of migrating some databases to Amazon Aurora. The ea
se by which we can do this using the AWS Database Migration Service has
simplified this process for us and enabled us to accelerate our migration ef
forts. The ability to closely monitor the process, the detailed logging feature, a
nd the support we received from AWS have given us a great deal of confidenc
e in a successful migration.”
32. Heterogeneous migration
Oracle private DC to RDS PostgreSQL migration
Used the AWS Schema Conversion Tool to conve
rt their database schema
Used on-going replication (CDC) to keep databas
es in sync until they reached the cutover window
Benefits:
• Improved reliability of the cloud environment
• Savings on Oracle licensing costs
• SCT Assessment Report let them understand th
e scope of the migration
33. Scale-up migration
RDS MySQL to Amazon Aurora Migration
Used DMS with on-going replication (CDC) to mi
grate the data
Benefits:
• Aurora handles their larger data storage require
ments. Per regulations they are storing 120 TB
of data for 2 years
• Reduced cost and improved performance when
compared to large MySQL instances
34. Homogeneous migration
RDS MySQL on EC2 Classic to VPC
Database ran an end-user application so coul
d not take downtime
70 RDS instances have been migrated
Benefits:
• Leveraging CDC, they could decrease outag
e per database to less than 5 mins
• 70 RDS instances have been seamlessly mig
rated
35. Split migration35 million members on it’s site
Many interdependent applications built over th
e last 15 years with unique High IOPS require
ments
Migration from legacy cloud service to AWS
Combination of migration to MySQL on EC2 a
nd Amazon Aurora
Benefits:
• DMS reduced the time required to migrate our
databases by 40 percent
• Realized 55 percent cost savings by moving so
me db’s to Amazon Aurora
37. Other database migration use cases
Migration of business-critical applications
Migration from Classic to VPC
Cheap Read Replicas for Oracle
Read Replicas for other engines
Cross-region Read Replicas for Oracle and SQL Server
Analytics in the cloud
Dev/test and production environment sync
Ongoing replication for BI
Minor version upgrade