Data Migrations - which option is best for you? | Tel Aviv Summit Tel Aviv

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Data Migrations - Which Option is
Best for You?
Ronen Amrani
Solutions Architect
Amazon Web Services
S K L 2 0 4

Agenda
• Introduction, key questions and portfolio options
• Network-based transfer services
• Data migration services
• Database migration services
• AWS Partners

Why move to the cloud?
Common drivers of moving data to the cloud:
Pain points of data migration:
While every cloud adoption journey is unique, all require a data migration step, which
can be hindered by blockers such as:
Cost
effectiveness
Workforce
productivity
Business
agility
Operational
resilience
Access to
innovative
services
Disruption Speed Costs Channels Cloud
compatibility

Migrating data: Five key questions
1) What kind of data is it, and where is it going?
4) How much data and time do you have?
2) One time or continuous movement?
3) One way or bi-directional?
5) WAN links & bandwidth constraints?
Amazon
S3
Amazon
EC2
Amazon
EFS
Amazon
EBS
Amazon
Aurora
Amazon
EMR
Amazon
Glacier
Amazon
RDS
AWS
IoT
Amazon
Redshift
Files Block
volumes
Databases IoT Streams
Amazon
FSx
Amazon
DynamoDB
AWS
Machine Learning

AWS Storage portfolio
Object storage
S3 Standard
S3 Glacier Deep Archive
S3 Glacier
S3 Intelligent-Tiering
S3 One Zone-IA
S3 Standard-IA
Block storage
Provisioned IOPS SSD
Cold HDD
Throughput-Optimized HDD
NEW!
COMING
SOON!
File storage
EFS Standard
EFS Infrequent Access
NEW!
Elastic
Amazon EFS AWS Storage
Gateway Family
Amazon S3
NEW!
Amazon FSx
for Lustre
Amazon FSx
for Windows
File Server
NEW!
Amazon
EBS
Amazon
EC2

AWS data transfer & hybrid storage
Online managed
data transfer
Hybrid
storage
Offline
data transfer
Private
network
connections
to AWS
Load
streaming
data into
Amazon S3
Ship static
data into and
out of
Amazon S3
Access AWS
storage from
on-premises
Edge locations
for Amazon
S3 enabled
applications
Online
transfer of
active data
AWS
DataSync
AWS
Transfer
for SFTP
SFTP transfers
into Amazon S3
NEW NEW
Storage and
compute in
disconnected
environments
Network-based
services

AWS Direct Connect
Reduce
bandwidth Costs
Consistent
network
performance
Compatible with
all AWS services
Private
connectivity to
VPC
Elastic Simple
• Establish private connectivity between AWS and your data center
• Dedicated connection can be partitioned into multiple virtual interfaces
• Maintain network separation between public and private environments
BENEFITS

Amazon S3 Transfer Acceleration
AWS Edge
Location
Optimized
Throughput!
Leverages AWS Global Edge Locations
(Amazon CloudFront) and optimized
AWS network path
Optimized protocols
Change your endpoint, not your code
No firewall exceptions & no client
software required
Speeds up transfers for applications that use S3 API over long distances

Rio De Janeiro Warsaw New York Atlanta Madrid Virginia Melbourne Paris Los Angeles Seattle Tokyo Singapore
Time[hrs]
500 GB upload from these edge locations to a bucket in Singapore
Public Internet
How Fast is Amazon S3 Transfer Acceleration?
S3 Transfer Acceleration
On average, we have seen 171%
improvement over regular Amazon S3
when uploading over long distances

What use cases need to transfer active data?
Migration of active
application data
Transferring data
for time sensitive
in-cloud analysis
Replication of data
for business
continuity
Online data transfer

AWS DataSync
Online transfer service that simplifies, automates, and accelerates
moving data between on-premises storage and AWS
Fast data
transfer
Cost-
effective
Enterprise
ready
Combines the speed and reliability of network acceleration software
with the cost-effectiveness of open source tools
Easy to use Secure and
reliable
Up to 10Gbps Fully managed
in-cloud w/
agents on-prem.
Data encryption
& validation
PCI & HIPAA;
Works w/ AWS
IAM & CloudTrail
Usage-based,
$0.04 per-GB
copied

As simple as one, two, three ...
On-premises NFS file
systems, Amazon S3 buckets, or
Amazon EFS file systems
Create a task by configuring
storage locations and options
Monitor in the
console or through
Amazon CloudWatch
Start the task and
monitor progress
VMware ESXi
4 vCPU
32 GB memory
Deploy the agent and
associate to your AWS account
1 2 3

Shared
file system
NFS TLS
How AWS DataSync works
On-Premise
Amazon S3
bucket
AWS Storage resources
AWS
DataSync
Agent deployed
on-premises for
fast access to
local storage
Region
Amazon EFS
file system
AWS DataSync
agent
Data transfer
over the WAN via
efficient purpose-
built protocol
Managed from the
console or AWS
Command Line
Interface (AWS CLI)
Service in AWS
writes or reads
data from AWS
storage services

SFTP: It’s here; it’s everywhere
Protocol is deeply embedded in workflows across a variety of industries
Financial services
$
Retail
Healthcare … and more

AWS Transfer for SFTP
Fully managed service enabling transfer
of data over SFTP while stored in Amazon S3
Seamless migration
of existing workflows
Native integration
with AWS services
Simple
to use
Cost
effective
Fully managed
in AWS
Enterprise
ready

AWS Storage Gateway
Existing Data
Archives
New Data
Corporate
Data Centers or
Offices
AWS Storage Gateway
HTTPS
NFS
SMB
iSCSI
VTL
Hybrid storage service enabling applications to seamlessly use AWS storage
On-Premises Gateway Service
Amazon S3
Amazon EBS
snapshots
Amazon Glacier

The AWS Storage Gateway family
File gateway
Store and access objects in Amazon S3 from file-based
applications with local caching
Volume gateway
Block storage on-premises backed by cloud storage with local
caching, Amazon EBS snapshots, and clones
Tape gateway
Drop-in replacement for physical tape infrastructure backed by
cloud storage with local caching
Three gateway types provide file, block, and tape storage interfaces

File gateway overview
Store and access objects in Amazon S3 from file-based applications with local caching
Use cases
• Backup files and
databases as objects
• Hybrid workflows for on-
premises data (e.g., data
piplelines)
• Low-latency on-premises
access to data in cloud
(e.g., media editing)
• Content distribution and
collaboration
File Gateway Objects in your
Amazon S3 bucket
NFS v3/v4
SMB v2/v3

Volume gateway overview
• Supports iSCSI block protocol
• Available in two modes: cached and stored
• Compresses and tiers partial or whole volumes to the cloud to reduce
on-premises SAN/NAS footprint
• Take EBS snapshots of on-premises volumes and store them in cloud
Cloud-backed block storage presented on-premises
Key
Capabilities
Application
server
Amazon EBS
snapshots
ServiceVolume
Gateway
Volume stored in
Amazon S3
HTTPSiSCSI
Customer Premises

• Emulates physical tape device with a media changer and tape drives
• Virtual tapes written to Amazon S3
• Ejected virtual tapes are marked “read only” and moved to “tape shelf” in
Amazon Glacier
• Recovery: Retrieve tapes to library (3–5 hours) and read data from a gateway
Tape gateway overview
Virtual tapes presented to on-premises backup applications
Key
Capabilities
Backup
server
Tape library Tape shelf
On-Premise
iSCSI HTTPS
Media
changer
Tape Gateway
Tape
drives

Storage Gateway is available on a variety of form factors
Virtual machines Amazon EC2
Hardware
appliance
Corporate data centers In AWS
Remote locations,
branch offices
WhereWhen
Leverage existing VM
infrastructure
In-cloud data
retrieval/access/DR
Out of the box
simplified experience

Simplify and Accelerate Migration With CloudEndure
• Designed for rapid, mass-scale migrations
• Simple setup lets you start in minutes
• Same highly automated process for any workload
(regardless of OS type/version, application, or DBs)
• Eliminates complexity and reduces risk
• Migrate with minimal business disruption
Highly Automated
Migrate From
Any Source
Short Cutover
Windows With
Minimal Downtime
Minimal Skill Set
Required to Operate
Easily Plugs Into
Migration Factories
and Cloud COEs
Easy, Non-
Disruptive Tests
Prior to Cutover
ReliableFlexible
Option to
Migrate Back
Robust, Predictable,
Non-Disruptive
Continuous Replication
Wide Range of OS,
Application, and
Database Support
Highly Secure
for Regulated
Environments

How CloudEndure Migration Works
Lightweight Staging Area in
Target Region
Source
Data Center
Target Subnet(s)
Continuous data
replication traffic
(compressed and
encrypted)
Lightweight Linux
Replication Server
Low-Cost
Block Storage
Orchestration &
system conversion
ready to run
workloads in minutes
regardless of disk
size
• CloudEndure continuously replicates any application or database from any source into AWS
• Business outcome: Allow self-service, rapid, reliable migrations with minimal business disruption

Physical
Data Centers
Wide Platform Support*
Any
Application
Any
Database
x86 Operating
Systems
Source
Infrastructure
* See documentation or contact Support for a complete list.

AWS Database Migration Service
M I G R A T I N G
D A T A B A S E S
T O A W S
Migrate between on-premises and AWS
Migrate between databases
Automated schema conversion
Data replication for zero
downtime migration

When to use AWS DMS and AWS SCT?
Modernize Migrate Replicate

AWS SCT
• Modernize your data warehouse
Convert your Oracle, SQL Server, Netezza,
Greenplum, Vertica, or Teradata to Amazon
Redshift
Modernize
Amazon
Aurora
Amazon
Redshift
• Modernize your database
Convert your Oracle, SQL Server, or DB2 LUW to
PostgreSQL, MySQL, or Amazon Aurora
MySQL
PostgreSQL
PostgreSQL

AWS DMS
Migrate
• Migrate business-critical applications
• Migrate data warehouse to Amazon
Redshift
• Upgrade to a minor version
• Consolidate shards into Aurora
• Archive old data
• Migrate from NoSQL to SQL, SQL to
NoSQL, or NoSQL to NoSQL
Amazon RDS
Amazon
Redshift
Amazon
Aurora
Amazon
DynamoDB
Amazon S3

AWS Database Migration Service
Replicate
• Create cross region Read Replicas
• Run your analytics in the cloud
• Populate your data lake

Customer
premises
Application users
AWS
Internet
VPN
® Start a replication instance
® Connect to source and target
databases
® Select tables, schemas, or
databases
® Let AWS DMS create tables,
load data, and keep them in
sync
® Switch applications over to
the target at your
convenience
Keep your apps running during the migration
AWS
DMS

Backup & restore Archive Primary storage BC/DRData migration
AWS Partner Network (APN): Migration & storage

Data Migrations - which option is best for you? | Tel Aviv Summit Tel Aviv

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Data Migrations - which option is best for you? | Tel Aviv Summit Tel Aviv

Similar to Data Migrations - which option is best for you? | Tel Aviv Summit Tel Aviv (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Data Migrations - which option is best for you? | Tel Aviv Summit Tel Aviv