The document discusses automating large-scale migrations to AWS. It covers the migration journey from discovery and planning to application migrations. It then discusses benefits of migration automation like repeatability and traceability. Examples of automation architectures are presented for discovery, database migration, and setting application status on cutover. Recent AWS service launches that help with automation are also briefly mentioned.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Executing a Large Scale Migration
to AWS
Michael Sciscenti
Sr Product Manager
AWS Migration Hub
E N T 3 3 7
Diego Dalmolin
Solutions Architect
AWS/Partner Program

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
• Migration journey
• Migration automation

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migrating your portfolio
Discover Plan Design Migrate Optimize

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ASSESSMENT READINESS & PLANNING (Mobilization) APPLICATION MIGRATIONS
Migration journey
Migration Readiness
Assessment (MRA)
Migration (at scale)Migration mobilization
Discover
Design
Build
Integrate
Cutover
Validate
Operating
model
Landing
zone
Security &
compliance
Discovery
& planning
Skills/CoE
Migration
expertise
Migration
business case
Migration
plan
Operating
model
Directional
business case
Rapid
discovery
1-2 months 4-6 months
Migration factory

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Application migrations

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Benefits of migration automation
Repeatability
Move lots of servers and
databases with speed
Traceability
No effort status tracking and
dashboard reporting
Test coverage
Cutover tests can be
repurposed after migration for
monitoring
Benefits of migration
automation

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migration tracking challenges
No easy way to
track migrations
Existing tools don’t
track migrations by
application
Workload migrations
require different
migration tools
Migration tracking
challenges

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migration Hub integrated tools

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tools for automating your migration journey
Business case Discovery &
planning
Dependency
mapping
Workload &
data migration
ValidationInventory

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation examples
Discover Plan Design Migrate Optimize

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation architecture example
Database server
App server
Corporate datacenter AWS Cloud
Replicated instance
Target
DB instance

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation architecture example
Database Server
Corporate datacenter AWS Cloud
Replicated Instance
Target
DB Instance
App Server
App Server
App Server
App Server
App Server
App Server
App server
App server
Database Server
Database Server
Database Server
Database Server
Database Server
Database Server
Database server
Database server
Replicated Instance
Replicated Instance
Replicated Instance
Replicated Instance
Replicated instance
Replicated instance
Target
DB InstanceTarget
DB InstanceTarget
DB InstanceTarget
DB Instance
Target
DB instance

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation architecture example - Discovery
Database server
App server
Corporate datacenter AWS Cloud
Application
Discovery
plugin
Scripts

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Discovery data in Athena:
Analyze dependencies (query 1)
WITH valid_inbound_ips (source_ip) AS
(SELECT DISTINCT source_ip FROM inbound_connection_agent ),
outer_inbound_query AS (
SELECT agent_id,
source_ip,
destination_ip,
destination_port,
COUNT(*) frequency
FROM inbound_connection_agent
WHERE ((ip_version = 'IPv4')
AND (destination_ip IN (SELECT * FROM valid_inbound_ips )))
GROUP BY agent_id, source_ip, destination_ip, destination_port
)

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Analyze dependencies (query 2)
SELECT
source_ip Source,
destination_port Port,
destination_ip Target,
Frequency,
hin1.host_name “Source Host Name”,
hin2.host_name “Destination Host Name”
FROM outer_inbound_query o, hostname_ip_helper hin1, hostname_ip_helper hin2
WHERE
((o.source_ip = hin1.ip_address)
AND (o.destination_ip = hin2.ip_address))
ORDER BY Frequency DESC

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tag servers in Application Discovery Service
SELECT
host_name,
dports.destination_ip,
dports.destination_port,
ianap.service_name
FROM inbound_connection_agent dports
JOIN iana_service_ports_import ianap ON (dports.destination_port =
ianap.port_number)
JOIN hostname_ip_helper hip ON hip.ip_address = dports.destination_ip
WHERE (ianap.transport_protocol = 'tcp')
GROUP BY
host_name,
dports.destination_ip,
dports.destination_port,
ianap.service_name

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automation architecture example
Database server
App server
Corporate datacenter AWS Cloud
AMI
Replicated instance
Target
DB instance
Database migration
workflow/job
SNS topic
Lambda function
SQS queue
Post-Mig
script
Client

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DB instance
standby
App
Target architecture
VPC
Public subnet
AWS Cloud
Availability Zone 1
Auto Scaling group
AWS Region
App
Public subnet
Availability Zone 2
RDS Multi-AZ
DB instance

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
instance_metadata = urllib.urlopen("http://169.254.169.254/latest/dynamic/instance-
identity/document/imageId").read()
json_instance_metadata = json.loads(instance_metadata)
sns_topic = "arn:aws:sns:%s:%s:ENT319CloudEndureSNSTopic" %
((json_instance_metadata['region']),(json_instance_metadata['accountId']))
message = {"Pass": "True", "instanceId": json_instance_metadata['instanceId']}
sns_client = boto3.client('sns', region_name=json_instance_metadata['region'])
sns_response = sns_client.publish(
TopicArn = sns_topic,
Message=json.dumps(message),
Subject = 'ENT319Demo’)
Notify SNS after test

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
def lambda_handler(event, context):
logger.info(event)
json_sns_message = json.loads(event['Records'][0]['Sns']['Message'])
if json_sns_message['Pass'] != "True":
logger.error("%s did not pass post migration testing! Not creating an AMI." %
(json_sns_message['instanceId']))
else:
logger.info("%s passed post migration testing. Creating an AMI." %
(json_sns_message['instanceId']))
create_ami(json_sns_message['instanceId'])
Lambda - SNS

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Auto set app status on cutover
def updateHUBstatus(applicationname, status):
"""Function to update application status on migration hub - status can be set as
'NOT_STARTED'|'IN_PROGRESS'|'COMPLETED' """
try:
appname = boto3.client('discovery')
appID = appname.list_configurations(configurationType='APPLICATION',
filters=[{'name':'application.name',
'values':[applicationname],'condition':'EQUALS'}])['configurations']
appID = appID[0]['application.configurationId']
hub = boto3.client('mgh')
response = hub.notify_application_state(ApplicationId=appID, Status=status)
except ClientError as err:
print(err.response)

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Recent SMS launches
Hourly replication Pause/resume jobs
AMI encryption Up to 16TB volume size

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DataSync
Online transfer service that simplifies, automates, and accelerates moving data
Transfers
up to 10 Gbps
per agent
Pay as
you go
Simple data
movement to
Amazon S3 or
Amazon EFS
Secure and
reliable
transfers
Migrate active
application data to AWS
Combines the speed and reliability of network acceleration
software with the cost-effectiveness of open source tools
Transfer data for timely
in-cloud analysis
Replicate data to AWS
for business continuity
AWS
integrated
AWS

34. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.