Injustice - Developers Among Us (SciFiDevCon 2024)
AWS - Database Migration Service - Abdul Rasheed Feroz Khan
1. AWS – Database
Migration Service
www.codesizzler.in
Abdul Rasheed Feroz Khan
Director – CodeSizzler
Microsoft MVP – Azure
2. About the Instructor
• Microsoft Most Valuable Professional – Azure
• C# Corner Most Valuable Professional
• Microsoft Certified Trainer
• 8 years of experience as Cloud Consultant
• Azure – AWS – GCP – IoT – Machine Learning – Cognitive Services
– Bot – Xamarin – Big Data
• Consultant for Accenture, Adobe, Boeing, Deloitte., Infosys,
Johnson Controls, Microsoft, Wipro, etc.,
www.codesizzler.in
Twitter - @TechFero
Email ID – feroz@codesizzler.info
AWS Database Migration Service (AWS DMS) is a cloud service that makes it easy to migrate relational databases, data warehouses, NoSQL databases, and other types of data stores. You can use AWS DMS to migrate your data into the AWS Cloud, between on-premises instances, or between combinations of cloud and on-premises setups.
At its most basic level, AWS DMS is a server in the AWS Cloud that runs replication software. You create a source and target connection to tell AWS DMS where to extract from and load to. Then you schedule a task that runs on this server to move your data. AWS DMS creates the tables and associated primary keys if they don't exist on the target. You can precreate the target tables manually, if you prefer. Or you can use AWS SCT to create some or all of the target tables, indexes, views, triggers, and so on.
1. To start a migration project, identify your source and target data stores. These data stores can reside on any of the data engines mentioned preceding.
2. For both the source and target, configure endpoints within AWS DMS that specify the connection information to the databases. The endpoints use the appropriate ODBC drivers to communicate with your source and target.
3. Provision a replication instance, which is a server that AWS DMS automatically configures with replication software.
4. Create a replication task, which specifies the actual data tables to migrate and data transformation rules to apply. AWS DMS manages running the replication task and provides you status on the migration process.
1. AWS Database Migration Service (AWS DMS) is a web service that you can use to migrate data from a source data store to a target data store. These two data stores are called endpoints.
2. You can migrate between source and target endpoints that use the same database engine, such as from an Oracle database to an Oracle database. You can also migrate between source and target endpoints that use different database engines, such as from an Oracle database to a PostgresSQL database.
3. The only requirement to use AWS DMS is that one of your endpoints must be on an AWS service. You can't use AWS DMS to migrate from an on-premises database to another on-premises database.
At a high level, an AWS DMS replication instance is simply a managed Amazon Elastic Compute Cloud (Amazon EC2) instance that hosts one or more replication tasks.
An AWS DMS migration consists of three components:
Replication instance
Source and target endpoints
Replication task
You create an AWS DMS migration by creating the necessary replication instance, endpoints, and tasks in an AWS Region.
AWS DMS uses an endpoint to access your source or target data store. The specific connection information is different, depending on your data store, but in general you supply the following information when you create an endpoint.
Endpoint type — Source or target.
Engine type — Type of database engine, such as Oracle, Postgres, or Amazon S3.
Server name — Server name or IP address, reachable by AWS DMS
Port — Port number used for database server connections.
Encryption — SSL mode, if used to encrypt the connection.
Credentials — User name and password for an account with the required access rights
On-premises and EC2 instance databases
Microsoft Azure
Amazon RDS instance databases, and Amazon S3
On-premises and Amazon EC2 instance databases
Amazon RDS instance databases, Amazon Redshift, Amazon DynamoDB, and Amazon S3
Open https://aws.amazon.com/ and choose Create an AWS Account and follow the online instructions.
You can create an IAM user if you don’t want to use you Administrator credentials for implementing demo.
If you wish to create a new user credential, then create a new user with IAM policy allowing AWS managed - job function.
You will need to configure a network that connects your source and target databases to a AWS DMS replication instance.
Source and Target Endpoints – You will need to know what information and tables in the source database need to be migrated to the target database.
Schema/Code Migration – AWS DMS doesn't perform schema or code conversion. You can use tools such as Oracle SQL Developer, MySQL Workbench, or pgAdmin III to convert your schema.
Unsupported Data Types – Some source data types need to be converted into the equivalent data types for the target database.
To perform DMS in AWS, we need to create a few prerequisites. They are,
VPC – Virtual Private Cloud
Subnet
Subnet Group
Internet Gateway
Navigate to console.aws.amazon.com and login using your credentials. Choose your desired location to create your services.