Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Data Migration - Activity slide.pptx
1. Scope of Work – High-level activities
Data Migration and Azure Synapse setup
• Project Kickoff session
• Stakeholder Identification
• Conduct Sizing of various datasets and
systems.
• Assess the existing ecosystem and
obtain relevant access from Customer.
• Finalize data migration approach
• Obtain any pre-defined rules pertaining
to infrastructure security, business rules
for data processing, dashboard
development.
• Design the high-level architecture
required for this solution.
Discovery and Design
On prem SQL to Azure SQL DB migration
• ExpressRoute to be configured,
• Assess and evaluate your on-premises
database for any blocking issues by
using the Data Migration Assistant.
• Open your Windows Firewall to allow the
Azure Database Migration Service to
access the source SQL Server
• Ensure that the credentials used to
connect to source SQL Server instance
have CONTROL SERVER permissions
• Create an Azure Database Migration
Service instance
• Create an instance of Azure SQL
Database instance
• Create a migration project by using
Azure Database Migration Service.
• Migrate the required schemas, tables,
SSIS packages, SSRS reports etc.
Data Migration using ADMS
• Migration of existing Power BI Reports
• Existing PowerBI Dashboards to be
repointed to the modern data platform
• New Dashboards to be created using
any of the provided options
o Create Semantic Model using
Azure Analysis Services and
enable self service BI
capabilities
OR
o Create model using PowerBI
suit of product
Dashboard on Power BI
• Using Azure IR, data will be pulled from
Azure SQL DB to ADLS Gen2
• Appropriate transformation and logic to
be implemented and data to be prepared
• Using Polybase scalable bulk data
loading will be carried out
• This will be tightly integrated with Data
Factory which will cater to perform Data
Quality
• Check and create necessary tables
within Azure Synapse
• If required the migrated SPs and
Functions will be migrated
• Incremental load to be carried out from
Staging
• Model appropriate data marts by
leveraging the Dedicated SQL Pool task
• Appropriate performance tuning
approaches to be implemented
Data Modernization using
Synapse Analytics