SlideShare a Scribd company logo
1 of 12
Data Migration
Method outline
2
A successful Data Migration is defined by a set of quality
criteria
2
A seasoned method balances
attention to the criteria
• Agreed stakeholder impact – customer, organization & third parties
• Reliable and correct execution – supported by a transparent validation process
• Controlled migration process – with well defined decision points
• Auditable – process is fully reconstructable
• Right cost and duration – adjusted to risk appetite
3
Data Migration is represented as a Workstream in a
transition program
3
Analysis Design, Build & Component Test Integration Test
Data
Quality
Commercial
Preparation
Target Application
Landscape
Work Processes and
Instructions
Data
Migration
Execute
PilotDress
Rehearsal
Business Process Tests
Realization of target application
landscape
Configuration of Target Applications
(i.e. products, …)
Migration
Iterations
Commercial Migration Process
Client Communication (i.e. letters)
Customer
panel
Customer
Impact analysis
Data
Analysis
Data Quality
Improvement
Functional Migration Process
Data Mapping
Design of Migration Components
Migration System (Components)
Work Process Definition and
Description
Work Instructions (i.e. Aris)
Migration
Tests
Ist/Soll
Gap
Analysis
Product/Chann
el matrix
1 2 3 4
Data Quality
Improvement
New objects in
Target Applications
(Commercial Go
Live) Pilot
Test of target landscape for
new Objects
Dry-Run of
Work
Processes
Data Migration
Strategy (incl.
Acceptance
Criteria)
4
Data Migration done Agile: series of incremental
migration iterations
4
Migratie
strategy
Migration Tranche 1
Migration Tranche 2
Migration Tranche N
Close out
Number and duration of iterations depends on:
• Desired level of automation
• Available IT capacity
• Available capacity for manual migration processes
• acceptabele customer timpact & impact on own organization
Gap analysis
Execution
(optional)
Data analysis
5
Migration Iterations consist of a set of standard activities
5
Objectives, scope &
acceptance criteria
Data Analysis
Data Cleansing
Data Mapping
Design, Build, Test
Extract, Transform, Load, Validate
Migration test
Business process test
Execution
(0, 1 or n tranches)
Design, Build, Test
Configuration and adaptations of tagret applications
• test cycles (2)
• Dress Rehearsal
• Internal Tranche
• Live Migration
• Data Ware House
6
Migration activities result in standard migration
deliverables (with dependencies)
6
Migration
Strategy
Program
Objectives
& Scope
Data
Analysis
(source)
Production
Data
Functional
Migration
Process
Component
Design
Technical
Migration
Process
Migration
System
Component
Design
Business
Process
Test
Target
Application
Landscape
Clean
Production
Data
Dress
Reheasal
Run
Book
Migration
System/Int.
Test
Design
Execution
Governance
Migration
Test Plan
Readiness
Assessment
Migration
Test Report
Data
Mapping
Execution
Status/
Evaluation
Report
Work
Instructions
Ist/Soll
Gap
Analysis
Commercial
Migration
Approach
7
Data Migration Strategy defines the outlines of the migration
7
Subjects to be addressed
Migrating Objects (incl. volumes)
Source & Target Systems
Scope (i.e. active objects vs historic data)
Stake Holders
Acceptance Criteria
Migration Approach
• big bang vs iterations, slicing criteria,
• On-/Off-Line/Real time/Batch
• Timing – critical migration windows vs. synchronization source/target
• Load approach (database, application, service)
• Test approach (Business Process Tests)
• Manual/Automated
• Pipeline issues
• Rollback / fallback
Validation Approach (i.e. confidence checks)
Customer Impact, systems availability, communication
Data Quality (required vs desirable)
8
Data Analysis provide insight in production data volumes,
relations and frequency distribution
8
Data Analysis ReportSQL QueriesExcel Pivot Table
The truth is in the data
9
Data Migration designed according to Extract Transform Load
Validate pattern
9
Source
Systems
Landing
Extracted
Files
Staging
Conversion Engine
Transform Load
Target
Systems
Extracted
Files
Validation Tool
Validation
Database
Validation Tool
 Validation tool shares platform with Conversion Engine
 Both the engine and the validation tool are based on extraction files from
Source and Target
 Mapping is conducted independently from conversion engine to ensure
proper validation
Control Model
 The control model defines where the checkpoints in the migration process
are created and the metrics
 Every time data flows from one stage to the other, a report is generated to
show counts, sums and cross connections
Each table contains source, timestamp and where
applicable reference to transformation rules
Counts and Sums are calculated at each point where
data is handed over to next stage
10
First Test Cycle serves as proof of concept and learning
curve, subsequent Test Cycles iron out defects
10
Cycle #1 Cycle #2 Cycle #3
Proof of concept Test completion
• Goal 1st test cycle is a complete run to proof the concept
• Duration needed for sub-sequent cycles can be derived
• Both full migration execution as well as business processes in
target in scope
• Goal of subsequent cycles is to complete test execution until defects are
removed
• Every cycle will be based on a new release of migration engine (except the last
one which must be based on a stable version)
• Duration of a cycle is not expected to decrease significant
Set-up preconditions
Execute migration
Conduct BP Testing
Wrap-up results
Fix defects
11
Successful Data Migration execution relies on five
deliverables
11
Five Deliverables for Data Migration Execution Stage:
1. Governance process and structure with representation of key stake holders
2. Central control room capable of directing the migration process
3. Run book with full details of data migration activities (who, when, where and dependencies)
4. Proven migration system and process – passed successful Dress Rehearsal
5. Readiness assessment artifacts
12
Successful Data Migration requires skills and experience
12
DataDogs have Data in their DNA
20 Highly trained, skilled and experienced professionals
More than 15 successful migration projects
Vincent Wormer
Ruud Kapteijn Manuel Noechel
Jacco de Gooijer
Datadogs is the right partner for a
successful Data Migration

More Related Content

What's hot

Data Migration Plan PowerPoint Presentation Slides
Data Migration Plan PowerPoint Presentation SlidesData Migration Plan PowerPoint Presentation Slides
Data Migration Plan PowerPoint Presentation SlidesSlideTeam
 
Data Migration Steps PowerPoint Presentation Slides
Data Migration Steps PowerPoint Presentation Slides Data Migration Steps PowerPoint Presentation Slides
Data Migration Steps PowerPoint Presentation Slides SlideTeam
 
Solution deck capgemini cloud assessment
Solution deck capgemini cloud assessmentSolution deck capgemini cloud assessment
Solution deck capgemini cloud assessmentAdobe
 
Cloud Migration: Moving Data and Infrastructure to the Cloud
Cloud Migration: Moving Data and Infrastructure to the CloudCloud Migration: Moving Data and Infrastructure to the Cloud
Cloud Migration: Moving Data and Infrastructure to the CloudSafe Software
 
Azure data analytics platform - A reference architecture
Azure data analytics platform - A reference architecture Azure data analytics platform - A reference architecture
Azure data analytics platform - A reference architecture Rajesh Kumar
 
IMPLEMENTATION BEST PRACTICES Sep 22.pdf
IMPLEMENTATION BEST PRACTICES Sep 22.pdfIMPLEMENTATION BEST PRACTICES Sep 22.pdf
IMPLEMENTATION BEST PRACTICES Sep 22.pdfudayabhaskar42
 
Cloud Adoption in the Enterprise
Cloud Adoption in the EnterpriseCloud Adoption in the Enterprise
Cloud Adoption in the EnterpriseAmazon Web Services
 
Jade Global Digital Transformation & Cloud Consulting Partner - Overview
Jade Global Digital Transformation & Cloud Consulting Partner - OverviewJade Global Digital Transformation & Cloud Consulting Partner - Overview
Jade Global Digital Transformation & Cloud Consulting Partner - OverviewJade Global
 
A cloud readiness assessment framework
A cloud readiness assessment frameworkA cloud readiness assessment framework
A cloud readiness assessment frameworkCarlo Colicchio
 
An Overview of Best Practices for Large Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large Scale Migrations - AWS Transformation...An Overview of Best Practices for Large Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large Scale Migrations - AWS Transformation...Amazon Web Services
 
How to Build TOGAF Architectures With System Architect (2).ppt
How to Build TOGAF Architectures With System Architect (2).pptHow to Build TOGAF Architectures With System Architect (2).ppt
How to Build TOGAF Architectures With System Architect (2).pptStevenShing
 
On-premise to Microsoft Azure Cloud Migration.
 On-premise to Microsoft Azure Cloud Migration. On-premise to Microsoft Azure Cloud Migration.
On-premise to Microsoft Azure Cloud Migration.Emtec Inc.
 
Cloud Migration: Cloud Readiness Assessment Case Study
Cloud Migration: Cloud Readiness Assessment Case StudyCloud Migration: Cloud Readiness Assessment Case Study
Cloud Migration: Cloud Readiness Assessment Case StudyCAST
 
Moving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmapsMoving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmapsJisc
 
VisiQuate: Azure cloud migration case study
VisiQuate: Azure cloud migration case studyVisiQuate: Azure cloud migration case study
VisiQuate: Azure cloud migration case studyLeonid Nekhymchuk
 
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...Amazon Web Services
 
Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...
Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...
Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...Andrejs Prokopjevs
 

What's hot (20)

Data Migration Plan PowerPoint Presentation Slides
Data Migration Plan PowerPoint Presentation SlidesData Migration Plan PowerPoint Presentation Slides
Data Migration Plan PowerPoint Presentation Slides
 
Data Migration Steps PowerPoint Presentation Slides
Data Migration Steps PowerPoint Presentation Slides Data Migration Steps PowerPoint Presentation Slides
Data Migration Steps PowerPoint Presentation Slides
 
Cloud Migration: A How-To Guide
Cloud Migration: A How-To GuideCloud Migration: A How-To Guide
Cloud Migration: A How-To Guide
 
Solution deck capgemini cloud assessment
Solution deck capgemini cloud assessmentSolution deck capgemini cloud assessment
Solution deck capgemini cloud assessment
 
Cloud Migration: Moving Data and Infrastructure to the Cloud
Cloud Migration: Moving Data and Infrastructure to the CloudCloud Migration: Moving Data and Infrastructure to the Cloud
Cloud Migration: Moving Data and Infrastructure to the Cloud
 
Azure data analytics platform - A reference architecture
Azure data analytics platform - A reference architecture Azure data analytics platform - A reference architecture
Azure data analytics platform - A reference architecture
 
IMPLEMENTATION BEST PRACTICES Sep 22.pdf
IMPLEMENTATION BEST PRACTICES Sep 22.pdfIMPLEMENTATION BEST PRACTICES Sep 22.pdf
IMPLEMENTATION BEST PRACTICES Sep 22.pdf
 
Cloud Adoption in the Enterprise
Cloud Adoption in the EnterpriseCloud Adoption in the Enterprise
Cloud Adoption in the Enterprise
 
Jade Global Digital Transformation & Cloud Consulting Partner - Overview
Jade Global Digital Transformation & Cloud Consulting Partner - OverviewJade Global Digital Transformation & Cloud Consulting Partner - Overview
Jade Global Digital Transformation & Cloud Consulting Partner - Overview
 
A cloud readiness assessment framework
A cloud readiness assessment frameworkA cloud readiness assessment framework
A cloud readiness assessment framework
 
Cloud Migration Workshop
Cloud Migration WorkshopCloud Migration Workshop
Cloud Migration Workshop
 
Migration Planning
Migration PlanningMigration Planning
Migration Planning
 
An Overview of Best Practices for Large Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large Scale Migrations - AWS Transformation...An Overview of Best Practices for Large Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large Scale Migrations - AWS Transformation...
 
How to Build TOGAF Architectures With System Architect (2).ppt
How to Build TOGAF Architectures With System Architect (2).pptHow to Build TOGAF Architectures With System Architect (2).ppt
How to Build TOGAF Architectures With System Architect (2).ppt
 
On-premise to Microsoft Azure Cloud Migration.
 On-premise to Microsoft Azure Cloud Migration. On-premise to Microsoft Azure Cloud Migration.
On-premise to Microsoft Azure Cloud Migration.
 
Cloud Migration: Cloud Readiness Assessment Case Study
Cloud Migration: Cloud Readiness Assessment Case StudyCloud Migration: Cloud Readiness Assessment Case Study
Cloud Migration: Cloud Readiness Assessment Case Study
 
Moving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmapsMoving to the cloud: cloud strategies and roadmaps
Moving to the cloud: cloud strategies and roadmaps
 
VisiQuate: Azure cloud migration case study
VisiQuate: Azure cloud migration case studyVisiQuate: Azure cloud migration case study
VisiQuate: Azure cloud migration case study
 
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
Migrating Enterprise Applications to AWS: Best Practices & Techniques (ENT303...
 
Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...
Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...
Oracle EBS Journey to the Cloud - What is New in 2022 (UKOUG Breakthrough 22 ...
 

Similar to 20171019 data migration (rk)

DMM9 - Data Migration Testing
DMM9 - Data Migration TestingDMM9 - Data Migration Testing
DMM9 - Data Migration TestingNick van Beest
 
Nicholas king oracle epm migration and upgrade
Nicholas king   oracle epm migration and upgradeNicholas king   oracle epm migration and upgrade
Nicholas king oracle epm migration and upgradenking821
 
An Introduction to Clinical Study Migrations
An Introduction to Clinical Study MigrationsAn Introduction to Clinical Study Migrations
An Introduction to Clinical Study MigrationsPerficient, Inc.
 
How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...
How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...
How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...Perficient
 
Production-Cutover-Strategy1-1qvnpnh.ppt
Production-Cutover-Strategy1-1qvnpnh.pptProduction-Cutover-Strategy1-1qvnpnh.ppt
Production-Cutover-Strategy1-1qvnpnh.pptJohnRichard90
 
Structured NERC CIP Process Improvement Using Six Sigma
Structured NERC CIP Process Improvement Using Six SigmaStructured NERC CIP Process Improvement Using Six Sigma
Structured NERC CIP Process Improvement Using Six SigmaEnergySec
 
Project Management for Information System Development
Project Management for Information System DevelopmentProject Management for Information System Development
Project Management for Information System DevelopmentNabilaNuzhat
 
Etl testing strategies
Etl testing strategiesEtl testing strategies
Etl testing strategiessivam_1
 
Testing insights from data lakes
Testing insights from data lakesTesting insights from data lakes
Testing insights from data lakesshivindkaur
 
rough-work.pptx
rough-work.pptxrough-work.pptx
rough-work.pptxsharpan
 
Enterprise resource planning_system
Enterprise resource planning_systemEnterprise resource planning_system
Enterprise resource planning_systemJithin Zcs
 
kuali-research-testing-straterrtegy.pptx
kuali-research-testing-straterrtegy.pptxkuali-research-testing-straterrtegy.pptx
kuali-research-testing-straterrtegy.pptxkedarnathgoud05
 
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...Cognizant
 
Validation and Business Considerations for Clinical Study Migrations
Validation and Business Considerations for Clinical Study MigrationsValidation and Business Considerations for Clinical Study Migrations
Validation and Business Considerations for Clinical Study MigrationsPerficient, Inc.
 
Muskan asnani internet marketing
Muskan asnani  internet marketingMuskan asnani  internet marketing
Muskan asnani internet marketingMuskan Asnani
 
Unit 1 sepm cleanroom engineering
Unit 1 sepm cleanroom engineeringUnit 1 sepm cleanroom engineering
Unit 1 sepm cleanroom engineeringKanchanPatil34
 
Continuous validation of office 365
Continuous validation of office 365Continuous validation of office 365
Continuous validation of office 365Montrium
 

Similar to 20171019 data migration (rk) (20)

DMM9 - Data Migration Testing
DMM9 - Data Migration TestingDMM9 - Data Migration Testing
DMM9 - Data Migration Testing
 
Nicholas king oracle epm migration and upgrade
Nicholas king   oracle epm migration and upgradeNicholas king   oracle epm migration and upgrade
Nicholas king oracle epm migration and upgrade
 
An Introduction to Clinical Study Migrations
An Introduction to Clinical Study MigrationsAn Introduction to Clinical Study Migrations
An Introduction to Clinical Study Migrations
 
How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...
How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...
How to Migrate Drug Safety and Pharmacovigilance Data Cost-Effectively and wi...
 
Production-Cutover-Strategy1-1qvnpnh.ppt
Production-Cutover-Strategy1-1qvnpnh.pptProduction-Cutover-Strategy1-1qvnpnh.ppt
Production-Cutover-Strategy1-1qvnpnh.ppt
 
Structured NERC CIP Process Improvement Using Six Sigma
Structured NERC CIP Process Improvement Using Six SigmaStructured NERC CIP Process Improvement Using Six Sigma
Structured NERC CIP Process Improvement Using Six Sigma
 
Project Management for Information System Development
Project Management for Information System DevelopmentProject Management for Information System Development
Project Management for Information System Development
 
Etl testing strategies
Etl testing strategiesEtl testing strategies
Etl testing strategies
 
Taleo FSO Sales Presentation.pdf
Taleo FSO Sales Presentation.pdfTaleo FSO Sales Presentation.pdf
Taleo FSO Sales Presentation.pdf
 
Testing insights from data lakes
Testing insights from data lakesTesting insights from data lakes
Testing insights from data lakes
 
rough-work.pptx
rough-work.pptxrough-work.pptx
rough-work.pptx
 
Agile testing approach
Agile testing approachAgile testing approach
Agile testing approach
 
Enterprise resource planning_system
Enterprise resource planning_systemEnterprise resource planning_system
Enterprise resource planning_system
 
ASAP Overview.ppt
ASAP Overview.pptASAP Overview.ppt
ASAP Overview.ppt
 
kuali-research-testing-straterrtegy.pptx
kuali-research-testing-straterrtegy.pptxkuali-research-testing-straterrtegy.pptx
kuali-research-testing-straterrtegy.pptx
 
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
 
Validation and Business Considerations for Clinical Study Migrations
Validation and Business Considerations for Clinical Study MigrationsValidation and Business Considerations for Clinical Study Migrations
Validation and Business Considerations for Clinical Study Migrations
 
Muskan asnani internet marketing
Muskan asnani  internet marketingMuskan asnani  internet marketing
Muskan asnani internet marketing
 
Unit 1 sepm cleanroom engineering
Unit 1 sepm cleanroom engineeringUnit 1 sepm cleanroom engineering
Unit 1 sepm cleanroom engineering
 
Continuous validation of office 365
Continuous validation of office 365Continuous validation of office 365
Continuous validation of office 365
 

Recently uploaded

Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

20171019 data migration (rk)

  • 2. 2 A successful Data Migration is defined by a set of quality criteria 2 A seasoned method balances attention to the criteria • Agreed stakeholder impact – customer, organization & third parties • Reliable and correct execution – supported by a transparent validation process • Controlled migration process – with well defined decision points • Auditable – process is fully reconstructable • Right cost and duration – adjusted to risk appetite
  • 3. 3 Data Migration is represented as a Workstream in a transition program 3 Analysis Design, Build & Component Test Integration Test Data Quality Commercial Preparation Target Application Landscape Work Processes and Instructions Data Migration Execute PilotDress Rehearsal Business Process Tests Realization of target application landscape Configuration of Target Applications (i.e. products, …) Migration Iterations Commercial Migration Process Client Communication (i.e. letters) Customer panel Customer Impact analysis Data Analysis Data Quality Improvement Functional Migration Process Data Mapping Design of Migration Components Migration System (Components) Work Process Definition and Description Work Instructions (i.e. Aris) Migration Tests Ist/Soll Gap Analysis Product/Chann el matrix 1 2 3 4 Data Quality Improvement New objects in Target Applications (Commercial Go Live) Pilot Test of target landscape for new Objects Dry-Run of Work Processes Data Migration Strategy (incl. Acceptance Criteria)
  • 4. 4 Data Migration done Agile: series of incremental migration iterations 4 Migratie strategy Migration Tranche 1 Migration Tranche 2 Migration Tranche N Close out Number and duration of iterations depends on: • Desired level of automation • Available IT capacity • Available capacity for manual migration processes • acceptabele customer timpact & impact on own organization Gap analysis Execution (optional) Data analysis
  • 5. 5 Migration Iterations consist of a set of standard activities 5 Objectives, scope & acceptance criteria Data Analysis Data Cleansing Data Mapping Design, Build, Test Extract, Transform, Load, Validate Migration test Business process test Execution (0, 1 or n tranches) Design, Build, Test Configuration and adaptations of tagret applications • test cycles (2) • Dress Rehearsal • Internal Tranche • Live Migration • Data Ware House
  • 6. 6 Migration activities result in standard migration deliverables (with dependencies) 6 Migration Strategy Program Objectives & Scope Data Analysis (source) Production Data Functional Migration Process Component Design Technical Migration Process Migration System Component Design Business Process Test Target Application Landscape Clean Production Data Dress Reheasal Run Book Migration System/Int. Test Design Execution Governance Migration Test Plan Readiness Assessment Migration Test Report Data Mapping Execution Status/ Evaluation Report Work Instructions Ist/Soll Gap Analysis Commercial Migration Approach
  • 7. 7 Data Migration Strategy defines the outlines of the migration 7 Subjects to be addressed Migrating Objects (incl. volumes) Source & Target Systems Scope (i.e. active objects vs historic data) Stake Holders Acceptance Criteria Migration Approach • big bang vs iterations, slicing criteria, • On-/Off-Line/Real time/Batch • Timing – critical migration windows vs. synchronization source/target • Load approach (database, application, service) • Test approach (Business Process Tests) • Manual/Automated • Pipeline issues • Rollback / fallback Validation Approach (i.e. confidence checks) Customer Impact, systems availability, communication Data Quality (required vs desirable)
  • 8. 8 Data Analysis provide insight in production data volumes, relations and frequency distribution 8 Data Analysis ReportSQL QueriesExcel Pivot Table The truth is in the data
  • 9. 9 Data Migration designed according to Extract Transform Load Validate pattern 9 Source Systems Landing Extracted Files Staging Conversion Engine Transform Load Target Systems Extracted Files Validation Tool Validation Database Validation Tool  Validation tool shares platform with Conversion Engine  Both the engine and the validation tool are based on extraction files from Source and Target  Mapping is conducted independently from conversion engine to ensure proper validation Control Model  The control model defines where the checkpoints in the migration process are created and the metrics  Every time data flows from one stage to the other, a report is generated to show counts, sums and cross connections Each table contains source, timestamp and where applicable reference to transformation rules Counts and Sums are calculated at each point where data is handed over to next stage
  • 10. 10 First Test Cycle serves as proof of concept and learning curve, subsequent Test Cycles iron out defects 10 Cycle #1 Cycle #2 Cycle #3 Proof of concept Test completion • Goal 1st test cycle is a complete run to proof the concept • Duration needed for sub-sequent cycles can be derived • Both full migration execution as well as business processes in target in scope • Goal of subsequent cycles is to complete test execution until defects are removed • Every cycle will be based on a new release of migration engine (except the last one which must be based on a stable version) • Duration of a cycle is not expected to decrease significant Set-up preconditions Execute migration Conduct BP Testing Wrap-up results Fix defects
  • 11. 11 Successful Data Migration execution relies on five deliverables 11 Five Deliverables for Data Migration Execution Stage: 1. Governance process and structure with representation of key stake holders 2. Central control room capable of directing the migration process 3. Run book with full details of data migration activities (who, when, where and dependencies) 4. Proven migration system and process – passed successful Dress Rehearsal 5. Readiness assessment artifacts
  • 12. 12 Successful Data Migration requires skills and experience 12 DataDogs have Data in their DNA 20 Highly trained, skilled and experienced professionals More than 15 successful migration projects Vincent Wormer Ruud Kapteijn Manuel Noechel Jacco de Gooijer Datadogs is the right partner for a successful Data Migration