SlideShare a Scribd company logo
1 of 26
by Roque Daudt, BCompSC, ITIL, CRM
rdaudt@yahoo.com
The #1 Success Factor for Data
Migration Projects
Data Migration
Target Audience
Who needs to know it?
Project managers
..who want to ensure that data migration
projects are adequately resourced and
that deliverables are produced within the
approved budget and schedule
Project sponsors
..who want to know in advance the risks and
costs of data migration projects
BAs, SMEs, other project members
..who will work together with the data
migration team
Data teams
..who may be new to data migration projects
Problem Definition
What is the issue with data migration projects?
About 40% of the
projects overrun or are
cancelled 1
Data quality issues disable or severely cripple
application functionality. Compliance issues.
When there is an
overrun it nearly
always involves both
time and costs 2
QUALITY
Simply put, they fail too often
1, 2 Bloor Research, 2011
Problem definition
Data loss
Impact on quality of analytics services
Impact on business processes
Extended downtime
Lost revenue
Missed business timelines
Impact on clients and partners
Non-compliance
What is the impact on business?
Root cause
Data migration projects fail because they are poorly planned
Limited
understanding about
the nature, complexity
and risks associated
to data migration
Limited understanding about data quality
Lack of awareness
about the role and
importance of
collaboration and
governance
Root causes of poor planning
Data migration myths
Common attributes of a failed data migration project
Thin on expertise
Underfunded
Underresourced
Inadequate approach
Little business/IT collaboration
Unrealistic timelines
High risk
Poor governance
It starts too late!
Data migration mythology
Top myth
Misconceptions about data migrations are also
fueled by some myths
Chief among them is the understanding that the
work on data migration should only start when
the larger project is wrapping up
This is simply not true. A tremendous amount of
data migration-related work can and should be
done as soon as the broader project starts
An early start is the #1 success
factor for data migration efforts
Let’s explore ahead how it helps to decrease risk
and increase the chances of success
Benefits of an early start
Learn about the business and the application
The data team needs to acquire a good understanding of the
business and the application in order to develop and run a
successful data migration
Early access to SMEs, BAs, Architects, the legacy
application and existing documentation provide the data
team with enough knowledge and time to create and refine
the data migration approach
Benefits of an early start
Get familiar with the source data model
Detailed requirements will be fleshed out later on but the
domain of business data that will be migrated is usually known
at the start of most projects
Early access to the data model of the legacy application
provides the data team with an opportunity to map it to the
business data at a high level. This will be key input when
the time comes to map the source to the target data model.
Benefits of an early start
Design the user migration
In many projects, users will also be migrated to the new application/platform.
The user management frameworks are likely different between the legacy and
the new platforms
Very likely, the data team knows none of them and knows nothing about the
support that exists to it in the persistence layer
An early opportunity to review them will help the data team to develop the
approach to user migration. In some cases, it may also allow for early design
Benefits of an early start
Run technology survey and analysis
The diversity of database products and persistence
technologies is almost endless. Once the data team is put in
contact with the source data custodians, it can start to survey
and analyze the technology landscape
Information gathered by this work will be a key input to
develop the approach for data extract and data movement
Benefits of an early start
Get a handle on size
When it comes to data, size matters
Data profiling can be easily done with a productivity tool
such as MS Excel when the data source is, say, little more
than a few thousand Accounts. Things get increasingly more
challenging as the data volumes increase
Insights on data volumes will be key input for the
development of the overall data migration approach,
including the need to procure and acquire tools
Benefits of an early start
Review the sharing mechanisms
Data is always owned by one or more application users, teams,
groups, etc. It must often be shared with others
More often than not, the data sharing-related requirements
don't change much when an application is re-developed or
moved to a new platform
The sharing mechanisms are platform-specific, though. For
this reason, an early opportunity to review these
mechanisms will greatly help the data team to build support
for the data sharing requirements in the data migration
Benefits of an early start
Establish governance
Most enterprises have a slew of policies, standards and practices
that govern data availability, access, movement, storage, usability,
integrity and security
These constraints must be followed and taken into consideration
when the approach for the data migration is developed
Early review and structuring of the governance aspects of the data
migration will ensure compliance and will allow the data team to
timely identify and address potential roadblocks
Benefits of an early start
Review the toolbox
At times the data team will be required to work with a specific set of
ETL tools; those made available by the client. These tools may not
be well known by the team
To early identify such constraints allows the data migration team
to bring awareness to the project manager about the need to
build a ramp-up time in the project.
Benefits of an early start
Build a better application
The process of developing requirements for a new application or a re-
platform initiative is complex.
One valuable tool is the analysis of the data model of the legacy application.
By getting familiar with it early in the project, the data migration team can
provide rich insights to the BAs about data domains, relationships and
business rules that were missed or not clearly articulated while running
requirements development.
Benefits of an early start
Summary
the data team is given
the time and tools to
develop and refine the
approach for the data
migration
the data team gets an
opportunity to validate
several aspects of the
approach and confirm
that governance will be
in place
the overall development process is improved by the
insights that the data team can share with other project
members about the data source
when the time comes to design the
data migration in details the data team
is already familiar with the target and
source platforms, the tools, the security
and sharing models, the source data
model
all these aspects significanty improve the chances that the
data migration efforts will produce their deliverables in
time, on budget and with better quality.
And by starting it early, for
whatever was missed, there is
still time to deal with it!
That’s why our advice is
Why we created this presentation
I have been involved with data-related projects a number of times in my career. Many of
them were data migration projects. This gave me the opportunity to make my share of
mistakes and learn a bit from them. In particular, to learn that data migrations can look
like deceivingly straightforward efforts when in fact they are risky undertakings.
The risks carried by data migration are nothing new, though. Data practitioners have
been vocal about it for quite a while. However, for whatever reason, too often this
message fails to reach the ears of those in position to make the decisions that will make
or break such projects.
This presentation is a lighthearted, visual-oriented attempt to share the same message,
with hopes that it can reach a wider audience and foster some conversation. If you find
value in it and know someone who could benefit from these notes, feel free to pass it
along.
A couple of good references
Seek and you shall find. There is no shortage of good material about data and data
migration out there. Here are some that I bumped into while preparing this deck.
http://www.oracle.com/technetwork/middleware/oedq/successful-data-migration-wp-
1555708.pdf
http://dataagilitygroup.com/blog/most-data-migration-projects-bust-both-budgets-and-
schedules/
http://www.oracle.com/us/products/middleware/data-integration/enterprise-data-
quality/data-migration-wp-2345281.pdf
https://premier-international.com/the-impact-of-a-failed-data-migration/
https://www.dataqualitypro.com/
Let’s keep the conversation going!
Does it all make sense to you? Yes? No? Why not? Different experience? Similar
experience? No experience? Like the colors of the deck? Hate them? Are you Mike the
Sql Guy? Let us know. Sharing is caring. It is all for the greater good.
This material was originally published to LinkedIn where you can find me at
www.linkedin.com/in/rdaudt
Good, old email still works
rdaudt@yahoo.com
We appreciated the contributions received
Thank you very much to the fine folks that helped in one way or another to put this
deck together and..

More Related Content

What's hot

Do You Trust Your Machine Learning Outcomes?
 Do You Trust Your Machine Learning Outcomes?  Do You Trust Your Machine Learning Outcomes?
Do You Trust Your Machine Learning Outcomes? Precisely
 
Presentation by rahul ghodke
Presentation by rahul ghodkePresentation by rahul ghodke
Presentation by rahul ghodkePMI_IREP_TP
 
Doing qualitative data analysis
Doing qualitative data analysisDoing qualitative data analysis
Doing qualitative data analysisIrene Torres
 
Presentation by namit
Presentation by namitPresentation by namit
Presentation by namitPMI_IREP_TP
 
Methods of Organizational Change Management
Methods of Organizational Change ManagementMethods of Organizational Change Management
Methods of Organizational Change ManagementDATAVERSITY
 
Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...
Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...
Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...DATAVERSITY
 
Cutting through the hype - how to use advanced analytics to do practical thin...
Cutting through the hype - how to use advanced analytics to do practical thin...Cutting through the hype - how to use advanced analytics to do practical thin...
Cutting through the hype - how to use advanced analytics to do practical thin...Association for Project Management
 
The what, why, and how of master data management
The what, why, and how of master data managementThe what, why, and how of master data management
The what, why, and how of master data managementMohammad Yousri
 
Infosys best practices_mdm_wp
Infosys best practices_mdm_wpInfosys best practices_mdm_wp
Infosys best practices_mdm_wpwardell henley
 
Master data management executive mdm buy in business case (2)
Master data management executive mdm buy in business case (2)Master data management executive mdm buy in business case (2)
Master data management executive mdm buy in business case (2)Maria Pulsoni-Cicio
 
Dave Bennett Resume 03-09-15
Dave Bennett Resume 03-09-15Dave Bennett Resume 03-09-15
Dave Bennett Resume 03-09-15David Bennett
 
Space Evaders Hacking for Diplomacy week 8
Space Evaders Hacking for Diplomacy week 8Space Evaders Hacking for Diplomacy week 8
Space Evaders Hacking for Diplomacy week 8Stanford University
 
Tips for Effective Data Science in the Enterprise
Tips for Effective Data Science in the EnterpriseTips for Effective Data Science in the Enterprise
Tips for Effective Data Science in the EnterpriseLisa Cohen
 
Best Practices with the DMM
Best Practices with the DMMBest Practices with the DMM
Best Practices with the DMMDATAVERSITY
 
Edward W. Lake - Engagement Management 4-15-16
Edward W. Lake - Engagement Management 4-15-16Edward W. Lake - Engagement Management 4-15-16
Edward W. Lake - Engagement Management 4-15-16Edward Lake
 
MDM Strategy & Roadmap
MDM Strategy & RoadmapMDM Strategy & Roadmap
MDM Strategy & Roadmapvictorlbrown
 
Kevin+Bilbreys+Resume+2015
Kevin+Bilbreys+Resume+2015Kevin+Bilbreys+Resume+2015
Kevin+Bilbreys+Resume+2015Kevin Bilbrey
 
Overcoming Big Data Challenges on System z
Overcoming Big Data Challenges on System zOvercoming Big Data Challenges on System z
Overcoming Big Data Challenges on System zCA Technologies
 

What's hot (20)

Do You Trust Your Machine Learning Outcomes?
 Do You Trust Your Machine Learning Outcomes?  Do You Trust Your Machine Learning Outcomes?
Do You Trust Your Machine Learning Outcomes?
 
Presentation by rahul ghodke
Presentation by rahul ghodkePresentation by rahul ghodke
Presentation by rahul ghodke
 
Doing qualitative data analysis
Doing qualitative data analysisDoing qualitative data analysis
Doing qualitative data analysis
 
Presentation by namit
Presentation by namitPresentation by namit
Presentation by namit
 
Methods of Organizational Change Management
Methods of Organizational Change ManagementMethods of Organizational Change Management
Methods of Organizational Change Management
 
Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...
Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...
Data-Ed Webinar: Implementing the Data Management Maturity Model (DMM) - With...
 
Cornerstones of CASL Compliance
Cornerstones of CASL ComplianceCornerstones of CASL Compliance
Cornerstones of CASL Compliance
 
Cutting through the hype - how to use advanced analytics to do practical thin...
Cutting through the hype - how to use advanced analytics to do practical thin...Cutting through the hype - how to use advanced analytics to do practical thin...
Cutting through the hype - how to use advanced analytics to do practical thin...
 
The what, why, and how of master data management
The what, why, and how of master data managementThe what, why, and how of master data management
The what, why, and how of master data management
 
Infosys best practices_mdm_wp
Infosys best practices_mdm_wpInfosys best practices_mdm_wp
Infosys best practices_mdm_wp
 
Master data management executive mdm buy in business case (2)
Master data management executive mdm buy in business case (2)Master data management executive mdm buy in business case (2)
Master data management executive mdm buy in business case (2)
 
Where's the data
Where's the dataWhere's the data
Where's the data
 
Dave Bennett Resume 03-09-15
Dave Bennett Resume 03-09-15Dave Bennett Resume 03-09-15
Dave Bennett Resume 03-09-15
 
Space Evaders Hacking for Diplomacy week 8
Space Evaders Hacking for Diplomacy week 8Space Evaders Hacking for Diplomacy week 8
Space Evaders Hacking for Diplomacy week 8
 
Tips for Effective Data Science in the Enterprise
Tips for Effective Data Science in the EnterpriseTips for Effective Data Science in the Enterprise
Tips for Effective Data Science in the Enterprise
 
Best Practices with the DMM
Best Practices with the DMMBest Practices with the DMM
Best Practices with the DMM
 
Edward W. Lake - Engagement Management 4-15-16
Edward W. Lake - Engagement Management 4-15-16Edward W. Lake - Engagement Management 4-15-16
Edward W. Lake - Engagement Management 4-15-16
 
MDM Strategy & Roadmap
MDM Strategy & RoadmapMDM Strategy & Roadmap
MDM Strategy & Roadmap
 
Kevin+Bilbreys+Resume+2015
Kevin+Bilbreys+Resume+2015Kevin+Bilbreys+Resume+2015
Kevin+Bilbreys+Resume+2015
 
Overcoming Big Data Challenges on System z
Overcoming Big Data Challenges on System zOvercoming Big Data Challenges on System z
Overcoming Big Data Challenges on System z
 

Similar to The #1 Success Factor for Data Migration Projects

Scope of Data Integration
Scope of Data IntegrationScope of Data Integration
Scope of Data IntegrationHEXANIKA
 
The Four Pillars of Analytics Technology Whitepaper
The Four Pillars of Analytics Technology WhitepaperThe Four Pillars of Analytics Technology Whitepaper
The Four Pillars of Analytics Technology WhitepaperEdgar Alejandro Villegas
 
Comprehensive Data Governance Program
Comprehensive Data Governance ProgramComprehensive Data Governance Program
Comprehensive Data Governance ProgramSteve Sugulas
 
User access profiling model
User access profiling modelUser access profiling model
User access profiling modelJose Guerrero
 
Get ahead of the cloud or get left behind
Get ahead of the cloud or get left behindGet ahead of the cloud or get left behind
Get ahead of the cloud or get left behindMatt Mandich
 
Data Migration in Malta and Libya
Data Migration in Malta and LibyaData Migration in Malta and Libya
Data Migration in Malta and LibyaData Tech
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Nathan Bijnens
 
Learn How to Maximize Your ServiceNow Investment
Learn How to Maximize Your ServiceNow InvestmentLearn How to Maximize Your ServiceNow Investment
Learn How to Maximize Your ServiceNow InvestmentStave
 
Troux Presentation Austin Texas
Troux Presentation Austin TexasTroux Presentation Austin Texas
Troux Presentation Austin TexasJoeFaghani
 
How to add security in dataops and devops
How to add security in dataops and devopsHow to add security in dataops and devops
How to add security in dataops and devopsUlf Mattsson
 
Creating a Successful DataOps Framework for Your Business.pdf
Creating a Successful DataOps Framework for Your Business.pdfCreating a Successful DataOps Framework for Your Business.pdf
Creating a Successful DataOps Framework for Your Business.pdfEnov8
 
December 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWA
December 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWADecember 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWA
December 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWACarsten Roland
 
Accelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data InitiativesAccelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data Initiatives☁Jake Weaver ☁
 
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...Databricks
 
The Path to Data and Analytics Modernization
The Path to Data and Analytics ModernizationThe Path to Data and Analytics Modernization
The Path to Data and Analytics ModernizationAnalytics8
 
Lotus Notes Application Migration
Lotus Notes Application  MigrationLotus Notes Application  Migration
Lotus Notes Application MigrationMaarga Systems
 
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...Boston Data Engineering
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperRyan Dowd
 

Similar to The #1 Success Factor for Data Migration Projects (20)

Scope of Data Integration
Scope of Data IntegrationScope of Data Integration
Scope of Data Integration
 
The Four Pillars of Analytics Technology Whitepaper
The Four Pillars of Analytics Technology WhitepaperThe Four Pillars of Analytics Technology Whitepaper
The Four Pillars of Analytics Technology Whitepaper
 
Comprehensive Data Governance Program
Comprehensive Data Governance ProgramComprehensive Data Governance Program
Comprehensive Data Governance Program
 
Research paper on big data and hadoop
Research paper on big data and hadoopResearch paper on big data and hadoop
Research paper on big data and hadoop
 
User access profiling model
User access profiling modelUser access profiling model
User access profiling model
 
Get ahead of the cloud or get left behind
Get ahead of the cloud or get left behindGet ahead of the cloud or get left behind
Get ahead of the cloud or get left behind
 
Data Migration in Malta and Libya
Data Migration in Malta and LibyaData Migration in Malta and Libya
Data Migration in Malta and Libya
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)
 
Learn How to Maximize Your ServiceNow Investment
Learn How to Maximize Your ServiceNow InvestmentLearn How to Maximize Your ServiceNow Investment
Learn How to Maximize Your ServiceNow Investment
 
Troux Presentation Austin Texas
Troux Presentation Austin TexasTroux Presentation Austin Texas
Troux Presentation Austin Texas
 
How to add security in dataops and devops
How to add security in dataops and devopsHow to add security in dataops and devops
How to add security in dataops and devops
 
Creating a Successful DataOps Framework for Your Business.pdf
Creating a Successful DataOps Framework for Your Business.pdfCreating a Successful DataOps Framework for Your Business.pdf
Creating a Successful DataOps Framework for Your Business.pdf
 
December 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWA
December 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWADecember 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWA
December 2015 - TDWI Checklist Report - Seven Best Practices for Adapting DWA
 
Accelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data InitiativesAccelerating Time to Success for Your Big Data Initiatives
Accelerating Time to Success for Your Big Data Initiatives
 
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
 
The Path to Data and Analytics Modernization
The Path to Data and Analytics ModernizationThe Path to Data and Analytics Modernization
The Path to Data and Analytics Modernization
 
Lotus Notes Application Migration
Lotus Notes Application  MigrationLotus Notes Application  Migration
Lotus Notes Application Migration
 
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - Whitepaper
 
Buyer's guide to strategic analytics
Buyer's guide to strategic analyticsBuyer's guide to strategic analytics
Buyer's guide to strategic analytics
 

Recently uploaded

PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPramod Kumar Srivastava
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceSapana Sha
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理e4aez8ss
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
Dubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls DubaiDubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls Dubaihf8803863
 
办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一
办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一
办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一F La
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptSonatrach
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024thyngster
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfBoston Institute of Analytics
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degreeyuu sss
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queensdataanalyticsqueen03
 
GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]📊 Markus Baersch
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 

Recently uploaded (20)

PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
 
Call Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts ServiceCall Girls In Dwarka 9654467111 Escorts Service
Call Girls In Dwarka 9654467111 Escorts Service
 
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
科罗拉多大学波尔得分校毕业证学位证成绩单-可办理
 
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
Dubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls DubaiDubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls Dubai
 
办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一
办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一
办理(UWIC毕业证书)英国卡迪夫城市大学毕业证成绩单原版一比一
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdf
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
Consent & Privacy Signals on Google *Pixels* - MeasureCamp Amsterdam 2024
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
毕业文凭制作#回国入职#diploma#degree澳洲中央昆士兰大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
 
Top 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In QueensTop 5 Best Data Analytics Courses In Queens
Top 5 Best Data Analytics Courses In Queens
 
GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]GA4 Without Cookies [Measure Camp AMS]
GA4 Without Cookies [Measure Camp AMS]
 
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptxE-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 

The #1 Success Factor for Data Migration Projects

  • 1.
  • 2.
  • 3. by Roque Daudt, BCompSC, ITIL, CRM rdaudt@yahoo.com The #1 Success Factor for Data Migration Projects Data Migration
  • 4. Target Audience Who needs to know it? Project managers ..who want to ensure that data migration projects are adequately resourced and that deliverables are produced within the approved budget and schedule Project sponsors ..who want to know in advance the risks and costs of data migration projects BAs, SMEs, other project members ..who will work together with the data migration team Data teams ..who may be new to data migration projects
  • 5. Problem Definition What is the issue with data migration projects? About 40% of the projects overrun or are cancelled 1 Data quality issues disable or severely cripple application functionality. Compliance issues. When there is an overrun it nearly always involves both time and costs 2 QUALITY Simply put, they fail too often 1, 2 Bloor Research, 2011
  • 6. Problem definition Data loss Impact on quality of analytics services Impact on business processes Extended downtime Lost revenue Missed business timelines Impact on clients and partners Non-compliance What is the impact on business?
  • 7. Root cause Data migration projects fail because they are poorly planned Limited understanding about the nature, complexity and risks associated to data migration Limited understanding about data quality Lack of awareness about the role and importance of collaboration and governance Root causes of poor planning Data migration myths
  • 8. Common attributes of a failed data migration project Thin on expertise Underfunded Underresourced Inadequate approach Little business/IT collaboration Unrealistic timelines High risk Poor governance It starts too late!
  • 9. Data migration mythology Top myth Misconceptions about data migrations are also fueled by some myths Chief among them is the understanding that the work on data migration should only start when the larger project is wrapping up This is simply not true. A tremendous amount of data migration-related work can and should be done as soon as the broader project starts
  • 10. An early start is the #1 success factor for data migration efforts Let’s explore ahead how it helps to decrease risk and increase the chances of success
  • 11. Benefits of an early start Learn about the business and the application The data team needs to acquire a good understanding of the business and the application in order to develop and run a successful data migration Early access to SMEs, BAs, Architects, the legacy application and existing documentation provide the data team with enough knowledge and time to create and refine the data migration approach
  • 12. Benefits of an early start Get familiar with the source data model Detailed requirements will be fleshed out later on but the domain of business data that will be migrated is usually known at the start of most projects Early access to the data model of the legacy application provides the data team with an opportunity to map it to the business data at a high level. This will be key input when the time comes to map the source to the target data model.
  • 13. Benefits of an early start Design the user migration In many projects, users will also be migrated to the new application/platform. The user management frameworks are likely different between the legacy and the new platforms Very likely, the data team knows none of them and knows nothing about the support that exists to it in the persistence layer An early opportunity to review them will help the data team to develop the approach to user migration. In some cases, it may also allow for early design
  • 14. Benefits of an early start Run technology survey and analysis The diversity of database products and persistence technologies is almost endless. Once the data team is put in contact with the source data custodians, it can start to survey and analyze the technology landscape Information gathered by this work will be a key input to develop the approach for data extract and data movement
  • 15. Benefits of an early start Get a handle on size When it comes to data, size matters Data profiling can be easily done with a productivity tool such as MS Excel when the data source is, say, little more than a few thousand Accounts. Things get increasingly more challenging as the data volumes increase Insights on data volumes will be key input for the development of the overall data migration approach, including the need to procure and acquire tools
  • 16. Benefits of an early start Review the sharing mechanisms Data is always owned by one or more application users, teams, groups, etc. It must often be shared with others More often than not, the data sharing-related requirements don't change much when an application is re-developed or moved to a new platform The sharing mechanisms are platform-specific, though. For this reason, an early opportunity to review these mechanisms will greatly help the data team to build support for the data sharing requirements in the data migration
  • 17. Benefits of an early start Establish governance Most enterprises have a slew of policies, standards and practices that govern data availability, access, movement, storage, usability, integrity and security These constraints must be followed and taken into consideration when the approach for the data migration is developed Early review and structuring of the governance aspects of the data migration will ensure compliance and will allow the data team to timely identify and address potential roadblocks
  • 18. Benefits of an early start Review the toolbox At times the data team will be required to work with a specific set of ETL tools; those made available by the client. These tools may not be well known by the team To early identify such constraints allows the data migration team to bring awareness to the project manager about the need to build a ramp-up time in the project.
  • 19. Benefits of an early start Build a better application The process of developing requirements for a new application or a re- platform initiative is complex. One valuable tool is the analysis of the data model of the legacy application. By getting familiar with it early in the project, the data migration team can provide rich insights to the BAs about data domains, relationships and business rules that were missed or not clearly articulated while running requirements development.
  • 20. Benefits of an early start Summary the data team is given the time and tools to develop and refine the approach for the data migration the data team gets an opportunity to validate several aspects of the approach and confirm that governance will be in place the overall development process is improved by the insights that the data team can share with other project members about the data source when the time comes to design the data migration in details the data team is already familiar with the target and source platforms, the tools, the security and sharing models, the source data model all these aspects significanty improve the chances that the data migration efforts will produce their deliverables in time, on budget and with better quality.
  • 21. And by starting it early, for whatever was missed, there is still time to deal with it!
  • 22. That’s why our advice is
  • 23. Why we created this presentation I have been involved with data-related projects a number of times in my career. Many of them were data migration projects. This gave me the opportunity to make my share of mistakes and learn a bit from them. In particular, to learn that data migrations can look like deceivingly straightforward efforts when in fact they are risky undertakings. The risks carried by data migration are nothing new, though. Data practitioners have been vocal about it for quite a while. However, for whatever reason, too often this message fails to reach the ears of those in position to make the decisions that will make or break such projects. This presentation is a lighthearted, visual-oriented attempt to share the same message, with hopes that it can reach a wider audience and foster some conversation. If you find value in it and know someone who could benefit from these notes, feel free to pass it along.
  • 24. A couple of good references Seek and you shall find. There is no shortage of good material about data and data migration out there. Here are some that I bumped into while preparing this deck. http://www.oracle.com/technetwork/middleware/oedq/successful-data-migration-wp- 1555708.pdf http://dataagilitygroup.com/blog/most-data-migration-projects-bust-both-budgets-and- schedules/ http://www.oracle.com/us/products/middleware/data-integration/enterprise-data- quality/data-migration-wp-2345281.pdf https://premier-international.com/the-impact-of-a-failed-data-migration/ https://www.dataqualitypro.com/
  • 25. Let’s keep the conversation going! Does it all make sense to you? Yes? No? Why not? Different experience? Similar experience? No experience? Like the colors of the deck? Hate them? Are you Mike the Sql Guy? Let us know. Sharing is caring. It is all for the greater good. This material was originally published to LinkedIn where you can find me at www.linkedin.com/in/rdaudt Good, old email still works rdaudt@yahoo.com
  • 26. We appreciated the contributions received Thank you very much to the fine folks that helped in one way or another to put this deck together and..