SlideShare a Scribd company logo
TEST DATA TRANSFER TOOL (TDTT) – Hai Nguyen
Agenda
•Overview
•Demo
•QA
Goals
This tool is designed to transfer the data
between environments to create test or demo
environments with the latest data.
It shouldn’t be used to import data into the
production environment.
Goals (cont)
The Test Data Transfer Tool works by calling the Microsoft SQL Server
client tools bulk copy program, BCP.exe. BCP runs very quickly, thus
this tool runs faster than some other data transfer tools. The Test
Data Transfer Tool does not interact with the AOS.
You must have a CustomerSource or PartnerSource account to be
able to download the Test Data Transfer Tool installer. The installer
must be run by an administrator account.
As of today, you can download the tool from LCS (Life Cycle
Services).
Pre-requisites
• To be run on a system with SQL Server client tools installed.
• During import, you must run the tool directly from the
computer that is hosting the database.
• Select & Bulk Insert permissions on the SQL database and
ALTER INDEX permission on the table (this is needed if the
data violates the unique index constraints and you want index
to be
disabled automatically).
• Permission to execute SQL scripts that are executed pre- and
post export/import. These can be found in import and
export directory.
PROS and CONS
PROS
1. Very lightweight and simple to use tool.
2. Can be installed on any machine that has the SQL Server Client tools installed.
3. Can be handy tool in transferring the data among the different environments (for example
data transfer from production to the training environment).
4. This tool can be used to move subset of the data.
5. The tool can be used to import and export any AX entity but I found it more useful while
transferring configuration data among the environments. (for example module parameters
tables)
6. Fast when compare to other data migration tools for AX.
7. Can export or import data when an AOS instance is not running.
8. Export or import Microsoft Dynamics AX data more quickly compared to other methods.
9. Only minimal changes are made to the data that you import. This feature helps guarantee
that the data is stable over time. For example, the tool never renumbers RecIDs.
PROS (cont)
10. The data file format is text-based. Therefore, the data can be compared with earlier versions and
stored in a version control system.
11. The data file format is a standard format that is produced by bcp.
12. Exported data can be filtered. Therefore, specified tables, columns, or rows can be easily excluded
from the export.
13. Differences often occur during development. Because of this feature, data can often be imported
without user intervention, even when the table definitions have changed. For example, tables or fields
that have been renamed do not prevent import.
14. Entity IDs, such as table IDs, class IDs, and extended data type IDs, are updated to match the IDs of the
target system.
15. The tool reads and correctly updates the SYSTEMSEQUENCES table.
CONS
1.The usage of this tool requires you to have a SQL related skillset.
Since the tool is actually a wrapper on top of SQL Server Bulk Copy
Program (bcp) that’s why the expert level knowledge of the AX
database schema and T-SQL is a must.
2.Since the tool works directly on SQL Server database that’s why the
tool doesn’t make sure that your import produces a complete or
coherent database.
3.Need to have access to SQL database and can run as Admin
4.Command line and there is no UI
Export and import process illustrated
Syntax
DP.exe {direction} {directory} {database name} {server}
Syntax
Parameter Description Default value
Direction Parameters indicates the direction (Import/Export)
Specify IMPORT for Importing Data and EXPORT for
exporting data.
EXPORT
directory Indicates the directory
• from which to import data (or)
• To which to export data files
Defaults to current directory if not
specified
database The name of the database:
• from which to export data (or)
• To which import data in to.
AXDB
server The name of the sql server on which the database
is hosted
The current computer name
DEMO
Q&A

More Related Content

What's hot

Oracle BI Publsiher Using Data Template
Oracle BI Publsiher Using Data TemplateOracle BI Publsiher Using Data Template
Oracle BI Publsiher Using Data Template
Edi Yanto
 
AX2012 Technical Track - Entreprise portal, Czesia Langoswka
AX2012 Technical Track -  Entreprise portal, Czesia LangoswkaAX2012 Technical Track -  Entreprise portal, Czesia Langoswka
AX2012 Technical Track - Entreprise portal, Czesia Langoswkadynamicscom
 
An Introduction to the Dynamics AX Application Integration Framework
An Introduction to the Dynamics AX Application Integration FrameworkAn Introduction to the Dynamics AX Application Integration Framework
An Introduction to the Dynamics AX Application Integration Framework
Folio3-Dynamics-Services
 
Data Warehouse approaches with Dynamics AX
Data Warehouse  approaches with Dynamics AXData Warehouse  approaches with Dynamics AX
Data Warehouse approaches with Dynamics AX
Alvin You
 
Xml Publisher
Xml PublisherXml Publisher
Xml Publisher
Duncan Davies
 
SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration Services
Robert MacLean
 
Microsoft Dynamics Ax 2012 extended architecture
Microsoft Dynamics Ax 2012 extended architectureMicrosoft Dynamics Ax 2012 extended architecture
Microsoft Dynamics Ax 2012 extended architecture
Johnkrish S
 
Oracle cloud security | User Security, Roles, Access Control and more
Oracle cloud security | User Security, Roles, Access Control and moreOracle cloud security | User Security, Roles, Access Control and more
Oracle cloud security | User Security, Roles, Access Control and more
CLTConsultingService
 
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
CLTConsultingService
 
What is Business Objects
What is Business Objects What is Business Objects
What is Business Objects
BigClasses.com
 
Graviton BI Publisher Presentation
Graviton BI Publisher PresentationGraviton BI Publisher Presentation
Graviton BI Publisher Presentationgravitonconsulting
 
MS SQL SERVER: SSIS and data mining
MS SQL SERVER: SSIS and data miningMS SQL SERVER: SSIS and data mining
MS SQL SERVER: SSIS and data mining
DataminingTools Inc
 
New features of sql server 2016 bi features
New features of sql server 2016 bi featuresNew features of sql server 2016 bi features
New features of sql server 2016 bi features
Chris Testa-O'Neill
 
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
Edureka!
 
SQL Server Integration Services Best Practices
SQL Server Integration Services Best PracticesSQL Server Integration Services Best Practices
SQL Server Integration Services Best Practices
Denny Lee
 
Data Aware Enterprise v2
Data Aware Enterprise v2Data Aware Enterprise v2
Data Aware Enterprise v2
ukdpe
 
SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration Services
Robert MacLean
 
Bi publisher starter guide to develop first report
Bi publisher starter guide to develop first reportBi publisher starter guide to develop first report
Bi publisher starter guide to develop first report
ketulp
 
Adx studio migration
Adx studio migrationAdx studio migration
Adx studio migration
Umakant Bhardwaj
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssisdeepakk073
 

What's hot (20)

Oracle BI Publsiher Using Data Template
Oracle BI Publsiher Using Data TemplateOracle BI Publsiher Using Data Template
Oracle BI Publsiher Using Data Template
 
AX2012 Technical Track - Entreprise portal, Czesia Langoswka
AX2012 Technical Track -  Entreprise portal, Czesia LangoswkaAX2012 Technical Track -  Entreprise portal, Czesia Langoswka
AX2012 Technical Track - Entreprise portal, Czesia Langoswka
 
An Introduction to the Dynamics AX Application Integration Framework
An Introduction to the Dynamics AX Application Integration FrameworkAn Introduction to the Dynamics AX Application Integration Framework
An Introduction to the Dynamics AX Application Integration Framework
 
Data Warehouse approaches with Dynamics AX
Data Warehouse  approaches with Dynamics AXData Warehouse  approaches with Dynamics AX
Data Warehouse approaches with Dynamics AX
 
Xml Publisher
Xml PublisherXml Publisher
Xml Publisher
 
SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration Services
 
Microsoft Dynamics Ax 2012 extended architecture
Microsoft Dynamics Ax 2012 extended architectureMicrosoft Dynamics Ax 2012 extended architecture
Microsoft Dynamics Ax 2012 extended architecture
 
Oracle cloud security | User Security, Roles, Access Control and more
Oracle cloud security | User Security, Roles, Access Control and moreOracle cloud security | User Security, Roles, Access Control and more
Oracle cloud security | User Security, Roles, Access Control and more
 
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
Oracle Cloud ERP Report and Analytics | What are Cloud ERP reporting Options ...
 
What is Business Objects
What is Business Objects What is Business Objects
What is Business Objects
 
Graviton BI Publisher Presentation
Graviton BI Publisher PresentationGraviton BI Publisher Presentation
Graviton BI Publisher Presentation
 
MS SQL SERVER: SSIS and data mining
MS SQL SERVER: SSIS and data miningMS SQL SERVER: SSIS and data mining
MS SQL SERVER: SSIS and data mining
 
New features of sql server 2016 bi features
New features of sql server 2016 bi featuresNew features of sql server 2016 bi features
New features of sql server 2016 bi features
 
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
SSIS Tutorial For Beginners | SQL Server Integration Services (SSIS) | MSBI T...
 
SQL Server Integration Services Best Practices
SQL Server Integration Services Best PracticesSQL Server Integration Services Best Practices
SQL Server Integration Services Best Practices
 
Data Aware Enterprise v2
Data Aware Enterprise v2Data Aware Enterprise v2
Data Aware Enterprise v2
 
SQL Server Integration Services
SQL Server Integration ServicesSQL Server Integration Services
SQL Server Integration Services
 
Bi publisher starter guide to develop first report
Bi publisher starter guide to develop first reportBi publisher starter guide to develop first report
Bi publisher starter guide to develop first report
 
Adx studio migration
Adx studio migrationAdx studio migration
Adx studio migration
 
Introduction of ssis
Introduction of ssisIntroduction of ssis
Introduction of ssis
 

Viewers also liked

Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
Hai Nguyen
 
What's new in microsoft dynamics ax7
What's new in microsoft dynamics ax7What's new in microsoft dynamics ax7
What's new in microsoft dynamics ax7
Sameh Senosi
 
SharePoint Benefits
SharePoint BenefitsSharePoint Benefits
SharePoint Benefits
Sameh Senosi
 
12 Personality Traits Of A Great Boss
12 Personality Traits Of A Great Boss 12 Personality Traits Of A Great Boss
12 Personality Traits Of A Great Boss
D B
 
Managing for Happiness by Jurgen Appelo
Managing for Happiness by Jurgen AppeloManaging for Happiness by Jurgen Appelo
Managing for Happiness by Jurgen Appelo
Agile ME
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodology
Database Architechs
 

Viewers also liked (6)

Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
 
What's new in microsoft dynamics ax7
What's new in microsoft dynamics ax7What's new in microsoft dynamics ax7
What's new in microsoft dynamics ax7
 
SharePoint Benefits
SharePoint BenefitsSharePoint Benefits
SharePoint Benefits
 
12 Personality Traits Of A Great Boss
12 Personality Traits Of A Great Boss 12 Personality Traits Of A Great Boss
12 Personality Traits Of A Great Boss
 
Managing for Happiness by Jurgen Appelo
Managing for Happiness by Jurgen AppeloManaging for Happiness by Jurgen Appelo
Managing for Happiness by Jurgen Appelo
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodology
 

Similar to Test Data Transfer Tool

introductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptxintroductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptx
YashaswiniSrinivasan1
 
AWS RDS Migration Tool
AWS RDS Migration Tool AWS RDS Migration Tool
Introduction to SQL, SQL*Plus
Introduction to SQL, SQL*PlusIntroduction to SQL, SQL*Plus
Introduction to SQL, SQL*Plus
Chhom Karath
 
Oracle application express
Oracle application expressOracle application express
Oracle application express
Abhinaw Kumar
 
Oracle application express ppt
Oracle application express pptOracle application express ppt
Oracle application express pptAbhinaw Kumar
 
Microsoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations PresentationMicrosoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations PresentationMicrosoft Private Cloud
 
Project Presentation
Project PresentationProject Presentation
Project Presentation
ShariffAyesha
 
Novidades do SQL Server 2016
Novidades do SQL Server 2016Novidades do SQL Server 2016
Novidades do SQL Server 2016
Marcos Freccia
 
Azure Data Fundamentals DP 900 Full Course
Azure Data Fundamentals DP 900 Full CourseAzure Data Fundamentals DP 900 Full Course
Azure Data Fundamentals DP 900 Full Course
Piyush sachdeva
 
Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005
rainynovember12
 
Deep Dive into Azure Data Factory v2
Deep Dive into Azure Data Factory v2Deep Dive into Azure Data Factory v2
Deep Dive into Azure Data Factory v2
Eric Bragas
 
SQL PPT.pptx
SQL PPT.pptxSQL PPT.pptx
SQL PPT.pptx
Kulbir4
 
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
mahdi ahmadi
 
Oracle applications r12.2, ebr, online patching means lot of work for devel...
Oracle applications r12.2, ebr, online patching   means lot of work for devel...Oracle applications r12.2, ebr, online patching   means lot of work for devel...
Oracle applications r12.2, ebr, online patching means lot of work for devel...
Ajith Narayanan
 
Building the DW - ETL
Building the DW - ETLBuilding the DW - ETL
Building the DW - ETLganblues
 
Tech Days09 Sqldev
Tech Days09 SqldevTech Days09 Sqldev
Tech Days09 Sqldev
llangit
 
SQL Server 2008 for Developers
SQL Server 2008 for DevelopersSQL Server 2008 for Developers
SQL Server 2008 for Developers
llangit
 

Similar to Test Data Transfer Tool (20)

introductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptxintroductionofssis-130418034853-phpapp01.pptx
introductionofssis-130418034853-phpapp01.pptx
 
AWS RDS Migration Tool
AWS RDS Migration Tool AWS RDS Migration Tool
AWS RDS Migration Tool
 
Introduction to SQL, SQL*Plus
Introduction to SQL, SQL*PlusIntroduction to SQL, SQL*Plus
Introduction to SQL, SQL*Plus
 
IDUG 2015 NA Data Movement Utilities final
IDUG 2015 NA Data Movement Utilities finalIDUG 2015 NA Data Movement Utilities final
IDUG 2015 NA Data Movement Utilities final
 
Oracle application express
Oracle application expressOracle application express
Oracle application express
 
Oracle application express ppt
Oracle application express pptOracle application express ppt
Oracle application express ppt
 
Microsoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations PresentationMicrosoft SQL Server - SQL Server Migrations Presentation
Microsoft SQL Server - SQL Server Migrations Presentation
 
Project Presentation
Project PresentationProject Presentation
Project Presentation
 
Novidades do SQL Server 2016
Novidades do SQL Server 2016Novidades do SQL Server 2016
Novidades do SQL Server 2016
 
Azure Data Fundamentals DP 900 Full Course
Azure Data Fundamentals DP 900 Full CourseAzure Data Fundamentals DP 900 Full Course
Azure Data Fundamentals DP 900 Full Course
 
Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005
 
Deep Dive into Azure Data Factory v2
Deep Dive into Azure Data Factory v2Deep Dive into Azure Data Factory v2
Deep Dive into Azure Data Factory v2
 
SQL PPT.pptx
SQL PPT.pptxSQL PPT.pptx
SQL PPT.pptx
 
Ado
AdoAdo
Ado
 
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
Oracle restful api & data live charting by Oracle Apex - داشبورد آنلاین (داده...
 
People soft basics
People soft basicsPeople soft basics
People soft basics
 
Oracle applications r12.2, ebr, online patching means lot of work for devel...
Oracle applications r12.2, ebr, online patching   means lot of work for devel...Oracle applications r12.2, ebr, online patching   means lot of work for devel...
Oracle applications r12.2, ebr, online patching means lot of work for devel...
 
Building the DW - ETL
Building the DW - ETLBuilding the DW - ETL
Building the DW - ETL
 
Tech Days09 Sqldev
Tech Days09 SqldevTech Days09 Sqldev
Tech Days09 Sqldev
 
SQL Server 2008 for Developers
SQL Server 2008 for DevelopersSQL Server 2008 for Developers
SQL Server 2008 for Developers
 

Recently uploaded

Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
Fwdays
 

Recently uploaded (20)

Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 

Test Data Transfer Tool

  • 1. TEST DATA TRANSFER TOOL (TDTT) – Hai Nguyen
  • 3. Goals This tool is designed to transfer the data between environments to create test or demo environments with the latest data. It shouldn’t be used to import data into the production environment.
  • 4. Goals (cont) The Test Data Transfer Tool works by calling the Microsoft SQL Server client tools bulk copy program, BCP.exe. BCP runs very quickly, thus this tool runs faster than some other data transfer tools. The Test Data Transfer Tool does not interact with the AOS. You must have a CustomerSource or PartnerSource account to be able to download the Test Data Transfer Tool installer. The installer must be run by an administrator account. As of today, you can download the tool from LCS (Life Cycle Services).
  • 5. Pre-requisites • To be run on a system with SQL Server client tools installed. • During import, you must run the tool directly from the computer that is hosting the database. • Select & Bulk Insert permissions on the SQL database and ALTER INDEX permission on the table (this is needed if the data violates the unique index constraints and you want index to be disabled automatically). • Permission to execute SQL scripts that are executed pre- and post export/import. These can be found in import and export directory.
  • 7. PROS 1. Very lightweight and simple to use tool. 2. Can be installed on any machine that has the SQL Server Client tools installed. 3. Can be handy tool in transferring the data among the different environments (for example data transfer from production to the training environment). 4. This tool can be used to move subset of the data. 5. The tool can be used to import and export any AX entity but I found it more useful while transferring configuration data among the environments. (for example module parameters tables) 6. Fast when compare to other data migration tools for AX. 7. Can export or import data when an AOS instance is not running. 8. Export or import Microsoft Dynamics AX data more quickly compared to other methods. 9. Only minimal changes are made to the data that you import. This feature helps guarantee that the data is stable over time. For example, the tool never renumbers RecIDs.
  • 8. PROS (cont) 10. The data file format is text-based. Therefore, the data can be compared with earlier versions and stored in a version control system. 11. The data file format is a standard format that is produced by bcp. 12. Exported data can be filtered. Therefore, specified tables, columns, or rows can be easily excluded from the export. 13. Differences often occur during development. Because of this feature, data can often be imported without user intervention, even when the table definitions have changed. For example, tables or fields that have been renamed do not prevent import. 14. Entity IDs, such as table IDs, class IDs, and extended data type IDs, are updated to match the IDs of the target system. 15. The tool reads and correctly updates the SYSTEMSEQUENCES table.
  • 9. CONS 1.The usage of this tool requires you to have a SQL related skillset. Since the tool is actually a wrapper on top of SQL Server Bulk Copy Program (bcp) that’s why the expert level knowledge of the AX database schema and T-SQL is a must. 2.Since the tool works directly on SQL Server database that’s why the tool doesn’t make sure that your import produces a complete or coherent database. 3.Need to have access to SQL database and can run as Admin 4.Command line and there is no UI
  • 10. Export and import process illustrated
  • 11. Syntax DP.exe {direction} {directory} {database name} {server}
  • 12. Syntax Parameter Description Default value Direction Parameters indicates the direction (Import/Export) Specify IMPORT for Importing Data and EXPORT for exporting data. EXPORT directory Indicates the directory • from which to import data (or) • To which to export data files Defaults to current directory if not specified database The name of the database: • from which to export data (or) • To which import data in to. AXDB server The name of the sql server on which the database is hosted The current computer name
  • 13. DEMO
  • 14. Q&A

Editor's Notes

  1. Here is the architecture of the tool. The Left side is Export process, The right side is Import process and the middle one is where the output files are created. Export Metadata.xml – A list of table definitions in your AX system. We need to update this file before export. There is a job that shipped with the tool. You need to import the job into AX, run the job, it will update the Metadatafile.xml with all the tables in the AOT. DP.exe processes user input from the command line, a metadata file, and data from the AX 2012 model database , and transfers the information to three files for each table that is being exported: an .out file, an .outModel file, and an.xml file that contains SQL Server metadata Output – .Out file: A bcp data file that contains table data. Columns are separated by #|EOC|# and rows are separated by #|EOR|#\n .Outmodel file: A file that contains metadata that is specific to Microsoft Dynamics AX. This metadata includes all names and IDs of the table and its fields. This file also includes the elementType attribute, which stores the names and IDs of any Microsoft Dynamics AX tables, classes, or extended data types that are referenced by the table. This information is used during import to match up fields that have been renamed. The information is also used to update the table IDs, class IDs, or data type IDs so that those IDs match the IDs in the target database. Data in the .outmodel file is constructed from the Metadata.xml file. This file is generated by an X++ job that you run from Microsoft Dynamics AX on the source database. .xml file: A bcp data file that contains sql metadata (column descriptors) Import Three files that result from the export process are used as input to DP.exe, along with command-line parameters. DP.exe then transfers the data to the AX 2012 database and model database in the test environment. The results of the import process are stored in an .xml file called DPLog.xml
  2. The syntax is very simple. We can break it down to 4 component Direction: IMPORT or EXPORT Directory: If it is EXPORT process, it is the location of the output files that will created. If it is IMPORT process, it is also the same location where output files were created. Normally, Direcotry should be the same for both IMPORT and PROCESS Database name: SQL Server name