SlideShare a Scribd company logo
1 of 7
SAP BO DATA Integrator / Data Services
Data servicesisintegrated withSAPBI/SAPR3/SAPApplicationsandnonSAPWare house.
Purpose:- ItdoETL viabatch Job and online methodthrubulkanddeltaloadprocessingof both
structuredand unstructured datato generate aWare House (sapand Non-sap)
Data Servicesisthe combinationof DataIntegratorand Data Quality.Previouslythese are separate tools
like DataIntegratorwhichisusedto do the ETL part and Data Qualitytodo the data profilingandData
Cleansing.NowwithDataServicesbothDIandDQ are combinedintoonce interface sothat itprovides
the complete solution(dataintegrationandQuality) underone platform.
Thisevencombinesthe separate jobservers&Repositoriesof DIand DI into one.
Data Federator: - The outputof the data federatoristhe virtual data.Federatorprovidesthe dataas
inputto the data servicesandusingfederatorwe canprojectdatafrom multiple sourcesasa single
source.
Data ServicesScenarios:-
Source  Ware House
SQL -- DS -- SQL
FlatFile -- DS -- SQL
FlatFile -- DS -- BI
R/3 -- DS -- BI
R/3 -- DS -- SQL
SQL -- DS -- BI
We can move the data fromany source to any targetDB usingData Services.
Data Servicesisan utilitytodoETL process,Itis nota ware house ,so it doesn’tstage anyamountof
data init.
Data Servicescancreate ETL processand can create a ware house (SAP/Non-Sap) .
DS is usedmajorlyfor3 sort of projects
1) Migration
2) Ware house or DB building
3) Data Quality
Data Profiling:- Pre processingof databefore the ETL to check the healthof the data. By profilingwe
checkthe healthof the data if it’sgoodor bad.
Advantages of Data ServicesoverSAP BI/BW ETL process
It’sa GUI basedframe work
It has multiple datasourcesinbuiltconfiguration
It has numerousinbuiltTransformations(Integrator,Quality,Platform)
It doesdata profilingactivity
It easilyaddsexternal systems
It supportsExportExecutionCommandtoloadthe data into the ware house viabatchmode process
It generatesABAPcode automatically
It recognizesStructure andunstructuresdata
It can generate aware house (sap/Non Sap)
It supportshuge data cleansing/Consolidation/Transformation
It can do real time data load/Full dataload/Incremental Dataload
Data integrator / ServicesArchitecture
RepositoryManager
AccessServer
JobServer
Meta Data
Integrator
Designer
Management
Console
Profiler
Local
Central
Profiler
No conceptof Processchains/ DTP/Infopackagesif you use the data servicestoloadthe data.
Data IntegratorComponents
Designer
It Createsthe ETL Process
It has wide setof transformations
It includesall the artifactsof the project( Work Flow,Data Flow,DataStore,Tables)
It isa gate way to doprofiling
All the designerobjectsare reusable
ManagementConsole (URL basedtool / Webbasedtool)
It isusedto activate the repositories
It allowsusto activate userprofilestospecificenvironment
It allowsusto create usersand usergroupsand assignthe usersto the usergroupswithprivileges
It allowstoauto schedule orexecute the jobs
We can execute the jobsfromanygeographiclocationasthisisa webbasedtool
It allowsusto connectthe repositoriestoConnections(Dev/Qual /Prod)
It allowsusto customize the datastores
Access Server
It isusedto run the real time jobs
It getsthe XML input(real time data)
XML inputscanbe loadedtothe Ware house usingthe Accessserver
It isresponsibleforthe executionof online/real time jobs
RepositoryManager
It allowsusto create the Repositories(Local,Central,andProfiler)
Repositoriesare createdusingstandarddatabase
Data Servicessystemtablesare available here
Mete Data Integrator
It generates AutoDocumentation
It generatessample reportsandsemanticlayers
It generatesjobbasedstatisticdashboards
Job Server
Thisis the serverwhichisresponsible toexecutethe jobs.Withoutassigningthe local /central
repositorywe cannotexecute the job.
Data Integrator Objects
Projects:-
Projectisa folderwhere youstore all the relatedjobsatonce place.We can call it as a Folderto
organize jobs.
Jobs:-
Jobsare the executable partof the Data Services.Thisjobispresentunderthe project.
Batch Job
Online jobs
Work Flows:-
Thiswork flowactsa foldertocontainthe relatedDataFlows.ThisWorkFlowsare re-usable
Conditionals:-
Conditional containsWorkFlowsordata flowsandthese are controlledbyscriptwhethertotriggeror
not.
Scripts:-
Scriptsare setof codesusedtodefine orinitialize the globalvariables,Controlthe flow of conditionals
or control the flowof execution,toprintsome statementsatthe runtime andalsoto assignspecific
defaultvaluestothe variables.
Data Flow:-
The actual data processinghappenshere.
Source Data Store:-
It isthe place heldtoimportthe data fromthe data base/sapto data serviceslocal repository
Target Data Store:-
It isthe collectionof dimensionsandfacttablestocreate the data ware house.
Transformations:-
These are the querytransformationsthatare usedtocarry out the ETL process.These are broadly
categorizedinto3 (platform,Qualityandintegrator)
File Format :-
It containsvariouslegacysystemfileformats
Variables:-
We can create and use the local and global variablesanduse theminthe project.The variablesstarts
with“$” Symbol.
Functions:-
We have numerousinbuiltfunctionslike (String,math,lookup,enrichandsoon)
Template Table:-
These are the temporarytablesthatare usedto holdthe intermediate dataorthe final data.
Data Store:-
These data storesacts a port fromwhichyoucan define the connectionstothe source orthe target
systems.Youcan create multiple configurationsinone datastore to connectthisto the different
systems
ATL :-
ATL filesare like the BIARfiles.Thisisnamedafteracompany.ATL doesn’tholdanyfull formlike BIAR.
The Project/Job/Work Flow/DataFlow/Tablescan be exportedtoATL sothat theycan be moved
betweenDev Qual and from Qual Prod.
Similarlyyoucanalsoimportthe Project/Job/WorkFlow/Data Flow/Tableswhichare exportedtoATL,
back into the data services

More Related Content

Similar to 01_Intro_SAP BO DATA Integrator.docx

Aucfanlab Datalake - Big Data Management Platform -
Aucfanlab Datalake - Big Data Management Platform -Aucfanlab Datalake - Big Data Management Platform -
Aucfanlab Datalake - Big Data Management Platform -Aucfan
 
Real time web app integration with hadoop on docker
Real time web app integration with hadoop on dockerReal time web app integration with hadoop on docker
Real time web app integration with hadoop on dockerRajasekaran kandhasamy
 
MuleSoft London Community February 2020 - MuleSoft and OData
MuleSoft London Community February 2020 - MuleSoft and ODataMuleSoft London Community February 2020 - MuleSoft and OData
MuleSoft London Community February 2020 - MuleSoft and ODataPace Integration
 
Splice Machine Overview
Splice Machine OverviewSplice Machine Overview
Splice Machine OverviewKunal Gupta
 
Big Data Taiwan 2014 Track2-2: Informatica Big Data Solution
Big Data Taiwan 2014 Track2-2: Informatica Big Data SolutionBig Data Taiwan 2014 Track2-2: Informatica Big Data Solution
Big Data Taiwan 2014 Track2-2: Informatica Big Data SolutionEtu Solution
 
Visualization using Tableau
Visualization using TableauVisualization using Tableau
Visualization using TableauGirija Muscut
 
Java Web Programming on Google Cloud Platform [1/3] : Google App Engine
Java Web Programming on Google Cloud Platform [1/3] : Google App EngineJava Web Programming on Google Cloud Platform [1/3] : Google App Engine
Java Web Programming on Google Cloud Platform [1/3] : Google App EngineIMC Institute
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Eduardo Castro
 
01 Architecture Of Integration Services
01 Architecture Of Integration Services01 Architecture Of Integration Services
01 Architecture Of Integration ServicesSlava Kokaev
 
Te kslate sap bods
Te kslate sap bodsTe kslate sap bods
Te kslate sap bodstekslate1
 
IRMUK-SOA_for_MDM_DQ_Integration_DV_20min
IRMUK-SOA_for_MDM_DQ_Integration_DV_20minIRMUK-SOA_for_MDM_DQ_Integration_DV_20min
IRMUK-SOA_for_MDM_DQ_Integration_DV_20minDigendra Vir Singh (DV)
 
Create Home Directories on Storage Using WFA and ServiceNow integration
Create Home Directories on Storage Using WFA and ServiceNow integrationCreate Home Directories on Storage Using WFA and ServiceNow integration
Create Home Directories on Storage Using WFA and ServiceNow integrationRutul Shah
 
Accessing sap and_mainframe_data_and_applications_via_share_point
Accessing sap and_mainframe_data_and_applications_via_share_pointAccessing sap and_mainframe_data_and_applications_via_share_point
Accessing sap and_mainframe_data_and_applications_via_share_pointYuval Birenboum
 
Transform your data with Azure Data factory
Transform your data with Azure Data factoryTransform your data with Azure Data factory
Transform your data with Azure Data factoryPrometix Pty Ltd
 

Similar to 01_Intro_SAP BO DATA Integrator.docx (20)

Tableau Server Basics
Tableau Server BasicsTableau Server Basics
Tableau Server Basics
 
dvprimer-architecture
dvprimer-architecturedvprimer-architecture
dvprimer-architecture
 
Aucfanlab Datalake - Big Data Management Platform -
Aucfanlab Datalake - Big Data Management Platform -Aucfanlab Datalake - Big Data Management Platform -
Aucfanlab Datalake - Big Data Management Platform -
 
Real time web app integration with hadoop on docker
Real time web app integration with hadoop on dockerReal time web app integration with hadoop on docker
Real time web app integration with hadoop on docker
 
MuleSoft London Community February 2020 - MuleSoft and OData
MuleSoft London Community February 2020 - MuleSoft and ODataMuleSoft London Community February 2020 - MuleSoft and OData
MuleSoft London Community February 2020 - MuleSoft and OData
 
Data virtualization using polybase
Data virtualization using polybaseData virtualization using polybase
Data virtualization using polybase
 
Splice Machine Overview
Splice Machine OverviewSplice Machine Overview
Splice Machine Overview
 
Tableau
TableauTableau
Tableau
 
Big Data Taiwan 2014 Track2-2: Informatica Big Data Solution
Big Data Taiwan 2014 Track2-2: Informatica Big Data SolutionBig Data Taiwan 2014 Track2-2: Informatica Big Data Solution
Big Data Taiwan 2014 Track2-2: Informatica Big Data Solution
 
Visualization using Tableau
Visualization using TableauVisualization using Tableau
Visualization using Tableau
 
Java Web Programming on Google Cloud Platform [1/3] : Google App Engine
Java Web Programming on Google Cloud Platform [1/3] : Google App EngineJava Web Programming on Google Cloud Platform [1/3] : Google App Engine
Java Web Programming on Google Cloud Platform [1/3] : Google App Engine
 
Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2Whats New Sql Server 2008 R2
Whats New Sql Server 2008 R2
 
01 Architecture Of Integration Services
01 Architecture Of Integration Services01 Architecture Of Integration Services
01 Architecture Of Integration Services
 
Te kslate sap bods
Te kslate sap bodsTe kslate sap bods
Te kslate sap bods
 
CouchDB
CouchDBCouchDB
CouchDB
 
Practical OData
Practical ODataPractical OData
Practical OData
 
IRMUK-SOA_for_MDM_DQ_Integration_DV_20min
IRMUK-SOA_for_MDM_DQ_Integration_DV_20minIRMUK-SOA_for_MDM_DQ_Integration_DV_20min
IRMUK-SOA_for_MDM_DQ_Integration_DV_20min
 
Create Home Directories on Storage Using WFA and ServiceNow integration
Create Home Directories on Storage Using WFA and ServiceNow integrationCreate Home Directories on Storage Using WFA and ServiceNow integration
Create Home Directories on Storage Using WFA and ServiceNow integration
 
Accessing sap and_mainframe_data_and_applications_via_share_point
Accessing sap and_mainframe_data_and_applications_via_share_pointAccessing sap and_mainframe_data_and_applications_via_share_point
Accessing sap and_mainframe_data_and_applications_via_share_point
 
Transform your data with Azure Data factory
Transform your data with Azure Data factoryTransform your data with Azure Data factory
Transform your data with Azure Data factory
 

Recently uploaded

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...panagenda
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsAndolasoft Inc
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AIABDERRAOUF MEHENNI
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerThousandEyes
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️anilsa9823
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendArshad QA
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxComplianceQuest1
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Modelsaagamshah0812
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...OnePlan Solutions
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about usDynamic Netsoft
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providermohitmore19
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfjoe51371421
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 

Recently uploaded (20)

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online  ☂️
CALL ON ➥8923113531 🔝Call Girls Kakori Lucknow best sexual service Online ☂️
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
Test Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and BackendTest Automation Strategy for Frontend and Backend
Test Automation Strategy for Frontend and Backend
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
DNT_Corporate presentation know about us
DNT_Corporate presentation know about usDNT_Corporate presentation know about us
DNT_Corporate presentation know about us
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
why an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdfwhy an Opensea Clone Script might be your perfect match.pdf
why an Opensea Clone Script might be your perfect match.pdf
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 

01_Intro_SAP BO DATA Integrator.docx

  • 1. SAP BO DATA Integrator / Data Services Data servicesisintegrated withSAPBI/SAPR3/SAPApplicationsandnonSAPWare house. Purpose:- ItdoETL viabatch Job and online methodthrubulkanddeltaloadprocessingof both structuredand unstructured datato generate aWare House (sapand Non-sap) Data Servicesisthe combinationof DataIntegratorand Data Quality.Previouslythese are separate tools like DataIntegratorwhichisusedto do the ETL part and Data Qualitytodo the data profilingandData Cleansing.NowwithDataServicesbothDIandDQ are combinedintoonce interface sothat itprovides the complete solution(dataintegrationandQuality) underone platform. Thisevencombinesthe separate jobservers&Repositoriesof DIand DI into one. Data Federator: - The outputof the data federatoristhe virtual data.Federatorprovidesthe dataas inputto the data servicesandusingfederatorwe canprojectdatafrom multiple sourcesasa single source. Data ServicesScenarios:- Source  Ware House SQL -- DS -- SQL FlatFile -- DS -- SQL FlatFile -- DS -- BI R/3 -- DS -- BI R/3 -- DS -- SQL SQL -- DS -- BI We can move the data fromany source to any targetDB usingData Services. Data Servicesisan utilitytodoETL process,Itis nota ware house ,so it doesn’tstage anyamountof data init. Data Servicescancreate ETL processand can create a ware house (SAP/Non-Sap) . DS is usedmajorlyfor3 sort of projects 1) Migration 2) Ware house or DB building 3) Data Quality
  • 2. Data Profiling:- Pre processingof databefore the ETL to check the healthof the data. By profilingwe checkthe healthof the data if it’sgoodor bad. Advantages of Data ServicesoverSAP BI/BW ETL process It’sa GUI basedframe work It has multiple datasourcesinbuiltconfiguration It has numerousinbuiltTransformations(Integrator,Quality,Platform) It doesdata profilingactivity It easilyaddsexternal systems It supportsExportExecutionCommandtoloadthe data into the ware house viabatchmode process It generatesABAPcode automatically It recognizesStructure andunstructuresdata It can generate aware house (sap/Non Sap) It supportshuge data cleansing/Consolidation/Transformation It can do real time data load/Full dataload/Incremental Dataload Data integrator / ServicesArchitecture RepositoryManager AccessServer JobServer Meta Data Integrator Designer Management Console Profiler Local Central Profiler
  • 3. No conceptof Processchains/ DTP/Infopackagesif you use the data servicestoloadthe data. Data IntegratorComponents Designer It Createsthe ETL Process It has wide setof transformations It includesall the artifactsof the project( Work Flow,Data Flow,DataStore,Tables) It isa gate way to doprofiling All the designerobjectsare reusable
  • 4. ManagementConsole (URL basedtool / Webbasedtool) It isusedto activate the repositories It allowsusto activate userprofilestospecificenvironment It allowsusto create usersand usergroupsand assignthe usersto the usergroupswithprivileges It allowstoauto schedule orexecute the jobs We can execute the jobsfromanygeographiclocationasthisisa webbasedtool It allowsusto connectthe repositoriestoConnections(Dev/Qual /Prod) It allowsusto customize the datastores
  • 5. Access Server It isusedto run the real time jobs It getsthe XML input(real time data) XML inputscanbe loadedtothe Ware house usingthe Accessserver It isresponsibleforthe executionof online/real time jobs RepositoryManager It allowsusto create the Repositories(Local,Central,andProfiler) Repositoriesare createdusingstandarddatabase Data Servicessystemtablesare available here
  • 6. Mete Data Integrator It generates AutoDocumentation It generatessample reportsandsemanticlayers It generatesjobbasedstatisticdashboards Job Server Thisis the serverwhichisresponsible toexecutethe jobs.Withoutassigningthe local /central repositorywe cannotexecute the job. Data Integrator Objects Projects:- Projectisa folderwhere youstore all the relatedjobsatonce place.We can call it as a Folderto organize jobs. Jobs:- Jobsare the executable partof the Data Services.Thisjobispresentunderthe project. Batch Job Online jobs Work Flows:- Thiswork flowactsa foldertocontainthe relatedDataFlows.ThisWorkFlowsare re-usable Conditionals:- Conditional containsWorkFlowsordata flowsandthese are controlledbyscriptwhethertotriggeror not. Scripts:- Scriptsare setof codesusedtodefine orinitialize the globalvariables,Controlthe flow of conditionals or control the flowof execution,toprintsome statementsatthe runtime andalsoto assignspecific defaultvaluestothe variables. Data Flow:- The actual data processinghappenshere.
  • 7. Source Data Store:- It isthe place heldtoimportthe data fromthe data base/sapto data serviceslocal repository Target Data Store:- It isthe collectionof dimensionsandfacttablestocreate the data ware house. Transformations:- These are the querytransformationsthatare usedtocarry out the ETL process.These are broadly categorizedinto3 (platform,Qualityandintegrator) File Format :- It containsvariouslegacysystemfileformats Variables:- We can create and use the local and global variablesanduse theminthe project.The variablesstarts with“$” Symbol. Functions:- We have numerousinbuiltfunctionslike (String,math,lookup,enrichandsoon) Template Table:- These are the temporarytablesthatare usedto holdthe intermediate dataorthe final data. Data Store:- These data storesacts a port fromwhichyoucan define the connectionstothe source orthe target systems.Youcan create multiple configurationsinone datastore to connectthisto the different systems ATL :- ATL filesare like the BIARfiles.Thisisnamedafteracompany.ATL doesn’tholdanyfull formlike BIAR. The Project/Job/Work Flow/DataFlow/Tablescan be exportedtoATL sothat theycan be moved betweenDev Qual and from Qual Prod. Similarlyyoucanalsoimportthe Project/Job/WorkFlow/Data Flow/Tableswhichare exportedtoATL, back into the data services