SlideShare a Scribd company logo
0Like
First Prev
Next Last




Datastage real time scenario
amulas
Questions by amulas
Yes 1
Reply
Yes
Reply
Vinod
This one is the most complicated that i had ever seen.
Basically it is inverse pivot functionality. but in order to perform inverse pivot
functionality we need at-least 2 columns. So, i am going to generate that extra
column with "1" in 6 rows.
Then Based on this i done the concatenation, after concatenation i used copy
stage then from copy stage one link is going to remove duplicate stage and
another one to lookup stage. in remove duplicate stage i collected the retain =
last value (a,b,c,1,2,3), 1 . in lookup stage i combined both the data and used
transformer stage to collect (a,b,c) then i made a concatenate with (a,b,c) with
actual values(a,b,c,1,2,3) then the data will be {(a,b,c,a),(a,b,c,b),(a,b,c,c),(a,b,c,1),
(a,b,c,2),(a,b,c,3)} now i specified a condition so that i can collect the specified
requirement {(a,b,c,1),(a,b,c,2),(a,b,c,3)}
I can't post the screen shot's if u need further clarification Feel free to mail
mee. I will send the screen shots..
ALL THE BEST !!
KEEP POSTING...
kumar
We can do it using Transformer.Take 3 stage variables(s1,s2,s3),for s1 map the
input column and for s2 we have to write the condition like if
alpha(inputcolumn)= true then trim(s3:,:s1,,,) else s3:,:inputcolumn. for s3 also
we have to write the condition like if alpha(inputcol) true then map s2 into s3
else map s3 to s3.
Input column---->S1
if alpha(inputcolumn)=true then trim(s3:,:s1) else trim(s3:,:inputcolumn)--------
>s2
if alpha(inputcoumn)=true then s2 else s3------->s3
In constraint part we have to write the below condition
if alnum(s2)=true
In derivation part we have to map s2 to output column
I think it will work
poorna
source-->Transformer(use field function by taking stage variable like
field(inputcolumn,,,1,3) and concatenate this field value aging with field ---->
Pivot stage--->target.
Yes
Reply
Yes
Reply
Yes 1
Reply

rupam
Source->TR->RD->Pivot->Target,by using these order of stages we can get
required output.
Transformer:
we have to concatenate the values by using loop(we will get like a,b,c,1,2,3)
after that we have to split it into separate fields using field function.
o/p is:c1 c2 c3 c4 c5 c6 c7
1 a
1 a b
1 a b c
1 a b c 1
1 a b c 1 2
1 a b c 1 2 3
(if we dont want this dummy column we can drop it here itself)
RemoveDuplicate:
put condition retain last
o/p is: c1 c2 c3 c4 c5 c6 c7
1 a b c 1 2 3
pivot;
in derivation of c5 column give c5,c6,c7
here we are converting columns into rows
o/p is: c2 c3 c4 c5 c6 c7
a b c 1
a b c 2
a b c 3
sreenu
Hi.,
we can achieve this by
source--->pivot-->Transformer --> target
we will get 6 columns from pivot stage(columns to rows) then
In transformer stage we have to concatenate the input columns
like col1:col2:col3:(here we can use stage variables and increment that value by
one)
regards
sreenu
Yes
Reply
Yes
Reply
venkatasuresh
Source we have like this a,b,c,d,e,f here 6 columns
a,b,c,1,2,3
e,f,g,4,5,6 we need to get in target
like this a,b,c,1 and a,b,c,2 and a,b,c,3 and e,f,g,4 for that we have to use just
three stages
source---------------->pivot------------------------>target
in pivot we need to implement this code
column,derivation
a,a
b,b
c,c
values,d,e,f and target file name this will work to get that result
Prabhakar Achyuta
Very simple..please go through below.
Input:
CUST_ID
----------
a,b,c,1,2,3
Output:
CUST_ID:
-------------
a,b,c,1
a,b,c,2
a,b,c,3
Solution:
We can solve it from below solution.
JOB flow: Transformer (3 ouyput links)----> Funnel---->Dataset
In Transformer: Use 3 stage variables,
in sv1: left(Cust_id,1,7)
in sv2: left(Cust_id,1,6)||Left(right(Cust_id,3),1)
in sv3: left(Cust_id,1,6)||Right(Cust_id,1)
Take 3 outputs from Transformer, map sv1 to output-1 column CUST_ID,
map sv2 to output-2 column CUST_ID,
map sv3 to output-3 column CUST_ID
Here one input record splits into 3 output records.
Now cature all three output records using Funnel stage.
Yes
ReplyAnswer Question
Send
Reset
RELATED ANSWERED QUESTIONS
 How much time should it to take to set up a server with 5
workstations and network it?
 What is slowly changing dimension(scd)
 What is range look up and how it is used in datastage.
 Having single input source want three different outputs.
 A wall clock looses 10 mins in 1 hr. 4 one hours of wall clock
table clock gains 10mins for 1 hour of table clock alarm clock
looses 5 mins for 1hr of arm clock, wrist watch gains 5min they
were set
 Maintaining data integrity
 Question on testing
 Prepaid expenses
 When the application is ready for testing ?
sivaksa
Guys try simple way.
Source.....trans.....pivot...target
trans...we can use filed function and create new column
col1:filed(inputcol,,,4,1)
col2:filed(inputcol,,,5,1)
Col3:filed(inputcol,,,6,1)
And pivot put output col :col1,col2,col3
Then you can get output
Root cause of defect
Asked by: kurtz182
Obsolete and expired RMAN backups
Asked by: shanthiavari
Null keyword
Asked by: gkumawat
 Flatfiles(.Txt,.Csv,xml) to laod sequential files?
RELATED OPEN QUESTIONS
 Update strategy
 Datastage scenario - flat file
 Datastage scenario - two columns in the source
 Javascript difficulty
 How to identify updated records in datastage.
 Source file and 3 output tables records problem
 Write the real time scenario of different stages in datastage?
 Response time for uploading and downloading of file.
 Wants to change career into Informatica
 Replay the script without browser in vugen
Type and Press Enter

SUBSCRIBE TO RSS FEED
Enter you email
RANDOM QUESTIONS
Subscribe
What is difference between regression and
functional testing
Asked by: kamalakar2000
(52)
(7)
(1)
(2)
(25)
(15)
(26)
(35)
(1)
(22)
(2)
(1)
(212)
(6)
(1)
(206)
(65)
(396)
(217)
What are other performance tunings you have done
in your last project to increase the performance of
slowly running jobs?
Asked by: Interview Candidate
Interviews
TAGS
CLOUD
INTERVIEW QUESTIONS PDF FILES
SPONSORED LINKS
SOCIAL NETWORKS
FANS FOLLOWERS
SUBSCRIBE
TO RSS FEED
FOLLOWERS
SPONSORED LINKS
Datastage scenario - flat file
Asked by: sravanthi
Datastage scenario - two columns in the source
Asked by: sravanthi
Design a job
OPEN QUESTIONS ANSWERED
Asked by: Alekhya ch
Sequential file stage
Asked by: Alekhya ch
How to identify updated records in datastage.
Asked by: taruna.arya
Source file and 3 output tables records
problem
Asked by: taruna.arya
Write the real time scenario of different stages
in datastage?
Asked by: manojkitty
Transformer stage compilation error in
ascential datastage 7.5, windows xp
operating system
Asked by: MrReddy
Unknown transformer variable definition
Asked by: Gina Ying
How to use change capture stage in SCDs
Asked by: chandukommuri
How much time should it to take to set up a
server with 5 workstations and network it?
business
Asked by: Bethany Niccum
What is slowly changing dimension(scd)
Asked by: taruna.arya
What is range look up and how it is used in
datastage.
Asked by: taruna.arya
Having single input source want three different
outputs.
Asked by: taruna.arya
A wall clock looses 10 mins in 1 hr. 4 one hours
of wall clock table clock gains 10mins for 1
hour of table clock alarm clock looses 5 mins
for 1hr of...
Asked by: pravinraja
Maintaining data integrity
Asked by: abhiastra
Question on testing
Asked by: sayooj
Prepaid expenses
Asked by: Mashhood Ek
When the application is ready for testing ?
Asked by: lakshmip.yaganti
Flatfiles(.Txt,.Csv,xml) to laod sequential files?
Asked by: Kiranchandra
Subscribe
TAGS
 Accenture  Wipro  AMD  AMDOC  Axes-Technologies
 Aztec-Systems  BirlaSoft  Cisco  Cognizant  Dell  GE  HAL
 Infosys  ISRO  TCS  Sonata  Adobe  Oracle  Mphasis
RANDOM QUESTION
 LAN Connection
 What is the difference between bubble sort & quick sort?
 Slow Logins
 What is MULTI ORG FLOW? How many organisation are there
in an operating unit?
 How many attribute columns can we have for single dff?
QUESTION OF THE DAY
INTERVIEW & CAREER TIPS
About US Privacy Policy Terms & Conditions DMCA Contact Us
© Copyright 2014 GeekInterview.com | All Rights Reserved
CONTACT US

More Related Content

What's hot

Memory management ppt
Memory management pptMemory management ppt
Memory management ppt
ManishaJha43
 
Chapter 1 intro to internet and web based programming
Chapter  1   intro to internet and web based programmingChapter  1   intro to internet and web based programming
Chapter 1 intro to internet and web based programming
Richard Meriveles
 
Maximum Availability Architecture - Best Practices for Oracle Database 19c
Maximum Availability Architecture - Best Practices for Oracle Database 19cMaximum Availability Architecture - Best Practices for Oracle Database 19c
Maximum Availability Architecture - Best Practices for Oracle Database 19c
Glen Hawkins
 
Ch6 CPU Scheduling galvin
Ch6 CPU Scheduling galvinCh6 CPU Scheduling galvin
Ch6 CPU Scheduling galvin
Shubham Singh
 
Ch02 early system memory management
Ch02 early system  memory managementCh02 early system  memory management
Ch02 early system memory management
Jacob Cadeliña
 
push down automata
 push down automata push down automata
push down automata
nadiatariq6
 
System programs in o.s. for bca and bscit students by hardik nathani
System programs in o.s. for bca and bscit students by hardik nathaniSystem programs in o.s. for bca and bscit students by hardik nathani
System programs in o.s. for bca and bscit students by hardik nathani
Hardik Nathani
 
Ash architecture and advanced usage rmoug2014
Ash architecture and advanced usage rmoug2014Ash architecture and advanced usage rmoug2014
Ash architecture and advanced usage rmoug2014
John Beresniewicz
 
Operating Systems: Process Scheduling
Operating Systems: Process SchedulingOperating Systems: Process Scheduling
Operating Systems: Process Scheduling
Damian T. Gordon
 
Pushdown Automata Theory
Pushdown Automata TheoryPushdown Automata Theory
Pushdown Automata Theory
Saifur Rahman
 
Using data flow diagram
Using data flow diagramUsing data flow diagram
Using data flow diagram
Kiran Ajudiya
 
Push down automata
Push down automataPush down automata
Push down automata
Ratnakar Mikkili
 
DBMS 9 | Extendible Hashing
DBMS 9 | Extendible HashingDBMS 9 | Extendible Hashing
DBMS 9 | Extendible Hashing
Mohammad Imam Hossain
 
Chapter 3 - Processes
Chapter 3 - ProcessesChapter 3 - Processes
Chapter 3 - Processes
Wayne Jones Jnr
 
Processes description and process control.
Processes description and process control.Processes description and process control.
Processes description and process control.
Ahsan Rahim
 
Aries
AriesAries
Parallel streams in java 8
Parallel streams in java 8Parallel streams in java 8
Parallel streams in java 8
David Gómez García
 
Oracle RAC One Node 12c Overview
Oracle RAC One Node 12c OverviewOracle RAC One Node 12c Overview
Oracle RAC One Node 12c Overview
Markus Michalewicz
 
deadlock handling
deadlock handlingdeadlock handling
deadlock handling
Suraj Kumar
 
Minimization of DFA.pptx
Minimization of DFA.pptxMinimization of DFA.pptx
Minimization of DFA.pptx
SadagopanS
 

What's hot (20)

Memory management ppt
Memory management pptMemory management ppt
Memory management ppt
 
Chapter 1 intro to internet and web based programming
Chapter  1   intro to internet and web based programmingChapter  1   intro to internet and web based programming
Chapter 1 intro to internet and web based programming
 
Maximum Availability Architecture - Best Practices for Oracle Database 19c
Maximum Availability Architecture - Best Practices for Oracle Database 19cMaximum Availability Architecture - Best Practices for Oracle Database 19c
Maximum Availability Architecture - Best Practices for Oracle Database 19c
 
Ch6 CPU Scheduling galvin
Ch6 CPU Scheduling galvinCh6 CPU Scheduling galvin
Ch6 CPU Scheduling galvin
 
Ch02 early system memory management
Ch02 early system  memory managementCh02 early system  memory management
Ch02 early system memory management
 
push down automata
 push down automata push down automata
push down automata
 
System programs in o.s. for bca and bscit students by hardik nathani
System programs in o.s. for bca and bscit students by hardik nathaniSystem programs in o.s. for bca and bscit students by hardik nathani
System programs in o.s. for bca and bscit students by hardik nathani
 
Ash architecture and advanced usage rmoug2014
Ash architecture and advanced usage rmoug2014Ash architecture and advanced usage rmoug2014
Ash architecture and advanced usage rmoug2014
 
Operating Systems: Process Scheduling
Operating Systems: Process SchedulingOperating Systems: Process Scheduling
Operating Systems: Process Scheduling
 
Pushdown Automata Theory
Pushdown Automata TheoryPushdown Automata Theory
Pushdown Automata Theory
 
Using data flow diagram
Using data flow diagramUsing data flow diagram
Using data flow diagram
 
Push down automata
Push down automataPush down automata
Push down automata
 
DBMS 9 | Extendible Hashing
DBMS 9 | Extendible HashingDBMS 9 | Extendible Hashing
DBMS 9 | Extendible Hashing
 
Chapter 3 - Processes
Chapter 3 - ProcessesChapter 3 - Processes
Chapter 3 - Processes
 
Processes description and process control.
Processes description and process control.Processes description and process control.
Processes description and process control.
 
Aries
AriesAries
Aries
 
Parallel streams in java 8
Parallel streams in java 8Parallel streams in java 8
Parallel streams in java 8
 
Oracle RAC One Node 12c Overview
Oracle RAC One Node 12c OverviewOracle RAC One Node 12c Overview
Oracle RAC One Node 12c Overview
 
deadlock handling
deadlock handlingdeadlock handling
deadlock handling
 
Minimization of DFA.pptx
Minimization of DFA.pptxMinimization of DFA.pptx
Minimization of DFA.pptx
 

Viewers also liked

Migration from 8.1 to 11.3
Migration from 8.1 to 11.3Migration from 8.1 to 11.3
Migration from 8.1 to 11.3
Suryakant Bharati
 
data stage-material
data stage-materialdata stage-material
data stage-material
Rajesh Kv
 
Datastage ppt
Datastage pptDatastage ppt
Datastage ppt
Newyorksys.com
 
Datastage free tutorial
Datastage free tutorialDatastage free tutorial
Datastage free tutorial
tekslate1
 
Ibm info sphere datastage tutorial part 1 architecture examples
Ibm info sphere datastage tutorial part 1  architecture examplesIbm info sphere datastage tutorial part 1  architecture examples
Ibm info sphere datastage tutorial part 1 architecture examples
Sandeep Sharma IIMK Smart City,IoT,Bigdata,Cloud,BI,DW
 
Online Datastage training
Online Datastage trainingOnline Datastage training
Online Datastage training
chpriyaa1
 
DATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAINING
DATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAININGDATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAINING
DATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAINING
Datawarehouse Trainings
 
Data stage faqs datastage faqs
Data stage faqs  datastage faqsData stage faqs  datastage faqs
Data stage faqs datastage faqs
Naresh Bala
 
Data stage scenario design 2 - job1
Data stage scenario   design 2 - job1Data stage scenario   design 2 - job1
Data stage scenario design 2 - job1
Naresh Bala
 
Day 2 Data Stage Manager 11.0
Day 2 Data Stage Manager 11.0Day 2 Data Stage Manager 11.0
Day 2 Data Stage Manager 11.0
kshanmug2
 
Datastage
DatastageDatastage
Ibm info sphere datastage data flow and job design
Ibm info sphere datastage data flow and job designIbm info sphere datastage data flow and job design
Ibm info sphere datastage data flow and job design
divjeev
 
Datastage Introduction To Data Warehousing
Datastage Introduction To Data WarehousingDatastage Introduction To Data Warehousing
Datastage Introduction To Data Warehousing
Vibrant Technologies & Computers
 
Curriculum Vitae - Dinesh Babu S V
Curriculum Vitae - Dinesh Babu S VCurriculum Vitae - Dinesh Babu S V
Curriculum Vitae - Dinesh Babu S V
Dinesh Babu S V
 
Resume_Sathish
Resume_SathishResume_Sathish
Resume_Sathish
sathish kumar
 
Sql server select queries ppt 18
Sql server select queries ppt 18Sql server select queries ppt 18
Sql server select queries ppt 18
Vibrant Technologies & Computers
 
Datastage developer Resume
Datastage developer ResumeDatastage developer Resume
Datastage developer Resume
Mallikarjuna P
 
58750024 datastage-student-guide
58750024 datastage-student-guide58750024 datastage-student-guide
58750024 datastage-student-guide
Madhusudhanareddy Katta
 
Datastage parallell jobs vs datastage server jobs
Datastage parallell jobs vs datastage server jobsDatastage parallell jobs vs datastage server jobs
Datastage parallell jobs vs datastage server jobs
shanker_uma
 

Viewers also liked (19)

Migration from 8.1 to 11.3
Migration from 8.1 to 11.3Migration from 8.1 to 11.3
Migration from 8.1 to 11.3
 
data stage-material
data stage-materialdata stage-material
data stage-material
 
Datastage ppt
Datastage pptDatastage ppt
Datastage ppt
 
Datastage free tutorial
Datastage free tutorialDatastage free tutorial
Datastage free tutorial
 
Ibm info sphere datastage tutorial part 1 architecture examples
Ibm info sphere datastage tutorial part 1  architecture examplesIbm info sphere datastage tutorial part 1  architecture examples
Ibm info sphere datastage tutorial part 1 architecture examples
 
Online Datastage training
Online Datastage trainingOnline Datastage training
Online Datastage training
 
DATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAINING
DATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAININGDATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAINING
DATASTAGE AND QUALITY STAGE 9.1 ONLINE TRAINING
 
Data stage faqs datastage faqs
Data stage faqs  datastage faqsData stage faqs  datastage faqs
Data stage faqs datastage faqs
 
Data stage scenario design 2 - job1
Data stage scenario   design 2 - job1Data stage scenario   design 2 - job1
Data stage scenario design 2 - job1
 
Day 2 Data Stage Manager 11.0
Day 2 Data Stage Manager 11.0Day 2 Data Stage Manager 11.0
Day 2 Data Stage Manager 11.0
 
Datastage
DatastageDatastage
Datastage
 
Ibm info sphere datastage data flow and job design
Ibm info sphere datastage data flow and job designIbm info sphere datastage data flow and job design
Ibm info sphere datastage data flow and job design
 
Datastage Introduction To Data Warehousing
Datastage Introduction To Data WarehousingDatastage Introduction To Data Warehousing
Datastage Introduction To Data Warehousing
 
Curriculum Vitae - Dinesh Babu S V
Curriculum Vitae - Dinesh Babu S VCurriculum Vitae - Dinesh Babu S V
Curriculum Vitae - Dinesh Babu S V
 
Resume_Sathish
Resume_SathishResume_Sathish
Resume_Sathish
 
Sql server select queries ppt 18
Sql server select queries ppt 18Sql server select queries ppt 18
Sql server select queries ppt 18
 
Datastage developer Resume
Datastage developer ResumeDatastage developer Resume
Datastage developer Resume
 
58750024 datastage-student-guide
58750024 datastage-student-guide58750024 datastage-student-guide
58750024 datastage-student-guide
 
Datastage parallell jobs vs datastage server jobs
Datastage parallell jobs vs datastage server jobsDatastage parallell jobs vs datastage server jobs
Datastage parallell jobs vs datastage server jobs
 

Similar to Datastage real time scenario

Datastage job scenario questiond
Datastage job scenario questiondDatastage job scenario questiond
Datastage job scenario questiond
Naresh Bala
 
Astronomical data analysis by python.pdf
Astronomical data analysis by python.pdfAstronomical data analysis by python.pdf
Astronomical data analysis by python.pdf
ZainRahim3
 
Sample Exam Questions on Python for revision
Sample Exam Questions on Python for revisionSample Exam Questions on Python for revision
Sample Exam Questions on Python for revision
afsheenfaiq2
 
combat unacademy.pdf
combat unacademy.pdfcombat unacademy.pdf
combat unacademy.pdf
Vijayraj799513
 
Speeding Up Distributed Machine Learning Using Codes
Speeding Up Distributed Machine Learning Using CodesSpeeding Up Distributed Machine Learning Using Codes
Speeding Up Distributed Machine Learning Using Codes
NAVER Engineering
 
LalitBDA2015V3
LalitBDA2015V3LalitBDA2015V3
LalitBDA2015V3
Lalit Kumar
 
Gate-Cs 1993
Gate-Cs 1993Gate-Cs 1993
Gate-Cs 1993
Ravi Rajput
 
Adobe
AdobeAdobe
Java Keeps Throttling Up!
Java Keeps Throttling Up!Java Keeps Throttling Up!
Java Keeps Throttling Up!
José Paumard
 
Computation Assignment Help
Computation Assignment Help Computation Assignment Help
Computation Assignment Help
Programming Homework Help
 
3rd Semester Computer Science and Engineering (ACU-2022) Question papers
3rd Semester Computer Science and Engineering  (ACU-2022) Question papers3rd Semester Computer Science and Engineering  (ACU-2022) Question papers
3rd Semester Computer Science and Engineering (ACU-2022) Question papers
BGS Institute of Technology, Adichunchanagiri University (ACU)
 
Backpropagation - Elisa Sayrol - UPC Barcelona 2018
Backpropagation - Elisa Sayrol - UPC Barcelona 2018Backpropagation - Elisa Sayrol - UPC Barcelona 2018
Backpropagation - Elisa Sayrol - UPC Barcelona 2018
Universitat Politècnica de Catalunya
 
B61301007 matlab documentation
B61301007 matlab documentationB61301007 matlab documentation
B61301007 matlab documentation
Manchireddy Reddy
 
Dsoop (co 221) 1
Dsoop (co 221) 1Dsoop (co 221) 1
Dsoop (co 221) 1
Puja Koch
 
Computer science ms
Computer science msComputer science ms
Computer science ms
B Bhuvanesh
 
Oct27
Oct27Oct27
Oct27
Tak Lee
 
Quantum Computing Notes Ver 1.2
Quantum Computing Notes Ver 1.2Quantum Computing Notes Ver 1.2
Quantum Computing Notes Ver 1.2
Vijayananda Mohire
 
Dat 305 dat305 dat 305 education for service uopstudy.com
Dat 305 dat305 dat 305 education for service   uopstudy.comDat 305 dat305 dat 305 education for service   uopstudy.com
Dat 305 dat305 dat 305 education for service uopstudy.com
ULLPTT
 
MATLAB Questions and Answers.pdf
MATLAB Questions and Answers.pdfMATLAB Questions and Answers.pdf
MATLAB Questions and Answers.pdf
ahmed8651
 
2nd Semester M Tech: Structural Engineering (June-2015) Question Papers
2nd  Semester M Tech: Structural Engineering  (June-2015) Question Papers2nd  Semester M Tech: Structural Engineering  (June-2015) Question Papers
2nd Semester M Tech: Structural Engineering (June-2015) Question Papers
BGS Institute of Technology, Adichunchanagiri University (ACU)
 

Similar to Datastage real time scenario (20)

Datastage job scenario questiond
Datastage job scenario questiondDatastage job scenario questiond
Datastage job scenario questiond
 
Astronomical data analysis by python.pdf
Astronomical data analysis by python.pdfAstronomical data analysis by python.pdf
Astronomical data analysis by python.pdf
 
Sample Exam Questions on Python for revision
Sample Exam Questions on Python for revisionSample Exam Questions on Python for revision
Sample Exam Questions on Python for revision
 
combat unacademy.pdf
combat unacademy.pdfcombat unacademy.pdf
combat unacademy.pdf
 
Speeding Up Distributed Machine Learning Using Codes
Speeding Up Distributed Machine Learning Using CodesSpeeding Up Distributed Machine Learning Using Codes
Speeding Up Distributed Machine Learning Using Codes
 
LalitBDA2015V3
LalitBDA2015V3LalitBDA2015V3
LalitBDA2015V3
 
Gate-Cs 1993
Gate-Cs 1993Gate-Cs 1993
Gate-Cs 1993
 
Adobe
AdobeAdobe
Adobe
 
Java Keeps Throttling Up!
Java Keeps Throttling Up!Java Keeps Throttling Up!
Java Keeps Throttling Up!
 
Computation Assignment Help
Computation Assignment Help Computation Assignment Help
Computation Assignment Help
 
3rd Semester Computer Science and Engineering (ACU-2022) Question papers
3rd Semester Computer Science and Engineering  (ACU-2022) Question papers3rd Semester Computer Science and Engineering  (ACU-2022) Question papers
3rd Semester Computer Science and Engineering (ACU-2022) Question papers
 
Backpropagation - Elisa Sayrol - UPC Barcelona 2018
Backpropagation - Elisa Sayrol - UPC Barcelona 2018Backpropagation - Elisa Sayrol - UPC Barcelona 2018
Backpropagation - Elisa Sayrol - UPC Barcelona 2018
 
B61301007 matlab documentation
B61301007 matlab documentationB61301007 matlab documentation
B61301007 matlab documentation
 
Dsoop (co 221) 1
Dsoop (co 221) 1Dsoop (co 221) 1
Dsoop (co 221) 1
 
Computer science ms
Computer science msComputer science ms
Computer science ms
 
Oct27
Oct27Oct27
Oct27
 
Quantum Computing Notes Ver 1.2
Quantum Computing Notes Ver 1.2Quantum Computing Notes Ver 1.2
Quantum Computing Notes Ver 1.2
 
Dat 305 dat305 dat 305 education for service uopstudy.com
Dat 305 dat305 dat 305 education for service   uopstudy.comDat 305 dat305 dat 305 education for service   uopstudy.com
Dat 305 dat305 dat 305 education for service uopstudy.com
 
MATLAB Questions and Answers.pdf
MATLAB Questions and Answers.pdfMATLAB Questions and Answers.pdf
MATLAB Questions and Answers.pdf
 
2nd Semester M Tech: Structural Engineering (June-2015) Question Papers
2nd  Semester M Tech: Structural Engineering  (June-2015) Question Papers2nd  Semester M Tech: Structural Engineering  (June-2015) Question Papers
2nd Semester M Tech: Structural Engineering (June-2015) Question Papers
 

More from Naresh Bala

Data stage scenario design9 - job1
Data stage scenario   design9 - job1Data stage scenario   design9 - job1
Data stage scenario design9 - job1
Naresh Bala
 
Data stage scenario design6 - job1
Data stage scenario   design6 - job1Data stage scenario   design6 - job1
Data stage scenario design6 - job1
Naresh Bala
 
Data stage scenario design5 - job1
Data stage scenario   design5 - job1Data stage scenario   design5 - job1
Data stage scenario design5 - job1
Naresh Bala
 
Data stage scenario design4 - job1
Data stage scenario   design4 - job1Data stage scenario   design4 - job1
Data stage scenario design4 - job1
Naresh Bala
 
Data stage scenario design3 - job1
Data stage scenario   design3 - job1Data stage scenario   design3 - job1
Data stage scenario design3 - job1
Naresh Bala
 
Data stage scenario design2 - job3
Data stage scenario   design2 - job3Data stage scenario   design2 - job3
Data stage scenario design2 - job3
Naresh Bala
 
Datastage 8.1 real time q
Datastage 8.1 real time qDatastage 8.1 real time q
Datastage 8.1 real time q
Naresh Bala
 

More from Naresh Bala (7)

Data stage scenario design9 - job1
Data stage scenario   design9 - job1Data stage scenario   design9 - job1
Data stage scenario design9 - job1
 
Data stage scenario design6 - job1
Data stage scenario   design6 - job1Data stage scenario   design6 - job1
Data stage scenario design6 - job1
 
Data stage scenario design5 - job1
Data stage scenario   design5 - job1Data stage scenario   design5 - job1
Data stage scenario design5 - job1
 
Data stage scenario design4 - job1
Data stage scenario   design4 - job1Data stage scenario   design4 - job1
Data stage scenario design4 - job1
 
Data stage scenario design3 - job1
Data stage scenario   design3 - job1Data stage scenario   design3 - job1
Data stage scenario design3 - job1
 
Data stage scenario design2 - job3
Data stage scenario   design2 - job3Data stage scenario   design2 - job3
Data stage scenario design2 - job3
 
Datastage 8.1 real time q
Datastage 8.1 real time qDatastage 8.1 real time q
Datastage 8.1 real time q
 

Recently uploaded

Hand Gesture Control Robotic Arm using image processing.pptx
Hand Gesture Control Robotic Arm using image processing.pptxHand Gesture Control Robotic Arm using image processing.pptx
Hand Gesture Control Robotic Arm using image processing.pptx
wstatus456
 
new-HIFLY-TBR-catalogue size specification
new-HIFLY-TBR-catalogue size specificationnew-HIFLY-TBR-catalogue size specification
new-HIFLY-TBR-catalogue size specification
bosscmn
 
EV Charging at Multifamily Properties by Kevin Donnelly
EV Charging at Multifamily Properties by Kevin DonnellyEV Charging at Multifamily Properties by Kevin Donnelly
EV Charging at Multifamily Properties by Kevin Donnelly
Forth
 
What Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill Roads
What Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill RoadsWhat Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill Roads
What Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill Roads
Sprinter Gurus
 
一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理
一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理
一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理
afkxen
 
快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样
快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样
快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样
78tq3hi2
 
Case Study on Failure Product - Tata Nano
Case Study on Failure Product - Tata NanoCase Study on Failure Product - Tata Nano
Case Study on Failure Product - Tata Nano
chaitanyabelgaumkar
 
final-slide-deck-ACURE-AQ-December-1-webinar-2022.pdf
final-slide-deck-ACURE-AQ-December-1-webinar-2022.pdffinal-slide-deck-ACURE-AQ-December-1-webinar-2022.pdf
final-slide-deck-ACURE-AQ-December-1-webinar-2022.pdf
Ashfaq Ahmad
 
AadiShakti Projects ( Asp Cranes ) Raipur
AadiShakti Projects ( Asp Cranes ) RaipurAadiShakti Projects ( Asp Cranes ) Raipur
AadiShakti Projects ( Asp Cranes ) Raipur
AadiShakti Projects
 
Digital Fleet Management - Why Your Business Need It?
Digital Fleet Management - Why Your Business Need It?Digital Fleet Management - Why Your Business Need It?
Digital Fleet Management - Why Your Business Need It?
jennifermiller8137
 
一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理
一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理
一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理
mymwpc
 
TRAINEES-RECORD-BOOK- electronics and electrical
TRAINEES-RECORD-BOOK- electronics and electricalTRAINEES-RECORD-BOOK- electronics and electrical
TRAINEES-RECORD-BOOK- electronics and electrical
JohnCarloPajarilloKa
 
Here's Why Every Semi-Truck Should Have ELDs
Here's Why Every Semi-Truck Should Have ELDsHere's Why Every Semi-Truck Should Have ELDs
Here's Why Every Semi-Truck Should Have ELDs
jennifermiller8137
 
一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理
一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理
一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理
eygkup
 
一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理
一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理
一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理
bouvoy
 
Globalfleet - global fleet survey 2021 full results
Globalfleet - global fleet survey 2021 full resultsGlobalfleet - global fleet survey 2021 full results
Globalfleet - global fleet survey 2021 full results
vaterland
 
53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...
53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...
53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...
MarynaYurchenko2
 
What do the symbols on vehicle dashboard mean?
What do the symbols on vehicle dashboard mean?What do the symbols on vehicle dashboard mean?
What do the symbols on vehicle dashboard mean?
Hyundai Motor Group
 
原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样
原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样
原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样
78tq3hi2
 
Skoda Octavia Rs for Sale Perth | Skoda Perth
Skoda Octavia Rs for Sale Perth | Skoda PerthSkoda Octavia Rs for Sale Perth | Skoda Perth
Skoda Octavia Rs for Sale Perth | Skoda Perth
Perth City Skoda
 

Recently uploaded (20)

Hand Gesture Control Robotic Arm using image processing.pptx
Hand Gesture Control Robotic Arm using image processing.pptxHand Gesture Control Robotic Arm using image processing.pptx
Hand Gesture Control Robotic Arm using image processing.pptx
 
new-HIFLY-TBR-catalogue size specification
new-HIFLY-TBR-catalogue size specificationnew-HIFLY-TBR-catalogue size specification
new-HIFLY-TBR-catalogue size specification
 
EV Charging at Multifamily Properties by Kevin Donnelly
EV Charging at Multifamily Properties by Kevin DonnellyEV Charging at Multifamily Properties by Kevin Donnelly
EV Charging at Multifamily Properties by Kevin Donnelly
 
What Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill Roads
What Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill RoadsWhat Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill Roads
What Could Be Behind Your Mercedes Sprinter's Power Loss on Uphill Roads
 
一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理
一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理
一比一原版(WashU文凭证书)圣路易斯华盛顿大学毕业证如何办理
 
快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样
快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样
快速办理(napier毕业证书)英国龙比亚大学毕业证在读证明一模一样
 
Case Study on Failure Product - Tata Nano
Case Study on Failure Product - Tata NanoCase Study on Failure Product - Tata Nano
Case Study on Failure Product - Tata Nano
 
final-slide-deck-ACURE-AQ-December-1-webinar-2022.pdf
final-slide-deck-ACURE-AQ-December-1-webinar-2022.pdffinal-slide-deck-ACURE-AQ-December-1-webinar-2022.pdf
final-slide-deck-ACURE-AQ-December-1-webinar-2022.pdf
 
AadiShakti Projects ( Asp Cranes ) Raipur
AadiShakti Projects ( Asp Cranes ) RaipurAadiShakti Projects ( Asp Cranes ) Raipur
AadiShakti Projects ( Asp Cranes ) Raipur
 
Digital Fleet Management - Why Your Business Need It?
Digital Fleet Management - Why Your Business Need It?Digital Fleet Management - Why Your Business Need It?
Digital Fleet Management - Why Your Business Need It?
 
一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理
一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理
一比一原版(OP毕业证)奥塔哥理工学院毕业证成绩单如何办理
 
TRAINEES-RECORD-BOOK- electronics and electrical
TRAINEES-RECORD-BOOK- electronics and electricalTRAINEES-RECORD-BOOK- electronics and electrical
TRAINEES-RECORD-BOOK- electronics and electrical
 
Here's Why Every Semi-Truck Should Have ELDs
Here's Why Every Semi-Truck Should Have ELDsHere's Why Every Semi-Truck Should Have ELDs
Here's Why Every Semi-Truck Should Have ELDs
 
一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理
一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理
一比一原版(AIS毕业证)奥克兰商学院毕业证成绩单如何办理
 
一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理
一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理
一比一原版(UNITEC毕业证)UNITEC理工学院毕业证成绩单如何办理
 
Globalfleet - global fleet survey 2021 full results
Globalfleet - global fleet survey 2021 full resultsGlobalfleet - global fleet survey 2021 full results
Globalfleet - global fleet survey 2021 full results
 
53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...
53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...
53286592-Global-Entrepreneurship-and-the-Successful-Growth-Strategies-of-Earl...
 
What do the symbols on vehicle dashboard mean?
What do the symbols on vehicle dashboard mean?What do the symbols on vehicle dashboard mean?
What do the symbols on vehicle dashboard mean?
 
原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样
原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样
原版制作(Exeter毕业证书)埃克塞特大学毕业证完成信一模一样
 
Skoda Octavia Rs for Sale Perth | Skoda Perth
Skoda Octavia Rs for Sale Perth | Skoda PerthSkoda Octavia Rs for Sale Perth | Skoda Perth
Skoda Octavia Rs for Sale Perth | Skoda Perth
 

Datastage real time scenario

  • 1. 0Like First Prev Next Last     Datastage real time scenario amulas Questions by amulas
  • 2. Yes 1 Reply Yes Reply Vinod This one is the most complicated that i had ever seen. Basically it is inverse pivot functionality. but in order to perform inverse pivot functionality we need at-least 2 columns. So, i am going to generate that extra column with "1" in 6 rows. Then Based on this i done the concatenation, after concatenation i used copy stage then from copy stage one link is going to remove duplicate stage and another one to lookup stage. in remove duplicate stage i collected the retain = last value (a,b,c,1,2,3), 1 . in lookup stage i combined both the data and used transformer stage to collect (a,b,c) then i made a concatenate with (a,b,c) with actual values(a,b,c,1,2,3) then the data will be {(a,b,c,a),(a,b,c,b),(a,b,c,c),(a,b,c,1), (a,b,c,2),(a,b,c,3)} now i specified a condition so that i can collect the specified requirement {(a,b,c,1),(a,b,c,2),(a,b,c,3)} I can't post the screen shot's if u need further clarification Feel free to mail mee. I will send the screen shots.. ALL THE BEST !! KEEP POSTING... kumar We can do it using Transformer.Take 3 stage variables(s1,s2,s3),for s1 map the input column and for s2 we have to write the condition like if alpha(inputcolumn)= true then trim(s3:,:s1,,,) else s3:,:inputcolumn. for s3 also we have to write the condition like if alpha(inputcol) true then map s2 into s3 else map s3 to s3. Input column---->S1 if alpha(inputcolumn)=true then trim(s3:,:s1) else trim(s3:,:inputcolumn)-------- >s2 if alpha(inputcoumn)=true then s2 else s3------->s3 In constraint part we have to write the below condition if alnum(s2)=true In derivation part we have to map s2 to output column I think it will work poorna source-->Transformer(use field function by taking stage variable like field(inputcolumn,,,1,3) and concatenate this field value aging with field ----> Pivot stage--->target.
  • 3. Yes Reply Yes Reply Yes 1 Reply  rupam Source->TR->RD->Pivot->Target,by using these order of stages we can get required output. Transformer: we have to concatenate the values by using loop(we will get like a,b,c,1,2,3) after that we have to split it into separate fields using field function. o/p is:c1 c2 c3 c4 c5 c6 c7 1 a 1 a b 1 a b c 1 a b c 1 1 a b c 1 2 1 a b c 1 2 3 (if we dont want this dummy column we can drop it here itself) RemoveDuplicate: put condition retain last o/p is: c1 c2 c3 c4 c5 c6 c7 1 a b c 1 2 3 pivot; in derivation of c5 column give c5,c6,c7 here we are converting columns into rows o/p is: c2 c3 c4 c5 c6 c7 a b c 1 a b c 2 a b c 3 sreenu Hi., we can achieve this by source--->pivot-->Transformer --> target we will get 6 columns from pivot stage(columns to rows) then In transformer stage we have to concatenate the input columns like col1:col2:col3:(here we can use stage variables and increment that value by one) regards sreenu
  • 4. Yes Reply Yes Reply venkatasuresh Source we have like this a,b,c,d,e,f here 6 columns a,b,c,1,2,3 e,f,g,4,5,6 we need to get in target like this a,b,c,1 and a,b,c,2 and a,b,c,3 and e,f,g,4 for that we have to use just three stages source---------------->pivot------------------------>target in pivot we need to implement this code column,derivation a,a b,b c,c values,d,e,f and target file name this will work to get that result Prabhakar Achyuta Very simple..please go through below. Input: CUST_ID ---------- a,b,c,1,2,3 Output: CUST_ID: ------------- a,b,c,1 a,b,c,2 a,b,c,3 Solution: We can solve it from below solution. JOB flow: Transformer (3 ouyput links)----> Funnel---->Dataset In Transformer: Use 3 stage variables, in sv1: left(Cust_id,1,7) in sv2: left(Cust_id,1,6)||Left(right(Cust_id,3),1) in sv3: left(Cust_id,1,6)||Right(Cust_id,1) Take 3 outputs from Transformer, map sv1 to output-1 column CUST_ID, map sv2 to output-2 column CUST_ID, map sv3 to output-3 column CUST_ID Here one input record splits into 3 output records. Now cature all three output records using Funnel stage.
  • 5. Yes ReplyAnswer Question Send Reset RELATED ANSWERED QUESTIONS  How much time should it to take to set up a server with 5 workstations and network it?  What is slowly changing dimension(scd)  What is range look up and how it is used in datastage.  Having single input source want three different outputs.  A wall clock looses 10 mins in 1 hr. 4 one hours of wall clock table clock gains 10mins for 1 hour of table clock alarm clock looses 5 mins for 1hr of arm clock, wrist watch gains 5min they were set  Maintaining data integrity  Question on testing  Prepaid expenses  When the application is ready for testing ? sivaksa Guys try simple way. Source.....trans.....pivot...target trans...we can use filed function and create new column col1:filed(inputcol,,,4,1) col2:filed(inputcol,,,5,1) Col3:filed(inputcol,,,6,1) And pivot put output col :col1,col2,col3 Then you can get output
  • 6. Root cause of defect Asked by: kurtz182 Obsolete and expired RMAN backups Asked by: shanthiavari Null keyword Asked by: gkumawat  Flatfiles(.Txt,.Csv,xml) to laod sequential files? RELATED OPEN QUESTIONS  Update strategy  Datastage scenario - flat file  Datastage scenario - two columns in the source  Javascript difficulty  How to identify updated records in datastage.  Source file and 3 output tables records problem  Write the real time scenario of different stages in datastage?  Response time for uploading and downloading of file.  Wants to change career into Informatica  Replay the script without browser in vugen Type and Press Enter  SUBSCRIBE TO RSS FEED Enter you email RANDOM QUESTIONS Subscribe
  • 7. What is difference between regression and functional testing Asked by: kamalakar2000 (52) (7) (1) (2) (25) (15) (26) (35) (1) (22) (2) (1) (212) (6) (1) (206) (65) (396) (217) What are other performance tunings you have done in your last project to increase the performance of slowly running jobs? Asked by: Interview Candidate Interviews TAGS CLOUD INTERVIEW QUESTIONS PDF FILES
  • 9. SOCIAL NETWORKS FANS FOLLOWERS SUBSCRIBE TO RSS FEED FOLLOWERS SPONSORED LINKS
  • 10. Datastage scenario - flat file Asked by: sravanthi Datastage scenario - two columns in the source Asked by: sravanthi Design a job OPEN QUESTIONS ANSWERED
  • 11. Asked by: Alekhya ch Sequential file stage Asked by: Alekhya ch How to identify updated records in datastage. Asked by: taruna.arya Source file and 3 output tables records problem Asked by: taruna.arya Write the real time scenario of different stages in datastage? Asked by: manojkitty Transformer stage compilation error in ascential datastage 7.5, windows xp operating system Asked by: MrReddy Unknown transformer variable definition Asked by: Gina Ying How to use change capture stage in SCDs Asked by: chandukommuri
  • 12. How much time should it to take to set up a server with 5 workstations and network it? business Asked by: Bethany Niccum What is slowly changing dimension(scd) Asked by: taruna.arya What is range look up and how it is used in datastage. Asked by: taruna.arya Having single input source want three different outputs. Asked by: taruna.arya A wall clock looses 10 mins in 1 hr. 4 one hours of wall clock table clock gains 10mins for 1 hour of table clock alarm clock looses 5 mins for 1hr of... Asked by: pravinraja Maintaining data integrity Asked by: abhiastra Question on testing Asked by: sayooj
  • 13. Prepaid expenses Asked by: Mashhood Ek When the application is ready for testing ? Asked by: lakshmip.yaganti Flatfiles(.Txt,.Csv,xml) to laod sequential files? Asked by: Kiranchandra Subscribe TAGS  Accenture  Wipro  AMD  AMDOC  Axes-Technologies  Aztec-Systems  BirlaSoft  Cisco  Cognizant  Dell  GE  HAL  Infosys  ISRO  TCS  Sonata  Adobe  Oracle  Mphasis RANDOM QUESTION  LAN Connection  What is the difference between bubble sort & quick sort?  Slow Logins  What is MULTI ORG FLOW? How many organisation are there in an operating unit?  How many attribute columns can we have for single dff? QUESTION OF THE DAY INTERVIEW & CAREER TIPS
  • 14. About US Privacy Policy Terms & Conditions DMCA Contact Us © Copyright 2014 GeekInterview.com | All Rights Reserved CONTACT US