SlideShare a Scribd company logo
1 of 4
Download to read offline
Something about DataStage, DataStage Administration, Job Designing,Developing, DataStage troubleshooting, DataStage Installation & Configuration, ETL, DataWareHousing, DB2,
Teradata, Oracle and Scripting.
Nuts & Bolts of DataStage
Home Interview Questions DataStage Scenarios Series Posts E­Books About Me !!
Tuesday, February 04, 2014
DataStage Scenario Problem ­­>  DataStage Scenario ­ Problem2
Solution Design :
a) Job Design :
In job design, we are using Copy, Aggregator, Filter and Join stage to get the output.
b) Copy Stage Properties :
Simply map the input to both link output. first link goes to Aggregator and second link goes to Join stage. 
DataStage Scenario ­ Design2 ­ job2
Total Pageviews
1 4 5 4 6 1 1
Search
Try Me
DataSet in DataStage
Issuing commands to a Queue Manager (runmqsc)
Hash Files in DataStage
XMeta DB : Datastage Repository
InfoSphere DataStage Jobstatus returned Codes from
dsjob
Conductor Node in Datastage
Schema File in Datastage
Sort stage to remove duplicate
14 Good design tips in Datastage
Datastage Coding Checklist
Must Reads
1   More    Next Blog» Create Blog   Sign In
c) Aggregator Stage Properties :
Input data contains only one column "No" , In Aggregator stage, we have group the data on the "No" column and calculate the rows for each Key (
No ).
d) Filter Stage Properties :  
In Filter stage, we put 2 where condition  count=1 and count>1. and assigned different links to both conditions.
From filter Stage, first link (count=1) map to output file ( which contains the unique records )
and second link we map with Join stage.
e) Join Stage Properties : 
 In join stage, we join the both input on key column (No).
Get daily dose of Tech Food
Email address... Submit
DataStage4You
111 have us in circles View all
Follow
tech foodies
▼  2014 (103)
►  October (7)
►  September (9)
►  August (5)
►  July (12)
►  June (10)
►  May (13)
►  April (10)
►  March (9)
▼  February (16)
Check whether DataStage Job is Multi­
Instance or n...
Get DataStage Job Information without
using Direct...
How to find the patch History of IBM
Infosphere Da...
DataWareHouse (ETL) Designing Steps
Dimension Table and Its Type in Data
WareHouse
Datastage Coding Checklist
List of strong points for InterView :­)
DataStage Parallel job: Retrieve sql codes
Blog Archive
Newer Post Older PostHome
Subscribe to: Post Comments (Atom)
Output from Join map with second output files which contains all the dups as occur in input.
By ETL DataStage at 21:57  0 Comments
Labels: aggregator, copy, DataStage, design, develop, execution, filter, Job, join, output, problem, scenario, Seq File, solution, stages
0 Comments DataStage4You  Login
Sort by Best Share ⤤
Start the discussion…
Be the first to comment.
Subscribe✉ Add Disqus to your sited Privacy
Favorite ★
on a fa...
Interview Questions : DataWareHouse ­
Part 4
DataStage Error : Loop final value not
numeric ­ c...
How to find Agents Ports in IBM
InfoSphere Server ...
DataStage Scenario ­ Design2 ­ job3
How to find the product installed with IBM
Infosph...
DataStage Scenario ­ Design2 ­ job2
DataStage Scenario ­ Design 2 ­ job1
DataStage Scenario ­ Problem16
►  January (12)
►  2013 (167)
►  2012 (175)
►  2011 (8)
Administration 
application  authorities
client  Code  column
commands  Concept
Configuration 
create  Data  database  DataSet
DataStage  DataWareHouse  DB2  DBMS
debug  delete  design  develop
difference  director
Documentation  dsenv  dsjob  DSRPC 
environment Errors  ETL 
file 
function 
Information input  install  Interview 
Job  keys  Link Linux list 
Logging Logical  logs lookup 
managers  message  queue
Metadata Model  MQ  names
Tags Cloud
&PH& 421  advantage Agents aggregator
Answers  architecture ASB attribute 
backup basic binary block books Buffer certification  change
channel  checkpoint  cleanup  clear 
Column  Generator  compiler 
Conceptual  conductor  container  copy
counter  Crontab 
deadlock  deploy 
dimension  Dimensional 
DSparam  dump
duplicate encrypt engine  exception
execution export fact factless  FAQ  FileSet filter free ftp
fun  fundamentals granularity  Guest hadoop handling
hash  head hide horizontal  Host huge  hyperlink  import  increase
index  issue  istool Java
jdbc  join  leaders  listener load
local locks  Login  macro mail
maintenance  memory  merge 
modify Monitor  MQSC multiple 
Optimizing  Oracle 
output  Parallel  parameter  partition
performance  Physical 
port  problem  process 
Project  Putty Questions 
remove 
routine  rows 
scenario  Schema  Script 
Seq  File  sequence  Server  Service  Setting
Shell  shell  scripting 
sort source  SQL  stages
Start  Stop 
surrogate  table  target  teradata
tips  tool  transformer 
Troubleshoot  Tutorial  Unix User
Utility  UV  variables 
warnings  WAS  websphere
windows  XMETA 
NLS  node  notes  notification  odbc  odbc.ini  operator
orchadmin  ORLogging  orphan  OS  osh
package  Parallelism 
password peek  Perl phantom  pivot
player  Practices  profile
programming  purge  read registry
reject  release  report  Resource  Restart  Roles
row  generator  RTLogging  run  sample  SCD
scheduler  score  Scratch  section
session 
Share  shortcuts  show  slowly
snowflake solution  space  SSH 
Standards  Star  statistics  status  storage
switch system  tail  temporary 
time  trace  transformation  trigger
tuning  type unique 
uvodbc.config  version  videos  view
Vincent  McBurney  Virtual 
write Write Range Map  xml z/OS
The postings on this site are my own and don't necessarily represent IBM's or other companies positions, strategies or opinions. All content provided on this blog is for informational purposes only. The owner of this
blog makes no representations as to the accuracy or completeness of any information on this site or found by following any link on this site. The owner will not be liable for any errors or omissions in this information
nor for the availability of this information. The owner will not be liable for any losses, injuries, or damages from the display or use of his information. //­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­
Disclaimer
Did you find this Blog helpful ?? Let me know @ www.facebook.com/datastage4you. Ethereal template. Powered by Blogger.

More Related Content

Recently uploaded

Corporate Presentation Probe Canaccord Conference 2024.pdf
Corporate Presentation Probe Canaccord Conference 2024.pdfCorporate Presentation Probe Canaccord Conference 2024.pdf
Corporate Presentation Probe Canaccord Conference 2024.pdf
Probe Gold
 
一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样
一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样
一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样
sovco
 
Terna - 1Q 2024 Consolidated Results Presentation
Terna - 1Q 2024 Consolidated Results PresentationTerna - 1Q 2024 Consolidated Results Presentation
Terna - 1Q 2024 Consolidated Results Presentation
Terna SpA
 
一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证
一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证
一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证
xzxvi5zp
 

Recently uploaded (20)

Financial Results for the Fiscal Year Ended March 2024
Financial Results for the Fiscal Year Ended March 2024Financial Results for the Fiscal Year Ended March 2024
Financial Results for the Fiscal Year Ended March 2024
 
Teekay Tankers Q1-24 Earnings Presentation
Teekay Tankers Q1-24 Earnings PresentationTeekay Tankers Q1-24 Earnings Presentation
Teekay Tankers Q1-24 Earnings Presentation
 
Osisko Gold Royalties Ltd - Corporate Presentation, May 2024
Osisko Gold Royalties Ltd - Corporate Presentation, May 2024Osisko Gold Royalties Ltd - Corporate Presentation, May 2024
Osisko Gold Royalties Ltd - Corporate Presentation, May 2024
 
Corporate Presentation Probe Canaccord Conference 2024.pdf
Corporate Presentation Probe Canaccord Conference 2024.pdfCorporate Presentation Probe Canaccord Conference 2024.pdf
Corporate Presentation Probe Canaccord Conference 2024.pdf
 
The Leonardo 1Q 2024 Results Presentation
The Leonardo 1Q 2024 Results PresentationThe Leonardo 1Q 2024 Results Presentation
The Leonardo 1Q 2024 Results Presentation
 
SME IPO Opportunity and Trends of May 2024
SME IPO Opportunity and Trends of May 2024SME IPO Opportunity and Trends of May 2024
SME IPO Opportunity and Trends of May 2024
 
Camil Institutional Presentation_Mai24.pdf
Camil Institutional Presentation_Mai24.pdfCamil Institutional Presentation_Mai24.pdf
Camil Institutional Presentation_Mai24.pdf
 
Camil Institutional Presentation_Mai24.pdf
Camil Institutional Presentation_Mai24.pdfCamil Institutional Presentation_Mai24.pdf
Camil Institutional Presentation_Mai24.pdf
 
Osisko Gold Royalties Ltd - Q1 2024 Results
Osisko Gold Royalties Ltd - Q1 2024 ResultsOsisko Gold Royalties Ltd - Q1 2024 Results
Osisko Gold Royalties Ltd - Q1 2024 Results
 
Gorakhpur Call Girls 8250092165 Low Price Escorts Service in Your Area
Gorakhpur Call Girls 8250092165 Low Price Escorts Service in Your AreaGorakhpur Call Girls 8250092165 Low Price Escorts Service in Your Area
Gorakhpur Call Girls 8250092165 Low Price Escorts Service in Your Area
 
Teekay Corporation Q1-24 Earnings Results
Teekay Corporation Q1-24 Earnings ResultsTeekay Corporation Q1-24 Earnings Results
Teekay Corporation Q1-24 Earnings Results
 
一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样
一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样
一比一原版(EUR毕业证书)鹿特丹伊拉斯姆斯大学毕业证原件一模一样
 
Osisko Development - Investor Presentation - May 2024
Osisko Development - Investor Presentation - May 2024Osisko Development - Investor Presentation - May 2024
Osisko Development - Investor Presentation - May 2024
 
Dubai Call Girls/// Hot Afternoon O525547819 Call Girls In Dubai
Dubai Call Girls/// Hot Afternoon O525547819 Call Girls In DubaiDubai Call Girls/// Hot Afternoon O525547819 Call Girls In Dubai
Dubai Call Girls/// Hot Afternoon O525547819 Call Girls In Dubai
 
Premium Call Girls In Kapurthala} 9332606886❤️VVIP Sonya Call Girls
Premium Call Girls In Kapurthala} 9332606886❤️VVIP Sonya Call GirlsPremium Call Girls In Kapurthala} 9332606886❤️VVIP Sonya Call Girls
Premium Call Girls In Kapurthala} 9332606886❤️VVIP Sonya Call Girls
 
countries with the highest gold reserves in 2024
countries with the highest gold reserves in 2024countries with the highest gold reserves in 2024
countries with the highest gold reserves in 2024
 
Western Copper and Gold - May 2024 Presentation
Western Copper and Gold - May 2024 PresentationWestern Copper and Gold - May 2024 Presentation
Western Copper and Gold - May 2024 Presentation
 
AMG Quarterly Investor Presentation May 2024
AMG Quarterly Investor Presentation May 2024AMG Quarterly Investor Presentation May 2024
AMG Quarterly Investor Presentation May 2024
 
Terna - 1Q 2024 Consolidated Results Presentation
Terna - 1Q 2024 Consolidated Results PresentationTerna - 1Q 2024 Consolidated Results Presentation
Terna - 1Q 2024 Consolidated Results Presentation
 
一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证
一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证
一比一原版(Acadia毕业证书)加拿大阿卡迪亚大学毕业证学历认证可查认证
 

Featured

How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Data stage scenario design2 - job2

  • 1. Something about DataStage, DataStage Administration, Job Designing,Developing, DataStage troubleshooting, DataStage Installation & Configuration, ETL, DataWareHousing, DB2, Teradata, Oracle and Scripting. Nuts & Bolts of DataStage Home Interview Questions DataStage Scenarios Series Posts E­Books About Me !! Tuesday, February 04, 2014 DataStage Scenario Problem ­­>  DataStage Scenario ­ Problem2 Solution Design : a) Job Design : In job design, we are using Copy, Aggregator, Filter and Join stage to get the output. b) Copy Stage Properties : Simply map the input to both link output. first link goes to Aggregator and second link goes to Join stage.  DataStage Scenario ­ Design2 ­ job2 Total Pageviews 1 4 5 4 6 1 1 Search Try Me DataSet in DataStage Issuing commands to a Queue Manager (runmqsc) Hash Files in DataStage XMeta DB : Datastage Repository InfoSphere DataStage Jobstatus returned Codes from dsjob Conductor Node in Datastage Schema File in Datastage Sort stage to remove duplicate 14 Good design tips in Datastage Datastage Coding Checklist Must Reads 1   More    Next Blog» Create Blog   Sign In
  • 2. c) Aggregator Stage Properties : Input data contains only one column "No" , In Aggregator stage, we have group the data on the "No" column and calculate the rows for each Key ( No ). d) Filter Stage Properties :   In Filter stage, we put 2 where condition  count=1 and count>1. and assigned different links to both conditions. From filter Stage, first link (count=1) map to output file ( which contains the unique records ) and second link we map with Join stage. e) Join Stage Properties :   In join stage, we join the both input on key column (No). Get daily dose of Tech Food Email address... Submit DataStage4You 111 have us in circles View all Follow tech foodies ▼  2014 (103) ►  October (7) ►  September (9) ►  August (5) ►  July (12) ►  June (10) ►  May (13) ►  April (10) ►  March (9) ▼  February (16) Check whether DataStage Job is Multi­ Instance or n... Get DataStage Job Information without using Direct... How to find the patch History of IBM Infosphere Da... DataWareHouse (ETL) Designing Steps Dimension Table and Its Type in Data WareHouse Datastage Coding Checklist List of strong points for InterView :­) DataStage Parallel job: Retrieve sql codes Blog Archive
  • 3. Newer Post Older PostHome Subscribe to: Post Comments (Atom) Output from Join map with second output files which contains all the dups as occur in input. By ETL DataStage at 21:57  0 Comments Labels: aggregator, copy, DataStage, design, develop, execution, filter, Job, join, output, problem, scenario, Seq File, solution, stages 0 Comments DataStage4You  Login Sort by Best Share ⤤ Start the discussion… Be the first to comment. Subscribe✉ Add Disqus to your sited Privacy Favorite ★ on a fa... Interview Questions : DataWareHouse ­ Part 4 DataStage Error : Loop final value not numeric ­ c... How to find Agents Ports in IBM InfoSphere Server ... DataStage Scenario ­ Design2 ­ job3 How to find the product installed with IBM Infosph... DataStage Scenario ­ Design2 ­ job2 DataStage Scenario ­ Design 2 ­ job1 DataStage Scenario ­ Problem16 ►  January (12) ►  2013 (167) ►  2012 (175) ►  2011 (8) Administration  application  authorities client  Code  column commands  Concept Configuration  create  Data  database  DataSet DataStage  DataWareHouse  DB2  DBMS debug  delete  design  develop difference  director Documentation  dsenv  dsjob  DSRPC  environment Errors  ETL  file  function  Information input  install  Interview  Job  keys  Link Linux list  Logging Logical  logs lookup  managers  message  queue Metadata Model  MQ  names Tags Cloud &PH& 421  advantage Agents aggregator Answers  architecture ASB attribute  backup basic binary block books Buffer certification  change channel  checkpoint  cleanup  clear  Column  Generator  compiler  Conceptual  conductor  container  copy counter  Crontab  deadlock  deploy  dimension  Dimensional  DSparam  dump duplicate encrypt engine  exception execution export fact factless  FAQ  FileSet filter free ftp fun  fundamentals granularity  Guest hadoop handling hash  head hide horizontal  Host huge  hyperlink  import  increase index  issue  istool Java jdbc  join  leaders  listener load local locks  Login  macro mail maintenance  memory  merge  modify Monitor  MQSC multiple 
  • 4. Optimizing  Oracle  output  Parallel  parameter  partition performance  Physical  port  problem  process  Project  Putty Questions  remove  routine  rows  scenario  Schema  Script  Seq  File  sequence  Server  Service  Setting Shell  shell  scripting  sort source  SQL  stages Start  Stop  surrogate  table  target  teradata tips  tool  transformer  Troubleshoot  Tutorial  Unix User Utility  UV  variables  warnings  WAS  websphere windows  XMETA  NLS  node  notes  notification  odbc  odbc.ini  operator orchadmin  ORLogging  orphan  OS  osh package  Parallelism  password peek  Perl phantom  pivot player  Practices  profile programming  purge  read registry reject  release  report  Resource  Restart  Roles row  generator  RTLogging  run  sample  SCD scheduler  score  Scratch  section session  Share  shortcuts  show  slowly snowflake solution  space  SSH  Standards  Star  statistics  status  storage switch system  tail  temporary  time  trace  transformation  trigger tuning  type unique  uvodbc.config  version  videos  view Vincent  McBurney  Virtual  write Write Range Map  xml z/OS The postings on this site are my own and don't necessarily represent IBM's or other companies positions, strategies or opinions. All content provided on this blog is for informational purposes only. The owner of this blog makes no representations as to the accuracy or completeness of any information on this site or found by following any link on this site. The owner will not be liable for any errors or omissions in this information nor for the availability of this information. The owner will not be liable for any losses, injuries, or damages from the display or use of his information. //­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­ Disclaimer Did you find this Blog helpful ?? Let me know @ www.facebook.com/datastage4you. Ethereal template. Powered by Blogger.