Tuesday, April 15, 2014

DataStage Scenario - Design4 - job1


DataStage Scenario Problem -->  DataStage Scenario - Problem4

Solution Design :

a) Job Design :

Below is the design which can achieve the output as we needed. Here, we are reading seq file as a input, then data is passing through a Sort and Transformer stage to achieve the output.


Monday, April 14, 2014

DataStage Scenario - Design3 - job1


DataStage Scenario Problem -->  DataStage Scenario - Problem3

Solution Design :

a) Job Design :


Below is the design which can achieve the output as we needed. Here, we are reading seq file as a input, then data is passing through a Sort and Transformer stage to achieve the output.

Wednesday, April 09, 2014

Some more design tips for DataStage Job Development


• Common information like home directory, system date, username, password should be initialized in a global variable and then variable should be referred everywhere.

• Stage Variables allow you to hold data from a previous record when the next record, allowing you to compare between previous and current records. Stage variables also allow you return multiple errors for a record of information. By being able to evaluate all data in a record and not just error on the first exception that is found, the cleanup of data is more efficient and requires less iteration.


Tuesday, April 08, 2014

Setting up "CRON" Jobs in Nix



If you want to use the emacs editor for editing cron jobs, then, set the following in your "/home/user/.bash_profile"

EDITOR=emacs

Then, to edit cron jobs

$ crontab -e

You may want to put in the following header