BookmarkSubscribeRSS Feed
Riteshdell
Quartz | Level 8

Hello SAS DI experts,

I need a help in SAS DI Job related to seneario based Job.

Suppose I have a layer name Raw Jobs which contain 5 jobs, and it is quire simple One to one.
to execute those 5 jobs, I want one master job which should trigger those 5 jobs and as well as
validate that which job data is available or not?


Can any body have experience on this mixing kind of Scenario, pelase let me know the procedure.,How we can do it.
please help me.

 

4 REPLIES 4
SteveED
SAS Employee

hi Ritesh_dellvostro,

 

The typical scenario that I've seen for this is done by deploying the 5 jobs to the scheduler and creating a scheduling flow that runs the jobs conditionally. A 6th job could be created to validate the results, or they could be validated after each of the 5 jobs is run. 

 

But you could also create a "master" DI Studio flow by creating a new flow and dragging the other 5 flows onto it. You can implement Conditional Start and Conditional End transformations to control execution and write/drop transformations to evaluate results.  I'm not exactly sure what you mean by "validate that which job data is available or not" (there are several interpretations of this) so I can't give a specific answer, but it is possible.

 

Steve

Riteshdell
Quartz | Level 8

Thanks @SteveED@Patrick for your input. it was good suggestion given by you, I will try to implement it.

 

For more information asked by @Patrick and @SteveED is given below:

 

1)-  For all 5 job, Source file is available or not?

2)-  If 4 Files are available and 1 is not updated with new file, what kind of validation we can keep for schduling and How?

3)-  @SteveED-  Can you Give more information on this statement - "You can implement Conditional Start and Conditional End transformations to control execution and write/drop transformations to evaluate results."

 

 

Thanks for your help.

 

Regards,

Ritesh

SteveED
SAS Employee

Ritesh,

 

from the users guide:

 

Running Conditional Processing

 

Managing the status of jobs and transformations

 

You can use these to selectively execute transformations (or nested flows) and evaluate the results to determine if processing should continue. Investigate deploying jobs and using the schedule manager first though. It's a better solution.

 

Steve

Patrick
Opal | Level 21

I'm very much with @SteveED on the same page here. If you have to run 5 jobs in parallel, sequentially or with some dependencies then you'd typically use a scheduler.

Logically you can also go for a master DIS job by dragging all the other jobs into the master DIS job canvas - BUT: What this does is actually creating a single big job which runs in a single workspace session. Such an approach works but I'd consider it from an operational point of view as inferior to proper scheduling.

 

As for your data availability question:The answer depends very much of what kind of control/validation you're after.

- Source files available? Source files not empty? Data loaded into target? Data in source was valid? Extract job run successfully and loaded data?

- What should happen if a condition is not met?

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to connect to databases in SAS Viya

Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 4 replies
  • 938 views
  • 0 likes
  • 3 in conversation