SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Job execution when a transformation fails

Reply
Contributor
Posts: 23

Job execution when a transformation fails

Is it always , when a transformation in a job fails, the successive transformations will get executed upto the job's post code?

Super User
Posts: 5,424

Re: Job execution when a transformation fails

What do you mean by "fails"?

And no, not always.

Data never sleeps
Contributor
Posts: 23

Re: Job execution when a transformation fails

By fails, i mean that, the transformation may fail for any reason, ie. a lookup table is missing or anything else like that,

error code > 0

Can you just give me a scenario where the job wont run till postcode if anything fails inbetween. Because, for all possible error scenarios, the job is running till the post code.

Contributor
Posts: 23

Re: Job execution when a transformation fails

Actually, we need to write an entry into the audit log if the job fails. Since, the job is running till postcode, we have written the code for audit log in the job's post code based on the return code value. If the job is not going to be executed till the job's post code on failure cases, then we need to handle this code at the transformation level. For this purpose only, we just want to confirm.

Super User
Posts: 5,424

Re: Job execution when a transformation fails

It could be a challenge to rely on code within a SAS sessions that has a failing step.

The risk is that it will occur a situation that is not prepared for, and not possible for at post process to log/audit.

What is the purpose?

The usual requirements are monitoring, and that should be handled outside SAS, usually by the scheduler.

Other auditing/logging: I would say this might be interesting for keeping statistics, like process time, resources consumed etc, so that you can see changes over time, making prognosis on future use etc,

Data never sleeps
Ask a Question
Discussion stats
  • 4 replies
  • 235 views
  • 0 likes
  • 2 in conversation