topic Re: Creating email with a data table after a failure in Data Integration Studio 4.905 in SAS Programming

Creating email with a data table after a failure in Data Integration Studio 4.905

HannaSinger — Tue, 19 Nov 2024 13:25:15 GMT

Hello,
I'm developing a process in Data Integration Studio 4.905.
The goal is to get a set of transformations, where the first part is a group of loop transformations which can fail and the last transformation should send an email with the status of the failure.
The mail should contain a text message in the subject and a table with some data in the mail body.
The process doesn't work completely as it supposed to. The mail is being sent, but only the mail subject is available without the data table in the mail body.
Once the process finishes and I run only the last transformation, the mail is being sent completely together with the data table.

The data table is printed by means of proc print.
I can see in the log that in case that all transformations are running together, the proc print doesn't deliver any observation, but once the last transformation runs alone, the observations are being read.
Any advice, how can I get the proc print delivering all the observations when all transformations are running?

In the meantime, I found a workaround. I’m selecting all values of the relevant column in the data table separated by comma into a macro variable and using this macro variable withing proc odstext for mail creation. It works, but the solution is not very satisfying.

Thank in advance for any idea.

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

Patrick — Tue, 19 Nov 2024 21:25:58 GMT

I don't really understand how your process/flow looks like but based on your description it sounds like a timing issue. Make sure that your error check/send email step is outside of the loop (especially when running in parallel).

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

HannaSinger — Wed, 20 Nov 2024 05:53:07 GMT

Thanks Patrick for your reply.
Yes, the send mail step is outside of the loop and the process is running sequentially.
The issue is:
When there is no error in the loop' everything is fine and the email contains the subject and the data table in the mail body,
but once there is an error in the loop the email is not complete - it contains the subject but doesn't contain the data table. I noticed that it happens because of the proc print which is printing the table and doesn't retrieve any observations in case of a failure in the loop

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

LinusH — Wed, 20 Nov 2024 07:04:34 GMT

Se eaprt of the log (the error and then the email/proint) might help us to understand.

A guess, some errors make SAS go into syntax check mode, and sets obs=0.

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

HannaSinger — Wed, 20 Nov 2024 11:05:43 GMT

Thanks!
Yes, indeed. There is a NOTE OBS=0, enabling syntax check mode
in the log with the failure.
Because of the custom data I cannot send the whole log.
Is there a possibility to force the system not to get to the syntax check mode in the specific run?

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

Patrick — Wed, 20 Nov 2024 12:20:23 GMT

I’d ask what’s causing this error in first place. Ideally you’ve got some error handling in your job so it doesn’t go into syntax check mode.

If an error situation doesn’t cause this table to not even get populated then you could of course also set options obs=max for the portion of your code where you create and send the email using some code along the line of below (not tested, but syntax will be at least close to working).

%let sv_obs=%sysfunc(getoption(obs,keyword));
Options obs=max;
/* here your code for the email */
Options &sv_obs;

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

HannaSinger — Thu, 21 Nov 2024 08:55:12 GMT

Thank you.
I will try this.

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

HannaSinger — Sun, 24 Nov 2024 11:56:50 GMT

Unfortunately, It didn't work.
So for now I will stay with the workaround, using the proc odstext

Re: Creating email with a data table after a failure in Data Integration Studio 4.905

Patrick — Sun, 24 Nov 2024 21:48:08 GMT

@HannaSinger If confidentiality allows share the whole DIS generated code as attachment.