topic Re: SAS DI Studio: "Treat consecutive delimiters as a single delimiter" option is cutting in SAS Data Management

SAS DI Studio: "Treat consecutive delimiters as a single delimiter" option is cutting off characters

josh_rodriguez — Wed, 09 Feb 2022 22:45:28 GMT

Hi All, and thanks in advance!!!

I recently found out that my File Writer transformation is outputting blank spaces instead of nulls. I need it to be nulls.

I've tried several things, but to no avail. The closest thing that's gotten me to where I'm trying to go is to use the "Treat consecutive delimiters as a single delimiter" option on the very first File Reader transformation and then modifying the File Writer transformation code on the "put" section to display the field values without the ""s. And it does the trick.

However, a big drawback is that it is cutting of the values of 1 or 2 other fields, for some reason. This is odd, because I double and triple-checked the lengths, formats, and informats of said fields on every single transformation and everything is in sync throughout all of the transformations.

Again, thank you for any help you might give this SAS newbie!!!

-Josh

Re: SAS DI Studio: "Treat consecutive delimiters as a single delimiter" option is cutting

AllanBowe — Thu, 10 Feb 2022 13:07:01 GMT

Hi Josh - if you're happy with a custom code transform you could try this macro: https://core.sasjs.io/mp__ds2csv_8sas.html

I just tested with this code:

data withnulls;
   length a b c $1;
   length d e f 8;
   call missing(of _all_);
run;

%mp_ds2csv(withnulls,outref="%sysfunc(pathname(work))/file.csv")

data _null_;
  infile "%sysfunc(pathname(work))/file.csv";
  input;
  putlog _infile_;
run;

And it generated this:

 A, B, C, D, E, F
 "" ,"" ,"" ,,,

If the blank space after the null value is a problem, we could get that removed.

Re: SAS DI Studio: "Treat consecutive delimiters as a single delimiter" option is cutting

Tom — Thu, 10 Feb 2022 14:18:55 GMT

In your first photograph of the text file you are generating there are a LOT of unneeded quotes. (Why did you post a photograph of text instead of just pasting the text into a text box?) For example the values DCCC_CRJ and 88.78 have quotes around them. Neither of those values contain either commas or quotes, so there was no need to add quotes around them in the CSV file.

Did you ask DI to insert all of those unneeded quotes? If so why? How?

Can you show what actual SAS code DI generated to create the CSV file?

Re: SAS DI Studio: "Treat consecutive delimiters as a single delimiter" option is cutting

josh_rodriguez — Fri, 18 Feb 2022 20:14:33 GMT

Thank you for your reply, Allan.
I was able to solve it. The concatenation function works- that's what I had to use in my Put statement, right before said Put statement.

Re: SAS DI Studio: "Treat consecutive delimiters as a single delimiter" option is cutting

josh_rodriguez — Fri, 18 Feb 2022 20:15:26 GMT

Thank you for your reply, Tom.
I was able to solve it. The concatenation function works- that's what I had to use in my Put statement, right before said Put statement.

Re: SAS DI Studio: "Treat consecutive delimiters as a single delimiter" option is cutting

Tom — Sat, 19 Feb 2022 00:25:42 GMT

So you got it to work?

Note: You posted photographs of text again.

And you didn't answer why you need to jump through hoops to create such a non-standard file. What is going to read the file that requires all of those unneeded quote characters?