topic Re: Character constant truncated to 32767 characters. in SAS Programming

Character constant truncated to 32767 characters.

Liliya95 — Fri, 27 Jul 2018 05:41:11 GMT

Hi!
Running the code causes a truncation error. Although the input file has a length less than the maximum. This is a test code, but in fact there will come texts of large dimension.
What could be the reason?

%macro test;

%let temp=PGVudE5hbT7QntCR0KnQldCh0KLQktCeINChINCe0JPQoNCQ0J3QmNCn0JXQndCd0J7QmSDQntCi0JLQldCi0KHQotCS0JXQndCd0J7QodCi0KzQriAi0KHQotCg0J7QmNCi0JXQm9Cs0J3QkNCvINCa0J7QnNCf0JDQndCY0K8gItCS0JjQlCI8L2VudE5hbT4=;

		%put temp=&temp;
        %let decodedata =%qsysfunc(inputc(&temp,$base64x32767));
		%put decodedata=&decodedata;
		%let DOCFILE = &TEST/tesе/2.xml;
		FILENAME DOCFILE "&DOCFILE" encoding='wcyrillic' LRECL=32767;

		data _null_;		  
           file DOCFILE LRECL=32767 recfm=f;
           length temp $32767;
           put "&decodedata";		  
        run;

 

%mend test;


%test;

Re: Character constant truncated to 32767 characters.

andreas_lds — Fri, 27 Jul 2018 06:00:29 GMT

It has been said many times: don't put data in macro-variables.

Seems to work fine:

data work.have;
   temp = "PGVudE5hbT7QntCR0KnQldCh0KLQktCeINChINCe0JPQoNCQ0J3QmNCn0JXQndCd0J7QmSDQntCi0JLQldCi0KHQotCS0JXQndCd0J7QodCi0KzQriAi0KHQotCg0J7QmNCi0JXQm9Cs0J3QkNCvINCa0J7QnNCf0JDQndCY0K8gItCS0JjQlCI8L2VudE5hbT4=";
   decodeData = input(temp, $base64x32767.);
run;


filename docfile "&TEST/tesе/2.xml" encoding='wcyrillic' lrecl=32767;

data _null_;
   set have;
   file docfile lrecl=32767 recfm=f;
   put decodedata;
run;

Re: Character constant truncated to 32767 characters.

Sharkman — Thu, 26 May 2022 17:05:55 GMT

Sorry if it has been said many times but the code doesn't work. SAS truncate the base64 text. The code have 17699 characters.

Re: Character constant truncated to 32767 characters.

Tom — Thu, 26 May 2022 18:11:03 GMT

What are you trying to do? Your posted code does not make much sense. Why are you defining a variable in the data step that you never use?

Why are you trying to work with BASE64 text in macro variables?

You need to use %QSYSFUNC() but that will add macro quoting to the trailing spaces produced by using an informat with a width that is longer than needed.

1    %let
1  ! temp=PGVudE5hbT7QntCR0KnQldCh0KLQktCeINChINCe0JPQoNCQ0J3QmNCn0JXQndC
1  ! d0J7QmSDQntCi0JLQldCi0KHQotCS0JXQndCd0J7QodCi0KzQriAi0KHQotCg0J7QmNC
1  ! i0JXQm9Cs0J3QkNCvINCa0J7QnNCf0JDQndCY0K8gItCS0JjQlCI8L2VudE5hbT4=;
2
3    %put %length(&temp);
196
4    %let decoded=%qsysfunc(inputc(&temp,$base64x32767.));
5    %put %length(&decoded);
32767

For an encoded string of 196 bytes the result is a string of 147 bytes. 3*196/4= 147.

So here is what you need to do.

1) Use the length of the ENCODED string in the INFORMAT. But this will return a string of that length (so padded with 49 (196-147) extra spaces).

2) So then use the %QSUBSTR() to remove the extra spaces.

109  %let
109! temp=PGVudE5hbT7QntCR0KnQldCh0KLQktCeINChINCe0JPQoNCQ0J3QmNCn0JXQndC
109! d0J7QmSDQntCi0JLQldCi0KHQotCS0JXQndCd0J7QodCi0KzQriAi0KHQotCg0J7QmNC
109! i0JXQm9Cs0J3QkNCvINCa0J7QnNCf0JDQndCY0K8gItCS0JjQlCI8L2VudE5hbT4=;
110  %let inlength=%length(&temp);
111  %let outlength=%eval((&inlength+3)/4*3);
112  %put &=inlength &=outlength;
INLENGTH=196 OUTLENGTH=147
113  %let
113! decoded=%qsubstr(%qsysfunc(inputc(&temp,$base64x&inlength)),1,&outle
113! ngth);
114  %put &=decoded;
DECODED=<entNam>ÐžÐ‘Ð©Ð•Ð¡Ð¢Ð’Ðž Ð¡ ÐžÐ“Ð ÐÐÐ˜Ð§Ð•ÐÐÐžÐ™
ÐžÐ¢Ð’Ð•Ð¢Ð¡Ð¢Ð’Ð•ÐÐÐžÐ¡Ð¢Ð¬Ð® "Ð¡Ð¢Ð ÐžÐ˜Ð¢Ð•Ð›Ð¬ÐÐÐ¯
ÐšÐžÐœÐŸÐÐÐ˜Ð¯ "Ð’Ð˜Ð”"</entNam>
115  %put %length(&decoded);
147

Re: Character constant truncated to 32767 characters.

Tom — Thu, 26 May 2022 18:21:03 GMT

Note also that if the encoded string is not an exact multiple of 4 bytes long then you need to append equal signs until it is so that the BASE64 string has the right number of bits to be split back into base256 strings.

Example:

217  data test;
218    x='AB';
219    encode = put(x,$base64x4.);
220    put encode=;
221  run;

encode=QUI=
NOTE: The data set WORK.TEST has 1 observations and 2 variables.
NOTE: DATA statement used (Total process time):
      real time           0.00 seconds
      cpu time            0.00 seconds


222
223
224  %let coded=QUI;
225  %let raw_length=%length(&coded);
226  %let actual_length=%eval((&raw_length+3)/4*4);
227  %put &=raw_length &=actual_length ;
RAW_LENGTH=3 ACTUAL_LENGTH=4
228  %put %sysfunc(inputc(&coded,$base64x&raw_length));

229  %put %sysfunc(inputc(&coded,$base64x&actual_length));

230  %put %sysfunc(inputc(&coded===,$base64x&actual_length));
AB

So make sure to figure out the right length to use and to append some equal signs.