topic Re: Data truncation Issue while exporting an XML from SAS in SAS Programming

Data truncation Issue while exporting an XML from SAS

sathasivam — Tue, 08 Feb 2022 20:50:09 GMT

Hi everyone,

In SAS I have a dataset and I need to export that an XML file in UTF-8 encoding. In a particular field, there is a long string with special characters which is getting truncated while exporting to XML. There are other values which has more characters are exported without any issue. But the particular field with issue has more special characters. Requesting your help to get it resolved

Thank you

Re: Data truncation Issue while exporting an XML from SAS

Sajid01 — Tue, 08 Feb 2022 23:12:00 GMT

Hello
Can you share sample data and the code you are using?
Make sure the data includes good and bad fields and should be as a data step.

Re: Data truncation Issue while exporting an XML from SAS

sathasivam — Tue, 08 Feb 2022 23:25:47 GMT

Hello, Thanks for the response

Value from Dataset:
8822: yhrtahdjdidodjdhsgs 'Gebeew: Harash 2 & 3'Met outgrguytf rocket 'Gebeew: Harash 8 & 9' ward tyehtdhctsf or luhuh edf oea doo Rankedd DOublueh OH abëpogf tyfjjfb.Ir ravel doubl ufhjfnbf kj uhtdgc poyhgdb or do siyufjdkhvnfbg khhff onto ereikendheid

Value in XML:

8822: yhrtahdjdidodjdhsgs 'Gebeew: Harash 2 & 3'Met outgrguytf rocket 'Gebeew: Harash 8 & 9' ward tyehtdhctsf or luhuh edf oea doo Rankedd DOublueh OH abëpogf tyfjjfb.Ir ravel doubl ufhjfnbf

Truncated portion:

kj uhtdgc poyhgdb or do siyufjdkhvnfbg khhff onto ereikendheid

XML map used:

%macro file_loop(Field_ID);
if &Field_ID. not in('.',' ') then Do;
if indexc(&Field_ID.,'&%<>') = 0 then do;
put '<question>';
put '<answer>' &Field_ID. +(-1) '</answer>';
put '</question>';
End;
else Do;
put '<question>';
Field_Special = HTMLENCODE(&Field_ID.);
put '<answer>' Field_Special +(-1) '</answer>';
put '</question>';
end;
End;
else Do;
put '<question>';
put '<answer/>';
put '</question>';
end;
%mend file_loop;

Another query is, in data set there is an "&" symbol which is printed as "&" in XML, please help with the same, Thanks in advance

Re: Data truncation Issue while exporting an XML from SAS

Tom — Wed, 09 Feb 2022 03:38:42 GMT

You seem to be showing a macro that generates PART of a data step.

To know why values might be truncated you need to see the full data step that is being run. And the definition of any input data it is reading.

For example your macro is generating this code:

Field_Special = HTMLENCODE(&Field_ID.);
put '<answer>' Field_Special +(-1) '</answer>';

What is the length defined for the variable FIELD_SPECIAL?

What is the value of the macro variable FIELD_ID? If it is the NAME of a variable then what is the length defined for that variable.

To be extra careful you might try defining FIELD_SPECIAL to be longer. The maximum length for a character variable is 32767 bytes. So try adding this line to the top of the data step where you are going to run the code generated by calling that macro.

length FIELD_SPECIAL $32767 ;

Re: Data truncation Issue while exporting an XML from SAS

sathasivam — Wed, 09 Feb 2022 11:56:37 GMT

Hi Tom,

Declared length FIELD_SPECIAL $32767 ; in datastep and it is working as expected

Thank you