topic Re: ERROR: Some character data was lost during transcoding in the dataset YYYY.PERSON. in Administration and Deployment

ERROR: Some character data was lost during transcoding in the dataset YYYY.PERSON.

Sandhya55 — Tue, 02 Nov 2021 14:45:56 GMT

Im getting below error while extracting metadata from sas management console.

ERROR: Some character data was lost during transcoding in the dataset YYYY.PERSON. Either the data contains characters that are not representable in the new encoding or truncation occurred during transcoding.

Re: ERROR: Some character data was lost during transcoding in the dataset YYYY.PERSON.

gwootton — Tue, 02 Nov 2021 15:09:48 GMT

This means you are trying to write special characters to a dataset with encoding that doesn't support it. Since it has no way to represent that character it throws an error. For example if you have in a user's display name in Metadata a character that only exists in UTF-8 and you try to write that value to a LATIN1 dataset, this error would occur.

Re: ERROR: Some character data was lost during transcoding in the dataset YYYY.PERSON.

Sandhya55 — Tue, 02 Nov 2021 15:27:11 GMT

how to identify if the data extracted from metadata is latin1 or utf-8 or any other encoding ..currently we have set the current session to run in utf-8

Re: ERROR: Some character data was lost during transcoding in the dataset YYYY.PERSON.

gwootton — Tue, 02 Nov 2021 15:34:45 GMT

If your session is running in UTF-8 then perhaps the dataset YYYY.PERSON already exists and is not a UTF-8 dataset? Perhaps you could create a new one? Depending on how you are pulling information from Metadata you could use the regular expression [^\x00-\x7F] to find characters outside the ASCII range.