topic Re: Format ERROR in SAS Programming

Format ERROR

raajdesaii — Tue, 13 Jul 2021 05:06:40 GMT

Hi all,

I have downloaded a SAS dataset but as soon as I open it, I get this error:

NOTE: Data file TMP1.CORE.DATA is in a format that is native to another host, or the file
encoding does not match the session encoding. Cross Environment Data Access will be used,
which might require additional CPU resources and might reduce performance.

If I try to do any further analyses, I get this error:
ERROR: Some character data was lost during transcoding in the dataset TMP1.CORE. Either the data
contains characters that are not representable in the new encoding or truncation occurred
during transcoding.

Please let me know how do I fix this.

Thanks!!

Re: Format ERROR

andreas_lds — Tue, 13 Jul 2021 05:42:11 GMT

The note about "Cross Environment Data Access" warns you that the dataset

is in a format that is native to another host => more time is necessary to process the data
the file encoding does not match the session encoding => problems could arise if chars are used that don't exist in the encoding of your session

So first step: Use proc contents to check the encoding used to create the dataset and compare that with the encoding your sas session using. If you can, try changing the encoding of you session.

Re: Format ERROR

ballardw — Tue, 13 Jul 2021 06:38:50 GMT

Please note that nothing you post in the body of your question says "Format error" or references a format. Since Formats are a very specific concept in SAS you want to use "format error" when an actual format is giving problems or you get an error or warning referencing a format name.

You have issue with data content.

Re: Format ERROR

Oligolas — Tue, 13 Jul 2021 08:52:45 GMT

Hi,

I guess you've got unicode signs in your datasets.

1.Start SAS with unicode support and

2. Run this to identify the variables:

%let libname=TMP1;
DATA _NULL_;
   SET sashelp.vtable(keep=libname memname);
   WHERE libname eq "%upcase(&libname.)";
      call execute("DATA WORK."||strip(memname)||"; set &libname.."||strip(memname));
      call execute(compbl('ARRAY chars _CHARACTER_;
                           DO OVER chars;
                              if prxmatch("/[^\x20-\x7E]/",chars) then put "W" "ARNING:# special character detected in '||strip(memname)||' dataset " chars=;
                           END;')
                  );
   call execute('RUN;');
RUN;

Re: Format ERROR

Ksharp — Tue, 13 Jul 2021 12:42:20 GMT

That is because the encoding of your sas is different than the dataset's encoding.
Therefore, try start a sas with 'utf-8' (unicode sas) from START menu .and see if the problem is solved.

https://blogs.sas.com/content/sgf/2021/07/12/subchar-option-sas-access/