topic infile encoding issue in SAS Programming

infile encoding issue

Dawn_Wu — Fri, 27 Mar 2020 01:43:22 GMT

Morning!

I have transcoding problem.

A CSV(contain English and Chinese character) to be imported to SAS format.

1. workable code

data &filename ; ;
infile "&filepath" delimiter = ',' ENCODING="UTF-8" MISSOVER DSD lrecl=32767 firstobs=2 ;

2.failure code

libname dw "..." Inencoding=any;

data dw.&filename ; ;
infile "&filepath" delimiter = ',' ENCODING="UTF-8" MISSOVER DSD lrecl=32767 firstobs=2 ;

3. error log

ERROR: Some character data was lost during transcoding in the dataset DW.TRANSACTIONS_HIST_TABLE_20200325.
Either the data contains characters that are not representable in the new encoding or truncation occurred
during transcoding.

As you can see, if import to work, code runs OK without error;(English/number/Chinese are imported correctly)

while import to libname DW, code runs with error. (English/number are imported correctly, Chinese character not imported)

SAS 9.3/EG 5.1 used. Chinese language supported.

Can anyone give a solution?

Thanks and Regards,

Dawn

Re: infile encoding issue

Dawn_Wu — Fri, 27 Mar 2020 02:02:51 GMT

Morning All,

To make up.

error accurred when libname is a share folder on server other than local ;

no error when libname is any folder of local PC.

Regards,

Dawn

Re: infile encoding issue

ChrisNZ — Fri, 27 Mar 2020 03:14:20 GMT

1. > error accurred when libname is a share folder on server other than local

How do you access the server location?

UNC path such as \\server\path ?

2. What OS for the local machine and for the server?

3. libname dw "..." Inencoding=any;

Why use inencoding= (please use a lower case i to make things more legible) when you use the library for output?

outencoding= would seem more useful here.

4. Why not use encoding='UTF-8' as a libname or as a data set option, rather than encoding=any ?

Re: infile encoding issue

Tom — Fri, 27 Mar 2020 03:20:31 GMT

Do you mean the libref is using the REMOTE engine to connect to a SAS/Share server? What encoding is the remote session using?