Bulk load to Greenplum issue using SAS

[gyambqt]

Hello Experts,

I am loading a single record with (special character embedded) to Greenplum using the code:

LIBNAME test GREENPLM    PRESERVE_COL_NAMES=NO  PRESERVE_TAB_NAMES=NO  DATABASE=xxx SERVER="xxx"  SCHEMA=xxx  AUTHDOMAIN="xxx" ;

data table;
test='aébcabcabc';
run;

proc append base = test.test (BULKLOAD=YES   BL_PROTOCOL= "gpfdist"  BL_HOST = "&BL_HOST" BL_DELETE_DATAFILE=NO BL_PORT = &BL_PORT )
      data = table  force ;
 run;

and I hit the error:

ERROR: [SAS][ODBC Greenplum Wire Protocol driver][Greenplum]ERROR: invalid byte sequence for encoding "UTF8": 0xe97f00  (seg20
       slice1 192.168.99.26:40004 pid=303354)

the underlying dat file generated contains:

aé    abcabc

if directly copy and paste from dat file you get:

aé

if open this dat file from Linux then you will have 

aé^@^@abcabc

1. Encoding in GP is UTF8

2. Encoding in SAS session is Latin1

3.SAS verions is 9.4 M6 on linux

I want to know why cause the issue and how to solve it?

Thanks
Chen Xu

[Kurt_Bremser]

Have your SAS session run with utf encoding also. It is not a good idea to mix encodings in your environment.

[gyambqt]

We changed SAS session from Latin1 to UTF8 and still receiving same error message.

Inrestingly, it worked in our old environment with SAS9.4 M3