Bulk load to Greenplum issue using SAS

gyambqt — Tue, 28 Jan 2020 05:40:56 GMT

Hello Experts,

I am loading a single record with (special character embedded) to Greenplum using the code:

LIBNAME test GREENPLM PRESERVE_COL_NAMES=NO PRESERVE_TAB_NAMES=NO DATABASE=xxx SERVER="xxx" SCHEMA=xxx AUTHDOMAIN="xxx" ;

data table;
test='aébcabcabc';
run;

proc append base = test.test (BULKLOAD=YES BL_PROTOCOL= "gpfdist" BL_HOST = "&BL_HOST" BL_DELETE_DATAFILE=NO BL_PORT = &BL_PORT )
data = table force ;
run;

and I hit the error:

ERROR: [SAS][ODBC Greenplum Wire Protocol driver][Greenplum]ERROR: invalid byte sequence for encoding "UTF8": 0xe97f00 (seg20
slice1 192.168.99.26:40004 pid=303354)

the underlying dat file generated contains:

aé abcabc

if directly copy and paste from dat file you get:

aé

if open this dat file from Linux then you will have

aé^@^@abcabc

1. Encoding in GP is UTF8

2. Encoding in SAS session is Latin1

3.SAS verions is 9.4 M6 on linux

I want to know why cause the issue and how to solve it?

Thanks
Chen Xu

Re: Bulk load to Greenplum issue using SAS

Kurt_Bremser — Tue, 28 Jan 2020 09:06:50 GMT

Have your SAS session run with utf encoding also. It is not a good idea to mix encodings in your environment.

Re: Bulk load to Greenplum issue using SAS

gyambqt — Wed, 29 Jan 2020 00:03:17 GMT

We changed SAS session from Latin1 to UTF8 and still receiving same error message.

Inrestingly, it worked in our old environment with SAS9.4 M3

topic Re: Bulk load to Greenplum issue using SAS in SAS Programming

Bulk load to Greenplum issue using SAS

Re: Bulk load to Greenplum issue using SAS

Re: Bulk load to Greenplum issue using SAS