topic Re: How to do I solve ERROR: invalid byte sequence for encoding "UTF8": 0x81 in SAS Programming

How to do I solve ERROR: invalid byte sequence for encoding "UTF8": 0x81

Gweeks — Thu, 20 May 2021 14:23:10 GMT

Hi All,

I'm trying to write to a postgres database and I am getting the following error:

ERROR: CLI execute error: ERROR: invalid byte sequence for encoding "UTF8": 0x81; Error while executing the query.

I've added the PRESERVE_COL_NAMES options to my libname statement as well as the dquote option to my proc sql statement and I'm still getting the error.

Please help suggest other options to use.

I've included the proc sql code I used as well as the error message received.

Thank you for all your help.

proc sql dquote=ansi;
 create table pg_rep.activation_Rate_base as
 select * 
 from Factor_Base;
quit;

@Community_Help

Re: How to do I solve ERROR: invalid byte sequence for encoding "UTF8": 0x81

SASKiwi — Thu, 20 May 2021 21:01:48 GMT

Check your SAS session encoding using PROC OPTIONS:

proc options option = encoding;
run;

If it is different to UTF8 then this could be the cause of your error.

Re: How to do I solve ERROR: invalid byte sequence for encoding "UTF8": 0x81

Gweeks — Thu, 20 May 2021 22:24:46 GMT

The encoding of the SAS session is UTF-8.

Re: How to do I solve ERROR: invalid byte sequence for encoding "UTF8": 0x81

Tom — Fri, 21 May 2021 00:39:48 GMT

What is the definition of the pg_rep libref?

Is it using SAS base engine?
Some external database?

Re: How to do I solve ERROR: invalid byte sequence for encoding "UTF8": 0x81

Kurt_Bremser — Fri, 21 May 2021 05:13:17 GMT

'81'x is a byte that must only appear as a continuation byte in UTF-8. Even in Windows 1252, it is not used.

I suggest you inspect your data to see where it appears. It might be you have binary coded values (e.g. a UUID stored in 16 bytes) that need to be translated with a DBSASTYPE option.

Re: How to do I solve ERROR: invalid byte sequence for encoding "UTF8": 0x81

Gweeks — Fri, 21 May 2021 05:53:47 GMT

It is an external database, PostgresSQl database