topic Re: Addidtional characters added to certain fields after SAS VIYA code saved table in DB2 in SAS Programming

Addidtional characters added to certain fields after SAS VIYA code saved table in DB2

smm662002 — Tue, 23 Apr 2024 12:53:44 GMT

Hello,

SAS VIYA LTS 2023.03

We are running a SAS code, processing some DB2 tables and also saving the results to DB2. After last night run, in two of the fields we found that additional characters have been added at the end of the string. The additional characters fills in the entire length of the string. In SAS Studio the additional charter looks like:

which is repeated again and again creating something like: .

The same character copied to a text editor and using a different encoding looks like: ï¿½. When I am scrolling in SAS Studio some the additional characters disappear but if I resize the table column the additional characters reappears.

I have done the following tests but no improvements:

- used VIYA in a different browser

- reassigned the libname in a different Compute context

After checking with DB2 DBA no encoding changes occurs in the source or target DB2 tables.

Finally, the same table loaded directly from DB2 using a different tool shows no additional characters for the same fields.

What do you think?

Thank you.

smm662002

Re: Addidtional characters added to certain fields after SAS VIYA code saved table in DB2

ballardw — Tue, 23 Apr 2024 13:23:53 GMT

Provide examples of the data before the SAS code was run.

Provide the SAS code.

Provide example actual results.

And since this involves looking at data after sent to DB2 if I follow, then perhaps some details of how you sent it to DB2.

Re: Addidtional characters added to certain fields after SAS VIYA code saved table in DB2

Ksharp — Wed, 24 Apr 2024 05:34:43 GMT

It seems that your sas encoding is not compatible with DB2 .
Change sas encoding in a file like 'sasenvlocal' .