Data Flux Real time Service (Proc dmsrvdatasvc), increasing character length by 4 times.

_Rama — Wed, 12 Apr 2023 07:43:06 GMT

Hi SAS Team,

I have been running real time service procedure for a while in our current environment 9.4M2 which is Latin-1 Encoding, there were no issues with increase in length from character variable from the output.

We recently upgrading to SAS 9.4 M7 with UTF-8 Encoding, I did notice the real time service procedure is increasing character variables by 4 times, this is leading into some changes to previously developed jobs.

Following images shows the data flux Realtime service job, and calling it using SAS code producing the results in both current and new environment.
Does anyone have an idea with this issue or come across with this one before? Otherwise I can contact SAS Support.

Data Flux Real time Service, input length Name of 150 Characters

The Parsing Node Separating Name Field

Current Environment with Latin1 encoding, and its output lengths not changed for Character VariablesNew Environment with Utf-8 encoding, and its output changed by 4 times for Character Variables

Re: Data Flux Real time Service (Proc dmsrvdatasvc), increasing character length by 4 times.

_Rama — Thu, 03 Aug 2023 07:21:43 GMT

After few trials, it was found that the dataflux creates varchar as datatype.
SAS environment with UTF-8 , allocates varchar X 4 bytes for storage character data.

Testing
Data test;
Length x varchar(1);/*I tested to something like this*/
X='A';
Run;

Proc contents data=test;
Run;

Along with placing target node to dataflux job identified it's varchar data type for character data.

topic Data Flux Real time Service (Proc dmsrvdatasvc), increasing character length by 4 times. in SAS Data Management

Data Flux Real time Service (Proc dmsrvdatasvc), increasing character length by 4 times.

Re: Data Flux Real time Service (Proc dmsrvdatasvc), increasing character length by 4 times.