topic Re: SAS Blank space in SAS Programming

SAS Blank space

JJP1 — Mon, 20 Jan 2020 12:29:12 GMT

Hi,
iam trying to filter the column where flg not missing.
but iam still getting blank values whose records does not have flag.
i tried compress(flg) and strip(flg) options.but not wotking.
please help.

Re: SAS Blank space

ed_sas_member — Mon, 20 Jan 2020 12:53:44 GMT

Hi @JJP1

Coud you please share a portion of your data and the code you tried?

Did you tried then NMISS() function to filter you data for example?

Re: SAS Blank space

Oligolas — Mon, 20 Jan 2020 13:07:05 GMT

Hi,

you may have a non printable character in your flg variable, try to analyse which values it contains:

data want;
   set have;

   do i=1 to length(flg);
      rank=rank(substr(flg,i,1));
      output;
   end;
run;
proc print;run;

Re: SAS Blank space

Ksharp — Mon, 20 Jan 2020 13:46:24 GMT

data want;
   set have;
if not anyspace(flg);
run;

Re: SAS Blank space

Amir — Mon, 20 Jan 2020 13:51:48 GMT

Along the same lines as what @Oligolas has said about there potentially being non-printable characters in the flg variable, you could try something like the following code after you've filtered your data and if you get some records in the have data set then those are the ones that have non-printable characters. Your original data will have have to either be read in correctly or pre-processed to remove the non-printable characters.

The code removes printable characters and checks if the result is blank.

data want;
   set have;
   flg2 = compress(flg,,'w');
   if flg2 ne '';
run;

Regards,

Amir.

Re: SAS Blank space

JJP1 — Mon, 20 Jan 2020 15:10:56 GMT

Thanks @Ksharp ,

actually i need to do it using proc sql option please and iam trying below option and it says that " Variable Flg not appended because of type mismatch."would you please help

   proc sql;
      create table work.W5II6SX as
         select
            
               
            (anyspace(Flg )) asFlg length = 1
      from &etls_lastTable
      ;
   quit;
   
   %let SYSLAST = work.W5II6SX;
   
   %let etls_lastTable = &SYSLAST;

Re: SAS Blank space

JJP1 — Mon, 20 Jan 2020 15:16:04 GMT

Hi @Oligolas ,

i ran below code and i can see Y or N.how can i find out non printable character and resolve the issue please.

data want(keep=flg);
   set have

   do i=1 to length(flg);
      rank=rank(substr(flg,i,1));
      output;
   end;
run;
proc print;run;

Re: SAS Blank space

JJP1 — Mon, 20 Jan 2020 15:18:47 GMT

Actually iam getting these values from mainframe application in the form of text file.whether the mainframe is causing the issue and sending some incorrect data please .

no data is showing just blank spaces i can see.please help

Re: SAS Blank space

Kurt_Bremser — Mon, 20 Jan 2020 18:08:44 GMT

How do you get the file, and how do you read it? Dealing with EBCDIC-coded data can be tricky on another platform.

Re: SAS Blank space

Tom — Mon, 20 Jan 2020 18:27:44 GMT

@JJP1 wrote:

Actually iam getting these values from mainframe application in the form of text file.whether the mainframe is causing the issue and sending some incorrect data please .

no data is showing just blank spaces i can see.please help

You need to show more details to get more help. Are you trying to use a data step to read a text file and convert it into a SAS dataset? Do you already have a SAS dataset? Are you getting errors (or informative notes) in the SAS log. Show in detail what you are doing and how it does not match what you need.

Re: SAS Blank space

ChrisNZ — Mon, 20 Jan 2020 21:10:29 GMT

I like @Amir 's suggestion, as you end up with clean data, rather than filtering on a more complex filter without cleaning.

You could also replace non-printable characters rather than remove them as @Amir does.

data WANT;
   set HAVE;
   FLG2 = prxchange('s/\s/ /o',-1,FLG);
   if FLG2 ne '';
run;

Re: SAS Blank space

ChrisNZ — Tue, 21 Jan 2020 10:56:32 GMT

Or:

data WANT;
   set HAVE;
   FLG2 = prxchange('s/[:^print:]/ /o',-1,FLG);
   if FLG2 ne '';
run;

to target more than white spaces.

Re: SAS Blank space

Oligolas — Tue, 21 Jan 2020 08:20:41 GMT

@JJP1 The number you get in the rank column stands for the ASCII code.

You'll know your variable contains a non-printable character whenever you get a number <= 31.

With this you'll be able to specifically aim at a sign you would like to handle.

Re: SAS Blank space

Kurt_Bremser — Tue, 21 Jan 2020 08:57:44 GMT

Or a number >= 127 😉

Re: SAS Blank space

JJP1 — Tue, 21 Jan 2020 10:32:14 GMT

Thanks all for your help.
Actually for flg column mainframe team is sending the null values in it.so beacuse of this SAS treated null value as value,even thought it do not have actual values.
i requested them to remove null values and send to SAS.
now it looks good.thanks