topic Re: Leading blank in strings in SAS Programming

Leading blank in strings

Cruise — Tue, 05 May 2020 22:39:50 GMT

Hi Folks:

I'm trying to remove the leading indent from a variable. None of trim, trimn, strip and compbl functions work.

What is not working here? I appreciate your suggestions.

data test_urb1; set test_urb;
ID_strip=strip(Municipality);
ID_trim=trim(left(Municipality));
ID_trimn=trimn(left(Municipality));
ID_compbl=compbl(Municipality);
run;

Re: Leading blank in strings

novinosrin — Tue, 05 May 2020 22:43:13 GMT

Please check the length's of each value of the Municipality variable in test_urb1 vs Id_strip

using length function.

len=lengthn(id_strip) and notice the difference in the lengths. This should give you some idea than deceiving visuals

Re: Leading blank in strings

Reeza — Tue, 05 May 2020 22:44:59 GMT

Try displaying the variable with a hex format to see what character are there.

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 22:48:07 GMT

@novinosrin

Interesting. What shall I do? Take it as a success in using strip function?

Re: Leading blank in strings

Shmuel — Tue, 05 May 2020 22:48:39 GMT

Maybe the indent is not a result of blanks.

check the left most character by:

indent = substr(municipality,1,1);
put indent $hex2.;

Re: Leading blank in strings

ballardw — Tue, 05 May 2020 22:53:37 GMT

Use the data step generator to show what values you actually have:
Instructions here: https://communities.sas.com/t5/SAS-Communities-Library/How-to-create-a-data-step-version-of-your-data-AKA-generate/ta-p/258712 will show how to turn an existing SAS data set into data step code that can be pasted into a forum code box using the <> icon or attached as text to show exactly what you have and that we can test code against.

Warning: if you are using some double-byte character set this may not help.

Or use the RANK function to see what the first character may be:

data want;

set have;

x = rank(first(municipality));

run;

X would be the order in the ASCII (or EBCDIC) character set. If the value is not 32 you do not have a blank. Note that Rank will return the Hex number.

I'm not sure if this will work but the second string below starts with a null character that can be entered on some systems using Alt plus the digits 255 and if the box works correctly the second X= should show 160 (the hex equiv of 255).

data example;
   string = ' abcdef';
   x = rank(first(string));
   put x=;
   string = ' abcdef';
   x = rank(first(string));
   put x=;
run;

The functions you tried would not remove the null as they are not blanks, i.e. ASCII 32.

Re: Leading blank in strings

novinosrin — Tue, 05 May 2020 22:55:50 GMT

Nope all values being 12 bytes of length concerns me.

You may try to remove hexadecimal characters and control chars if any using:

X is hexadecimal characters

C is control chars

' ' is blank

id_strip=strip(compress(Municipality,' ','xc'));

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 22:57:45 GMT

@ballardw

thank you, pls see rank results below. testing your code on my data now.

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 23:00:28 GMT

Thanks Ballardw, what would 227 indicate?

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 23:02:17 GMT

Thanks Shmuel. It returned E3. What would E3 indicate? I have no idea.

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 23:03:25 GMT

Variable indent is black. Took no values. I'm confused.

Re: Leading blank in strings

ballardw — Tue, 05 May 2020 23:05:53 GMT

You should be able to use Byte(227) as a character to remove with COMPRESS.

compress(municipality,byte(227))

May still need to use COMPBL to remove blanks depending on result.

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 23:09:09 GMT

@ballardw I got leading blank replaced by weird symbols as shown below.

Re: Leading blank in strings

novinosrin — Tue, 05 May 2020 23:10:47 GMT

@Cruise Just extract the need if thats ok?

data want;
set have;
length 	id_strip $15;
id_strip=substr(municipality,anyalpha(municipality));
check_length=lengthn(id_strip);
run;

Re: Leading blank in strings

ballardw — Tue, 05 May 2020 23:14:48 GMT

@Cruise wrote:
Thanks Ballardw, what would 227 indicate?

Anything above 127 is font dependent. Typically used for "foreign language" characters from an American English speakers point of view (Hint: what does the A in ASCII stand for?). Or graphic characters.

For kicks you could run this code:

data _null_;
   file print;
   do x= 32 to 255;
      z= byte(x);
      put x= z=;
   end;
run;

save the result to a text file. Open the file and change the display font to see things change.

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 23:14:49 GMT

@ballardw

data WORK.URBANICITY;
  infile datalines dsd truncover;
  input Municipality:$36. urbanicity:COMMA15.;
  format urbanicity COMMA15.;
  label Municipality="Municipality" urbanicity="urbanicity";
datalines;
Seoul 605,569,314
ã€€ã€€ã€€Jongno-gu 23,972,507
ã€€ã€€ã€€Jung-gu 9,974,292
ã€€ã€€ã€€Yongsan-gu 21,870,000
ã€€ã€€ã€€Seongdong-gu 16,804,426
;;;;

Hope I got the guidance right. This is the data I'm dealing with.

Re: Leading blank in strings

ballardw — Tue, 05 May 2020 23:17:17 GMT

Repeats of the same 3 characters is making me think that your actual data may be DBCS.

And perhaps the KCOMPRESS, KTRIM may be wanted.

Re: Leading blank in strings

novinosrin — Tue, 05 May 2020 23:19:01 GMT

@ballardw has nailed it. That's the reason, I have nicknamed him the "Cop"

Re: Leading blank in strings

Cruise — Tue, 05 May 2020 23:24:07 GMT

@ballardw

You hit the nail on the head! kcomp it is. Hurray!

Re: Leading blank in strings

ChrisNZ — Tue, 05 May 2020 23:28:42 GMT

Searching for ã€€ brings up ã€€ 文字化け

So MBCS indeed.