topic Remove invalid characters in SAS Procedures

Remove invalid characters

raveena — Thu, 08 Dec 2011 15:31:36 GMT

Hi,

I have a dataset with vendor number containing invalid characters.I would not select any vendor numbers that contain characters other than A-Z,0-9 or dash(-).We can use compress function, but not sure what are the invalid characters in the data.

Example:

data test;
input vendor ;
cards;
111948722-070Ž
1119789^78A
789567890
908765TYR
;
RUN;

REQUIRED OUTPUT :

Vendor

789567890

908765TYR

Please let me know.

Thanks in Advance.

Remove invalid characters

FriedEgg — Thu, 08 Dec 2011 16:34:09 GMT

compress(vendor,,'adk');

Re: Remove invalid characters

art297 — Thu, 08 Dec 2011 16:38:57 GMT

Sort of like FE's suggestion, but because 'a' will accept non-English characters, I'd suggest the following to limit it to only English characters. However, this assumes that underscores are also valid for your purpose. Otherwise, one additional check would be needed:

data test;

informat vendor $30.;

input vendor &;

if compress(vendor,'-','dfk') eq vendor;

cards;

111948722-070Ž

1119789^78A

789567890

908765TYR

;

Remove invalid characters

FriedEgg — Thu, 08 Dec 2011 16:53:58 GMT

data foo;

informat vendor $30.;

input vendor & $30.;

if notalnum(strip(vendor))=0;

cards;

111948722-070Ž

1119789^78A

789567890

908765TYR

;

run;

Remove invalid characters

art297 — Thu, 08 Dec 2011 17:25:53 GMT

FE, That wouldn't correctly handle an entry like 908765-TYR

Remove invalid characters

FriedEgg — Thu, 08 Dec 2011 17:31:31 GMT

Art,

I tested and it works for me?

NOTALNUM should provide value >0 for any character that is not a letter or digit.

data foo;

informat vendor $30.;

input vendor & $30.;

if notalnum(strip(vendor))=0;

cards;

111948722-070Ž

1119789^78A

789567890

908765TYR

908765-TYR

;

run;

789567890

908765TYR

Remove invalid characters

art297 — Thu, 08 Dec 2011 17:46:55 GMT

The OP considered a dash as a valid character.

Remove invalid characters

FriedEgg — Thu, 08 Dec 2011 17:50:09 GMT

That's what I get for skimming the post.

Remove invalid characters

Ksharp — Fri, 09 Dec 2011 02:28:00 GMT

data test;
  informat vendor $30.;
  input vendor &;
  if not findc(strip(vendor),'-','duk');
cards;
111948722-070^
1119789^78A
789567890
908765TYR
;
run;

Ksharp