topic Re: How to create a data step version of your data AKA generate sample data for forums in SAS Programming

RegEx and Arabic letters

nour_anwar — Wed, 24 Jun 2020 23:49:07 GMT

data _null_;
	v1 = "aYT;-/*A - تwsilيتيتddيت يlămâieD  @يlămâieD D^)M";
	v2=upcase(v1);
	v3 = prxchange("s/[^-A-Z]/ /",-1,v2); 
    v4 = compress(v3, , 'kw');
put (_all_) (=/);
run;

I want to keep only English characters ,hyphen "-" , and Arabic characters .this code worked fine for the English characters and hyphen but it escape the Arabic characters , how can I keep the Arabic characters too !!

Re: How to create a data step version of your data AKA generate sample data for forums

ChrisNZ — Thu, 25 Jun 2020 00:52:20 GMT

Moved and re-titled.

Did you try letter intervals like A-Z ?

Or even adding all letters to the character class [ ] ?

Re: How to create a data step version of your data AKA generate sample data for forums

ChrisNZ — Thu, 25 Jun 2020 00:59:30 GMT

Also, if the Arabic letters are encoded using UTF-8, the "common" string functions (such as compress() or prxchange() ) will not work. You must use MBCS-aware functions, such as kcompress() . Not all single-byte functions have a multi-byte equivalent.

Re: RegEx and Arabic letters

andreas_lds — Thu, 25 Jun 2020 09:56:32 GMT

I found this note in the docs of prxmatch:

This function is assigned an I18N Level 0 status, and is designed for SBCS data. Do not use this function to process DBCS or MBCS data.

Same problem with compress, fortunately kcompress exists, so maybe this is what you need:

data _null_;
	v1 = "aYT;-/*A - تwsilيتيتddيت يlămâieD  @يlămâieD D^)M";
	v2 = upcase(v1);
   v3 = kcompress(v2, , 'kw');
   put (_all_) (=/);
run;

Re: RegEx and Arabic letters

Ksharp — Thu, 25 Jun 2020 12:04:14 GMT

Not sure.
Could Try

Kcompress()
Ksubstr()
Klength()