topic Re: How do I use the Compress function without crashing my session in SAS Programming

How do I use the Compress function without crashing my session

f_shoko — Fri, 09 Feb 2018 11:06:25 GMT

Hi all,

I am trying to compress unwanted characters from a variable to remain with digits only. The dataset has about 1.8 million records and everytime I run the code EG crashes. I have tried restricting the OBS to say 1000 and that works fine. How can I avoid EG crashing when I run the code on the whole dataset. Code example below:

data test_003

(keep =

variable_1

variable_2

variable_3

variable_4);

set work.test_oo1;

variable_4_new=compress(variable_4,'','kd');

run;

So I am trying to compress variable_4 and have digits only remaining without out crashing my session.

Re: How do I use the Compress function without crashing my session

ChrisBrooks — Fri, 09 Feb 2018 11:53:18 GMT

It sounds like some sort of memory leak or disk space issue although 1.8M obs isn't that huge.

Try increasing the amount of available memory with the Memsize option http://support.sas.com/documentation/cdl/en/hostwin/69955/HTML/default/viewer.htm#n0srij4mcdpzv2n1vtphltb00xjw.htm although note that this has to be done at invocation of the session or in the config file.

Re: How do I use the Compress function without crashing my session

andreas_lds — Fri, 09 Feb 2018 12:00:38 GMT

How many variables are in work.test_oo1? Moving the keep-Option to the set-statement could help.

Re: How do I use the Compress function without crashing my session

Astounding — Fri, 09 Feb 2018 13:26:04 GMT

Absolutely right, move keep= to the SET statement. The way the program is written now, why bother to create the new variable? It wouldn't even become part of the new data set?

If this program really crashes EG, you might just need to clean out the WORK area (or more simply, just close down EG and start up a new session). From the names of your data sets, it's possible you have run so many tests that you are filling up the WORK area with data sets that you no longer need.

Re: How do I use the Compress function without crashing my session

Ksharp — Fri, 09 Feb 2018 13:35:45 GMT

variable_4_new=compress(variable_4, ,'kd');