topic Re: SAS not working fully in SAS Programming

SAS not working fully

Eileen1496 — Mon, 02 Oct 2023 18:17:21 GMT

Hi all,

I'm new to SAS, while I was able to realize the results I want, I found my SAS is running "inefficiently".

So for example, I'm trying to get rid of parenthesis and any text inside the parenthesis of a variable (com_up). The new variable is called com_par.

The number of observations are around 19700000, which is a lot I think so should take some time. But today I wait for more than half and hour and the code is still running. I checked my task manager, it says SAS is using only 0.1% CPU.

The file is on my google drive but I synchronize it to my local computer. I have 128 gb ram. The code I use is as follows:

data new_db;

set old_db;

com_par = prxchange('s/\(([^\)]+)\)//i',-1,com_up);

run;

I was wondering does this means SAS is not actually working? And is there any solutions on this?

Re: SAS not working fully

Kurt_Bremser — Mon, 02 Oct 2023 17:00:31 GMT

You may have submitted only a part of the code (e.g. without the RUN statement).

What do you see in the log?

Re: SAS not working fully

PaigeMiller — Mon, 02 Oct 2023 17:04:55 GMT

Please examine your code carefully. There is a semi-colon missing.

Re: SAS not working fully

ballardw — Mon, 02 Oct 2023 17:40:23 GMT

@Eileen1496 wrote:

Hi all,

I'm new to SAS, while I was able to realize the results I want, I found my SAS is running "inefficiently".

So for example, I'm trying to get rid of parenthesis and any text inside the parenthesis of a variable (com_up). The new variable is called com_par.

The number of observations are around 19700000, which is a lot I think so should take some time. But today I wait for more than half and hour and the code is still running. I checked my task manager, it says SAS is using only 0.1% CPU.

The file is on my google drive but I synchronize it to my local computer. I have 128 gb ram. The code I use is as follows:
data new_db;

set old_db;

com_par = prxchange('s/\(([^\)]+)\)//i',-1,com_up)

run;
I was wondering does this means SAS is not actually working? And is there any solutions on this?

I wonder if your "synchronize" means that every time you modify a record on your "synchronized" data set that something is trying to send that change back to the Google Drive. And that link may not be very efficient.

What do your system diagnostics say about network usage? and anything related to Google?

Re: SAS not working fully

Eileen1496 — Mon, 02 Oct 2023 18:19:03 GMT

I saw the copy of the code in black. I also saw this before and when it finished running there will be blue lines showing me the running time and number of observations. So I think I submit the whole code, but it is really weird in the task manager, only 0.1% CPU used before the result comes out.

Re: SAS not working fully

Eileen1496 — Mon, 02 Oct 2023 18:19:43 GMT

Hi, yes you are right, it is a typo when I post the question. The code has semicolon.

Re: SAS not working fully

Eileen1496 — Mon, 02 Oct 2023 18:22:23 GMT

Yes I think I mean that. Because everytime I change anything, I can see google drive is synchronizing the change. By network usage do you mean internet? It is good. I don't think before I finish running this block of code, thus generating the new dataset, drive will synchronize. I used to suspect some of the time is used to download the file from google drive, but I tried all my files, even they are very large, when I click them they open immediately, so I rule out this factor.

Re: SAS not working fully

SASKiwi — Mon, 02 Oct 2023 19:00:15 GMT

Running SAS programs accessing remotely-stored data is nearly always slower than local data. I suggest you copy your data to a local drive and do a test run on that source, then compare SAS log run times.

Re: SAS not working fully

Eileen1496 — Sat, 04 Nov 2023 16:54:35 GMT

I put them completely in a local drive, and it is way faster!