topic Re: Sudden slowness in data steps while procedures run at normal speed in Administration and Deployment

Sudden slowness in data steps while procedures run at normal speed

polarjud — Tue, 06 Jul 2021 12:43:47 GMT

Programs that were running fine and now taking hours to run. The problem is restricted to data steps. My processing is local after the first step when I retrieve a permanent data step via a VPN connection to a central file server. All subsequent data steps are in the work directory which is mapped to the C drive in my laptop. Datasteps that were taking 0.04 seconds of real time and 0.06 seconds of CPU time are now taking 5+ minutes of real time and 8+seconds of CPU time. Something is clearly interfering. If it were anti-malware or actual malware, it would probably impact both data steps and procedure calls. So I am thinking that SAS is trying to communicate with the remote file server even though it was not asked to do so. Any way to check out this theory? Other solutions? The files involved are small, and the temporary SAS datasets appear to be of reasonable size. No sign of exhausting virtual drive space. Running SAS 9.4 TS Level 1M6. X64_10Pro platform.

Re: Sudden slowness in data steps while procedures run at normal speed

Kurt_Bremser — Tue, 06 Jul 2021 12:54:40 GMT

Please post the log of running this:

data class;
set sashelp.class;
run;

Re: Sudden slowness in data steps while procedures run at normal speed

polarjud — Tue, 06 Jul 2021 13:03:49 GMT

Well, that ran at normal speed. Strange.

data class;
set sashelp.class;

run;

NOTE: There were 19 observations read from the data set SASHELP.CLASS.
NOTE: The data set WORK.CLASS has 19 observations and 5 variables.
NOTE: DATA statement used (Total process time):
real time 0.01 seconds
cpu time 0.01 seconds

Re: Sudden slowness in data steps while procedures run at normal speed

MargaretC — Tue, 06 Jul 2021 13:08:55 GMT

Is it just the first Data step (the one that moves data from the permanent SAS data file locally) that is slow? Or are all the Data steps after you move your data local slow?

Re: Sudden slowness in data steps while procedures run at normal speed

polarjud — Tue, 06 Jul 2021 13:12:42 GMT

Okay, I figured out the issue. It was a bad format search. Thanks for the help, Kurt!

Re: Sudden slowness in data steps while procedures run at normal speed

polarjud — Tue, 06 Jul 2021 13:15:03 GMT

All of them, but I figured out the issue. It was a bad format search option.

Re: Sudden slowness in data steps while procedures run at normal speed

Kurt_Bremser — Tue, 06 Jul 2021 13:18:38 GMT

Oh yes, those can have dire consequences. Especially the messages from SQL can be very interesting.

Re: Sudden slowness in data steps while procedures run at normal speed

polarjud — Tue, 06 Jul 2021 13:25:30 GMT

My format catalogs are stored on the remote server. Is there some easy way to create copies of them in the work library at the start of a job?