BookmarkSubscribeRSS Feed
TomaszTarczynski
Calcite | Level 5

Is there any way to see which record is currently being processed in a data step that is inside rsubmit?

There is plenty ways of tracking the progress when we have a local data step, but I have no idea how to deal with remote data steps.

5 REPLIES 5
FriedEgg
SAS Employee

Also, you can pass an altlog option to your sascmd statement in your signon statement.

Such as:

signon task1 sascmd="/usr/local/SAS/SASFoundation/9.2/sas -altlog /mylogs/mylog.log" wait=no;

rdisplay is also useful as long as you are running you program interactivly.

SASKiwi
PROC Star

You can also put comments in your log from within your DATA step like so:

if mod(_n_, 100000) = 0 then put 'Processing Row: ' _n_;

This will write a comment for every 100,000 rows processed. The difficulty with remote processing and this applies to batch SAS jobs as well is that the log is buffered and only updated when "sufficient" lines have been written.

FriedEgg
SAS Employee

SASKiwi makes a good point and references another topic that I had actually posted:

http://communities.sas.com/message/103760#103760

I have still not had an opportunity to look into using the write=immediate option for logparm.


FriedEgg wrote:

I am not currently able to test but I know in my current enviornment the following will not work:

Curent Enviornment: LOGPARM=WRITE=BUFFERED ROLLOVER=NONE OPEN=REPLACE

data _null_;

  do i=1 to 10000000;

   call ranuni(1234);

   if mod(i,50000)=0 then putlog i=;

end;

run;

If the write=immediate option doesn't resolve the issue my next thought is to call sysexec and cat a note onto the end of the logfile (if I even can incase there is a lock on the file held by sas while using write=buffered?).

data _null_;

  do i=1 to 10**6;

   if mod(i,100000)=1 then call sysexec('x echo ' || put(i,comma.) || ' > /mylogs/tracker.dat'

  end;

run;

SASKiwi
PROC Star

Here's a reference to the SAS doc covering LOGPARM as discussed by FriedEgg:

http://support.sas.com/documentation/cdl/en/lrcon/62955/HTML/default/viewer.htm#a000998454.htm

I haven't tried the WRITE=IMMEDIATE option either but would be interested in feedback from anyone who has tried it.

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 5 replies
  • 1708 views
  • 0 likes
  • 4 in conversation