Is there any way to see which record is currently being processed in a data step that is inside rsubmit?
There is plenty ways of tracking the progress when we have a local data step, but I have no idea how to deal with remote data steps.
Depending upon how closely you want to track, you may only need:
http://support.sas.com/documentation/cdl/en/connref/61908/HTML/default/viewer.htm#a002590489.htm
Also, you can pass an altlog option to your sascmd statement in your signon statement.
Such as:
signon task1 sascmd="/usr/local/SAS/SASFoundation/9.2/sas -altlog /mylogs/mylog.log" wait=no;
rdisplay is also useful as long as you are running you program interactivly.
You can also put comments in your log from within your DATA step like so:
if mod(_n_, 100000) = 0 then put 'Processing Row: ' _n_;
This will write a comment for every 100,000 rows processed. The difficulty with remote processing and this applies to batch SAS jobs as well is that the log is buffered and only updated when "sufficient" lines have been written.
SASKiwi makes a good point and references another topic that I had actually posted:
http://communities.sas.com/message/103760#103760
I have still not had an opportunity to look into using the write=immediate option for logparm.
FriedEgg wrote:
I am not currently able to test but I know in my current enviornment the following will not work:
data _null_;
do i=1 to 10000000;
call ranuni(1234);
if mod(i,50000)=0 then putlog i=;
end;
run;
If the write=immediate option doesn't resolve the issue my next thought is to call sysexec and cat a note onto the end of the logfile (if I even can incase there is a lock on the file held by sas while using write=buffered?).
data _null_;
do i=1 to 10**6;
if mod(i,100000)=1 then call sysexec('x echo ' || put(i,comma.) || ' > /mylogs/tracker.dat'
end;
run;
Here's a reference to the SAS doc covering LOGPARM as discussed by FriedEgg:
http://support.sas.com/documentation/cdl/en/lrcon/62955/HTML/default/viewer.htm#a000998454.htm
I haven't tried the WRITE=IMMEDIATE option either but would be interested in feedback from anyone who has tried it.
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.