07-28-2016 02:16 PM - edited 07-28-2016 02:18 PM
I have a SAS macro part that will run the entire dataset and do some analysis, and during the analysis part, each instance is dealt with once a time.so that the entire dataset can be run and we could keep an eye on the 'log' file.
However, I would like to split the entire dataset into several parts. (Ex, first 500 observations, 501~1000 observations, etc). Which means the engine will stop after running 500 instances, and then run again. And in the end they can be generated in one table as before. How can I add this 'split' part into my prior code?
OPTIONS NOTES SOURCE SOURCE2 MPRINT MLOGIC MERROR SYMBOLGEN;
/* Part A starts*/
set WORK.LOCATION end=last;
if last then call symput('nfiles',_n_);
%do i=1 %to &nfiles;
if &i=_n_ then call symput('code',LOCATION_ID);
/* Part A ends */
create table WORK.pt as select
%if %sysfunc(exist(WORK.result)) %then %do;
set WORK.result WORK.pt;
Where 'WORK.LOCATION' is the dataset that I call in 'proc sql' procedure that contains all the 'LOCATION_ID" information that I need.
Part A is where Macro works that it runs from start to the end; can I replace it with a data splitting procedure so that every 500 observations are run altogether and finally combined to one table?
10-26-2016 07:26 PM
So you wanted your program to take first 500 then process it write output and then process nextn 500 process it and add that to the first batch. This way your program runs for each batch having 500 records and when it completes it appends all the output into one file which would your output.