Sort needs approximately 2.5 disk space relating to original dataset disk space.
Is the data already sorted by any key plus or including month ?
If positive you can do:
proc sort data=have(where=(month=<desired>))
out=month_sorted nodupkey;
by <key variables>;
run;
data new;
set have(where=(moth < <desired>))
month_sorted
have(where=(month > <desired>))
;
run;
Sort needs approximately 2.5 disk space relating to original dataset disk space.
Is the data already sorted by any key plus or including month ?
If positive you can do:
proc sort data=have(where=(month=<desired>))
out=month_sorted nodupkey;
by <key variables>;
run;
data new;
set have(where=(moth < <desired>))
month_sorted
have(where=(month > <desired>))
;
run;
try TAGSORT option of proc sort.
proc sort data=have out=month_sorted nodupkey tagsort sortsize=max;
run;
Hi Ksharp,
As Shmuel quoted "Sort needs approximately 2.5 disk space relating to original dataset disk space.". So in my case I tried with shmuel suggesition and CPU, I/O statistics looks good.
I would like to highlight one more point on the data set which I worked is, its a size of approxmately 1 TB since it was compressed its of 200 GB. So I obersved that working on segments of huge data set is looks fine.
Thanks for your suggesition!
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.
Find more tutorials on the SAS Users YouTube channel.