Hello everybody,
the following proc casutil:
data hseq.HSEQ_INSP_FIND_TEMP1;
set staging.HSEQ_INSP_FIND_TEMP
;
run;
proc casutil incaslib="hseq" outcaslib="hseq";
droptable casdata="HSEQ_INSP_FIND_TEMP" quiet;
promote casdata="HSEQ_INSP_FIND_TEMP1" casout="HSEQ_INSP_FIND_TEMP";
save casdata="HSEQ_INSP_FIND_TEMP" casout="HSEQ_INSP_FIND_TEMP" replace;
quit;
deals with uploading a dataset of about 15 million observations and 240 columns to the CAS. The loading times are very long about 2 hours. Is there any option to improve this upload?
Thank you
Hello,
What if you use the Table action set in PROC CAS?
And also use DVR memory format?
DVR = duplicate value reduction
Take care : instead of the actions illustrated below, you will need to replace with the loadTable Action !
proc cas;
t.name = "waterflow";
tdvr.name = t.name || "_dvr";
table.tableDetails / table=t.name;
table.copyTable /
table=t,
casOut=tdvr + {memoryFormat="DVR", replace=True};
table.dropTable / table=t.name;
table.tableDetails / table=tdvr.name;
table.tableInfo / table=tdvr.name;
run;
Cheers,
Koen
Build your skills. Make connections. Enjoy creative freedom. Maybe change the world. Registration is now open through August 30th. Visit the SAS Hackathon homepage.
Register today!Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.