BookmarkSubscribeRSS Feed
dipand
Quartz | Level 8

Hello everybody,
the following proc casutil:


data hseq.HSEQ_INSP_FIND_TEMP1;
set staging.HSEQ_INSP_FIND_TEMP
;
run;


proc casutil incaslib="hseq" outcaslib="hseq";
droptable casdata="HSEQ_INSP_FIND_TEMP" quiet;
promote casdata="HSEQ_INSP_FIND_TEMP1" casout="HSEQ_INSP_FIND_TEMP";
save casdata="HSEQ_INSP_FIND_TEMP" casout="HSEQ_INSP_FIND_TEMP" replace;
quit;

 


deals with uploading a dataset of about 15 million observations and 240 columns to the CAS. The loading times are very long about 2 hours. Is there any option to improve this upload?

Thank you

1 REPLY 1
sbxkoenk
SAS Super FREQ

Hello,

What if you use the Table action set in PROC CAS?

And also use DVR memory format?
DVR = duplicate value reduction 
Take care : instead of the actions illustrated below, you will need to replace with the loadTable Action !

 

proc cas;
  t.name = "waterflow";
  tdvr.name = t.name || "_dvr";

  table.tableDetails / table=t.name;
  table.copyTable /    
    table=t,
    casOut=tdvr + {memoryFormat="DVR", replace=True};
  table.dropTable / table=t.name;

  table.tableDetails / table=tdvr.name;
  table.tableInfo / table=tdvr.name;
run;

Cheers,

 

Koen

sas-innovate-2024.png

Available on demand!

Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.

 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 355 views
  • 0 likes
  • 2 in conversation