BookmarkSubscribeRSS Feed
dipand
Quartz | Level 8

Hello everybody,
the following proc casutil:


data hseq.HSEQ_INSP_FIND_TEMP1;
set staging.HSEQ_INSP_FIND_TEMP
;
run;


proc casutil incaslib="hseq" outcaslib="hseq";
droptable casdata="HSEQ_INSP_FIND_TEMP" quiet;
promote casdata="HSEQ_INSP_FIND_TEMP1" casout="HSEQ_INSP_FIND_TEMP";
save casdata="HSEQ_INSP_FIND_TEMP" casout="HSEQ_INSP_FIND_TEMP" replace;
quit;

 


deals with uploading a dataset of about 15 million observations and 240 columns to the CAS. The loading times are very long about 2 hours. Is there any option to improve this upload?

Thank you

1 REPLY 1
sbxkoenk
SAS Super FREQ

Hello,

What if you use the Table action set in PROC CAS?

And also use DVR memory format?
DVR = duplicate value reduction 
Take care : instead of the actions illustrated below, you will need to replace with the loadTable Action !

 

proc cas;
  t.name = "waterflow";
  tdvr.name = t.name || "_dvr";

  table.tableDetails / table=t.name;
  table.copyTable /    
    table=t,
    casOut=tdvr + {memoryFormat="DVR", replace=True};
  table.dropTable / table=t.name;

  table.tableDetails / table=tdvr.name;
  table.tableInfo / table=tdvr.name;
run;

Cheers,

 

Koen

Ready to join fellow brilliant minds for the SAS Hackathon?

Build your skills. Make connections. Enjoy creative freedom. Maybe change the world. Registration is now open through August 30th. Visit the SAS Hackathon homepage.

Register today!
How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 377 views
  • 0 likes
  • 2 in conversation