BookmarkSubscribeRSS Feed
dipand
Quartz | Level 8

Hello everybody,
the following proc casutil:


data hseq.HSEQ_INSP_FIND_TEMP1;
set staging.HSEQ_INSP_FIND_TEMP
;
run;


proc casutil incaslib="hseq" outcaslib="hseq";
droptable casdata="HSEQ_INSP_FIND_TEMP" quiet;
promote casdata="HSEQ_INSP_FIND_TEMP1" casout="HSEQ_INSP_FIND_TEMP";
save casdata="HSEQ_INSP_FIND_TEMP" casout="HSEQ_INSP_FIND_TEMP" replace;
quit;

 


deals with uploading a dataset of about 15 million observations and 240 columns to the CAS. The loading times are very long about 2 hours. Is there any option to improve this upload?

Thank you

1 REPLY 1
sbxkoenk
SAS Super FREQ

Hello,

What if you use the Table action set in PROC CAS?

And also use DVR memory format?
DVR = duplicate value reduction 
Take care : instead of the actions illustrated below, you will need to replace with the loadTable Action !

 

proc cas;
  t.name = "waterflow";
  tdvr.name = t.name || "_dvr";

  table.tableDetails / table=t.name;
  table.copyTable /    
    table=t,
    casOut=tdvr + {memoryFormat="DVR", replace=True};
  table.dropTable / table=t.name;

  table.tableDetails / table=tdvr.name;
  table.tableInfo / table=tdvr.name;
run;

Cheers,

 

Koen

hackathon24-white-horiz.png

The 2025 SAS Hackathon has begun!

It's finally time to hack! Remember to visit the SAS Hacker's Hub regularly for news and updates.

Latest Updates

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

SAS Training: Just a Click Away

 Ready to level-up your skills? Choose your own adventure.

Browse our catalog!

Discussion stats
  • 1 reply
  • 760 views
  • 0 likes
  • 2 in conversation