09-28-2011 03:40 AM
HI are there any options to append huge datasets and reduce the time
i am having two datasets having 1 crs obs each every time it will get 1 crs obs in data set 2 any optins to optimise the time
for appending i am using this command
proc append base=data1 data=data2;
09-28-2011 09:23 AM
Well, too little information here for helping you out.
Given your example code and by using the term "data set", I guess that your data is in SAS tables (Base, or perhaps SPDE?).
If your problem handles temporary tables, just be sure to add the smaller table to the larger.
If you base table is permanent:
- Bulkload: I would consider PROC APPEND as equivalent in speed (or better) than RDBMS bulkload. That is, if your base table doesn't have any constraints (especially PK/FK) or indexes defined. If your base table is in a SPDE libref, you could have indexes defined, and then SAS will simultaneously insert data and update the index.