topic Indexing vs. Sorting in SAS Programming

Indexing vs. Sorting

Adam_Black — Mon, 31 Oct 2016 16:38:24 GMT

Hi,

I would like to add two simple indexes to a large dataset based on "column1" and "column2". Is adding the two simple indexes effectively the same thing as sorting the dataset on "column1" and adding an index based on "column2" assuming that the datasets will not be sorted again in the future?

The options I'm considering are:

proc datasets library=mylib;
modify largeDataset;
index create column1;
index create column2;
quit;

vs.

proc sort data=mylib.largeDataset;
by column1;
run;

proc datasets library=mylib;
modify largeDataset;
index create column2;
quit;

Wouldn't the second option be more space efficient than the first?

Thanks for your help!

Adam

SAS version 9.3

Re: Indexing vs. Sorting

LinusH — Mon, 31 Oct 2016 16:48:33 GMT

No, it's not the same. The main feature of indexes is to allow for direct access to individual records (which in reality mens data page), which is beneficial for small subset operations.
Yes, by omitting an index you are saving space, but again, you will not get the same functionality.

Re: Indexing vs. Sorting

Astounding — Mon, 31 Oct 2016 17:07:32 GMT

There are other considerations besides storage space to hold an index. Mainly, they focus on whether you are trying to retrieve all the observations vs. a subset. Here's an earlier discussion that seems relevant:

https://communities.sas.com/t5/SAS-Procedures/Performance-SQL-vs-MERGE/td-p/117358