Thanks @RW9 - when we go about using .csv (and some of our large datasets are already worked with as .sas7bdat datasets), we run into slow I/O when working with large datasets. Sometimes reading datasets on the order of 500GB can take a long time, especially if we are processing it with temporary datasets, too. Is there some mechanism you use to speed things up? For reference, we use SAS version 9.4 TS1M5 in linux. Edit: our SAS datasets do use indices as well, which speeds things up. We've also experimented with using SAS views, but no improvement in performance when doing so.
... View more