topic accessing tab separated file in network folder with filter in SAS Programming

accessing tab separated file in network folder with filter

csetzkorn — Tue, 17 Jan 2017 18:04:00 GMT

Let us say I have a massive tab separated file stored in a network drive visible to SAS. The file contains these columns:

Can I access this file via, for axample PROC SQL, to only populate a SAS dataset based on a subset of this data (e.g. where Id = 1234)?

Re: accessing tab separated file in network folder with filter

Shmuel — Tue, 17 Jan 2017 18:20:21 GMT

SAS sql will handle SAS dataset, not a TAB separated file.

You need first to import it into sas using FILENAME ... DLM='09'x;

Use either proc import or a datastep to read the file;

Re: accessing tab separated file in network folder with filter

csetzkorn — Tue, 17 Jan 2017 18:28:56 GMT

OK thanks. Can I apply filter here?

Re: accessing tab separated file in network folder with filter

ballardw — Tue, 17 Jan 2017 18:41:56 GMT

I would suggest reading the entire set into SAS. Then you can subset with a WHERE clause in Proc SQL to your hearts content.

I do not know the number of times I have had someone tell me we need the "XYZ" values only. And then finish the project and get told "need ABC and XYZ_2" also. If you subset the data too early then you may be rereading the data from scratch many times.

Re: accessing tab separated file in network folder with filter

Kurt_Bremser — Tue, 17 Jan 2017 18:50:08 GMT

A subsetting if can be used in a data step that reads from a flat file. But I would only contemplate this if the dataset grows to considerable size. Otherwise you're better off by subsetting later.

Re: accessing tab separated file in network folder with filter

Shmuel — Tue, 17 Jan 2017 18:59:04 GMT

If you use a datastep you can filter data while reading the external file, but if possible

better read the whole file then filter as need using sas tools.