accessing tab separated file in network folder with filter

Accepted Solution Solved
Reply
Contributor
Posts: 74
Accepted Solution

accessing tab separated file in network folder with filter

Let us say I have a massive tab separated file stored in a network drive visible to SAS. The file contains these columns:

 

 

 

Can I access this file via, for axample PROC SQL, to only populate a SAS dataset based on a subset of this data (e.g. where Id = 1234)?


Accepted Solutions
Solution
‎01-18-2017 06:38 AM
Super User
Posts: 1,256

Re: accessing tab separated file in network folder with filter

If you use a datastep you can filter data while reading the external file, but if possible

better read the whole file then filter as need using sas tools.

View solution in original post


All Replies
Super User
Posts: 1,256

Re: accessing tab separated file in network folder with filter

SAS sql will handle SAS dataset, not a TAB separated file.

You need first to import it into sas  using FILENAME ... DLM='09'x;

Use either proc import or a datastep to read the file;

Contributor
Posts: 74

Re: accessing tab separated file in network folder with filter

OK thanks. Can I apply filter here?
Grand Advisor
Posts: 10,251

Re: accessing tab separated file in network folder with filter

I would suggest reading the entire set into SAS. Then you can subset with a WHERE clause in Proc SQL to your hearts content.

 

I do not know the number of times I have had someone tell me we need the "XYZ" values only. And then finish the project and get told "need ABC and XYZ_2" also. If you subset the data too early then you may be rereading the data from scratch many times.

Solution
‎01-18-2017 06:38 AM
Super User
Posts: 1,256

Re: accessing tab separated file in network folder with filter

If you use a datastep you can filter data while reading the external file, but if possible

better read the whole file then filter as need using sas tools.

Esteemed Advisor
Posts: 6,723

Re: accessing tab separated file in network folder with filter

A subsetting if can be used in a data step that reads from a flat file. But I would only contemplate this if the dataset grows to considerable size. Otherwise you're better off by subsetting later.

 

---------------------------------------------------------------------------------------------
Maxims of Maximally Efficient SAS Programmers
☑ This topic is SOLVED.

Need further help from the community? Please ask a new question.

Discussion stats
  • 5 replies
  • 102 views
  • 0 likes
  • 4 in conversation