SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

filter a work table in DataFlux

Accepted Solution Solved
Reply
Occasional Contributor
Posts: 17
Accepted Solution

filter a work table in DataFlux

[ Edited ]

Hello,

 

I am new with DataFlux and I am trying to play a little bit to understand better the tool.

 

I have a csv file, I import it and I create a "work table" as an output. Is it possible to use this work tabel as an input for an sql statement and filter it with "where clauses"?

 

Thank you for your time!

 

 


Accepted Solutions
Solution
‎04-19-2016 08:09 AM
SAS Super FREQ
Posts: 97

Re: filter a work table in DataFlux

Hi,

 

As you have probably already figured out, work tables are used for temporary storage of data so that it can be accessed in other parts of your data job or process job. It can't be used as input for a SQL statement - at least not directly. It would be possible to read values out of a work table and store the values in macro variables that could be used as parameters to an SQL statement in other steps in your job.

 

If your goal is to read data into your job from a csv file to then subset it in some way, you could read it in directly, skip the work table step, and use the expression node to select/filter the rows that you are interested in.

 

Ron

View solution in original post


All Replies
Solution
‎04-19-2016 08:09 AM
SAS Super FREQ
Posts: 97

Re: filter a work table in DataFlux

Hi,

 

As you have probably already figured out, work tables are used for temporary storage of data so that it can be accessed in other parts of your data job or process job. It can't be used as input for a SQL statement - at least not directly. It would be possible to read values out of a work table and store the values in macro variables that could be used as parameters to an SQL statement in other steps in your job.

 

If your goal is to read data into your job from a csv file to then subset it in some way, you could read it in directly, skip the work table step, and use the expression node to select/filter the rows that you are interested in.

 

Ron

☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 1 reply
  • 401 views
  • 1 like
  • 2 in conversation