SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

How to persist native SAS data sets to Hadoop (Hive)

Reply
New Contributor
Posts: 3

How to persist native SAS data sets to Hadoop (Hive)

Hi,

 

I am having a table in Hive and using that table I am trying to create a temporary table in Hive based on some conditions and lookup values, which are stored in a SAS dataset.

 

I am using Execute (insert into ....  ) by hadoop inside proc sql. On using the SAS dataset reference inside Execute by hadoop, it gives me an error.

 

Can somebody suggest how can I achieve this.

Thanks for the help.

 

 

Super User
Posts: 5,260

Re: How to persist native SAS data sets to Hadoop (Hive)

Please share the code/log so we better can understand what you are trying to do. Including the look-up step.

Data never sleeps
SAS Employee
Posts: 203

Re: How to persist native SAS data sets to Hadoop (Hive)

[ Edited ]

Hi @deepika2

 

Anything enclosed in the parentheses is sent directly to Hive. Hive doesn't know anything about a SAS data set so you will get an error. 

 

EXECUTE (all this stuff goes straight to Hive) BY HADOOP;

 

Update: I just noticed the Subject of this post. Are you trying to store SAS7BDAT files on HDFS?

 

Best wishes,

Jeff

Community Manager
Posts: 486

Re: How to persist native SAS data sets to Hadoop (Hive)

Hi deepika2,

 

This article by @brian_kinnebrew_sas may help you: 

 

How to persist native SAS data sets to Hadoop (Hive)

 

Anna

Ask a Question
Discussion stats
  • 3 replies
  • 106 views
  • 0 likes
  • 4 in conversation