topic Re: Connecting SAS with Hadoop in SAS Data Management

Connecting SAS with Hadoop

newbie_ari — Tue, 08 Apr 2014 08:05:32 GMT

Hi.

I'm trying to run the following code:

proc sql; connect to hadoop (user="myusr1" pw="mypwd1" server=hxpduped port=10000 schema=default); create table test as (select * from connection to hadoop (select * from dataset limit 100; )); disconnect from hadoop; quit;

But my code is running without any result. I can't able see the job running in job tracker as well.

Can anybody please help?

Regards,

Re: Connecting SAS with Hadoop

LinusH — Tue, 08 Apr 2014 09:01:59 GMT

Have you completed the post install configuration, moving jar-files, setting up configuration file etc?

Have you tried a libname?

Can you ping the server?

Re: Connecting SAS with Hadoop

newbie_ari — Tue, 08 Apr 2014 09:18:21 GMT

Thanks a lot LinusH for your reply! Yes. We have completed all the configurations. I tried the libname option, but was getting the same problem.

We can ping the server as well. The Hadoop server is up & running. And we can submit task which are getting completed.

But can't able to connect sas with Hadoop. Also, I'm using SAS Enterprise in case that's an issue.

Re: Connecting SAS with Hadoop

LinusH — Tue, 08 Apr 2014 11:45:04 GMT

With libname, can you connect, but not read data? What does PROC DATASETS LIST give you?

Do you have a Hive or Hive2 server?

Have you tried FILENAME?

If you can connect but not read, it's...odd. And I guess that you tried the same HiveQL inside Hive with the same user?

Perhaps this typical SAS tech support issue, hard to troubleshoot remotely for forum participants...

Re: Connecting SAS with Hadoop

newbie_ari — Tue, 08 Apr 2014 13:35:50 GMT

Thanks LinusH for your helpful reply. We have Hive server. I also have the feeling that I need to contact SAS guyz to look into the issues. But thanks anywayz.

Re: Connecting SAS with Hadoop

JBailey — Wed, 09 Apr 2014 15:36:06 GMT

Hi,

Can you try something similar to this and post your SAS log?

libname h1 hadoop server=hxpduped port=10000 user=myusr1 password=mypwd1 schema=default;

options sastrace=',,,d' sastraceloc=saslog nostsuffix;

data h1.cars;

set sashelp.cars;

run;

select count(*) from h1.cars;