SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Connecting SAS with Hadoop

Reply
Contributor
Posts: 22

Connecting SAS with Hadoop

Hi.

I'm trying to run the following code:

proc sql; connect to hadoop (user="myusr1" pw="mypwd1" server=hxpduped port=10000 schema=default); create table test as (select * from connection to hadoop (select * from dataset limit 100; )); disconnect from hadoop; quit; 

But my code is running without any result. I can't able see the job running in job tracker as well.

Can anybody please help?

Regards,

Super User
Posts: 5,424

Re: Connecting SAS with Hadoop

Posted in reply to newbie_ari

Have you completed the post install configuration, moving jar-files, setting up configuration file etc?

Have you tried a libname?

Can you ping the server?

Data never sleeps
Contributor
Posts: 22

Re: Connecting SAS with Hadoop

Thanks a lot LinusH for your reply! Yes. We have completed all the configurations. I tried the libname option, but was getting the same problem.

We can ping the server as well. The Hadoop server is up & running. And we can submit task which are getting completed.

But can't able to connect sas with Hadoop. Also, I'm using SAS Enterprise in case that's an issue.

Super User
Posts: 5,424

Re: Connecting SAS with Hadoop

Posted in reply to newbie_ari

With libname, can you connect, but not read data? What does PROC DATASETS LIST give you?

Do you have a Hive or Hive2 server?

Have you tried FILENAME?

If you can connect but not read, it's...odd. And I guess that you tried the same HiveQL inside Hive with the same user?

Perhaps this typical SAS tech support issue, hard to troubleshoot remotely for forum participants...

Data never sleeps
Contributor
Posts: 22

Re: Connecting SAS with Hadoop

Thanks LinusH for your helpful reply. We have Hive server. I also have the feeling that I need to contact SAS guyz to look into the issues. But thanks anywayz.

SAS Employee
Posts: 215

Re: Connecting SAS with Hadoop

Posted in reply to newbie_ari

Hi,

Can you try something similar to this and post your SAS log?

libname h1 hadoop server=hxpduped port=10000 user=myusr1 password=mypwd1 schema=default;

options sastrace=',,,d' sastraceloc=saslog nostsuffix;

data h1.cars;

   set sashelp.cars;

run;

select count(*) from h1.cars;

Ask a Question
Discussion stats
  • 5 replies
  • 496 views
  • 3 likes
  • 3 in conversation