SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

Does anybody know how connect SAS and Hortonworks?

Accepted Solution Solved
Reply
Occasional Contributor
Posts: 6
Accepted Solution

Does anybody know how connect SAS and Hortonworks?

I have a task to make a connection from SAS to Hortonworks.

There is an instance of SAS 9.4 with SAS/Access to Hadoop on Windows Server 9.4.

Also there is a cluster of Hortonworks (with 10 nodes, OS: RedHat).

Unfortunately I couldn't find any information about the Jar files that I needed.

I just found "Chapter 4: Configuring Hadoop JAR Files" in configuration guide.

If someone has experience in this task please let me know how you did it.

Sincerely yours,

Nikolay.


Accepted Solutions
Solution
‎05-28-2014 08:57 AM
SAS Employee
Posts: 215

Re: Does anybody know how connect SAS and Hortonworks?

This thread may contain the info you need. If you tell me the version of HDP you are using, I will tell you what I have.

https://communities.sas.com/message/212423#212423

View solution in original post


All Replies
Super User
Posts: 5,441

Re: Does anybody know how connect SAS and Hortonworks?

Did you follow this:

http://support.sas.com/documentation/installcenter/en/ikfdtnwincg/67230/PDF/default/config.pdf?

I successfully connected to IBM BigInsights following this.

The distribution may vary on where to find the appropriate jar-files specified - there are no distribution specific complete "pick list". You probably need to search for these manually in Hortonworks. If you fins multiple, pick the ones with latest version no.

Data never sleeps
Occasional Contributor
Posts: 6

Re: Does anybody know how connect SAS and Hortonworks?

LinusH, you right.

I follow exactly mentioned config documentation.

But unfortunately in this documentation it is only the Jar files for Cloudera CDH4.0.1 (It's realy old version ).

How did you find which Jar files needed for IBM BigInsights?

And could you please write the list of this files.

Solution
‎05-28-2014 08:57 AM
SAS Employee
Posts: 215

Re: Does anybody know how connect SAS and Hortonworks?

This thread may contain the info you need. If you tell me the version of HDP you are using, I will tell you what I have.

https://communities.sas.com/message/212423#212423

Occasional Contributor
Posts: 6

Re: Does anybody know how connect SAS and Hortonworks?

Dear Jeff,

I have HDP 2.0 version.

I found of the 20 JAR files that you have in your link above.

Also I set SAS_HADOOP_JAR_PATH.

But when I started the program, it was faced with another problem. The program hangs in "processing submitted statements".

err_norespose.jpg

I was forced to quit the program  by "Terminated the SAS System".

Could you tell why this program could hang?

P.S.

I've done the connection first and second ways according your video " Getting Started with SAS® and Hadoop Part1".

Jeff, thank you your video.

Occasional Contributor
Posts: 6

Re: Does anybody know how connect SAS and Hortonworks?

I solved the problem with connection.

The problem was in incorrect libname.  My Hive server was HiveSever2 and it was critical to add option SUBPROTOCOL=HIVE2.

When I wrote libname hdp hadoop server="192.168.14.26" user="hadoop1" SUBPROTOCOL=HIVE2; everything was working.

SAS Employee
Posts: 215

Re: Does anybody know how connect SAS and Hortonworks?

It is very easy to overlook the SUBPROTOCOL= option. In the near future we will likely make HIVE2 the default. The use of Hive1 (for want of a better way to describe it) is rapidly disappearing. Eventually, the option may go away. But in the meantime, it sure is easy to overlook it.

🔒 This topic is solved and locked.

Need further help from the community? Please ask a new question.

Discussion stats
  • 6 replies
  • 900 views
  • 3 likes
  • 3 in conversation