Issue with SAS connectivity to Hadoop - Unable to connect to Hive Server

mliem — Thu, 24 Sep 2015 17:45:51 GMT

Hello,

I am trying to configure SAS access to Hadoop and running into the below error when running the Sample Lib code for SAS Hadoop connectivity. I am using HDP 2.2 and used the hadooptracer.py script to get all the jar and conf files. I set the SAS_HADOOP_CONFIG_PATH and SAS_HADOOP_JAR_PATH to the respective files.

We are using kerberos so maybe I am missing some other step? From the SAS Server i can access hdfs and hive. This is the error we are recieving as well as the lib code we are using: (also not i tried settign subprotocol=hive2 but that did not resolve anything)

options set=SAS_HADOOP_CONFIG_PATH "/sasdev/app/sasinst/hadoop/conf";

options set=SAS_HADOOP_JAR_PATH "/sasdev/app/sasinst/hadoop/lib";

libname hdplib hadoop server="700224-hdp.coach.com";

1 ;*';*";*/;quit;run;

2 OPTIONS PAGENO=MIN;

3 %LET _CLIENTTASKLABEL='Program';

4 %LET _CLIENTPROJECTPATH='';

5 %LET _CLIENTPROJECTNAME='';

6 %LET _SASPROGRAMFILE=;

8 ODS _ALL_ CLOSE;

9 OPTIONS DEV=ACTIVEX;

10 GOPTIONS XPIXELS=0 YPIXELS=0;

11 FILENAME EGSR TEMP;

12 ODS tagsets.sasreport13(ID=EGSR) FILE=EGSR STYLE=HtmlBlue

12 ! STYLESHEET=(URL="file:///C:/Program%20Files/SASHome/SASEnterpriseGuide/5.1/Styles/HtmlBlue.css") NOGTITLE NOGFOOTNOTE

12 ! GPATH=&sasworklocation ENCODING=UTF8 options(rolap="on");

NOTE: Writing TAGSETS.SASREPORT13(EGSR) Body file: EGSR

14 GOPTIONS ACCESSIBLE;

15 options set=SAS_HADOOP_CONFIG_PATH "/sasdev/app/sasinst/hadoop/conf";

16 options set=SAS_HADOOP_JAR_PATH "/sasdev/app/sasinst/hadoop/lib";

17 libname hdplib hadoop server="700224-hdp.coach.com";

ERROR: Unable to connect to the Hive server.

WARNING: Connection to HiveServer2 failed. Attempting to connect using Hive1. Set SUBPROTOCOL=hive2 if you are running HiveServer2.

Set SUBPROTOCOL=hive if you are running Hive1.

ERROR: Could not open connection to jdbc:hive://700224-hdp.coach.com:10000/default;principal=hive/_HOST@DEV.COACH.COM. Check your

Hive server status and also set option SUBPROTOCOL= appropriately. Set SUBPROTOCOL=hive2 if you are running HiveServer2.

Set SUBPROTOCOL=hive if you are running Hive1.

ERROR: Error trying to establish connection.

ERROR: Error in the LIBNAME statement.

19 GOPTIONS NOACCESSIBLE;

20 %LET _CLIENTTASKLABEL=;

21 %LET _CLIENTPROJECTPATH=;

22 %LET _CLIENTPROJECTNAME=;

23 %LET _SASPROGRAMFILE=;

25 ;*';*";*/;quit;run;

26 ODS _ALL_ CLOSE;

29 QUIT; RUN;

Re: Issue with SAS connectivity to Hadoop - Unable to connect to Hive Server

mliem — Thu, 24 Sep 2015 19:19:15 GMT

So i have confirmed that it is soemthing kerberos related.

I ran the SAS deployment manager which pulled down the JAR/CONF files and i have verified that the SAS_HADOOP_CONFIG_PATH and SAS_HADOOP_JAR_PATH are pointing to the correct path.

Can someone outline the steps involved with kerberos? It is a little unclear. Which user does it try to authenticate with when it runs the libname command?

I created a ticket (kinit) with the user on the SAS server (this allows me to access hdfs) and tried to EXPORT KRB5CCNAME=/tmp/krb5_"id" but that did not work either.

Does the HDFS/HIVE on the cluster user need to have a valid ticket?

topic Re: Issue with SAS connectivity to Hadoop - Unable to connect to Hive Server in SAS Data Management

Issue with SAS connectivity to Hadoop - Unable to connect to Hive Server

Re: Issue with SAS connectivity to Hadoop - Unable to connect to Hive Server