topic Re: Hadoop connectivity issue in SAS Data Management

Hadoop connectivity issue

brulard — Mon, 16 Jan 2017 14:31:07 GMT

hello,

I am trying to connect to a database we internally refer to as EDL, but am getting error message.

Here is my code:

proc sql;
               connect to hadoop (user=''myname'  pwd=’xxxxxx’  server='sdpsvrwm0121.scglobal.ad.source.com' schema=edice  uri='jdbc:hive2://sdpsvrwm0121.scglobal.ad.source.com:8443/cmstr;ssl=true;sslTrustStore=/sashome/hadoop/gateway.jks;trustStorePassword=xxxx?hive.server2.transport.mode=http;hive.server2.thrift.http.path=gateway/default/hive');
create table table_Pull as
                              select * from connection to  hadoop
               (select * from MSTR_TABLE
                             where ID='0000000001'); quit;

Error messages in blue:

14 ! hive.server2.thrift.http.path=gateway/default/hive');
ERROR: The Hive Kerberos principal string is present in the hive-site.xml file in the
       SAS_HADOOP_JAR_PATH. The USER= and PASSWORD= options cannot not be specified when the Hive
       Kerberos principal string is present.
15   create table table_Pull as
16                                 select * from connection to hadoop
17                  (select * from MSTR_TABLE
18                                where ID='0000000001');
18 !                                                                    quit;
ERROR: Connection is missing required option SERVER.
NOTE: The SAS System stopped processing this step because of errors.

My Unix SAS version

:For Base SAS Software ...
   Custom version information: 9.4_M3
   Image version information: 9.04.01M3P060315
For SAS/STAT ...
   Custom version information: 14.1
For SAS/GRAPH ...
   Custom version information: 9.4_M3
For SAS/ETS ...
   Custom version information: 14.1
For SAS/OR ...
   Custom version information: 14.1
For SAS/IML ...
   Custom version information: 14.1
For SAS/QC ...
   Custom version information: 14.1
For SAS/CONNECT ...
   Custom version information: 9.4_M3
For SAS Integration Technologies ...
   Custom version information: 9.4_M3
For SAS/Secure 168-bit ...
   Custom version information: 9.4_M2
For SAS/ACCESS Interface to DB2 ...
   Custom version information: 9.4_M2
For SAS/ACCESS Interface to PC Files ...
   Custom version information: 9.4_M3
For SAS/ACCESS Interface to ODBC ...
   Custom version information: 9.4_M3
For SAS/ACCESS Interface to Microsoft SQL Server ...
   Custom version information: 9.41
For SAS Model Manager ...
   Custom version information: 13.1
   Image version information: 9.04.01M0P061715
For SAS/ACCESS Interface to Netezza ...
   Custom version information: 9.4_M3
For SAS/ACCESS to Hadoop ...
   Custom version information: 9.43
For High Performance Suite ...
   Custom version information: 2.2_M4
For Model Mgmt Shared Macros ...
   Custom version information: 14.1
   Image version information: 9.04.01M0P061715
For Decision Manager Server ...
   Custom version information: 3.1
   Image version information: 9.04.01M0P061715

Also, when I try connect to database with Libname from Autoexec, I receive error:

“ERROR: java.sql.SQLException: Could not open client transport with JDBC Uri:”

Any tips toward resolving this is greatly appreciated. Thanks,

Dave

Re: Hadoop connectivity issue

JBailey — Tue, 17 Jan 2017 16:25:49 GMT

Hi @brulard

I am guessing here... there may be issues with the XML files or Kerberos kinit. I am not sure. Generally, these types of questions are best handled by SAS Tech Support. I suggest opening a track. Please let us know the fix for the problem.

If you like you can have the Tech Support consultant add me as an interested party.

Thanks,

Jeff

Re: Hadoop connectivity issue

brulard — Wed, 18 Jan 2017 11:43:25 GMT

hi Jeff,

Thanks for responding. How do I "open a track"? Is it through SAS website, or via my organization?

Re: Hadoop connectivity issue

JBailey — Wed, 18 Jan 2017 14:18:47 GMT

Hi @brulard,

This page may help you out. If this doesn't help, let me know.

http://support.sas.com/en/technical-support.html#contact-technical-support

Good luck,
Jeff

Re: Hadoop connectivity issue

maheshtalla — Wed, 19 Apr 2017 20:44:20 GMT

Hi brulard,

I'm also intrested in this topic, we have same SAS products on Linux. Can you please let me know if you have done any additional configuration for connecting to Hadoop.?

Re: Hadoop connectivity issue

brulard — Thu, 20 Apr 2017 15:45:43 GMT

hi maheshtalla ,

The approach to connect to hadoop that I posted above never worked for me. I have some colleague that embed that in their sas queries.

I tried another approach, code that I embed in my autoexec to add a library. I then refer to the library in each of my queries. Here is my code, where xxx is PII. Hope this helps you.

libname edl hadoop
server='xxxxxxxxx.com'
schema=edice
DBMAX_TEXT=255
user='xxxxxxxxx'
pwd='xxxxxxxxx'
uri='jdbc:hive2://xxxxxxxxx.com:8443/cmstr;ssl=true;sslTrustStore=/sashome/hadoop/gateway.jks;trustStorePassword=xxxxxxxxx?hive.server2.transport.mode=http;hive.server2.thrift.http.path=gateway/default/hive';

Cheers