topic SAS9.4M3<-->Hadoop(CDH_5.71) in Administration and Deployment

SAS9.4M3<-->Hadoop(CDH_5.71)

Go — Mon, 11 Jul 2016 14:31:40 GMT

I am trying to connect SAS and CDH, actually we already made succesfull connection to CHD5.5, since they upgraded it to CDH 5.7, I had to pull the files again, when I am trying to test some code I am getting below error

I get below error while trying to copy file from SAS to HDFS and copy file from HDFS to SAS, SSL is not configured in this environment, do i need to configure SSL to access CDH5.71 ????

ERROR: javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException: No X509TrustManager implementation available

Below is the log file

(code and error is highlighted below)

1 The SAS System 13:44 Monday, July 11, 2016

1 ;*';*";*/;quit;run;

2 OPTIONS PAGENO=MIN;

3 %LET _CLIENTTASKLABEL='Program';

4 %LET _CLIENTPROJECTPATH='';

5 %LET _CLIENTPROJECTNAME='';

6 %LET _SASPROGRAMFILE=;

8 ODS _ALL_ CLOSE;

9 OPTIONS DEV=ACTIVEX;

10 GOPTIONS XPIXELS=0 YPIXELS=0;

11 FILENAME EGSR TEMP;

12 ODS tagsets.sasreport13(ID=EGSR) FILE=EGSR

13 STYLE=HtmlBlue

14 STYLESHEET=(URL="file:///C:/Program%20Files/SASHome/SASEnterpriseGuide/7.1/Styles/HtmlBlue.css")

15 NOGTITLE

16 NOGFOOTNOTE

17 GPATH=&sasworklocation

18 ENCODING=UTF8

19 options(rolap="on")

20 ;

NOTE: Writing TAGSETS.SASREPORT13(EGSR) Body file: EGSR

22 GOPTIONS ACCESSIBLE;

23 proc hadoop;

24 hdfs copytolocal = '/user/gnayaki/testdir_5.71/tt.txt'

25 out = '/uhome/gnayaki/new_testfile_gov.txt' overwrite;

ERROR: javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException: No X509TrustManager implementation available

26 run;

NOTE: The SAS System stopped processing this step because of errors.

NOTE: PROCEDURE HADOOP used (Total process time):

real time 0.51 seconds

user cpu time 0.00 seconds

system cpu time 0.00 seconds

memory 39.31k

OS Memory 17824.00k

Timestamp 07/11/2016 01:47:57 PM

Step Count 4 Switch Count 39

Page Faults 0

Page Reclaims 21

Page Swaps 0

Voluntary Context Switches 349

Involuntary Context Switches 0

Block Input Operations 0

Block Output Operations 0

28 GOPTIONS NOACCESSIBLE;

29 %LET _CLIENTTASKLABEL=;

30 %LET _CLIENTPROJECTPATH=;

31 %LET _CLIENTPROJECTNAME=;

32 %LET _SASPROGRAMFILE=;

34 ;*';*";*/;quit;run;

35 ODS _ALL_ CLOSE;

2 The SAS System 13:44 Monday, July 11, 2016

38 QUIT; RUN;

Re: SAS9.4M3<-->Hadoop(CDH_5.71)

LinusH — Mon, 11 Jul 2016 14:41:19 GMT

Try to connect to Cloudera from the SAS server shell first, and do the file copy there. Once that's working, continue with verification of the SAS connection.

Re: SAS9.4M3<-->Hadoop(CDH_5.71)

Go — Mon, 11 Jul 2016 14:48:28 GMT

You mean ./sas -nodms right ?
I get the same error, see below
7? proc hadoop;
hdfs copyfromlocal = '/uhome/gnayaki/tt.txt'
out = '/user/gnayaki/testdir_57_0711e2r' overwrite;
run;
NOTE: The SAS System stopped processing this step because of errors.
NOTE: PROCEDURE HADOOP used (Total process time):
real time 1:06.49
user cpu time 0.01 seconds
system cpu time 0.00 seconds
memory 50.65k
OS Memory 6304.00k
Timestamp 07/11/2016 02:47:30 PM
Step Count 2 Switch Count 1
Page Faults 0
Page Reclaims 32
Page Swaps 0
Voluntary Context Switches 260
Involuntary Context Switches 0
Block Input Operations 0
Block Output Operations 0

9?

ERROR: javax.net.ssl.SSLHandshakeException:
java.security.cert.CertificateException: No X509TrustManager
implementation available

10?

Re: SAS9.4M3<-->Hadoop(CDH_5.71)

LinusH — Mon, 11 Jul 2016 19:47:35 GMT

No. Without any SAS intervention but from the SAS server.

Re: SAS9.4M3<-->Hadoop(CDH_5.71)

woo — Wed, 13 Jul 2016 17:34:53 GMT

see if this help,

refer this docs;

https://support.sas.com/resources/thirdpartysupport/v94/hadoop/hadoopbacg.pdf

Under documentaiton see topic called - Using a Single Configuration File

To connect to a Hadoop server with the FILENAME statement or PROC HADOOP ......

1. Create a directory that is accessible to the SAS client machine

2. Create a single configuration file with the properties from the Hadoop core configuration file or by merging the properties from multiple Hadoop configuration files.

3. Save the configuration file in the directory created in step 1.

4. In the FILENAME statement or PROC HADOOP statement, identify the configuration file with the CFG= option:

filename cfg1 'C:\Users\sasabc\hadoop\sample_config.xml';

proc hadoop cfg=cfg1 username='sasabc' password='sasabc' verbose;

hdfs mkdir='/user/sasabc/new_directory';

hdfs delete='/user/sasabc/temp2_directory';

hdfs copytolocal='/user/sasabc/testdata.txt'

out='C:\Users\sasabc\Hadoop\testdata.txt' overwrite;

run;

Re: SAS9.4M3<-->Hadoop(CDH_5.71)

Go — Mon, 18 Jul 2016 22:04:24 GMT

I added root certificate to app server through deployment manager, this fixed the issue, thanks for all the replies