topic Why I have to keep SAS_HADOOP_RESTFUL=1 even tough it is optional parameter as per SAS document? in SAS Data Management

Why I have to keep SAS_HADOOP_RESTFUL=1 even tough it is optional parameter as per SAS document?

ajain59 — Mon, 06 Mar 2017 14:12:36 GMT

Hi,

I have configured SAS Hadoop Env. by using the following steps:

1) using SAS9.4 in local laptop (without SAS/Access to Hadoop)

2) Install and run CDH 5.8 VM using VM player

Manuall set up SAS Hadoop Env.

3) Modified host file to point to CDH 5.8 quickstart.cloudera by adding IP address and hostname

4) Define SAS_HADOOP_RESTFUL=1

5) Define the SAS_HADOOP_CONFIG_PATH to point to following files:

core-site.xml,hdfs-site.xml,map-reduce.xml and yarn-site.xml

%put %sysget(SAS_HADOOP_JAR_PATH);

%put %sysget(SAS_HADOOP_CONFIG_PATH);

%put %sysget(SAS_HADOOP_RESTFUL);

/* write a file to HDFS directory */

proc hadoop username='cloudera' password='cloudera' verbose;

hdfs mkdir='/user/cloudera/newdirectory3';

run;

The above steps works fine without defining the SAS_HADOOP_JAR_PATH and .

However, If I define SAS_HADOOP_RESTFUL=0, and

set SAS_HADOOP_CONFIG_PATH to point config files

set SAS_HADOOP_JAR_PATH to point JARS

I am getting the following error related to dataflux studio, even though I donot have SAS Dataflux installed on my laptop.

JBailey — Mon, 06 Mar 2017 14:31:07 GMT

There is likely a problem with the JAR files. I suggest running the hadooptracer.py tool to pull the JAR and XML files from the cluster.

ajain59 — Mon, 06 Mar 2017 15:05:55 GMT

Where can i find this tool and how to use it?

ajain59 — Mon, 06 Mar 2017 15:27:51 GMT

I got the link here for python script

and I am now going to use it to extract all jar files and config files

Thanks for your help. I will share if it resolves the issue.

Thanks,

Ashish

JBailey — Mon, 06 Mar 2017 15:31:00 GMT

Just so it is documented in this thread... information regarding the tool can be found here:

This page is also useful:

ajain59 — Tue, 07 Mar 2017 10:17:04 GMT

Thanks for help....now I am able to copy the correct jars and config files. it is working.. hip Hip ..Hurray...