SAS/Hadoop Error for libname statement

[Go]

For some users in our organisation we are getting below java error.. All the members of SAS Administration team and some other users dont get this error at all, please look into this 

Error message when attempting to run the following libname statement:

libname hdp hadoop server=dqas1100a port=10000 schema=default subprotocol=hive2;

ERROR: java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: sun.util.calendar.ZoneInfoFile (initialization

       failure)

ERROR: Error trying to establish connection.

ERROR: Error in the LIBNAME statement.

[bsnithin]

I have seen no class error when any of the JAR files are missing. Did you configure SAS/Access for hadoop manually (or) SAS deployment wizard ? If you used the wizard it's supposed to copy all the required files automatically.

Regards,

-Nithin 

[Go]

I have done it through Wizard, and strange thing is it works for some of us, below are the jar files....

activation-1.1.jar

hadoop-yarn-server-nodemanager-2.6.0-cdh5.7.1.jar

parquet-generator.jar

jaxb-impl-2.2.3-1.jar

parquet-encoding.jar

antlr-runtime-3.4.jar

hadoop-yarn-server-resourcemanager-2.6.0-cdh5.7.1.jar

parquet-hadoop-bundle.jar

jersey-client-1.9.jar

parquet-format-javadoc.jar

aopalliance-1.0.jar

hadoop-yarn-server-tests-2.6.0-cdh5.7.1.jar

parquet-hadoop.jar

jersey-core-1.9.jar

parquet-format-sources.jar

apacheds-i18n-2.0.0-M15.jar

hadoop-yarn-server-web-proxy-2.6.0-cdh5.7.1.jar

parquet-jackson.jar

jersey-guice-1.9.jar

parquet-format.jar

apacheds-kerberos-codec-2.0.0-M15.jar

hamcrest-core-1.3.jar

parquet-pig-bundle.jar

jersey-json-1.9.jar

commons-math3-3.1.1.jar

api-asn1-api-1.0.0-M20.jar

hbase-annotations-1.2.0-cdh5.7.1.jar

parquet-pig.jar

jersey-server-1.9.jar

commons-net-3.1.jar

api-util-1.0.0-M20.jar

hbase-client-1.2.0-cdh5.7.1.jar

parquet-protobuf.jar

jets3t-0.9.0.jar

curator-client-2.7.1.jar

asm-3.2.jar

hbase-common-1.2.0-cdh5.7.1.jar

parquet-scala_2.10.jar

jettison-1.1.jar

curator-framework-2.7.1.jar

avro-1.7.6-cdh5.7.1.jar

hbase-protocol-1.2.0-cdh5.7.1.jar

parquet-scrooge_2.10.jar

jetty-6.1.26.cloudera.4.jar

curator-recipes-2.7.1.jar

aws-java-sdk-core-1.10.6.jar

hbase-server-1.2.0-cdh5.7.1.jar

parquet-test-hadoop2.jar

jetty-util-6.1.26.cloudera.4.jar

exclusionlist

aws-java-sdk-kms-1.10.6.jar

hive-beeline-1.1.0-cdh5.7.1.jar

parquet-thrift.jar

jline-2.11.jar

gson-2.2.4.jar

aws-java-sdk-s3-1.10.6.jar

hive-cli-1.1.0-cdh5.7.1.jar

parquet-tools.jar

jruby-cloudera-1.0.0.jar

guava-11.0.2.jar

calcite-avatica-1.0.0-incubating.jar

hive-exec-1.1.0-cdh5.7.1.jar

pig-0.12.0-cdh5.7.1-withouthadoop.jar

jsch-0.1.42.jar

guice-3.0.jar

calcite-core-1.0.0-incubating.jar

hive-hcatalog-core-1.1.0-cdh5.7.1.jar

postgresql-9.0-801.jdbc4.jar

jsp-api-2.1.jar

guice-servlet-3.0.jar

calcite-linq4j-1.0.0-incubating.jar

hive-jdbc-1.1.0-cdh5.7.1-standalone.jar

protobuf-java-2.5.0.jar

jsr305-3.0.0.jar

hadoop-annotations-2.6.0-cdh5.7.1.jar

commons-beanutils-1.7.0.jar

htrace-core-3.2.0-incubating.jar

servlet-api-2.5.jar

junit-4.11.jar

hadoop-auth-2.6.0-cdh5.7.1.jar

commons-beanutils-core-1.8.0.jar

htrace-core4-4.0.1-incubating.jar

slf4j-api-1.7.5.jar

leveldbjni-all-1.8.jar

hadoop-aws-2.6.0-cdh5.7.1.jar

commons-cli-1.2.jar

httpclient-4.2.5.jar

slf4j-log4j12-1.7.5.jar

libthrift-0.9.3.jar

hadoop-azure-2.6.0-cdh5.7.1.jar

commons-codec-1.4.jar

httpcore-4.2.5.jar

snappy-java-1.0.4.1.jar

log4j-1.2.17.jar

hadoop-common-2.6.0-cdh5.7.1-tests.jar

commons-collections-3.2.2.jar

hue-plugins-3.9.0-cdh5.7.1.jar

spark-1.6.0-cdh5.7.1-yarn-shuffle.jar

logredactor-1.0.3.jar

hadoop-common-2.6.0-cdh5.7.1.jar

commons-compress-1.4.1.jar

jackson-core-asl-1.8.8.jar

spark-assembly-1.6.0-cdh5.7.1-hadoop2.6.0-cdh5.7.1.jar

mockito-all-1.8.5.jar

hadoop-hdfs-2.6.0-cdh5.7.1-tests.jar

commons-configuration-1.6.jar

jackson-jaxrs-1.8.8.jar

stax-api-1.0-2.jar

netty-3.6.2.Final.jar

hadoop-hdfs-2.6.0-cdh5.7.1.jar

commons-daemon-1.0.13.jar

jackson-mapper-asl-1.8.8.jar

super-csv-2.2.0.jar

netty-all-4.0.23.Final.jar

hadoop-hdfs-nfs-2.6.0-cdh5.7.1.jar

commons-digester-1.8.jar

jackson-xc-1.8.8.jar

xalan-2.7.0.jar

ojdbc6.jar

hadoop-mapreduce-client-app-2.6.0-cdh5.7.1.jar

commons-el-1.0.jar

jasper-compiler-5.5.23.jar

xercesImpl-2.9.1.jar

paranamer-2.3.jar

hadoop-mapreduce-client-common-2.6.0-cdh5.7.1.jar

commons-httpclient-3.1.jar

jasper-runtime-5.5.23.jar

xml-apis-1.3.04.jar

parquet-avro.jar

hadoop-mapreduce-client-core-2.6.0-cdh5.7.1.jar

commons-io-2.4.jar

java-xmlbuilder-0.4.jar

xmlenc-0.52.jar

parquet-cascading.jar

hadoop-mapreduce-client-jobclient-2.6.0-cdh5.7.1.jar

commons-lang-2.6.jar

javax.inject-1.jar

xz-1.0.jar

parquet-column.jar

hadoop-mapreduce-examples-2.6.0-cdh5.7.1.jar

commons-logging-1.1.3.jar

jaxb-api-2.2.2.jar

zookeeper-3.4.5-cdh5.7.1.jar

parquet-common.jar

hadoop-nfs-2.6.0-cdh5.7.1.jar

hadoop-yarn-api-2.6.0-cdh5.7.1.jar

hadoop-yarn-client-2.6.0-cdh5.7.1.jar

hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.7.1.jar

hadoop-yarn-applications-distributedshell-2.6.0-cdh5.7.1.jar

hadoop-yarn-common-2.6.0-cdh5.7.1.jar

hadoop-yarn-server-common-2.6.0-cdh5.7.1.jar

hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.7.1.jar

hadoop-yarn-registry-2.6.0-cdh5.7.1.jar

[bsnithin]

As already pointed out if it works for few users and not for others looks like permissions issue. Make sure the user has read access to the jar files.

Regards,

-Nithin

[anja]

Hi there,

are there differences in permissions given for the users? Am wondering as it works for some users, for others it doesn't.

Where are they submitting the libname? From within EG?

Thanks

Anja

[anja]

Hit POST too quickly. 

Just throwing out some things to check ..

What "flavor" of Hadoop are you running? Are all users using the same port in the lib statements?

Are your users authenticating "through" Kerberos?

Post on Hadoop connections:

https://communities.sas.com/t5/SAS-Data-Management/Hadoop-connectivity-issues/td-p/114069

(maybe some info provided here migh help.)