topic Re: SAS® Viya Caslib SAS access to hadoop error in Developers

SAS® Viya Caslib SAS access to hadoop error

stalasani — Fri, 31 May 2019 15:39:43 GMT

ERROR: The connection to the data source driver failed.

ERROR: General error java.util.concurrent.TimeoutException

ERROR: Function failed.

ERROR: The action stopped due to errors.

cas mySession sessopts=(caslib=casuser timeout=1800 locale="en_US");

caslib hdlib datasource=(srctype="hadoop", dataTransferMode="serial", username="{username}", password="{password}"
uri="jdbc:hive2://{hostname}:2181,{hostname}:2181,{hostname}:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;ssl=true;",
hadoopjarpath="/sas_mirror/hadoopfiles/lib", 
hadoopconfigdir="/sas_mirror/hadoopfiles/conf", 
schema="default");

proc casutil; 
list files incaslib="hdlib";
run;

Re: SAS® Viya Caslib SAS access to hadoop error

Patrick — Sat, 01 Jun 2019 03:51:09 GMT

A similar error which I'm getting in SAS 9.4 occurs if SAS is not able to establish a connection due to an unresponsive Hadoop cluster (meaning: It only happens sometimes).

ERROR: Error trying to establish connection: java.util.concurrent.TimeoutException
ERROR: Error in the LIBNAME statement.

You could try to increase the value for timeout if your version of SAS lets you do this.

http://support.sas.com/kb/62/643.html

Re: SAS® Viya Caslib SAS access to hadoop error

stalasani — Tue, 04 Jun 2019 19:24:45 GMT

For me the issue is persistent.

I'm using SAS StudioV which is in SAS Viya deployment.

Re: SAS® Viya Caslib SAS access to hadoop error

stalasani — Thu, 06 Jun 2019 15:36:37 GMT

removing the uri option from the code resolved the issue.

cas mySession sessopts=(caslib=casuser timeout=1800 locale="en_US");

caslib hdlib datasource=(srctype="hadoop", dataTransferMode="serial", username="{username}", password="{password}"
hadoopjarpath="/sas_mirror/hadoopfiles/lib", 
hadoopconfigdir="/sas_mirror/hadoopfiles/conf", 
schema="default");

proc casutil; 
list files incaslib="hdlib";
run;

Re: SAS® Viya Caslib SAS access to hadoop error

stalasani — Thu, 06 Jun 2019 15:44:15 GMT

The solution was provided by SAS Technical support.

We should be able to surface the zookeeper configuration from your xml files if you remove the uri= option and continue to not have a server= as well. For example, the working caslib statement for our internal zookeeper cluster is just:

caslib hdlib

 datasource=(srctype="hadoop", dataTransferMode="serial", username="hive",

 hadoopjarpath="/opt/sas/hadoop/lib",

 hadoopconfigdir="/opt/sas/hadoop/conf",

 schema="hidetail");

If a similar caslib statement still times out for you then you may want to add the login_time= option with a value of 60.(the default is 30 for hadoop)