Hi All,
When trying to write a sas dataset out to Hadoop I get the error below. I will let everyone know that I have tried many of the fixes that have been posted but nothing has worked. In our data lake it looks like it is creating the table but it creates is the headers. We were able to write to the data lake 2 weeks ago but we have switched to a new cluster and we can no longer write from SAS EG, SAS EM or SAS Studio. Any help would be appreciated. The code that I use is also below.
options mprint mlogic symbolgen mlogicnest compress=yes;
options set=SAS_HADOOP_CONFIG_PATH='D:\\hadoopcfg';
options set=SAS_HADOOP_JAR_PATH='D:\\hdp22';
OPTIONS SET=SAS_HADOOP_RESTFUL='1';
libname liz hadoop server="xxxxx" PORT=10000 database=user_xxxxx SUBPROTOCOL=hive2
user="xxxxx" password="xxxxxxxx" HDFS_TEMPDIR="/tmp" ;
proc sql ;
drop table utility.HolidayCalendar2;
create table utility.HolidayCalendar2 (DBCREATE_TABLE_OPTS='STORED AS ORC') as select * from utility.referenceCalendar;
quit;
Well, if the environment changed then I'd take the information in the SAS Log very seriously:
Patrick,
We have tried the things that were mentioned in the error plus some other things that we had found online while researching hte issue.
Thanks for your help.
We found a solution to the problem. We ended up having to change the SAS config file for HADOOP.
Thanks,
Can I suggest you describe the issue you had and the resolution to the issue as detailed as possible and then mark this as the solution.
This could help others with similar challenges to use your resolution as guidance.
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Need to connect to databases in SAS Viya? SAS’ David Ghan shows you two methods – via SAS/ACCESS LIBNAME and SAS Data Connector SASLIBS – in this video.
Find more tutorials on the SAS Users YouTube channel.