Error in Reading from Hadoop Database

dhrumil_patel — Wed, 09 Nov 2016 23:58:24 GMT

On SAS 9.3, I'm trying to read in a dataset from a Hadoop database into my work library. The code I'm using is this:

proc sql;
connect to hadoop(subprotocol=hive2 server='&servername' port=10000 schema=&schema_name);
create table work.my_data as
select * from connection to hadoop (
select *
from &table_name
where valuation_date = '2008-01-01'
);
quit;

I get an error (see below) indicating that some of the values are not in Hadoop UTF-8 format and that therefore, the data cannot be read in as a SAS data set:

ERROR: Data from column 'make' in row 707 of the result set was not presented in Hadoop UTF-8 format. The length of this data is 21
bytes, and the first 7 characters are 'RENAULT'. Adding -JREOPTIONS (-Dfile.encoding=UTF-8) to the SAS invocation may
circumvent the issue. Otherwise the data should be corrected to UTF-8 format.

I tried searching for how to add -JREOPTIONS to the code, but was unable to find anything useful. Can anyone advise on the error and how to correct it?

Thank you.

Dhrumil Patel

Re: Error in Reading from Hadoop Database

LinusH — Thu, 10 Nov 2016 10:01:53 GMT

You can't add it to the code, you assign at SAS invocation:

http://support.sas.com/documentation/cdl/en/hostunx/67929/HTML/default/viewer.htm#p1e05jrt9fhl7tn17oormmfzayfx.htm

topic Re: Error in Reading from Hadoop Database in SAS Data Management

Error in Reading from Hadoop Database

Re: Error in Reading from Hadoop Database