topic Re: Error running script in Hadoop (Apache) in SAS Programming

Error running script in Hadoop (Apache)

brulard — Tue, 13 Feb 2018 12:38:49 GMT

hi,

I need to run a query of historical bank transactions, in Hadoop. I usually query in Netezza.

I received the following error, and was wondering if anyone had a tip to offer.

ERROR: Data from column 'mrcnt_dba_nm' in row 303856439 of the result set was not presented in Hadoop UTF-8 format. The length of
this data is 25 bytes, and the first 3 characters are '011'. Adding -JREOPTIONS (-Dfile.encoding=UTF-8) to the SAS
invocation may circumvent the issue. Otherwise the data should be corrected to UTF-8 format.
ERROR: PROC SQL runtime error for operation=sqxsrc.
ERROR: An error has occurred.
NOTE: PROC SQL set option NOEXEC and will continue to check the syntax of statements.
ERROR: java.sql.SQLException: org.apache.thrift.transport.TTransportException: org.apache.http.NoHttpResponseException:
sdpsvrwm0121.scglobal.ad.scotiacapital.com:8443 failed to respond
NOTE: The SAS System stopped processing this step because of errors.

NOTE: Updated analytical products:

SAS/STAT 14.1
SAS/ETS 14.1
SAS/OR 14.1
SAS/IML 14.1
SAS/QC 14.1

NOTE: Additional host information:

IBM AIX AIX 64 1 7 00C030A74C00

Thank you

Re: Error running script in Hadoop (Apache)

ChrisNZ — Fri, 16 Feb 2018 10:33:52 GMT

There seems to be corrupt/invalid data in the file.

Does the query work outside of SAS? Is the data in text files? Are the text files UTF-8? Can they be UTF8? Can you run a validation?

Re: Error running script in Hadoop (Apache)

brulard — Fri, 16 Feb 2018 12:46:42 GMT

thanks for ur reply. I ended running the variable but excluding a variable. The output was good.I didn't look further into this. A colleague later gave me, which i'm listing here in case in can help anyone:

Pls add this option in libname statement

DBMAX_TEXT=255 TRANSCODE_FAIL=SILENT LOGIN_TIMEOUT= 0 ;