BookmarkSubscribeRSS Feed
brulard
Pyrite | Level 9

hi,

 

I need to run a query of historical bank transactions, in Hadoop. I usually query in Netezza.

 

I received the following error, and was wondering if anyone had a tip to offer.

 

  • ERROR: Data from column 'mrcnt_dba_nm' in row 303856439 of the result set was not presented in Hadoop UTF-8 format. The length of
    this data is 25 bytes, and the first 3 characters are '011'. Adding -JREOPTIONS (-Dfile.encoding=UTF-8) to the SAS
    invocation may circumvent the issue. Otherwise the data should be corrected to UTF-8 format.
    ERROR: PROC SQL runtime error for operation=sqxsrc.
    ERROR: An error has occurred.
  • NOTE: PROC SQL set option NOEXEC and will continue to check the syntax of statements.
    ERROR: java.sql.SQLException: org.apache.thrift.transport.TTransportException: org.apache.http.NoHttpResponseException:
    sdpsvrwm0121.scglobal.ad.scotiacapital.com:8443 failed to respond
    NOTE: The SAS System stopped processing this step because of errors.

 

NOTE: Updated analytical products:

SAS/STAT 14.1
SAS/ETS 14.1
SAS/OR 14.1
SAS/IML 14.1
SAS/QC 14.1

NOTE: Additional host information:

IBM AIX AIX 64 1 7 00C030A74C00

 

Thank you

2 REPLIES 2
ChrisNZ
Tourmaline | Level 20

There seems to be corrupt/invalid data in the file.

Does the query work outside of SAS? Is the data in text files? Are the text files UTF-8? Can they be UTF8? Can you run a validation?

brulard
Pyrite | Level 9

thanks for ur reply. I ended running the variable but excluding a variable. The output was good.I didn't look further into this. A colleague later gave me, which i'm listing here in case in can help anyone: 

Pls add this option in libname statement

DBMAX_TEXT=255 TRANSCODE_FAIL=SILENT LOGIN_TIMEOUT= 0 ;

sas-innovate-2024.png

Join us for SAS Innovate April 16-19 at the Aria in Las Vegas. Bring the team and save big with our group pricing for a limited time only.

Pre-conference courses and tutorials are filling up fast and are always a sellout. Register today to reserve your seat.

 

Register now!

How to Concatenate Values

Learn how use the CAT functions in SAS to join values from multiple variables into a single value.

Find more tutorials on the SAS Users YouTube channel.

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 2 replies
  • 1843 views
  • 2 likes
  • 2 in conversation