How to read avro file from Hadoop in SAS DI?

[Peter_Wine]

Hi All,

Is it possible to read avro files from Hadoop in SAS DI?

All my trials failed. I tried "File reader" and "Hadoop File Reader".

Both doesn't work for me.

Thanks in advance,

Piotr

[JBailey · Accepted solution]

Hi @Peter_Wine 

If Hive (or Impala) can read the file then SAS can read it. SAS/ACCESS Interface to Hadoop has an optimization that can bypass the Hive JDBC driver and read a file directly from HDFS. AVRO is not supported by this bypass feature because SAS cannot directly read this file type. Therefore, you will want to set READ_METHOD=JDBC on your LIBNAME statement. 

Here is the relevant doc: https://go.documentation.sas.com/?cdcId=pgmsascdc&cdcVersion=9.4_3.5&docsetId=acreldb&docsetTarget=n...

Best wishes,

Jeff