How to read avro file from Hadoop in SAS DI?

Peter_Wine — Wed, 23 Sep 2020 10:41:00 GMT

Hi All,

Is it possible to read avro files from Hadoop in SAS DI?

All my trials failed. I tried "File reader" and "Hadoop File Reader".

Both doesn't work for me.

Thanks in advance,

Piotr

Re: How to read avro file from Hadoop in SAS DI?

JBailey — Wed, 23 Sep 2020 13:31:26 GMT

Hi @Peter_Wine

If Hive (or Impala) can read the file then SAS can read it. SAS/ACCESS Interface to Hadoop has an optimization that can bypass the Hive JDBC driver and read a file directly from HDFS. AVRO is not supported by this bypass feature because SAS cannot directly read this file type. Therefore, you will want to set READ_METHOD=JDBC on your LIBNAME statement.

Here is the relevant doc: https://go.documentation.sas.com/?cdcId=pgmsascdc&cdcVersion=9.4_3.5&docsetId=acreldb&docsetTarget=n1wovp3swlye3nn1xiio7nlkzw3c.htm&locale=en

Best wishes,

Jeff

topic Re: How to read avro file from Hadoop in SAS DI? in SAS Data Management

How to read avro file from Hadoop in SAS DI?

Re: How to read avro file from Hadoop in SAS DI?