Using SAS to read Parquet File in Hadoop without hive table

[cstegeman]

There is a parquet file in our hadoop cluster without a hive table built on top of it. 

 - Is there something I can do to read it into SAS without requiring someone to build a hive table on top of it?

 - Is there some way to access the table with Spark through SAS (kind of like pyspark)?

[ChrisNZ · Accepted solution]

1. There is no native way to read the parquet format in SAS as far as I know.

2. Access to Spark is supported with SAS Viya. See https://support.sas.com/en/documentation/third-party-software-reference/viya/34/support-for-database...

[LinusH]

Why not building Hive metadata on top of it. Seems easiest if you wish to use it using relational language like SAS.
With Hive, you can access the file using Impala (which uses Spark).

[cstegeman]

I was hoping for an alternative to hive - I didn't have permissions to create a hive table in that environment. Also Hive is slower than PySpark.

[ChrisNZ]

Impala can be much faster than Hive and supports parquet.