Using SAS to connect to Dremio in Big Data

[cstegeman]

We are exploring ways to pull data from Hive tables into SAS using Dremio.  Dremio is a SQL execution engine in hadoop that uses Apache Arrow, Apache Parquet, and Apache Calcite to speed up  SQL queries.  We are looking to leverage this technology using our existing SAS processes using a proc sql; connect to statement and using pass-through SQL.

Dremio does have a Linux ODBC driver (which we exploring with SAS/Access to ODBC in our Linux environment), but I am looking for options to connect from a UNIX AIX environment. Dremio does have a JDBC driver - is there a way to use that driver to connect to the Dremio engine? 

Has anyone else had luck connecting SAS to Dremio?  Any other suggestions?

[ChrisNZ]

I never used this but it looks promising.

https://documentation.sas.com/?docsetId=acreldb&docsetTarget=p0ly2onqqpbys8n1j9lra8qa6q20.htm&docset...

[IBLANCO]

Hi,

I hope you succeeded in your connection! 🙂

We are also currently trying to connect SAS to DREMIO.

1) Via ODBC WIndows (local client), it works to consult the data via LIBNAME in ENTERPRISE GUIDE. all columns/data is retrieved and displayed.

2) On the other hand, on LINUX, we installed the driver, defined server/connection/library, that part is OK.

We are having issues to refresh the metadata via SAS MC, the table names are selectable, but once your launch the refresh of the metadata, we get the following error message:

"ERROR: CLI prepare error: [Dremio][Connector] (1040) Dremio failed to execute the query: SELECT * FROM
TESTTABLE [30038]Query execution error. Details:[ PARSE ERROR: Failure parsing the query. "

Information/suggestions are more than welcome!

Regards,

Ignacio

[saggi2k15]

Hi IBLANCO,

Can you share your libname connection definition to connect to the Dremio? 

We are doing something similar and your help will give us a good start.

Thanks

Saurabh