topic Using SAS to connect to Dremio in Big Data in SAS Programming

Using SAS to connect to Dremio in Big Data

cstegeman — Mon, 05 Nov 2018 19:38:11 GMT

We are exploring ways to pull data from Hive tables into SAS using Dremio. Dremio is a SQL execution engine in hadoop that uses Apache Arrow, Apache Parquet, and Apache Calcite to speed up SQL queries. We are looking to leverage this technology using our existing SAS processes using a proc sql; connect to statement and using pass-through SQL.

Dremio does have a Linux ODBC driver (which we exploring with SAS/Access to ODBC in our Linux environment), but I am looking for options to connect from a UNIX AIX environment. Dremio does have a JDBC driver - is there a way to use that driver to connect to the Dremio engine?

Has anyone else had luck connecting SAS to Dremio? Any other suggestions?

Re: Using SAS to connect to Dremio in Big Data

ChrisNZ — Mon, 05 Nov 2018 20:13:53 GMT

I never used this but it looks promising.

https://documentation.sas.com/?docsetId=acreldb&docsetTarget=p0ly2onqqpbys8n1j9lra8qa6q20.htm&docsetVersion=9.4&locale=en

Re: Using SAS to connect to Dremio in Big Data

IBLANCO — Wed, 04 Sep 2019 10:16:12 GMT

Hi,

I hope you succeeded in your connection! 🙂

We are also currently trying to connect SAS to DREMIO.

1) Via ODBC WIndows (local client), it works to consult the data via LIBNAME in ENTERPRISE GUIDE. all columns/data is retrieved and displayed.

2) On the other hand, on LINUX, we installed the driver, defined server/connection/library, that part is OK.

We are having issues to refresh the metadata via SAS MC, the table names are selectable, but once your launch the refresh of the metadata, we get the following error message:

"ERROR: CLI prepare error: [Dremio][Connector] (1040) Dremio failed to execute the query: SELECT * FROM
TESTTABLE [30038]Query execution error. Details:[ PARSE ERROR: Failure parsing the query. "

Information/suggestions are more than welcome!

Regards,

Ignacio

Re: Using SAS to connect to Dremio in Big Data

saggi2k15 — Tue, 21 Jan 2020 17:43:13 GMT

Hi IBLANCO,

Can you share your libname connection definition to connect to the Dremio?

We are doing something similar and your help will give us a good start.

Thanks

Saurabh