BookmarkSubscribeRSS Feed
☑ This topic is solved. Need further help from the community? Please sign in and ask a new question.
SASWayne
Quartz | Level 8

Hello Experts,

 

Can SAS 9.4M7 access delta tables from Azure delta lake?

 

if yes to the above question, could someone help me with steps or documentation to establish SAS and delta lake connectivity please?

 

Thanks in advance!

1 ACCEPTED SOLUTION

Accepted Solutions
SASWayne
Quartz | Level 8

We were able to achieve this using Databricks through ODBC. Also, there was hint from SAS TS that support to read Parquet files might be available from SAS 9.4M8. If it happens, hopefully we should be able to directly access Delta lake.

Steps,

1. Installed ODBC Driver Manager

2. Installed ODBC Driver for Databricks.

3. Added DSN information into odbc.ini

4. Added ODBCINI env variable into <sashome>/SASFoundation/9.4/bin/sasenv_local

5. Validated the connection using isql command.

6. Setup DB connectivity at SAS Metadata and other stuff and tested connectivity from SAS clients. 

View solution in original post

6 REPLIES 6
SASKiwi
PROC Star

I assume you mean Azure Data Lake? AFAIK, ADL is a "souped up" version of Microsoft SQL Server. So most likely you will need either SAS/ACCESS to SQL Server or SAS/ACCESS to ODBC or JDBC. Do you have any of these? Do you want to connect from a server or a PC install of SAS?

SASWayne
Quartz | Level 8

Good day @SASKiwi - Thanks for responding!

 

I mean Azure Delta lake....

for reference - https://docs.microsoft.com/en-us/azure/databricks/delta/

and https://delta.io/

 

We do have SAS/ACCESS to ODBC licensed and trying to set this up on SAS 9.4M7 grid environment (Linux) hosted on Azure.

 

What I understood about delta lake is that delta tables stored in delta lakes are read and transformed by interfaces such as Azure Databricks, Apache Spark, Azure Synapse etc., I'm wondering if SAS could do the same as these Interfaces.

SASKiwi
PROC Star

OK, in theory SAS/ACCESS to ODBC should work. I suspect you need the Databricks ODBC driver which you can download here: https://docs.microsoft.com/en-us/azure/databricks/integrations/bi/jdbc-odbc-bi

 

You might want to open a Tech Support track to confirm requirements and configuration.

SASWayne
Quartz | Level 8
Same thoughts here! I was going through the below.
https://databricks.com/blog/2022/03/16/how-to-speed-up-data-flow-between-databricks-and-sas.html

I'll keep this thread open and add the steps here after establishing connectivity. thank you for looking into this!
shoin
Lapis Lazuli | Level 10
Interesting. I was wondering if Azure Synapse is could be connected from SAS using SAS ACCESS/SQL SERVER. I will give it a try and post what I found.

-S
SASWayne
Quartz | Level 8

We were able to achieve this using Databricks through ODBC. Also, there was hint from SAS TS that support to read Parquet files might be available from SAS 9.4M8. If it happens, hopefully we should be able to directly access Delta lake.

Steps,

1. Installed ODBC Driver Manager

2. Installed ODBC Driver for Databricks.

3. Added DSN information into odbc.ini

4. Added ODBCINI env variable into <sashome>/SASFoundation/9.4/bin/sasenv_local

5. Validated the connection using isql command.

6. Setup DB connectivity at SAS Metadata and other stuff and tested connectivity from SAS clients. 

suga badge.PNGThe SAS Users Group for Administrators (SUGA) is open to all SAS administrators and architects who install, update, manage or maintain a SAS deployment. 

Join SUGA 

Get Started with SAS Information Catalog in SAS Viya

SAS technical trainer Erin Winters shows you how to explore assets, create new data discovery agents, schedule data discovery agents, and much more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 6 replies
  • 4822 views
  • 5 likes
  • 3 in conversation