topic Re: SAS Viya CAS accessing Azure Data Lake files in SAS Programming

SAS Viya CAS accessing Azure Data Lake files

codek — Thu, 28 Jul 2022 14:15:22 GMT

Does SAS viya supports reading parquet file from Azure data lake Gen2 (ADLS Gen2) storage?

Re: SAS Viya CAS accessing Azure Data Lake files

JosvanderVelden — Sun, 31 Jul 2022 09:04:05 GMT

YES. In viya 3.5 and later versions. See: https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/casref/n1ogaeli0qbctqn1e3fx8gz70lkq.htm & https://www.sas.com/content/dam/SAS/support/en/sas-global-forum-proceedings/2020/4266-2020.pdf.

Re: SAS Viya CAS accessing Azure Data Lake files

codek — Mon, 01 Aug 2022 04:01:08 GMT

Per the link , it supports ORC and Csv file format. Does it support reading parquet files ?

Re: SAS Viya CAS accessing Azure Data Lake files

JosvanderVelden — Tue, 02 Aug 2022 07:49:27 GMT

viya 4 does: see doc https://documentation.sas.com/doc/en/pgmsascdc/v_029/casref/p0u5p2nvqu04gfn1w3zaohdfcoys.htm and thread https://communities.sas.com/t5/SAS-Communities-Library/SAS-Viya-CAS-accessing-Azure-Blob-Storage-data-files-via/ta-p/706324

Re: SAS Viya CAS accessing Azure Data Lake files

codek — Tue, 02 Aug 2022 10:38:40 GMT

Thank you. One link says it can read parquet files. Other link says HDcluster and Hive is required for SAS to read ADLS gen2 parquet files. Is hive database required for SAS to read Parquet files from ADLS gen2 ?

Re: SAS Viya CAS accessing Azure Data Lake files

JosvanderVelden — Wed, 03 Aug 2022 09:00:26 GMT

No, hive is not required if you are using a viya based environment. See the examples in the documentation.