SAS Viya CAS accessing Azure Data Lake files

[codek]

Does SAS viya supports reading parquet file from Azure data lake Gen2 (ADLS Gen2) storage?

[JosvanderVelden]

YES. In viya 3.5 and later versions. See: https://documentation.sas.com/doc/en/pgmsascdc/9.4_3.5/casref/n1ogaeli0qbctqn1e3fx8gz70lkq.htm & https://www.sas.com/content/dam/SAS/support/en/sas-global-forum-proceedings/2020/4266-2020.pdf.

[codek]

Per the link , it supports ORC and Csv file format. Does it support reading parquet files ?

[JosvanderVelden]

viya 4 does: see doc https://documentation.sas.com/doc/en/pgmsascdc/v_029/casref/p0u5p2nvqu04gfn1w3zaohdfcoys.htm and thread https://communities.sas.com/t5/SAS-Communities-Library/SAS-Viya-CAS-accessing-Azure-Blob-Storage-dat...

[codek]

Thank you. One link says it can read parquet files. Other link says HDcluster and Hive is required for SAS to read ADLS gen2 parquet files. Is hive database required for SAS  to read Parquet files from ADLS gen2 ?

[JosvanderVelden]

No, hive is not required if you are using a viya based environment. See the examples in the documentation.