Importing parquet files using SAS9.4

[HeidiDT]

Hi All

One of our teams is working on data that must be used in marketing campaigns using SAS CI Studio. The output they produce is stored in parquet files. I need to import that data into SAS using SAS 9.4. Based on my research, it looks like we will need SAS/ACCESS interface to ODBC. I would just like to confirm that this is the only way before I request that (cost implication).

Many thanks!

[LinusH]

Its' my understandning as well that Parquet files are not supported in 9.4 "ootb".

They are however supported in Viya.

Before investing, contact your SAS sales representative and virify your use case. You also need to verify that the ODBS driver of choice can work with Parquet fies in your infrastructure setup.

[Patrick]

Based on what I can find on the Internet here it looks like this could work. As @LinusH suggested I would first confirm with SAS before you spend money and effort on this.

Another option would be to store this Parquet file in an environment that can read the Parquet file and that you can access via a SAS Access engine that's licensed at your site. I've worked for example in the past with Parquet files stored under Hadoop that we could access via SAS Access to Hadoop and SAS Access to Impala.

[HeidiDT]

Thanks for the replies!! I am working on a solution to import the data to a pandas dataframe and then creating a SAS dataset (Python). Still struggling with it, but for now that is the way I am going 🙂

[Patrick · Accepted solution]

---

@HeidiDT wrote:

Thanks for the replies!! I am working on a solution to import the data to a pandas dataframe and then creating a SAS dataset (Python). Still struggling with it, but for now that is the way I am going 🙂

---

Yep, that should work as well and shouldn't be too hard as long as you have SAS and Python on the same machine (which is often the case). 

Using chatGPT with prompt "python read parquet write sas file" returned code and instructions that looked right to me.