BookmarkSubscribeRSS Feed

Currently when SAS reads and writes parquet data files via the libname parquet engine labels are dropped and thus cannot be restored when the file is read back in.  Parquet though supports arbitrary metadata storage in the file header.  

 

The suggestion here would be for SAS to store column labels in the parquet metadata and then retrieve and restore them when reading the file back in. 

 

For reference the R arrow::write_parquet() function already does this by storing R specific attributes in the "R" field of the parquet files metadata. 

1 Comment
ChrisNZ
Tourmaline | Level 20

That seems like such an obvious feature and hints of a rushed developement.