topic Re: How to compress a .csv using Dataflux in SAS Data Management

How to compress a .csv using Dataflux

MikeToole — Fri, 26 Aug 2016 19:05:59 GMT

I am trying to FTP a .csv using the DataFux Emai/FTP node. I am getting an error [2:COMMAND:Email and FTP 2] Out of memory!

The file is 76,831 kb. I would like to comepress it within the dataflux job before the FTP node. Anyone know how to do this?

Re: How to compress a .csv using Dataflux

RonAgresta — Tue, 30 Aug 2016 12:22:38 GMT

Hi,

You can use the execute() function in an Expression node to make a command line call to a compression/ZIP utility before making the call to the Email/FTP node. There are also "Execute Program" nodes that might meet your needs though they are set up to facilitate passing data into and out of external programs.

Ron

Re: How to compress a .csv using Dataflux

MikeToole — Tue, 30 Aug 2016 12:36:27 GMT

I have tried that, but can not get the syntax correct for the gzip. I get file not found when i is there, see below. Also, I am putting this aon a Shared drive in window, so how do I uncompress it in windows?

Command: gzip apps/dataflux/temp/OUTPUT/reports/vf_arcadia_vitals_file1.csv
apps/dataflux/temp/OUTPUT/reports/vf_arcadia_vitals_file1.csv: No such file or directory
0 rows read

Re: How to compress a .csv using Dataflux

MikeToole — Tue, 30 Aug 2016 13:15:35 GMT

i needed a / in front of apps it works now, and FTP'ed but how to I open a .csv.gz file on that windows shared drive?