SAS Data Integration Studio, DataFlux Data Management Studio, SAS/ACCESS, SAS Data Loader for Hadoop and others

How to compress a .csv using Dataflux

Reply
Occasional Contributor
Posts: 11

How to compress a .csv using Dataflux

I am trying to FTP a .csv using the DataFux Emai/FTP node.  I am getting an error  [2:COMMAND:Email and FTP 2] Out of memory!

The file is 76,831 kb.   I would like to comepress it within the dataflux job before the FTP node.  Anyone know how to do this?

SAS Super FREQ
Posts: 97

Re: How to compress a .csv using Dataflux

Posted in reply to MikeToole

Hi,

 

You can use the execute() function in an Expression node to make a command line call to a compression/ZIP utility before making the call to the Email/FTP node. There are also "Execute Program" nodes that might meet your needs though they are set up to facilitate passing data into and out of external programs.

 

Ron

Occasional Contributor
Posts: 11

Re: How to compress a .csv using Dataflux

Posted in reply to RonAgresta

I have tried that, but can not get the syntax correct for the gzip.  I get file not found when i is there, see below.  Also, I am putting this aon a Shared drive in window, so how do I uncompress it in windows?

 

Command: gzip apps/dataflux/temp/OUTPUT/reports/vf_arcadia_vitals_file1.csv
apps/dataflux/temp/OUTPUT/reports/vf_arcadia_vitals_file1.csv: No such file or directory
0 rows read

Occasional Contributor
Posts: 11

Re: How to compress a .csv using Dataflux

Posted in reply to MikeToole

i needed a  / in front of apps   it works now, and FTP'ed  but how to I open a  .csv.gz file on that windows shared drive?

Ask a Question
Discussion stats
  • 3 replies
  • 301 views
  • 0 likes
  • 2 in conversation