topic Re: Issue with ds2csv utility in SAS Programming

Issue with ds2csv utility

Sathya3 — Mon, 30 Oct 2023 17:05:57 GMT

%let out=/sas/output/file_name.csv;

filename dest hadoop "&out";

%ds2csv(data=input_table,labels=N,runmode=b,csvfile=out);

I have to create a csv file from dataset by only using ds2csv

log shows csv successfully generated but I am not able to find it in specified hadoop destination folder.

macro variable out is getting resolved correctly

should i not give csvfile=libref in ds2csv utility. What is the issue?

Re: Issue with ds2csv utility

Amir — Mon, 30 Oct 2023 17:13:49 GMT

Hi,

Have you tried using dest as your last argument, e.g.:

%ds2csv(data=input_table,labels=N,runmode=b,csvfile=dest);

If this does not help then please share the log.

Thanks & kind regards,

Amir.

Edit: Replaced out with dest.

Re: Issue with ds2csv utility

Sathya3 — Mon, 30 Oct 2023 17:16:01 GMT

There is a small typing mistake in the code I have posted.

csvfile=dest in ds2csv
( not csvfile=out)

Re: Issue with ds2csv utility

Amir — Mon, 30 Oct 2023 17:19:48 GMT

Hi,

Try using another parameter csvfref=dest (in place of csvfile=dest):

%ds2csv(data=input_table,labels=N,runmode=b,csvfref=dest);

Thanks & kind regards,

Amir.

Re: Issue with ds2csv utility

Tom — Mon, 30 Oct 2023 17:24:18 GMT

Can you write to the HADOOP area just using a simple a data step? For example try making a file with 3 columns and one row of data.

data _null_;
  file dest dsd;
  put 'a,b,c';
  put '1,2,3';
run;

If so then the issue is how %DS2CSV() is writing the file.

Can you just use PROC EXPORT instead to write the CSV file to HADOOP?

proc export data=input_table file=dest dbms=csv;
run;

Re: Issue with ds2csv utility

Kurt_Bremser — Mon, 30 Oct 2023 17:34:54 GMT

You must use the correct macro variable reference:

%ds2csv(data=input_table,labels=N,runmode=b,csvfile=&out.)

The documentation of the macro can be found here

Re: Issue with ds2csv utility

Tom — Mon, 30 Oct 2023 17:44:02 GMT

@Kurt_Bremser wrote:

You must use the correct macro variable reference:
%ds2csv(data=input_table,labels=N,runmode=b,csvfile=&out.)
The documentation of the macro can be found here

So that document say:

csvfile=external-filename

specifies the name of the CSV file where the formatted output is to be written. If the file that you specify does not exist, then it is created for you.

Note Do not use the CSVFILE argument if you use the CSVFREF argument.

Note	Do not use the CSVFILE argument if you use the CSVFREF argument.

csvfref=fileref

specifies the SAS fileref that points to the location of the CSV file where the formatted output is to be written. If the file that you specify does not exist, then it is created for you.

Note Do not use the CSVFREF argument if you use the CSVFILE argument.

Note	Do not use the CSVFREF argument if you use the CSVFILE argument.

So if they want to use the fileref DEST to write to HADOOP that was defined using the &OUT macro then they need to use CSVFREF parameter instead of CSVFILE parameter.

%ds2scv(...csvfref=dest)

topic Re: Issue with ds2csv utility in SAS Programming

Issue with ds2csv utility

Re: Issue with ds2csv utility

Re: Issue with ds2csv utility

Re: Issue with ds2csv utility

Re: Issue with ds2csv utility

Re: Issue with ds2csv utility

Re: Issue with ds2csv utility

csvfile=external-filename

csvfref=fileref