topic Re: using proc report to write very large CSV file in New SAS User

using proc report to write very large CSV file

walterwang — Thu, 13 Apr 2023 09:30:18 GMT

it is very very slow.

ODS CSV file="/ww/list.csv";
proc report data=temp;
columns customer_id;

define customer_id/display " customer_id";

run;
ODS CSV close;

any help?

Re: using proc report to write very large CSV file

Kurt_Bremser — Thu, 13 Apr 2023 09:49:58 GMT

Why so complicated?

data _null_;
set temp;
file "/ww/list.csv";
if _n_ = 1 then put "customer_id";
put customer_id;
run;

No ODS or any output-creating procedure involved.

Re: using proc report to write very large CSV file

walterwang — Thu, 13 Apr 2023 10:09:06 GMT

It is a very big file. a lot of columns. I want to use format to control the output.

Re: using proc report to write very large CSV file

Kurt_Bremser — Thu, 13 Apr 2023 10:19:25 GMT

You can use formats in the data step; alternatively, PROC EXPORT will create DATA step code for you.

Re: using proc report to write very large CSV file

PaigeMiller — Thu, 13 Apr 2023 10:21:30 GMT

Data steps still work with lots of variables, you can use formats and control the output. PROC EXPORT works, assign formats in the DATA step. Also, ODS CSV plus PROC PRINT works.

PROC REPORT is designed to make complicated reports, not appropriate for CSV files.

Re: using proc report to write very large CSV file

Tom — Thu, 13 Apr 2023 13:33:45 GMT

@walterwang wrote:
It is a very big file. a lot of columns. I want to use format to control the output.

You need to provide a better example of your code then. How many observations in the dataset? How many variables?

What do you mean by "use format"?

A CSV file has no "format". It is just a text file.

Normal CSV file generation will use the formats attached to the variables to display the values. If you want to display some of the values with a different format than is what is normally attached to the variable then perhaps you could just write the CSV with a data step and include a FORMAT statement in the data step.

Re: using proc report to write very large CSV file

walterwang — Fri, 14 Apr 2023 04:54:00 GMT

use data steps to format the output. for example, date9. for date. use label to control the output name.

proc export data=temp1
outfile="/ww/list.csv"
label dbms=csv
replace;
run;

for 1G output, it only need minutes. which use proc report need two hours.