topic Re: error with proc report in SAS Programming

error with proc report

walterwang — Wed, 16 Dec 2020 04:12:05 GMT

I am using Proc report to generate a report.

the obs=644776.

I have error messages:

ERROR: The SAS System stopped processing this step because of insufficient memory.
NOTE: There were 644776 observations read from the data set WORK.TEMP.
NOTE: PROCEDURE REPORT used (Total process time):
      real time           2:27.35
      user cpu time       2:09.94
      system cpu time     17.51 seconds
      memory              8707369.07k
      OS Memory           10485596.00k
      Timestamp           16/12/2020 03:05:28 PM
      Step Count                        25 Switch Count 41
      Page Faults                       2
      Page Reclaims                     6874226
      Page Swaps                        0
      Voluntary Context Switches        1321
      Involuntary Context Switches      577
      Block Input Operations            40
      Block Output Operations           63184

What can I do?

ods select all;
ods results off;
options missing="0";
ods excel file="/d/results1512.xlsx"

options (embedded_titles = 'no' embedded_footnotes='no' title_footnote_nobreak='off'
sheet_interval="table" sheet_name="RTO");
title "";

proc report data=temp;
columns foe GNF17 GF17;

define foe/ display "field of education" format=$grp. ;
define GNF17/ "2017 Non" format=comma7.;
define GF17/ "2017 yes" format=comma7.;

run;

Re: error with proc report

ChrisNZ — Wed, 16 Dec 2020 04:56:57 GMT

Are you really trying to create a report with 600,000 lines?

Re: error with proc report

andreas_lds — Wed, 16 Dec 2020 06:03:05 GMT

I don't think that proc reports is responsible for the out-of-memory error, but ods excel. Try using proc export with the label-option instead.

Re: error with proc report

ChrisNZ — Wed, 16 Dec 2020 06:07:54 GMT

I'm pretty sure a half million row report will easily run out of memory.

Re: error with proc report

Kurt_Bremser — Wed, 16 Dec 2020 07:24:31 GMT

At the time of the memory failure, your SAS process consumed 10G of RAM, and I suspect you ran into a limit set (wisely) by the SAS admin.

Use PROC EXPORT, as suggested. Or write your data to a csv file, which does not need to have all the XML data ready before running the zip.

Re: error with proc report

walterwang — Thu, 17 Dec 2020 00:16:26 GMT

Using CSV file, it works. But there is another issue. there is uni_code. They can be 0011, 0008.
using EXCEL. all good. But using CSV file, they becoem 11,8 etc.

Re: error with proc report

Tom — Thu, 17 Dec 2020 04:07:17 GMT

Why would writing UTF-8 characters have any impact on writing a text file?

Here is a simple method to create a CSV file from a dataset. If you need a header line make that line first and use the MOD option on the FILE statement in the step that writes the data.

data _null_;
  set have;
   file 'mydata_noheader.csv' dsd ;
   put (_all_) (+0);
run;