Insufficient memory in proc lifetest

haoduonge — Thu, 06 Oct 2022 21:54:13 GMT

Hi all,

I run proc lifetest as below but have this error [ERROR: The SAS System stopped processing this step because of insufficient memory].

Anyone has solution?

Thank you!

PROC LIFETEST data=ALL_3 PLOTS=SURVIVAL (ATRISK=0 TO 22 BY 2);

TIME fu_time*outcome(0);

STRATA GENDER_n/TEST=LOGRANK ADJUST=SIDAK;

RUN;

Re: Insufficient memory in proc lifetest

Reeza — Thu, 06 Oct 2022 22:09:00 GMT

How big is your data set and what is the memory settings? Also, please post the full log.

*check your memory allotment for SAS;

proc options option = memsize;
run;

@haoduonge wrote:

Hi all,

I run proc lifetest as below but have this error [ERROR: The SAS System stopped processing this step because of insufficient memory].

Anyone has solution?

Thank you!

PROC LIFETEST data=ALL_3 PLOTS=SURVIVAL (ATRISK=0 TO 22 BY 2);

TIME fu_time*outcome(0);

STRATA GENDER_n/TEST=LOGRANK ADJUST=SIDAK;

RUN;

Re: Insufficient memory in proc lifetest

haoduonge — Fri, 07 Oct 2022 16:05:22 GMT

I have a big data set, about 2mil observations

Please see memory and full log below:

SAS (r) Proprietary Software Release 9.4 TS1M6

MEMSIZE=51539607552

The SAS System

1 %_eg_hidenotesandsource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGSOURCE

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGNOTES)

MPRINT(_EG_HIDENOTESANDSOURCE): options nonotes;

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGSOURCE)

MPRINT(_EG_HIDENOTESANDSOURCE): options nosource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Ending execution.

MLOGIC(_EG_RESTORENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGSOURCE

MPRINT(_EG_RESTORENOTESANDSOURCE): options NOTES;

MPRINT(_EG_RESTORENOTESANDSOURCE): options SOURCE;

MLOGIC(_EG_RESTORENOTESANDSOURCE): Ending execution.

5 %_eg_hidenotesandsource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGSOURCE

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGNOTES)

MPRINT(_EG_HIDENOTESANDSOURCE): options nonotes;

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGSOURCE)

MPRINT(_EG_HIDENOTESANDSOURCE): options nosource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Ending execution.

WARNING: Unsupported device 'ACTIVEX' for EXCEL(EGXLSSX) destination. Using device 'ACTXIMG'.

MLOGIC(_EG_RESTORENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGSOURCE

MPRINT(_EG_RESTORENOTESANDSOURCE): options NOTES;

MPRINT(_EG_RESTORENOTESANDSOURCE): options SOURCE;

MLOGIC(_EG_RESTORENOTESANDSOURCE): Ending execution.

37 ODS graphics on;

38 PROC LIFETEST data=test PLOTS=SURVIVAL (ATRISK=0 TO 22 BY 2);

39 TIME fu_time*outcome(0);

40 STRATA GENDER_n/TEST=LOGRANK ADJUST=SIDAK;

41 RUN;

NOTE: The LOGLOG transform is used to compute the confidence limits for the quartiles of the survivor

distribution. To suppress using this transform, specify CONFTYPE=LINEAR in the PROC LIFETEST statement.

ERROR: The SAS System stopped processing this step because of insufficient memory.

NOTE: PROCEDURE LIFETEST used (Total process time):

real time 8:25.97

cpu time 8:25.75

43 %_eg_hidenotesandsource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGSOURCE

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGNOTES)

MPRINT(_EG_HIDENOTESANDSOURCE): options nonotes;

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGSOURCE)

MPRINT(_EG_HIDENOTESANDSOURCE): options nosource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Ending execution.

ERROR: Event Stack Underflow. This is probably caused by mis-matched begin and end event calls.

MLOGIC(_EG_RESTORENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGSOURCE

MPRINT(_EG_RESTORENOTESANDSOURCE): options NOTES;

MPRINT(_EG_RESTORENOTESANDSOURCE): options SOURCE;

MLOGIC(_EG_RESTORENOTESANDSOURCE): Ending execution.

60 %_eg_hidenotesandsource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_HIDENOTESANDSOURCE): %GLOBAL _EGSOURCE

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGNOTES)

MPRINT(_EG_HIDENOTESANDSOURCE): options nonotes;

MLOGIC(_EG_HIDENOTESANDSOURCE): %LET (variable name is _EGSOURCE)

The SAS System

MPRINT(_EG_HIDENOTESANDSOURCE): options nosource;

MLOGIC(_EG_HIDENOTESANDSOURCE): Ending execution.

MLOGIC(_EG_RESTORENOTESANDSOURCE): Beginning execution.

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGNOTES

MLOGIC(_EG_RESTORENOTESANDSOURCE): %GLOBAL _EGSOURCE

MPRINT(_EG_RESTORENOTESANDSOURCE): options NOTES;

MPRINT(_EG_RESTORENOTESANDSOURCE): options SOURCE;

MLOGIC(_EG_RESTORENOTESANDSOURCE): Ending execution.

Re: Insufficient memory in proc lifetest

Reeza — Fri, 07 Oct 2022 16:33:04 GMT

Hmm...seems like 51GB should be enough for 2 million rows.

Try the most basic model (no Strata) and also try loading the data into memory directly using a sasfile statement initially but I'd consider checking with SAS tech support.

sasfile 'work.test' open;

proc lifetest data=test plots=survival(atrisk=0 to 22 by 2);
time fu_time * outcome(0);
run;

Re: Insufficient memory in proc lifetest

SASKiwi — Fri, 07 Oct 2022 22:54:54 GMT

If you add this option to the top of your program LIFETEST memory usage will be printed in the log:

options fullstimer;

topic Re: Insufficient memory in proc lifetest in Statistical Procedures

Insufficient memory in proc lifetest

Re: Insufficient memory in proc lifetest

Re: Insufficient memory in proc lifetest

Re: Insufficient memory in proc lifetest

Re: Insufficient memory in proc lifetest