topic Re: Maximum Number of Observations Calibration Plot Fix in SAS Procedures

Maximum Number of Observations Calibration Plot Fix

CraigSmith — Tue, 30 May 2023 17:28:15 GMT

Hi all,

I am attempting to validate my logistic regression model in a large dataset.

However, it seems as if the max number of observations allowed for a calibration plot has been reached. Does anyone know how I could fix my code below. Have put error log below this.

Many thanks,

Craig

PROC LOGISTIC DATA=BIO3 PLOTS = ROC PLOTS(MAXPOINTS=NONE)
plots=calibration(CLM ShowObs);
MODEL HNC(EVENT='HNC') = PROB / ROCCI GOF OUTROC = ROC;
RUN;

NOTE: PROC LOGISTIC is modeling the probability that HNC='HNC'.
NOTE: Convergence criterion (GCONV=1E-8) satisfied.
NOTE: The number of observations of the LOESS plot (89450) exceeds the limit of 5000.
Specify the LOESSMAXOBS option of the ODS GRAPHICS statement to override the limit.
NOTE: The number of observations of the LOESS plot (89450) exceeds the limit of 5000.
Specify the LOESSMAXOBS option of the ODS GRAPHICS statement to override the limit.
NOTE: There were 89450 observations read from the data set WORK.BIO3.
NOTE: The data set WORK.ROC has 29701 observations and 8 variables.
NOTE: PROCEDURE LOGISTIC used (Total process time):
real time 10.92 seconds
cpu time 2.39 seconds

Re: Maximum Number of Observations Calibration Plot Fix

ballardw — Tue, 30 May 2023 22:28:08 GMT

SAS pretty much told you what to do with:

Specify the LOESSMAXOBS option of the ODS GRAPHICS statement to override the limit.

That means add, or modify your current, ODS Graphics with LOESSMAXOBS=89450, or larger.

You should have an ODS Graphics On somewhere in your code for Logistic to create the plots. So perhaps add this before the Proc Logistic.

ODS Graphics on / loessmaxobs=89450;

Your log does not show any errors. Those notes are information that you requested something that exceeds normal behavior for one option. Sometimes requesting large numbers of observations for such options doesn't really improve the quality of a graph or adds significant time for little added information.

Re: Maximum Number of Observations Calibration Plot Fix

CraigSmith — Wed, 31 May 2023 11:00:27 GMT

Hey Ballard,

Thanks for the help - that did it.

It did run for an hour and a half but lacked memory due to the size. May need to consult with colleuages r.e a more powerful computer.

Cheers

🙂

Re: Maximum Number of Observations Calibration Plot Fix

AhmedAl_Attar — Wed, 31 May 2023 11:12:24 GMT

Depending on how/where you are running SAS software, there are invocation options that could allocate more memory to your SAS session!

Command Line: sas -memsize 6G
Windows Shortcut: Target: "[somePath\]sas.exe" "[somePath\]sasv9.cfg" -memsize 6G
Enterprise Guide connecting to Server ---> Talk to your SAS system administrator 🙂