Hi all,
I am attempting to validate my logistic regression model in a large dataset.
However, it seems as if the max number of observations allowed for a calibration plot has been reached. Does anyone know how I could fix my code below. Have put error log below this.
Many thanks,
Craig
PROC LOGISTIC DATA=BIO3 PLOTS = ROC PLOTS(MAXPOINTS=NONE)
plots=calibration(CLM ShowObs);
MODEL HNC(EVENT='HNC') = PROB / ROCCI GOF OUTROC = ROC;
RUN;
NOTE: PROC LOGISTIC is modeling the probability that HNC='HNC'.
NOTE: Convergence criterion (GCONV=1E-8) satisfied.
NOTE: The number of observations of the LOESS plot (89450) exceeds the limit of 5000.
Specify the LOESSMAXOBS option of the ODS GRAPHICS statement to override the limit.
NOTE: The number of observations of the LOESS plot (89450) exceeds the limit of 5000.
Specify the LOESSMAXOBS option of the ODS GRAPHICS statement to override the limit.
NOTE: There were 89450 observations read from the data set WORK.BIO3.
NOTE: The data set WORK.ROC has 29701 observations and 8 variables.
NOTE: PROCEDURE LOGISTIC used (Total process time):
real time 10.92 seconds
cpu time 2.39 seconds
SAS pretty much told you what to do with:
Specify the LOESSMAXOBS option of the ODS GRAPHICS statement to override the limit.
That means add, or modify your current, ODS Graphics with LOESSMAXOBS=89450, or larger.
You should have an ODS Graphics On somewhere in your code for Logistic to create the plots. So perhaps add this before the Proc Logistic.
ODS Graphics on / loessmaxobs=89450;
Your log does not show any errors. Those notes are information that you requested something that exceeds normal behavior for one option. Sometimes requesting large numbers of observations for such options doesn't really improve the quality of a graph or adds significant time for little added information.
SAS pretty much told you what to do with:
Specify the LOESSMAXOBS option of the ODS GRAPHICS statement to override the limit.
That means add, or modify your current, ODS Graphics with LOESSMAXOBS=89450, or larger.
You should have an ODS Graphics On somewhere in your code for Logistic to create the plots. So perhaps add this before the Proc Logistic.
ODS Graphics on / loessmaxobs=89450;
Your log does not show any errors. Those notes are information that you requested something that exceeds normal behavior for one option. Sometimes requesting large numbers of observations for such options doesn't really improve the quality of a graph or adds significant time for little added information.
Hey Ballard,
Thanks for the help - that did it.
It did run for an hour and a half but lacked memory due to the size. May need to consult with colleuages r.e a more powerful computer.
Cheers
🙂
Depending on how/where you are running SAS software, there are invocation options that could allocate more memory to your SAS session!
Registration is open! SAS is returning to Vegas for an AI and analytics experience like no other! Whether you're an executive, manager, end user or SAS partner, SAS Innovate is designed for everyone on your team. Register for just $495 by 12/31/2023.
If you are interested in speaking, there is still time to submit a session idea. More details are posted on the website.
Learn the difference between classical and Bayesian statistical approaches and see a few PROC examples to perform Bayesian analysis in this video.
Find more tutorials on the SAS Users YouTube channel.