BookmarkSubscribeRSS Feed
jjjunyi
Calcite | Level 5

Hey all,

 

so if i am using a multinominal procedure (proc logistic with Class), how shall i test the goodness of fit? i suppose they are not the same as the binary logistic regression (i.e., AUC, BIC,Breier Score).

 

so any ideas on that?

4 REPLIES 4
PGStats
Opal | Level 21

Make sure you understand what the model is, i.e. how to interpret the estimates of logistic multinomial regression (when the response is not binomial). The model fitting information is described in the Model fitting information section of the Logistic Procedure documentation. It applies to binomial and multinomial models.

 

 

PG
jjjunyi
Calcite | Level 5

could you give me some example for that?

StatDave
SAS Super FREQ

Note that the presence of the CLASS statement does not make the model a multinomial model. In PROC LOGISTIC, the model is a multinomial model if the response variable has more than two distinct values. Further, a multinomial model can be a ordinal or nominal multinomial model depending on whether the multiple levels of the response have a natural ordering or not. PROC LOGISTIC fits an ordinal model by default (using cumulative logits) when there is a multilevel response. If the response level are not ordered, then the LINK=GLOGIT option in the MODEL statement can be specified to fit a nominal multinomial model. 

 

Now to your question. As with the binary logistic model, you can use the SCALE=NONE and AGGREGATE options in the MODEL statement to obtain Pearson and deviance statistics which are valid goodness of fit tests only if there is sufficient replication within the subpopulations defined by the distinct covariate patterns in the data. For purposes of comparing competing models you can use the R-square statistic available with the RSQUARE option in the MODEL statement. Also for comparing models, you could use the AIC and SC statistics which are provided by default. Of course, you can always save predicted probabilities from the model using the PREDPROBS=INDIVIDUAL option in the OUTPUT statement. Similarly, you can score a new set of data and save predicted probabilities using the SCORE statement.  See the example titled "Scoring Data Sets" in the LOGISTIC documentation. 

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!

Submit your idea!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 4 replies
  • 1664 views
  • 3 likes
  • 3 in conversation