BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
Juan2012
Calcite | Level 5

According with Akaike 1974 and many textbooks the best AIC is the minor value. However, I am still not clear what happen with the negative values. Some said that the minor value (the more negative value) is the best. However, other said that the value closer to zero, this means the minor absolute value, is the best.

Someone could help me with this doubt? Will be great if you could give a quote. I only have found answers in both directions in blogs

Thanks,

Juan

1 ACCEPTED SOLUTION

Accepted Solutions
1zmm
Quartz | Level 8

The magnitude of AIC for a specific model is less of interest than the comparison of AICs for two or more models because AIC is usually used in the context of comparing models, not as an absolute criterion in itself.   Thus, your question is irrelevant in this context because it asks about a "best" AIC value.  The usual "rule" for comparing two or more models is to choose the one with the minimum AIC value.  This minimum value may or may not be negative.  For example, in multiple linear regression, the AIC value is estimated as

     N*ln(error-sum-of-squares/N) + 2*(number of independent variable parameters including the intercept term),

        where N=the number of observations.

If a model were so good that it (almost) perfectly predicted the dependent variable, the error-sum-of squares would approach zero,

and the natural logarithm of this value and the AIC would approach negative infinity.  Thus, the better the independent variables of this linear regression model are in predicting the dependent variable, the more negative the AIC becomes.  However, this "asymptotic" behavior is less important to the usefulness of AIC than the comparison of the AIC values of different models.  Smaller AIC values are better when comparing two or more models.

View solution in original post

4 REPLIES 4
1zmm
Quartz | Level 8

The magnitude of AIC for a specific model is less of interest than the comparison of AICs for two or more models because AIC is usually used in the context of comparing models, not as an absolute criterion in itself.   Thus, your question is irrelevant in this context because it asks about a "best" AIC value.  The usual "rule" for comparing two or more models is to choose the one with the minimum AIC value.  This minimum value may or may not be negative.  For example, in multiple linear regression, the AIC value is estimated as

     N*ln(error-sum-of-squares/N) + 2*(number of independent variable parameters including the intercept term),

        where N=the number of observations.

If a model were so good that it (almost) perfectly predicted the dependent variable, the error-sum-of squares would approach zero,

and the natural logarithm of this value and the AIC would approach negative infinity.  Thus, the better the independent variables of this linear regression model are in predicting the dependent variable, the more negative the AIC becomes.  However, this "asymptotic" behavior is less important to the usefulness of AIC than the comparison of the AIC values of different models.  Smaller AIC values are better when comparing two or more models.

Juan2012
Calcite | Level 5

Thanks for your response. May be my question was not too clear.

Yes, understand there is not a best AIC value. I was asking if the have two or more negative AIC, What model I need to choice?

Following your example I understand that with the more negative AIC.

SteveDenham
Jade | Level 19

1zmm has given all you need: Smaller IC values are better when comparing models.  It makes no difference that the actual value is negative.  Suppose the first model you are considering has an AIC of -1000, while the second has an AIC of -950.  The first model has the smaller AIC, and fits your data better.

Steve Denham

Juan2012
Calcite | Level 5

Thanks Steve, I forgot to close the question

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 4 replies
  • 39047 views
  • 5 likes
  • 3 in conversation