Learning SAS? Welcome to the exclusive online community for all SAS learners.

accuracy of goodness of fit test

Reply
Contributor
Posts: 34

accuracy of goodness of fit test

If the data collected is classified into more number of classes, is it will improve the accuracy of goodness of fit test? why?

Super User
Posts: 10,483

Re: accuracy of goodness of fit test

You may need to define your meaning for "accuracy" for this purpose.

And the answer could well depend on the data you are testing. If the data is binomial in nature having more than 2 classes is likely to be difficult to create and/or interpret.

Contributor
Posts: 34

Re: accuracy of goodness of fit test

if i wish to test the accuracy of chi square test with more number of classes , will it improve the accruacy?

Frequent Contributor
Posts: 130

Re: accuracy of goodness of fit test

Hi koksiang.

I think a few of us are confused with the terms you've used in your original question. Reading further, it appears to me that you might be asking about the statistical power of a likelihood ratio of wald test, and how that is related to the number of discrete levels in the categorical variable that is the focus of the test.

If that is your underlying concern, increasing or decreasing the number of levels in a categorical predictor variable may or may not increase the overall fit of the model, and may or may not improve any overall model fit statistics (not that many, if any, of those have a known distribution that leads to useful tests), and can often decrease some of them (the ones that use degrees of freedom of the model to penalise the overall fit statistic). Overall fit statistics would be improved if the explanatory power of a predictor recoded with more levels was better than that of the predictor coded with fewer levels, but that does not always happen.

Does that help? Did I guess correctly?

Cheers.

Damien

N/A
Posts: 1

Re: accuracy of goodness of fit test

It depends on the number of observations being tested....should always have at least 30 samples (at least 1000 samples for research) especially if you want accurate results from the chi-square test; this way the expected numbers for each classes are more than 5. If the samples are less than above then you should probably try pooling those classes with small expected numbers or use an Exact Test method.

Ask a Question
Discussion stats
  • 4 replies
  • 414 views
  • 1 like
  • 4 in conversation