I am developing a prediction model with a logistic regression by using SASEnterprise Miner. The original sample (N=342) only has 16 target “1” category,which corresponds to 4,7% (16/342) of the observations. To handle theimbalanced sample and the rare events issue, at the sample general propertypanel, for the level based option I set sample proportion as 50.0. Hence I endup with a sample containing 32 observations (16 observations for target “1”category and 16 observations for the target “0” category), which I used todeveloped the prediction model.
However my PhD Adviser is concern because “the occurrence probability from the scoring is not the one that predicts correctly for the originaldistribution, it is the one that predicts correctly for the oversampled set”.For my PhD thesis stand point of view, I must provide references that thismethodology “oversampling” approach is legible.
Frankly, I'd be worried about the stability of any logistic regression model that had only 16 outcomes. Harrell states that one needs 10-20 outcomes per candidate predictor variable (e.g. degree of freedom).
[ http://biostat.mc.vanderbilt.edu/wiki/Main/RmS#REGRESSION_MODELING_STRATEGIES ]
With that rule of thumb, you could only consider one variable.
Doc Muhlbaier
Duke
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Learn how use the CAT functions in SAS to join values from multiple variables into a single value.
Find more tutorials on the SAS Users YouTube channel.