03-29-2016 09:51 AM
When the ratio of success (event of interest occurring) in the regressed dataset is extremely low, one could upsample it, i.e. choose all successes and only a portion of the non-success, to increase the ratio of success in the regressed sample. To do logistic regression on the new sample, a weight variable or the ‘offset=’ option should be used, and doing a regular logistic with the upsampled dataset will give incorrect estimates. My questions regarding this are:
1. When using an offset variable, this webpage defines the way this variable should be defined. Is this is the only ‘correct’ way to specify it?
‘Or, to adjust by using an offset, add a variable to your data set defined as log[(r1*(1-p1)) / ((1-r1)*p1)], where log represents the natural logarithm. Specify this variable in the OFFSET= option of the MODEL statement in PROC LOGISTIC.’
Also, if the offset variable is a constant (as is the case above), isn’t this regression equivalent to one without using offset variable? The only nominal difference would be in the one with offset, the intercept plus offset (who is forced to have coefficient of 1) is equal to the intercept of the plain logistic regression without offset. The coefficients on independent variables would still be the same, as would the overall fit. I tried it in SAS and it seems to be the case. If this is so, what’s the point of using an offset variable?
2. When using ‘weight’, how is the weight variable specified exactly? What’s the consequence of using a weight variable in logistic regression on the original dataset that’s not upsampled?
3. I haven’t seen anywhere that uses both weight and offset together, what happens if you use them both? Does it render the regression incorrect or is it just unnecessary?
4. If I run logistic regression with weight or offset, save the regression results with ‘outmodel=mymodel’ option. Then I do scoring on a new dataset (untreated, no upsampling, etc.) with ‘proc logistic inmodel=mymodel’, what precautions should be taken to produce the correct probability scores?
I am sorry that’s a lot of questions. Thank you so much.
03-29-2016 10:41 PM
"When the ratio of success (event of interest occurring) in the regressed dataset is extremely low" That would lead you to Possion or Negative Binomial Regression Model . Logistic link function : log(p/1-p) when p~0 ==> log(p) which is Possion Regression Model. Check this : http://support.sas.com/kb/24/188.html