topic Re: sas eminer - help on a method for increasing sampling in SAS Data Science

sas eminer - help on a method for increasing sampling

Prajna_450 — Mon, 29 Jan 2018 05:15:50 GMT

Problem – I have a data set where we have a few independent variables that are highly predictive but their frequency is low. An example is claims where claimants are diagnosed with mood disorders (less than 5% of the claimants) but among these 5% of the claimant the probability that the claim will be litigated is very high (> 30%). If you go through the variable selection exercise, the methods are dropping the independent variable as they are low frequency. In such a scenario, what is typically done to make sure that we do not lose this highly predictive variable?

I have a feeling that oversampling is an approach, but i need an explanation even if I am correct.

Thank you,

Prajna

Re: sas eminer - help on a method for increasing sampling

MikeStockstill — Mon, 29 Jan 2018 14:24:45 GMT

Hello Prajna_450 --

One solution is to use the Manual Selection property of the Variable Selection node. You can use that property to override any of the Role settings that the node determined. If a variable is rejected even though you want to include it, just change the role to Input.

Have a good week.

Re: sas eminer - help on a method for increasing sampling

Prajna_450 — Tue, 30 Jan 2018 06:56:59 GMT

Hi,

Firstly thanks for the reply, but my question is how do I increase the number of observations or records for those predictors whose frequency is low.

Help me in finding a method to handle the situation.

Thank you

Prajna