I am trying to use Enterprise miner 7.1 for over-sampling. I understand the concept, but am having trouble implementing it. How do I over-sample a dataset within the tool, and then have my Score node-created score code create the final predicted value based on the original target proportion.
In other words, my real data has a 2% success rate. I over sample using the Sample node, so my training data has a 50% success rate. I fit my model, and then use the score code to score. I want EM_EVENTPROBABILITY to have an average of .02, not an average of .50. What settings can I use to make that happen?
correct probabilities =
1/(1+(1/original fraction-1)/(1/oversampled fraction-1)*(1/scoring result-1));
In the EM click on the input data node. Then go to the properties panel and click the '....' button next to the Decision option. Once the window pops up, go to the tab 'Prior Probabilities' and enter actual probabilities in the Adjusted Probabilities column. This will adjust the model results for oversampling in the modeling dataset.
Hope that helps.
Available on demand!
Missed SAS Innovate Las Vegas? Watch all the action for free! View the keynotes, general sessions and 22 breakouts on demand.
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.