Lift curve allows modelers to compare models. But this is done visually. Can lift chart be translated into a single metric so that comparison can be made even easier?
Here is a lift curve example online:
http://www.kdnuggets.com/gpspubs/kdd99-est-ben-lift/sld022.htm
Hi, Aha. Do you really want to compare entire curves?
Data miners usually compare lift curves at a particular sample depth. In Enterprise Miner, the Model Comparison node uses a default depth of 10 when Lift is the model selection criterion, but you can change the default depth.
Ray
I'm no expert in this area but I think you are after the Gini index or Somer's D or calculating the area under a ROC curve. This link contains references to all of these:
I forgot to mention this is a question for regression problem. As far as I know, ROC is for classifier problems.
If its a binary outcome then PROC LOGISTIC is mentioned as well in the link page.
Hi, Aha. Do you really want to compare entire curves?
Data miners usually compare lift curves at a particular sample depth. In Enterprise Miner, the Model Comparison node uses a default depth of 10 when Lift is the model selection criterion, but you can change the default depth.
Ray
Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 25. Read more here about why you should contribute and what is in it for you!
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.