Lift curve allows modelers to compare models. But this is done visually. Can lift chart be translated into a single metric so that comparison can be made even easier?
Here is a lift curve example online:
http://www.kdnuggets.com/gpspubs/kdd99-est-ben-lift/sld022.htm
Hi, Aha. Do you really want to compare entire curves?
Data miners usually compare lift curves at a particular sample depth. In Enterprise Miner, the Model Comparison node uses a default depth of 10 when Lift is the model selection criterion, but you can change the default depth.
Ray
I'm no expert in this area but I think you are after the Gini index or Somer's D or calculating the area under a ROC curve. This link contains references to all of these:
I forgot to mention this is a question for regression problem. As far as I know, ROC is for classifier problems.
If its a binary outcome then PROC LOGISTIC is mentioned as well in the link page.
Hi, Aha. Do you really want to compare entire curves?
Data miners usually compare lift curves at a particular sample depth. In Enterprise Miner, the Model Comparison node uses a default depth of 10 when Lift is the model selection criterion, but you can change the default depth.
Ray
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.