turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

Find a Community

- Home
- /
- Analytics
- /
- Data Mining
- /
- Cumulative Total Expected Profit VS Average Profit...

Topic Options

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

03-11-2015 10:34 AM

Hello,

I have created two models in Enterprise Miner i.e. a regression model and a neural network model. I have also input a profit matrix as follows:

Solicit a good customer: A

Solicit a bad customer: B

Ignore a good customer: C

Ignore a bad customer: D

Solicit Ignore

Good A C

Bad B D

The results of the model comparison node (average profit) state that the regression model is better. I guess the formula for concluding to the average profit is: (TP*A+TN*D+FN*C+FP*B)/N. So the regression must have a bigger average profit.

My question is about the additional assessment criteria and more specifically the cumulative total expected profit chart. In this chart, the curve for the neural network is above the curve for the regression in all the deciles of the horizontal axis. How come then regression outperforms neural networls in the average profit measure? Should the two results be aligned?

Thank you very much in advance,

Andreas

Accepted Solutions

Solution

03-12-2015
04:02 AM

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohamed_zaki

03-12-2015 04:02 AM

Hello,

Thanks for the information. I found the mistake. The model comparison node was optimized for Average Profit/ Loss, whereas the regression and the neural network model were optimized for Average Squared Error. If i change the optimization of the regression and neural network nodes to average profit/ loss the results make sense.

Thanks again,

Andreas

All Replies

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to andreas_zaras

03-11-2015 10:33 PM

Solution

03-12-2015
04:02 AM

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohamed_zaki

03-12-2015 04:02 AM

Hello,

Thanks for the information. I found the mistake. The model comparison node was optimized for Average Profit/ Loss, whereas the regression and the neural network model were optimized for Average Squared Error. If i change the optimization of the regression and neural network nodes to average profit/ loss the results make sense.

Thanks again,

Andreas

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to andreas_zaras

03-12-2015 08:32 AM

I do not think that what you concluded is right. The profit chart and average profit is different. The regression being first in average profit does not mean that it should came above the neural in the chart.