Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

Find a Community

- Home
- /
- Analytics
- /
- Data Mining
- /
- Calculation of the Probabilities from Scores of De...

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

08-21-2016 10:31 AM

Dear All,

After I have created a Decesion Tree Model, kindlly i need your help to advice me how can I convert the Score I optained from the Variable P_target_1 in to Probabilites . Please note that I haven't used Deceison Node . Is that avaiable ?

All I have right now is the Score of Prediction and a Flag for the real event (1/0)

P.S : I have reviesed the below link (https://communities.sas.com/t5/SAS-Data-Mining/Adjusted-Prior-in-Enterprise-Miner-7-1-Please-help-Th...) for a simmilar enquiry but couldn't find a solution to my particular case.

Thanks and Best Regards,

Mohammed ElSofany

Data Scientist .

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohammad__101

08-21-2016 10:47 AM

What do you mean by probability? Probability of being a 0/1? I don't think that's how a decision tree process works. It's a rule based algorithm, not probabilistic.

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to Reeza

08-21-2016 11:03 AM

Dear Reeza,

Thanks for your reply . Normaly DT is not Probabilistic . But what if I want to extract from the Score produced a Probability of the event to happen (to be 1 not 0 ) .

Thanks

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohammad__101

08-21-2016 11:08 AM

I'm trying to think how that would work and it would be equivalent to the prior probability of 0/1 is my guess.

If you need a probability why not fit a different model type, ie logistic regression?

If you fit multiple trees with differing rules then perhaps an average of outcomes could be determined to extract a probability. So a simulation type analysis.

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohammad__101

08-21-2016 11:31 AM

I think your looking for the conditional probability of the end points/nodes. Does that sound correct?

Similar to this?

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to Reeza

08-21-2016 11:48 AM

As a matter of fact that's simmilar to what I'm reading now : )

Thanks !

Mohammed ElSofany

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohammad__101

08-21-2016 01:13 PM

In a matter of fact I still can't get it from the both links .

All I am looking for is to get the Probability using the Score and using overall Probabilty of event occure gained from trainning data or cross validation data.

VBR

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohammad__101

08-21-2016 02:02 PM

Is your issue technical, ie how to calculate a specific value, or methodological - how do I calculate the probabilities.

Please take the time to explain your question in as much detail as possible. Especially if its a calculation question.

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to Reeza

08-22-2016 08:49 AM

Dear Reeza,

Thank you for all the message very much!

Yes It's a calculation ,

I have built a Decesion Trees Model with Binary Classification.

To build this model I have used Oversampling approach .

I have't used any Decesion Nodes ( Before Model or After Model )

I want to get the Probability of occurnace of the event from the P_target_1

P_target_1 is not probability it's Model Score .

I need to have the Probability .

I hope I was clear enough,

Thanks and best regards,

Mohammed ElSofany

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to mohammad__101

08-21-2016 04:09 PM

For a decision tree built using a nominal or binary target, the P_ variables are the posterior probabilities (given a set of input values, what is the predicted probability of a particular outcome) for each possible outcome.

So you probably already have what you are looking for.

Here's a detailed reference:

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Highlight
- Email to a Friend
- Report Inappropriate Content

Posted in reply to rayIII

08-22-2016 08:33 AM

Thanks Rally for your reply ,

Is this can be applied even if I didn't use Decesion Node and I have used Oversampling ?

Regards,