Hi,
I am performing analysis of SVM, Decision Trees, Neural Network and Random Forest in EM and getting True Positve Rate, False Positive Rate etc for each of these 4 algos, I have a binary target variable called category with 1 for allergic and 0 for non allergic.
I know roughly that if i get TPR then it means allergic and FPR means false alarm of non allergic treated as allergic. (Dont know whether I am right or wrong)
could anyone tell me how can i declare allergic =1 as my positive class so that I can say for sure that this definitly means allergic.
And where should I declare this?
Regards
In the Enterprise Miner Reference Help, Model Comparison node chapter, the section Comparing Models with Binary Targets gives a nice chart showing what exactly these rates represent (shown below, but not formatted well). It mentions that typically the value 1 is treated as the target event, and 0 as the non-event. This is controlled by the Order that is set for the target variable in the Input Data node or a Metadata node. For a binary target, the order by default is Descending, which means the first value when sorting the target levels in descending order is used as the event (hence 1 if values are 0 and 1). Hope that helps...
|
Predicted Non-Event |
Predicted Event |
Total Actual Probability |
---|---|---|---|
Non-Event |
A (true negative) |
B (false positive) |
(A + B) / (A + B + C + D ) |
Event |
C (false negative) |
D (true positive) |
(C + D) / (A + B + C + D ) |
Total Predicted |
A + C |
B + D |
A + B + C + D |
The following classification measures are derived from the relationships in the table:
In the Enterprise Miner Reference Help, Model Comparison node chapter, the section Comparing Models with Binary Targets gives a nice chart showing what exactly these rates represent (shown below, but not formatted well). It mentions that typically the value 1 is treated as the target event, and 0 as the non-event. This is controlled by the Order that is set for the target variable in the Input Data node or a Metadata node. For a binary target, the order by default is Descending, which means the first value when sorting the target levels in descending order is used as the event (hence 1 if values are 0 and 1). Hope that helps...
|
Predicted Non-Event |
Predicted Event |
Total Actual Probability |
---|---|---|---|
Non-Event |
A (true negative) |
B (false positive) |
(A + B) / (A + B + C + D ) |
Event |
C (false negative) |
D (true positive) |
(C + D) / (A + B + C + D ) |
Total Predicted |
A + C |
B + D |
A + B + C + D |
The following classification measures are derived from the relationships in the table:
Hi,
Thanks for your reply which is very helpful.
Cleared my concept further.
Regards
Don't miss out on SAS Innovate - Register now for the FREE Livestream!
Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.