BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
Mike90
Quartz | Level 8

My Data Partition node is set at 40:30:30 (Train:Validate:Test)

 

My model is set up like this:

 

Data Source -> Data Partition -> Decision Tree  ->  Model Comparison

                                                -> Decision Tree  /

 

I can get a Classification Chart for the Train and Validation parts when looking at the individual Decision Tree results and in the Model Comparison results.

 

How do a get a Classification Chart for the test results?

 

Thanks

 

(In case it is somehow relevant, there are interval and nominal inputs, and the target is binary.

I used the option for Default with Inverse Prior Weights as there is a 95 / 5 distribution, and I'm

interested in improving the ability to predict the rare event, which of course cause a reduction

in the ability to predict the common event.)

 

 

 

1 ACCEPTED SOLUTION

Accepted Solutions
CraigDeVault
SAS Employee

 You will need to write your own SAS code in order to get this classification matrix.  If you add a SAS Code node after the Model Comparison node, you can write the following code to get the classification matrix:

***I am using the target variable named target.  If my target variable is bad, then I use f_bad and I_bad (assuming no decisions or prior probabilities set).

proc freq data=&em_import_test;
tables f_target*I_target;
run;

 

***I am using the target variable named target.  If my target variable is bad, then I use f_bad and I_bad (assuming decisions are set).

proc freq data=&em_import_test;
tables f_target*d_target;
run;

View solution in original post

2 REPLIES 2
AnujaNagpal
SAS Employee

You will see charts like ROC, score ranking overlays and other fit statistics for test data in model comparison node output.

 

CraigDeVault
SAS Employee

 You will need to write your own SAS code in order to get this classification matrix.  If you add a SAS Code node after the Model Comparison node, you can write the following code to get the classification matrix:

***I am using the target variable named target.  If my target variable is bad, then I use f_bad and I_bad (assuming no decisions or prior probabilities set).

proc freq data=&em_import_test;
tables f_target*I_target;
run;

 

***I am using the target variable named target.  If my target variable is bad, then I use f_bad and I_bad (assuming decisions are set).

proc freq data=&em_import_test;
tables f_target*d_target;
run;

SAS Innovate 2025: Call for Content

Are you ready for the spotlight? We're accepting content ideas for SAS Innovate 2025 to be held May 6-9 in Orlando, FL. The call is open until September 16. Read more here about why you should contribute and what is in it for you!

Submit your idea!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 2737 views
  • 2 likes
  • 3 in conversation