My Data Partition node is set at 40:30:30 (Train:Validate:Test)
My model is set up like this:
Data Source -> Data Partition -> Decision Tree -> Model Comparison
-> Decision Tree /
I can get a Classification Chart for the Train and Validation parts when looking at the individual Decision Tree results and in the Model Comparison results.
How do a get a Classification Chart for the test results?
Thanks
(In case it is somehow relevant, there are interval and nominal inputs, and the target is binary.
I used the option for Default with Inverse Prior Weights as there is a 95 / 5 distribution, and I'm
interested in improving the ability to predict the rare event, which of course cause a reduction
in the ability to predict the common event.)
You will need to write your own SAS code in order to get this classification matrix. If you add a SAS Code node after the Model Comparison node, you can write the following code to get the classification matrix:
***I am using the target variable named target. If my target variable is bad, then I use f_bad and I_bad (assuming no decisions or prior probabilities set).
proc freq data=&em_import_test;
tables f_target*I_target;
run;
***I am using the target variable named target. If my target variable is bad, then I use f_bad and I_bad (assuming decisions are set).
proc freq data=&em_import_test;
tables f_target*d_target;
run;
You will see charts like ROC, score ranking overlays and other fit statistics for test data in model comparison node output.
You will need to write your own SAS code in order to get this classification matrix. If you add a SAS Code node after the Model Comparison node, you can write the following code to get the classification matrix:
***I am using the target variable named target. If my target variable is bad, then I use f_bad and I_bad (assuming no decisions or prior probabilities set).
proc freq data=&em_import_test;
tables f_target*I_target;
run;
***I am using the target variable named target. If my target variable is bad, then I use f_bad and I_bad (assuming decisions are set).
proc freq data=&em_import_test;
tables f_target*d_target;
run;
April 27 – 30 | Gaylord Texan | Grapevine, Texas
Walk in ready to learn. Walk out ready to deliver. This is the data and AI conference you can't afford to miss.
Register now and lock in 2025 pricing—just $495!
Still thinking about your presentation idea? The submission deadline has been extended to Friday, Nov. 14, at 11:59 p.m. ET.
Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.
Find more tutorials on the SAS Users YouTube channel.