https://communities.sas.com/t5/SAS-Data-Science/How-to-visualize-and-evaluate-the-results-from-the-score-node-in/m-p/329850#M4934 <P>Hello,</P> <P>&nbsp;</P> <P>I am doing an analysis of imbalanced data for classification (2% to 98%) and evaluating different sampling techniques and classification algorithms. I use one dataset as a training/validation data and would like to use a separate dataset as a test / scoring data and asses / visualize the performance of a model on those data. However, when I use model comparison node after a score node, I still only see the model performance on training and validation dataset, and don't see any results for the separate dataset. I am attaching a screenshot of my workflow.</P> <P>&nbsp;</P> <P><IMG src="https://communities.sas.com/t5/image/serverpage/image-id/7098i05436FDF9E3D6ECD/image-size/original?v=1.0&amp;px=-1" border="0" alt="Screenshot 2017-02-03 18.36.10.png" title="Screenshot 2017-02-03 18.36.10.png" /></P> <P>&nbsp;</P> Fri, 03 Feb 2017 17:43:41 GMT gabon 2017-02-03T17:43:41Z https://communities.sas.com/t5/SAS-Data-Science/How-to-visualize-and-evaluate-the-results-from-the-score-node-in/m-p/329850#M4934 <P>Hello,</P> <P>&nbsp;</P> <P>I am doing an analysis of imbalanced data for classification (2% to 98%) and evaluating different sampling techniques and classification algorithms. I use one dataset as a training/validation data and would like to use a separate dataset as a test / scoring data and asses / visualize the performance of a model on those data. However, when I use model comparison node after a score node, I still only see the model performance on training and validation dataset, and don't see any results for the separate dataset. I am attaching a screenshot of my workflow.</P> <P>&nbsp;</P> <P><IMG src="https://communities.sas.com/t5/image/serverpage/image-id/7098i05436FDF9E3D6ECD/image-size/original?v=1.0&amp;px=-1" border="0" alt="Screenshot 2017-02-03 18.36.10.png" title="Screenshot 2017-02-03 18.36.10.png" /></P> <P>&nbsp;</P> Fri, 03 Feb 2017 17:43:41 GMT https://communities.sas.com/t5/SAS-Data-Science/How-to-visualize-and-evaluate-the-results-from-the-score-node-in/m-p/329850#M4934 gabon 2017-02-03T17:43:41Z https://communities.sas.com/t5/SAS-Data-Science/How-to-visualize-and-evaluate-the-results-from-the-score-node-in/m-p/330887#M4956 <P>In order to see the statistics that are generated for a test data set, you need to make sure that your separate data set has been read in before the modeling nodes and has a Role of Test.&nbsp; If you set the Role property in the data source to Test, then it will act like a Test data set and any of the fit statistics generated in the training and validation data sets will also be generated for the separate test data set.</P> <P>&nbsp;</P> <P>There is a similar story for the Score data set.&nbsp; You need to make sure that the Role property for that data set has been set to Score.&nbsp; You will not get many fit statistics for it; however, you will get some summary statistics around the predicted probabilities or predicted values for the target variables.</P><BR /><IMG src="https://communities.sas.com/t5/image/serverpage/image-id/13417iEF5FE548A3A92CAB/image-size/large?v=1.0&amp;px=600" border="0" alt="test_statistics.JPG" title="test_statistics.JPG" /> Wed, 08 Feb 2017 16:21:30 GMT https://communities.sas.com/t5/SAS-Data-Science/How-to-visualize-and-evaluate-the-results-from-the-score-node-in/m-p/330887#M4956 CraigDeVault 2017-02-08T16:21:30Z https://communities.sas.com/t5/SAS-Data-Science/How-to-visualize-and-evaluate-the-results-from-the-score-node-in/m-p/330977#M4957 <P>Thank you very much! <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span></P> Wed, 08 Feb 2017 20:47:00 GMT https://communities.sas.com/t5/SAS-Data-Science/How-to-visualize-and-evaluate-the-results-from-the-score-node-in/m-p/330977#M4957 gabon 2017-02-08T20:47:00Z