BookmarkSubscribeRSS Feed
🔒 This topic is solved and locked. Need further help from the community? Please sign in and ask a new question.
KimmoSivonen
Calcite | Level 5

Hello!

I found out that SAS EM Reporter Node produces an output containing Scorecard Points but those points are not included in the Score code

Scorecard Points.png

Is it possible to include those Scorecard Points in the Output data? Now I can only edit the score code by hand and include those Scorecard points in the right classes of the binned variables. Is there an automatic way?

Thank you in advance!

1 ACCEPTED SOLUTION

Accepted Solutions
M_Maldonado
Barite | Level 11

Hi Kimmo,

The "scorecard" from the Reporter node is not a true scorecard like a scorecard that you would use in the credit scoring industry. The main difference is that you can interpret the scorecard points of a true scorecard as the probability of an event doubling. For example, the Scorecard node (available if you have a credit scoring license) has points to double odds set to 20 (you can change this property to another value). This means that someone with a score of 740 has double the odds of being a default compared to someone with a 720 score.

The scorecard from the Reporter node is great to help you understand what is driving your model. Whether you used a neural network, a regression, a random forest, or any other model, you can use the points to compare groups within each variable. Unfortunately, I don't think you can use this scorecard to score future data.

For example, you can use the Reporter node scorecard from your screenshot to notice that the event you are modeling is related to lower groups of age, or that it is very related to low first-member-begin-months and just a tiny bit related to high first-member-begin-months. But since you cannot compare the 45 points of low age with the 71 points of low first-member-begin-months, you cannot compare a 720 score with a 740 score.

If you really wanted to use this scorecard results, below an idea. But again, this scorecard is intended as a summary, not as a real tool to score future data.

Notice that the Reporter node creates a SAS data set called report_scorecard in your project workspace. For example if my project is called MiguelDataMining, my first workspace would be in MiguelDataMining\Workspaces\EMWS1. If you want the scorecard from your first Reporter node, browse to find report_scorecard. If you had two or more Reporter nodes, find report2_scorecard, report3_scorecard, etc. It shouldn't take you much effort to convert this dataset into scoring code.

I hope it helps!

FYI, for anyone not familiar with the Reporter node, this option is available when you specify the Nodes property as Summary. A SAS program called Rapid Predictive Modeler creates this summary output for you.

Thanks,

Miguel

View solution in original post

2 REPLIES 2
M_Maldonado
Barite | Level 11

Hi Kimmo,

The "scorecard" from the Reporter node is not a true scorecard like a scorecard that you would use in the credit scoring industry. The main difference is that you can interpret the scorecard points of a true scorecard as the probability of an event doubling. For example, the Scorecard node (available if you have a credit scoring license) has points to double odds set to 20 (you can change this property to another value). This means that someone with a score of 740 has double the odds of being a default compared to someone with a 720 score.

The scorecard from the Reporter node is great to help you understand what is driving your model. Whether you used a neural network, a regression, a random forest, or any other model, you can use the points to compare groups within each variable. Unfortunately, I don't think you can use this scorecard to score future data.

For example, you can use the Reporter node scorecard from your screenshot to notice that the event you are modeling is related to lower groups of age, or that it is very related to low first-member-begin-months and just a tiny bit related to high first-member-begin-months. But since you cannot compare the 45 points of low age with the 71 points of low first-member-begin-months, you cannot compare a 720 score with a 740 score.

If you really wanted to use this scorecard results, below an idea. But again, this scorecard is intended as a summary, not as a real tool to score future data.

Notice that the Reporter node creates a SAS data set called report_scorecard in your project workspace. For example if my project is called MiguelDataMining, my first workspace would be in MiguelDataMining\Workspaces\EMWS1. If you want the scorecard from your first Reporter node, browse to find report_scorecard. If you had two or more Reporter nodes, find report2_scorecard, report3_scorecard, etc. It shouldn't take you much effort to convert this dataset into scoring code.

I hope it helps!

FYI, for anyone not familiar with the Reporter node, this option is available when you specify the Nodes property as Summary. A SAS program called Rapid Predictive Modeler creates this summary output for you.

Thanks,

Miguel

KimmoSivonen
Calcite | Level 5

Thank you Miguel!

Best Wishes!

Kimmo

sas-innovate-2024.png

Don't miss out on SAS Innovate - Register now for the FREE Livestream!

Can't make it to Vegas? No problem! Watch our general sessions LIVE or on-demand starting April 17th. Hear from SAS execs, best-selling author Adam Grant, Hot Ones host Sean Evans, top tech journalist Kara Swisher, AI expert Cassie Kozyrkov, and the mind-blowing dance crew iLuminate! Plus, get access to over 20 breakout sessions.

 

Register now!

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 2 replies
  • 1506 views
  • 0 likes
  • 2 in conversation