Building models with SAS Enterprise Miner, SAS Factory Miner, SAS Visual Data Mining and Machine Learning or just with programming

Score Node in Eminer doesn't throw eror if the required scoring variables are absent in scoring data

Reply
SAS Employee
Posts: 2

Score Node in Eminer doesn't throw eror if the required scoring variables are absent in scoring data

The score node in E-miner (version 14.2) does not throw error if required input scoring variables are not present in scoring data. I came across this issue while working on customer project. By mistake, Some of the variables in scoring data were named differently than input training data. If we would have been scoring outside E-miner, the sas code would throw error saying "variable not found". But, in case of score node in E-miner, it did not throw error. It ran fine with green check on. The results were misleading since all probabilities/scores were under predicted(or over predicted). I would propose that the score node must fail if required input scoring variables are not present in scoring data. This requirement is as fundamental as the need to define target variable before building model. Please share your ideas. In order to replicate the issue, I have used two dummy sample data available in permanent libraries of Eminer: 1. samsio.HMEQ is used as training data 2. sashelp.CLASS is used as scoring data Both these data are not remotely connected. They don't have a single common variable. Even then, the score node runs fine without error. Please see attachment for E-miner diagram. On further investigation, it was found that score node treats absent variables as variable present with all the values missing.
Untitled.png
Super User
Posts: 19,855

Re: Score Node in Eminer doesn't throw eror if the required scoring variables are absent in scoring

You can post ideas in the Ballotware though this is one I'd probably talk to SAS Support about as well.


I'd expect an error or an option to override that manually if required, but not as the default value.

 

Idea/suggestions go here and users can vote on them:

https://communities.sas.com/t5/SASware-Ballot-Ideas/idb-p/sas_ideas

 

SAS Employee
Posts: 2

Re: Score Node in Eminer doesn't throw eror if the required scoring variables are absent in scoring

Reeza,

 

Thanks for the link. The issue was also taken up with tech support. However, seems like this is how score node is built.

Super User
Posts: 19,855

Re: Score Node in Eminer doesn't throw eror if the required scoring variables are absent in scoring

Then I'd definitely add it to the ballot so people can vote to change it. 

 

There are always 'defaults' in programs that people can disagree on. 

Ask a Question
Discussion stats
  • 3 replies
  • 180 views
  • 3 likes
  • 2 in conversation