Building models with SAS Enterprise Miner, SAS Factory Miner, SAS Visual Data Mining and Machine Learning or just with programming

Help. How do I obtain a scree graph for a DMneural node?

Accepted Solution Solved
Reply
Contributor
Posts: 41
Accepted Solution

Help. How do I obtain a scree graph for a DMneural node?

Hello,

I am using SAS Enterprise miner 4.3 and I have a question about the Scree graph for the DMneural/Pricomp node.

Our lecturer wrote a tutorial explaining that I needed to connect the nodes as follows

INPUT DATA --> DATA PARTITION --> DMNEURAL --> NEURAL NETWORK.

First the exercise asks to run the Neural Network and perform some analysis. So far so good.

However, the exercise then asks for us to open the Dmneural node and look at the Scree Chart. I can't seem to find this chart anywhere! I looked all around. Could someone please advise how to find it?

Thanks in advance for the help.

Regards,

P.


Accepted Solutions
Solution
‎08-16-2017 01:35 PM
SAS Employee
Posts: 179

Re: Help. How do I obtain a scree graph for a DMneural node?

It is not clear what your professor is referring to as the 'Scree' plot.  That term is often used in association with hierarchical cluster analysis and provides a way to assess how many clusters should be retained.  The term scree is used as it refers to the rubble often found at the base of a cliff.  As the number of clusters increases, a great deal more explanation is achieved up to a point (representing a drastic drop in the the error) followed by a smaller more systematic change as additional cluster splits are added (representing the small slope at the bottom or the 'scree').   

 

I would guess that your professor is referring to the Iteration Plot which is generated by the Neural Network node.   It shows great improvement initially followed by lesser improvements to training over time.  If you have a validation data set, the performance on the validation plot will start to get worse.   You can then identify when to stop the iterative process when you have achieved the best values on the validation data and/or on the place where the more change in the performance is much less.   I suspect your professor was referring to the results of the Neural Network node and inadvertently referred to the wrong node since there is no such report generated by the DMNeural node.   

 

I hope this helps!

Doug

View solution in original post


All Replies
Solution
‎08-16-2017 01:35 PM
SAS Employee
Posts: 179

Re: Help. How do I obtain a scree graph for a DMneural node?

It is not clear what your professor is referring to as the 'Scree' plot.  That term is often used in association with hierarchical cluster analysis and provides a way to assess how many clusters should be retained.  The term scree is used as it refers to the rubble often found at the base of a cliff.  As the number of clusters increases, a great deal more explanation is achieved up to a point (representing a drastic drop in the the error) followed by a smaller more systematic change as additional cluster splits are added (representing the small slope at the bottom or the 'scree').   

 

I would guess that your professor is referring to the Iteration Plot which is generated by the Neural Network node.   It shows great improvement initially followed by lesser improvements to training over time.  If you have a validation data set, the performance on the validation plot will start to get worse.   You can then identify when to stop the iterative process when you have achieved the best values on the validation data and/or on the place where the more change in the performance is much less.   I suspect your professor was referring to the results of the Neural Network node and inadvertently referred to the wrong node since there is no such report generated by the DMNeural node.   

 

I hope this helps!

Doug

☑ This topic is solved.

Need further help from the community? Please ask a new question.

Discussion stats
  • 1 reply
  • 303 views
  • 0 likes
  • 2 in conversation