BookmarkSubscribeRSS Feed
rboire
Calcite | Level 5

what is the specific code or routines to incorporate the learning rate in PROC HPNEURAL 

1 REPLY 1
DougWielenga
SAS Employee

I am not aware of an option for adjusting the learning rate in the HPNEURAL procedure but you can adjust the learning rate in the Neural Network node in SAS Enterprise Miner.  To do so, drag a Neural Network node onto your SAS Enterprise Miner diagram and then click on the ... to the right of Optimization properties in the Neural Network node properties sheet.   From the dialog which appears, change the Training Technique property from Default to BackProp, QPROP, or RPROP and you will then be able to modify the Learn property:

 

Learn - Specifies the learning rate for BackProp or the initial learning rate for QPROP and RPROP optimization techniques.

 

When you specify RPROP which uses a separate learning rate for each weight and adapts all the learning rates during training, the dialog allows customization of some additional options including 

  Accelerate - Specifies the rate of increase of learning for the RPROP optimization technique.

  Decelerate - Specifies the rate of decrease of learning for the RPROP optimization technique.

  Maximum Learning - Specifies the maximum learning rate for RPROP.

  Minimum Learning - Specifies the minimum learning rate for RPROP.

 

When you specify QPROP (for QuickProp) which is a Newton-like method thatuses a diagonal approximation to the Hessian matrix, the dialog allows customization of the some additional options including 

   Maximum Momentum - Specifies the maximum momentum rate for QPROP.

   Tilt - Specifies the tilt value for QPROP.

 

The direct use of the NEURAL procedure which is used by the Neural Network node is not supported, however, so you would need to build this type of model using the SAS Enterprise Miner interface.  

 

Hope this helps!

Doug

hackathon24-white-horiz.png

2025 SAS Hackathon: There is still time!

Good news: We've extended SAS Hackathon registration until Sept. 12, so you still have time to be part of our biggest event yet – our five-year anniversary!

Register Now

How to choose a machine learning algorithm

Use this tutorial as a handy guide to weigh the pros and cons of these commonly used machine learning algorithms.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 1452 views
  • 0 likes
  • 2 in conversation