cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
BookmarkSubscribeRSS Feed
🔒 This topic is locked. We are no longer accepting replies to this topic. Need further help? Please sign in and ask a new question.
pvareschi
Quartz | Level 8 pvareschi
Quartz | Level 8

Choosing optimisation algorithm for estimation of Neural Networks parameters

Posted 05-30-2020 12:41 PM (291 views)

Re: Neural Network Modelling

Are there any guidelines/suggestions on how to choose which optimisation method to use in a given situation, beside the number of weights to be estimated? (see page 3.42-3.45 of course text).

In particular, are backprop, Qprop and Rprop ever used? And what about Double-Dogleg?
In addition, page 3.43 states that "Quasi-Newton is among the fastest and most reliable algorithms for unconstrained optimisation of smooth objective functions": when would that be the case when fitting a Neural Network, given that the error function tend to be highly non-linear?

0 Likes

 

This is a knowledge-sharing community for learners in the Academy. Find answers to your questions or post here for a reply.
To ensure your success, use these getting-started resources:

Estimating Your Study Time
Reserving Software Lab Time
Most Commonly Asked Questions
Troubleshooting Your SAS-Hadoop Training Environment

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 0 replies
  • ‎05-30-2020 12:41 PM
  • 292 views
  • 0 likes
  • 1 in conversation