BookmarkSubscribeRSS Feed
xliu1
Quartz | Level 8

This is a sample question from the certification preparation for advanced predictive modeling:

 

Consider a Generalized Additive Neural Network (GANN) with 3 continuous inputs and 2 hidden nodes
for each input.
How many parameters do you need to estimate when training the neural network?
A. 19
B. 21
C. 22
D. 25
correct_answer = "C"

 

I would like to know why the correct answer is C? Is there a formula that could be used to calculate the parameters estimated in GANN or can someone please draw a diagram to illustrate the correct answer? Thanks.

1 REPLY 1
sbxkoenk
SAS Super FREQ

Hello,

I think (!) it's like this :

  1. The basic architecture for a generalized additive neural network (GANN) has a separate MLP (multilayer perceptron) with a single hidden layer of h units for each input variable (h=2 in your example).
  2. Each individual univariate function has 3*h parameters (where h could vary across inputs).
  3. The individual output bias terms are absorbed into the overall bias
  4. An enhanced architecture includes an additional parameter for a direct connection (skip layer)

So, 3 continuous inputs with each of them having two hidden nodes (in one hidden layer) and a skip layer ... that makes:
3 * (3 * 2 + 1) + 1 = 22

  • First 3 due to 3 continuous inputs
  • 3 * 2 = 3 * h (see point 2 above)
  • + 1 between the brackets is for the direct connection (skip layer)
  • the last + 1 (outside the brackets) is for the overall bias (see point 3 above)

Koen

Welcome to the Certification Community

 

This is a knowledge-sharing community for SAS Certified Professionals and anyone who wants to learn more about becoming SAS Certified. Ask questions and get answers fast. Share with others who are interested in certification and who are studying for certifications.To get the most from your community experience, use these getting-started resources:

Community Do's and Don'ts
How to add SAS syntax to your post
How to get fast, helpful answers
3 ways to show off your SAS skills

 

Why Get SAS Certified.jpg

Click image to register for webinarClick image to register for webinar

Classroom Training Available!

Select SAS Training centers are offering in-person courses. View upcoming courses for:

View all other training opportunities.

Discussion stats
  • 1 reply
  • 358 views
  • 0 likes
  • 2 in conversation