BookmarkSubscribeRSS Feed
☑ This topic is solved. Need further help from the community? Please sign in and ask a new question.
iuri_leite
Fluorite | Level 6

Dear All,

I have some questions that are not related to the SAS use.

I am reading about the distributions that belong to the exponential family. There is also a subgroup that belongs to the canonical exponential family. The Bernoulli is one of them, it belongs to the exponential family and the canonical exponential family. When writing the Bernoulli distribution in the canonical form we identify the canonical link which is the natural ling for a Generalized Linear Model for binary variable. In this case, the natural link is the logit. Still dealing with a GLM for binary variable, we have the probit model, in which the link function is The Inverse CDF of the normal distribution. It also maps the probability that assumes values between 0 and 1 into something that assumes values between minus infinity and plus infinity. However, the link function is not a natural one. Both are appropriate to work with dichotomous variable (associated to Bernoulli distribution), but in the canonical form the natural link is the logit. Is that correct?

The canonical link function refers to the natural one? The Inverse CDF of the normal distribution used in the probit is a link function, but not a canonical link function?

Thanks a a lot.

1 ACCEPTED SOLUTION

Accepted Solutions
KevinScott
SAS Employee

In the canonical form, the natural link is the logit. Is that correct? Yes

Does the canonical link function refer to the natural one? Yes

The Inverse CDF of the normal distribution used in the probit is a link function but not a canonical one. Correct

 

The link is natural/canonical, If b(m) = q = Xbwhere is equal to the expectation of the exponentially distributed random variable:

 

KevinScott_3-1666009454479.png

b(q)=q, b is the identity function when density is written in canonical form. An advantage of canonical/natural links is that a minimal sufficient statistic for β exists, i.e., all the information about β is contained in a function of the data of the same dimensionality as β.

View solution in original post

1 REPLY 1
KevinScott
SAS Employee

In the canonical form, the natural link is the logit. Is that correct? Yes

Does the canonical link function refer to the natural one? Yes

The Inverse CDF of the normal distribution used in the probit is a link function but not a canonical one. Correct

 

The link is natural/canonical, If b(m) = q = Xbwhere is equal to the expectation of the exponentially distributed random variable:

 

KevinScott_3-1666009454479.png

b(q)=q, b is the identity function when density is written in canonical form. An advantage of canonical/natural links is that a minimal sufficient statistic for β exists, i.e., all the information about β is contained in a function of the data of the same dimensionality as β.

SAS Innovate 2025: Register Now

Registration is now open for SAS Innovate 2025 , our biggest and most exciting global event of the year! Join us in Orlando, FL, May 6-9.
Sign up by Dec. 31 to get the 2024 rate of just $495.
Register now!

What is ANOVA?

ANOVA, or Analysis Of Variance, is used to compare the averages or means of two or more populations to better understand how they differ. Watch this tutorial for more.

Find more tutorials on the SAS Users YouTube channel.

Discussion stats
  • 1 reply
  • 505 views
  • 1 like
  • 2 in conversation