topic Re: How does the covariance matrix gets the confidence intervals of regression coefficients? in Statistical Procedures

How does the covariance matrix gets the confidence intervals of regression coefficients?

TomHsiung — Wed, 03 Apr 2024 07:39:29 GMT

Hi, everyone

I don't quite understand the math behind the way the covariance matrix determines the CIs of regression coefficients. It is too hard for me because I know little about the matrix math. I guess there are some theories similar to the Delta method to get the results of CIs. However, I don't know where I should start. I intend to understand the proof and I would like to hear your suggestions. Thanks.

Re: How does the covariance matrix gets the confidence intervals of regression coefficients?

sbxkoenk — Thu, 04 Apr 2024 13:52:01 GMT

To obtain confidence intervals (CI)
, you first need to know about standard errors on (ML) parameter estimates.

Standard errors for maximum likelihood estimation
By Rick Wicklin on The DO Loop November 6, 2023
https://blogs.sas.com/content/iml/2023/11/06/stderr-mle.html

Koen

Re: How does the covariance matrix gets the confidence intervals of regression coefficients?

JacobSimonsen — Fri, 05 Apr 2024 11:09:27 GMT

I assume that with "covariance matrix" you mean the covariance between the parameter estimates.

Then you find the standard errors by taking squareroot to the diagonal elements in the covariance matrix.

Then you find CL by calculating the estimates +/- 1.96 x std errors.

Re: How does the covariance matrix gets the confidence intervals of regression coefficients?

TomHsiung — Tue, 09 Apr 2024 13:23:20 GMT

Hi, Jacob and all responders

Thank you for answering my question. Yep, so far I now this matrix method could be used to estimation the interval estimation of regression coefficients. However, I would like to understand the proof of this method because it is so fundamental and important for regression technology.

Tom